Note: The job is a remote job and is open to candidates in USA. ECS is seeking a Sr. Databricks Consultant to work remotely. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines in Databricks
- Optimize workflows and clusters for performance and cost efficiency
- Integrate Databricks with cloud platforms (AWS, Azure, or GCP)
- Implement data governance, security, and compliance standards
- Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights
- Troubleshoot issues and drive continuous improvement in data infrastructure
Skills
- Deep experience in Databricks
- Experience with Delta Lake, MLflow, and Databricks Machine Learning
- Ability to design, build, and maintain scalable ETL/ELT pipelines in Databricks
- Experience optimizing workflows and clusters for performance and cost efficiency
- Experience integrating Databricks with cloud platforms (AWS, Azure, or GCP)
- Knowledge of data governance, security, and compliance standards
- Ability to collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights
- Ability to troubleshoot issues and drive continuous improvement in data infrastructure
Benefits
- General Description of Benefits
Company Overview