Note: The job is a remote job and is open to candidates in USA. Codvo.ai is a company that builds scalable, future-ready digital platforms that drive real business impact. They are looking for a Senior Data Engineer with strong expertise in Databricks to build scalable data pipelines and optimize data workflows, enabling data-driven decision-making across the organization.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Databricks and Python
- Build and optimize ETL workflows for structured and unstructured data
- Work with Databricks Lakehouse architecture and implement best practices
- Manage and implement data governance using Unity Catalog
- Integrate AWS data services such as S3, IAM, VPC, and other relevant services
- Collaborate with cross-functional teams to deliver high-quality data solutions
- Build dashboards and support data visualization requirements
- Ensure data quality, reliability, and performance optimization
Skills
- Strong experience with Databricks platform
- Proficiency in Python for data engineering and ETL pipelines
- Hands-on experience with Unity Catalog
- Good knowledge of AWS services (S3, IAM, VPC, Glue/Lambda – preferred)
- Solid understanding of Data Lake / Lakehouse architecture
- Experience in building dashboards and reporting solutions
- Experience with REST API development (Flask, FastAPI, etc.)
- Knowledge of authentication/authorization (OAuth, API keys, IAM roles)
- Strong query optimization and performance tuning skills
- Experience with PySpark optimization
- Exposure to ML/AI pipelines
- Familiarity with Databricks AI/BI capabilities
Company Overview
Company H1B Sponsorship