Note: The job is a remote job and is open to candidates in USA. Celebal Technologies is seeking a Cloud Engineer to design, implement, and operate secure cloud platforms on AWS GovCloud. The role focuses on Databricks platform engineering, infrastructure automation, and operational excellence to support enterprise-scale Data, Analytics, and AI workloads.
Responsibilities
- Design and deploy AWS cloud infrastructure using Infrastructure as Code (Terraform)
- Build and manage Databricks environments across Development, Staging, and Production
- Implement secure networking architectures including VPCs, PrivateLink, Transit Gateway, Direct Connect, Security Groups, and NACLs
- Configure and manage IAM, AWS IAM Identity Center, SSO, SCIM, and role-based access controls
- Implement encryption and secrets management using AWS KMS and AWS Secrets Manager
- Develop and maintain CI/CD pipelines using GitHub Actions, GitLab CI/CD, or AWS CodePipeline
- Deploy and manage Databricks Asset Bundles (DAB), cluster policies, SQL Warehouses, Unity Catalog, and Delta Lake workloads
- Support data engineering, ML, and AI platform deployments in Databricks
- Implement governance, audit logging, monitoring, and compliance controls aligned with enterprise and GovCloud requirements
- Troubleshoot infrastructure, platform, networking, and deployment issues
- Collaborate with Data Engineers, Platform Engineers, Security Teams, and Architects to deliver enterprise cloud solutions
Skills
- Design and deploy AWS cloud infrastructure using Infrastructure as Code (Terraform)
- Build and manage Databricks environments across Development, Staging, and Production
- Implement secure networking architectures including VPCs, PrivateLink, Transit Gateway, Direct Connect, Security Groups, and NACLs
- Configure and manage IAM, AWS IAM Identity Center, SSO, SCIM, and role-based access controls
- Implement encryption and secrets management using AWS KMS and AWS Secrets Manager
- Develop and maintain CI/CD pipelines using GitHub Actions, GitLab CI/CD, or AWS CodePipeline
- Deploy and manage Databricks Asset Bundles (DAB), cluster policies, SQL Warehouses, Unity Catalog, and Delta Lake workloads
- Support data engineering, ML, and AI platform deployments in Databricks
- Implement governance, audit logging, monitoring, and compliance controls aligned with enterprise and GovCloud requirements
- Troubleshoot infrastructure, platform, networking, and deployment issues
- Collaborate with Data Engineers, Platform Engineers, Security Teams, and Architects to deliver enterprise cloud solutions
- AWS (EC2, S3, VPC, IAM, KMS, CloudWatch, Lambda, Direct Connect, Transit Gateway)
- Infrastructure as Code (Terraform)
- Databricks Administration
- Unity Catalog
- Delta Lake
- Databricks Workflows
- Cluster Policies
- SQL Warehouses
- GitHub Actions / GitLab CI/CD / CodePipeline
- Docker
- Bash / Python scripting
- IAM & RBAC
- Secrets Management
- Audit Logging
- Compliance & Security Best Practices
- Policy-as-Code (tfsec, Checkov)
- Bachelor's degree in Computer Science, Information Technology, or related field
- AWS GovCloud experience preferred
- MLflow (preferred)
- Kubernetes (EKS preferred)
- AI/ML Platform experience
- Databricks Certifications
- AWS Certifications
- Experience with Delta Sharing and Data Governance
- Experience working in regulated industries (Defense, Aerospace, Healthcare, Financial Services)
- AWS Certified Solutions Architect / SysOps / DevOps Engineer preferred
- Databricks Certified Associate or Professional certifications are a plus
Company Overview