AWS Data Broker (Software Engineer)
Requirements:
• 5+ years of work experience as a software engineer, with a strong focus on backend and middleware solutions, including API, compute, application-level networking, and security
• 2+ years of experience creating ETL data pipelines, data infrastructure, or data systems.
• 2+ years of work experience with AWS, specifically creating data pipelines in production using any or all of the following AWS services: AWS Glue, Step Functions, Athena, RDS, API Gateway, Lambda, SFTP, Eventbridge, SNS, SQS, SES, IAM.
• Expertise in Python, Typescript, and Object-Oriented Programming (OOP) with a strong understanding of design principles such as SOLID, YAGNI, DRY, etc.
• Expertise in SQL.
• Experience with data analysis, data modeling, and data warehousing.
• Experience working with REST APIs and understanding of OAuth flows (Postman a plus) with a strong emphasis on integrating and interacting with third-party APIs
• Experience with VS Code preferred (adaptability and willingness to use VS Code required)
Job Description Responsibilities:
• Implement a highly scalable, and resilient data integration system using AWS CDK (Cloud Development Kit) with TypeScript and Python.
• Implement Infrastructure as Code and automated release management, ensuring the platform's scalability, and maintainability
• Collaborate closely with cross-functional teams to ensure the data broker adheres to the highest security and compliance standards, safeguarding sensitive data and maintaining regulatory compliance across all processes.
• Engage as part of an Agile scrum software development team contributing to scrum ceremonies and collaborating with product owners and other engineers