Data Engineer

Key Responsibilities

- Design, build, and operate robust ingestion pipelines for batch and near-real-time data using AWS-native services - Implement CDC-based ingestion patterns for databases, SaaS platforms, and external partners - Standardize ingestion frameworks for files, APIs, event streams, and cross-account data sharing - Define and maintain raw and staging data models that preserve source fidelity and lineage - Partner with source system owners to define ingestion SLAs, contracts, schemas, and change management strategies - Ensure ingestion pipelines meet data quality, observability, and reliability standards - Implement metadata capture, schema evolution handling, and data validation at ingestion time - Automate infrastructure using AWS CDK and integrate CI/CD pipelines via CodeCommit and CodePipeline - Optimize ingestion workflows for scalability, cost efficiency, and fault tolerance - Support Agile delivery and collaborate closely with offshore engineering teams

Required Qualifications

- Bachelor’s or Master’s degree in Computer Science, Engineering, or a quantitative field - 5+ years of experience in data engineering, with a strong focus on data ingestion and integration - Strong understanding of change data capture (CDC) concepts and ingestion patterns - Hands-on experience with AWS services such as Lambda, Step Functions, MWAA, Glue, Redshift - Experience building ingestion pipelines for APIs, files, databases, and event-based systems - Proficiency in Python and familiarity with data serialization formats (JSON, Parquet, Avro) - Experience implementing infrastructure as code using AWS CDK - Working knowledge of CI/CD, version control, and automated deployments - Strong collaboration skills and comfort working with distributed offshore teams - Detail-oriented, proactive, and ownership-driven mindset