Data Engineer managing ingestion pipelines in cloud-native data ecosystem for analytics, marketing, and reporting use cases. Ensuring data quality and governance throughout the process.
Responsibilities
Design, build, and operate **robust ingestion pipelines** for batch and near-real-time data using AWS-native services
Implement **CDC-based ingestion patterns** for databases, SaaS platforms, and external partners
Standardize ingestion frameworks for files, APIs, event streams, and cross-account data sharing
Define and maintain **raw and staging data models** that preserve source fidelity and lineage
Partner with source system owners to define ingestion SLAs, contracts, schemas, and change management strategies
Ensure ingestion pipelines meet **data quality, observability, and reliability standards**
Implement metadata capture, schema evolution handling, and data validation at ingestion time
Automate infrastructure using **AWS CDK** and integrate CI/CD pipelines via CodeCommit and CodePipeline
Optimize ingestion workflows for scalability, cost efficiency, and fault tolerance
Support Agile delivery and collaborate closely with offshore engineering teams
Requirements
Bachelor’s or Master’s degree in Computer Science, Engineering, or a quantitative field
5+ years of experience in data engineering, with a strong focus on **data ingestion and integration**
Strong understanding of **change data capture (CDC)** concepts and ingestion patterns
Hands-on experience with AWS services such as **Lambda, Step Functions, MWAA, Glue, Redshift**
Experience building ingestion pipelines for **APIs, files, databases, and event-based systems**
Proficiency in **Python** and familiarity with data serialization formats (JSON, Parquet, Avro)
Experience implementing infrastructure as code using **AWS CDK**
Working knowledge of CI/CD, version control, and automated deployments
Strong collaboration skills and comfort working with distributed offshore teams
Detail-oriented, proactive, and ownership-driven mindset
Data Engineer building Azure data pipelines, warehouses, and analytics infrastructure. Supporting Innovation Federal Credit Union’s mission to simplify banking for Canadians.
Technical Recruiter owning full - cycle hiring for engineering and data roles at Mercury, a fintech rebuilding banking. Sourcing technical talent, managing pipelines, and closing offers.
Senior Data Engineer building governed AWS and Snowflake data products for Sun Life’s Canadian insurance business. Partnering with analysts and data scientists to power enterprise analytics.
Data Architecture Consultant defining governed data solutions for Beneva’s insurance and financial - services business. Modeling DataVault and dimensional data while guiding integration and architecture strategy.
Leading Cohere’s Data Foundation team for enterprise AI infrastructure. Owning governed warehouses, pipelines, analytics platforms, and agentic data products.
Data Platform & Analytics Capability Lead building, positioning, and scaling Avanade’s enterprise data and analytics capability in Canada. Shaping client solutions, opportunities, partnerships, and delivery standards.
Senior Data Engineer scaling blockchain, product analytics, and experimentation infrastructure for Phantom’s global open - markets trading app. Driving data quality and architecture across a remote team.
Data engineering intern supporting ETL, data quality, and transformation projects at Canadian asset manager PICTON Investments. Collaborating across business teams using SQL, Python, databases, and cloud platforms.
Data engineering student building Azure, SQL, Python, and Power BI solutions for CMHA Peel Dufferin’s mental health services. Supporting reporting, ETL pipelines, dashboards, automation, and data - driven decisions.
Senior Product Architect guiding AWS, SaaS, data and financial technology at FCC, a Canadian agriculture lender. Shaping secure enterprise roadmaps and integrations across financial applications.