LP
Azure Databricks Developer-HR Platforms
LinkedIn Recruiter Post
Azure Databricks Developer needed for HR tech projects at a top financial client. Design ETL solutions, support data integrations, and modernize HR data platforms.
About the role
- Data Engineer managing ingestion pipelines in cloud-native data ecosystem for analytics, marketing, and reporting use cases. Ensuring data quality and governance throughout the process.
Responsibilities
- Design, build, and operate **robust ingestion pipelines** for batch and near-real-time data using AWS-native services
- Implement **CDC-based ingestion patterns** for databases, SaaS platforms, and external partners
- Standardize ingestion frameworks for files, APIs, event streams, and cross-account data sharing
- Define and maintain **raw and staging data models** that preserve source fidelity and lineage
- Partner with source system owners to define ingestion SLAs, contracts, schemas, and change management strategies
- Ensure ingestion pipelines meet **data quality, observability, and reliability standards**
- Implement metadata capture, schema evolution handling, and data validation at ingestion time
- Automate infrastructure using **AWS CDK** and integrate CI/CD pipelines via CodeCommit and CodePipeline
- Optimize ingestion workflows for scalability, cost efficiency, and fault tolerance
- Support Agile delivery and collaborate closely with offshore engineering teams
Requirements
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a quantitative field
- 5+ years of experience in data engineering, with a strong focus on **data ingestion and integration**
- Strong understanding of **change data capture (CDC)** concepts and ingestion patterns
- Hands-on experience with AWS services such as **Lambda, Step Functions, MWAA, Glue, Redshift**
- Experience building ingestion pipelines for **APIs, files, databases, and event-based systems**
- Proficiency in **Python** and familiarity with data serialization formats (JSON, Parquet, Avro)
- Experience implementing infrastructure as code using **AWS CDK**
- Working knowledge of CI/CD, version control, and automated deployments
- Strong collaboration skills and comfort working with distributed offshore teams
- Detail-oriented, proactive, and ownership-driven mindset
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Software Engineer, Data responsible for building data pipelines and maintaining infrastructure for analytics and ML. Collaborate with teams to optimize data systems at Narvar.
Data Architect leading conversations and decisions on data modeling at a global consulting firm specializing in Data & Analytics. Transforming complex processes into clear, reusable information models.
Senior Data Engineer at Supabase managing data pipelines from source to analysis. Collaborating with growth, finance, and product teams to drive business insights.
LP
Data Architect – Snowflake
LinkedIn Recruiter Post
Data Architect - Snowflake needed for full - time hybrid role in Markham, ON. Expertise in Snowflake on AWS, data migration, and ETL required.
LP
Datastage ETL
LinkedIn Recruiter Post
Hiring Datastage ETL contractor for hybrid role in Toronto. Requires 5+ years experience with IBM DataStage, SQL, Unix scripting.
LP
Data Architect (Snowflake & DBT)
LinkedIn Recruiter Post
Data Architect needed to architect and implement Snowflake on AWS solutions, with 8+ years experience in data architecture and engineering.
Associate Data Architect collaborating with stakeholders to design scalable data architecture for AXIS Capital. Maximizing profit through data - driven decision making and implementing effective data governance strategies.
Data Engineer II at Finning supporting production data platforms and integrations using Snowflake, Databricks, Azure services. Collaborating with teams to ensure operational stability and reliability.
Staff Data Engineer at Ledgebrook responsible for architecting data platforms and ensuring data governance. Collaborates across teams to drive data - driven decisions and enhance engineering practices.