Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
LP
Data Engineer (Azure Data Factory | Databricks | PySpark)
Posted via LinkedIn Recruiter (not a company profile)
Posted 4 months ago
About the role
- Data Engineer needed for 12-month contract in Pickering, ON. Must have Azure Data Factory, Databricks, PySpark, and SQL expertise.
Responsibilities
- Build and productionize scalable ETL/ELT data pipelines; develop and optimize data workflows using Azure Data Factory and Azure Databricks; design and maintain data lakehouse and data warehouse solutions; implement data ingestion pipelines from multiple sources; ensure data quality, lineage, governance, and security standards; work closely with Data Architects, BI teams, and Data Scientists; support production systems and troubleshoot data pipeline issues; build orchestration and automation; participate in Agile ceremonies, code reviews, and CI/CD practices; contribute to metadata management and data catalog initiatives; develop automated testing for data pipelines.
Requirements
- Must-Have: Strong hands-on experience with Azure Data Factory (ADF), expertise in Azure Databricks, strong programming in PySpark and SparkSQL, advanced SQL skills, experience with Azure Data Lake (ADLS) and/or Azure Synapse Analytics, experience building ETL/ELT data pipelines, strong understanding of data structures and data processing frameworks. Nice to Have: Azure Purview or data governance tools, CI/CD for data pipelines, Power BI or data visualization exposure, experience with CI/CD, automation, and infrastructure-as-code concepts, experience working in Agile/SCRUM environments.
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.