Senior Data Engineer modernizing Alberta environmental regulatory data on Microsoft Azure. Building governed pipelines, APIs, and analytics-ready datasets for the DRAS platform.
Responsibilities
Collaborate with business stakeholders and product owners to understand data product objectives, requirements, and success criteria
Design and implement scalable, secure, and high-performance data architecture on Microsoft Azure in cloud-native and hybrid environments
Lead development of data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
Manage data lakes and structured storage solutions using Azure Data Lake Storage Gen2 with the Data Architect
Integrate diverse source systems, including ServiceNow and geospatial systems, using APIs, connectors, and custom scripts
Develop and maintain data models and semantic layers for operational reporting, analytics, machine learning, and downstream consumption
Build and optimize Python and SQL workflows for data cleansing, enrichment, and advanced analytics in Azure Databricks
Design and expose secure data services and APIs using Azure API Management
Implement metadata management, data classification, and lineage tracking
Ensure privacy and regulatory compliance through role-based access controls, encryption, and data masking
Monitor and troubleshoot data pipelines and integrations for reliability, scalability, and performance
Use AI and automation tools for pipeline development, testing, monitoring, and documentation
Leverage AI-assisted tools for code generation, optimization, and review
Design and curate standardized, high-quality datasets for advanced analytics and future AI use cases
Perform other duties as needed
Requirements
Experience designing scalable, secure, and high-performance data architecture on Microsoft Azure
Experience with Azure Data Factory, Azure Databricks, and Azure Synapse Analytics
Experience managing Azure Data Lake Storage Gen2
Experience integrating ServiceNow and geospatial systems using APIs, connectors, and custom scripts
Proficiency in Python and SQL
Knowledge of data modeling and semantic layers
Knowledge of Azure API Management
Knowledge of metadata management, data classification, and data lineage
Knowledge of role-based access controls, encryption, and data masking
Knowledge of FOIP and GDPR compliance
Ability to use AI and automation tools for data engineering workflows
Ability to use AI-assisted tools for code generation, optimization, and code review
Data & Analytics Engineer building scalable data platforms for Ledgebrook, an insurance company. Designing pipelines, governance, and cloud data systems while partnering with technical and insurance teams.
Data Engineer building scalable pipelines for SumerSports’ football intelligence platform. Supporting deep learning, video, LLM, analytics, and AI - driven products across sports.
Data Platform Engineer building ingestion pipelines, storage, governance, and observability systems for Movable Ink’s AI - driven marketing personalization platform. Supporting scalable, secure, multi - tenant data services.
Senior Data Engineer building AWS ETL/ELT pipelines and dbt models for Tango’s cloud real - estate and facilities SaaS. Managing databases, data quality, warehousing, and observability.
Senior Data Engineer building AWS and dbt data pipelines for Tango’s cloud real - estate and facilities SaaS platform. Managing databases, warehouses, data quality, and analytics - ready datasets.
Data Engineer building streaming pipelines and analytical databases for Movable Ink’s data - activated marketing personalization platform. Developing Elixir/Python services and reliable event - data products at billions - event scale.
Senior Data Engineer needed for a 1 - year contract with an asset management client in Toronto. Requires 7+ years of experience, Snowflake, Python, SQL, and cloud platform expertise.
Senior Data Engineer owning finance data pipelines and models for Instacart, a grocery delivery platform. Supporting accounting, billing, revenue, and financial reporting at scale.
Senior AI Data Engineer building production AI systems and marketing data infrastructure for Samsara’s connected - operations IoT platform. Automating workflows and enabling data - driven decisions.
Senior Data Engineer modernizing Alberta government regulatory data platforms. Building governed Azure pipelines, models, APIs, and analytics - ready datasets for DRAS.