Azure Data Engineer needed for a financial client to develop pipelines using ADF, Databricks, and Azure Functions, and migrate to Unity Catalog.
Responsibilities
Develop and maintain pipelines using Azure Data Factory (ADF), Databricks, and Azure Functions (C#). Build and optimize Spark/Pandas notebooks. Configure and manage Unity Catalog for data governance. Migrate Databricks workspace from hive metastore to Unity Catalog. Design delta tables with security controls. Implement Delta Live Tables (nice to have). Manage DevOps using Azure DevOps and GitHub Enterprise. Work with Azure Entra ID for SSO/RBAC. Deploy and manage Azure PaaS resources. Collaborate with team and lead technical sessions. Ensure compliance with data governance and security standards.
Requirements
7+ years with ADF, Databricks, Azure Functions (C#). Extensive Python/notebooks on Databricks/Spark/Pandas. Expert knowledge of Unity Catalog. Experience with Medallion architecture. Proven track record migrating Databricks to Unity Catalog. Ability to design delta tables. Strong DevOps skills. In-depth Azure Entra ID experience. Proficiency with Azure SQL PaaS, ADLS, Synapse. Familiarity with highly regulated environments. Ability to work independently and lead a team. Financial services experience (asset). Excellent communication skills.
Data Engineer building scalable Databricks ingestion pipelines for Irth Solutions’ infrastructure - protection SaaS. Supporting stakeholder - engagement analytics, LLM/NLP pipelines, and downstream data models.
Senior Databricks Architect needed for contract role in Winnipeg, MB. Must have Azure Databricks, PySpark, and Azure DevOps expertise; onsite mandatory.
Data Engineering Developer building scalable Azure data pipelines for an agile tech development firm. Advising clients, implementing governance, and improving cloud data engineering standards.
Ingénieur(e) données concevant des pipelines et architectures analytiques Azure. Collaboration client et amélioration des standards de gouvernance, qualité et performance des données.
Junior Data Engineer building reliable ETL pipelines and data solutions for PLATO, Canada’s Indigenous - owned technology services company. Improving data quality, accessibility, governance, and pipeline performance.
Senior Data Engineer building scalable, AI - powered data infrastructure for CloudBlue, HostPapa’s cloud commerce platform. Developing real - time pipelines, APIs, and production analytics systems.
Senior Fabric Data Engineer modernizing enterprise data for Canadian IT consulting clients. Building Microsoft Fabric pipelines, curated datasets, security controls, and analytics - ready models.
Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company. Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.