Senior Databricks Engineer responsible for designing and implementing modern data platforms on Azure Databricks. Working closely with client teams to migrate and optimize data workloads while ensuring best practices.
Responsibilities
Lead the implementation of modern data platforms and architectures on Databricks (including ETL, workload migrations, and Unity Catalog).
Design and implement data pipelines using Azure Databricks (PySpark, SQL)
Build and optimize batch and streaming data workloads
Migrate legacy data workloads to Azure + Databricks
Implement Delta Lake patterns (medallion architecture, CDC, data quality)
Integrate Databricks with Azure services such as ADLS, ADF, Azure Key Vault and DevOps/Github
Optimize performance and cost (cluster sizing, job orchestration, query tuning)
Collaborate with solution architects, analytics engineers, and client stakeholders
Support client enablement through knowledge transfer and documentation
Provide hands-on solution delivery, including guiding and working closely with client engineers and ensuring best practices.
Implement governance models and Unity Catalog including data access, lineage, and security frameworks.
Evaluate and prioritize high-value AI and ML use cases, embedding Generative AI into client strategies.
Act as a thought leader by contributing to client workshops, executive roundtables, and industry discussions.
Requirements
5–7+ years of experience in data engineering.
3+ years of hands-on experience with Databricks, including advanced features (Delta Lake, Unity Catalog, MLflow).
Proven experience leading large-scale data migrations (ETL, workloads, cloud platforms).
Strong expertise in Azure environments.
Multi-cloud experience is an asset.
Experience working with Azure data services (ADLS, ADF, Synapse, etc.)
Solid understanding of modern data architectures (lakehouse, medallion, ELT/ETL)
IAM Engineer designing Saviynt identity governance solutions for Colliers’ global commercial real estate enterprise. Automating access controls, compliance, provisioning, and cloud integrations across Canada.
Manufacturing Development Engineer scaling Arbutus Medical’s procedure - kit production from prototypes to reliable manufacturing. Bridging product development, suppliers, quality, and operations for surgical medical devices.
Forward Deployed Engineer building production AI systems for Sperton’s operating businesses. Discovering high - impact workflows, shipping end - to - end software, and measuring operational impact.
Autonomy Engineer developing hybrid behavior - tree and learned - policy systems for Dominion Dynamics’ sovereign Canadian combat platform. Deploying validated autonomy from simulation onto test aircraft.
Ingénieur responsable de projets électriques du bâtiment chez Norda Stelo, concevant des systèmes électromécaniques. Gestion de projets institutionnels, commerciaux et industriels, budgets et échéanciers.
Substation Owner’s Engineer overseeing utility power - delivery designs, standards, and construction quality for Leidos. Advising project owners across planning, procurement, construction, and commissioning.
Water resource engineer - in - training supporting flood, river, stormwater, and watercourse projects at Onterris. Assisting modelling, design, field investigations, and regulatory work.
Senior Process Engineer delivering mineral - processing design and improvements for Sedgman’s global resources business. Supporting mining projects from feasibility through detailed engineering in Montreal’s hybrid office.
Lead threat intelligence for Clio’s legal AI platform, tracking adversaries, fraud, and abuse. Building intelligence capabilities that protect law firms and Clio Payments.