Lead Databricks Engineer designing, building, and scaling cloud-based lakehouse platform. Collaborating with data teams for ML and analytical workloads.
Responsibilities
Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake.
Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards.
Optimize Spark jobs and cluster configurations for performance and cost, including partitioning, caching, and autoscaling strategies.
Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing.
Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines.
Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products.
Establish engineering best practices, conduct code reviews, and mentor junior data engineers.
Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement.
Requirements
5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark.
Expert proficiency in Python (PySpark) and advanced SQL.
Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern.
Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services.
Proven track record optimizing Spark performance and managing cluster cost.
Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets.
Proficiency with Git-based version control, CI/CD, and infrastructure-as-code.
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
Vehicle trim engineer developing and validating finishing components for Expleo, a global engineering and consulting services provider. Guiding design, supplier, validation, and production teams on vehicle systems.
Ingénieur forestier chez TEHORA, réalisant inventaires forestiers, cartographie et analyses géospatiales pour des mandats publics au Québec. Supervisant les relevés, données SIG et livrables techniques.
Senior I&C Engineer designing CANDU instrumentation and control systems for AtkinsRéalis, a Canadian nuclear engineering services company. Producing specifications, assessments, design documents, and engineering drawings.
Seeking a DDI Engineer with deep DNS expertise to support a large enterprise network in the GTA, ON. Contract role requiring hands - on experience with DNS/DHCP and IPAM platforms.
Fire engineer designing and evaluating fire protection systems for GHD’s Canadian architecture, engineering, and environmental projects. Conducting risk assessments, code reviews, inspections, project management, and mentoring junior engineers.
Engineer II performing design, analysis, testing, and field engineering for Framatome Canada’s nuclear technologies. Supporting safe, efficient CANDU reactor operations and product - life - cycle improvements.
Underground Geotechnical Engineer supporting ground control and mine planning at Coeur Silvertip, a Canadian precious - metals mining operation. Designing support systems, analyzing monitoring data, and managing geotechnical risk for underground excavations.
The City of Regina is hiring a Project Engineer/Coordinator for Water - Sewer Programming. Ideal for those with experience in municipal infrastructure, water/wastewater, engineering, or project management.