Databricks Data Engineer modernizing a Canadian enterprise data platform. Building ETL/ELT pipelines and lakehouse solutions supporting reporting, analytics, and AI initiatives.
Responsibilities
Design, develop, and maintain data pipelines within the Enterprise Data Platform (EDP)
Build and optimize ETL/ELT processes for data ingestion, transformation, and integration
Use an Agentic approach to development and ensure outputs meet development standards
Develop scalable and reusable data solutions with Databricks and cloud-based data technologies
Support migration and modernization from HANA environments to a modern data platform
Collaborate with Data Architects on scalable data models and platform solutions
Develop transformation logic and workflows for business and analytics requirements
Ensure data quality, integrity, consistency, and performance
Troubleshoot data issues, bottlenecks, and performance concerns
Participate in code reviews, testing, deployment, and release activities
Work with business and analytics teams to understand requirements and deliver fit-for-purpose solutions
Contribute to platform best practices, documentation, and continuous improvement
Requirements
At least 3 years of hands-on Databricks development experience
4+ years of overall Data Engineering, ETL, or Data Integration experience
Strong experience building ETL/ELT data pipelines and transformation processes
Proven experience working with large and complex datasets
Experience developing data solutions within cloud-based platforms
Solid understanding of data warehousing, data lake, and lakehouse concepts
Experience working in Agile delivery environments
Strong problem-solving and analytical skills
Excellent communication and collaboration abilities
Experience with Agentic frameworks and AI-assisted coding is a value add
Preferred: experience supporting large data platform initiatives
Preferred: experience in significant data migration efforts
Preferred: Azure Data Services and Databricks Lakehouse architecture experience
Preferred: modern data engineering frameworks and best practices
Preferred: exposure to AI, GenAI, Machine Learning, or advanced analytics initiatives
Preferred: large enterprise or consulting environment experience
Preferred: knowledge of data governance, metadata management, and data quality frameworks
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.