Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
About the role
- Azure/Databricks Data Engineer designing data-driven applications. Build data pipelines, collaborate with cross-functional teams, and work with Azure Stack tools in a hybrid environment.
Responsibilities
- As an Azure and Databricks Data Engineer, the role focuses on designing, building, and supporting data‑driven applications that enable innovative, customer‑centric digital experiences. Work as part of a cross‑discipline agile team, collaborating to solve problems across business areas. Build reliable, supportable, and performant data lake and data warehouse products to support reporting, analytics, applications, and innovation. Apply best practices in development, security, accessibility, and design to deliver high‑quality services. Develop modular and scalable ELT/ETL pipelines and data infrastructure leveraging diverse enterprise data sources. Create curated common data models in collaboration with Data Modelers and Data Architects to support business intelligence, reporting, and downstream systems. Partner with infrastructure, cyber teams, and Senior Data Developers to ensure secure data handling in transit and at rest. Clean, prepare, and optimize datasets with strong lineage and quality controls throughout the integration cycle. Support BI Analysts with dimensional modeling and aggregation optimization for visualization and reporting. Collaborate with Business Analysts, Data Scientists, Senior Data Engineers, Data Analysts, Solution Architects, and Data Modelers. Work with Microsoft Stack tools including Azure Data Factory, ADLS, Azure SQL, Synapse, Databricks, Purview, and Power BI. Operate within an agile SCRUM framework, contributing to backlog development and using Kanban/SCRUM toolsets. Develop performant pipelines and models using Python, Spark, and SQL across XML, CSV, JSON, REST APIs, and other formats. Create tooling to reduce operational toil and support CI/CD and DevOps practices for automated delivery and release management. Monitor in‑production solutions, troubleshoot issues, and provide Tier 2 dataset support. Implement role‑based access control and perform automated unit, regression, UAT, and integration testing.
Requirements
- Completion of a four‑year university program in computer science, engineering, or related data disciplines. Experience designing and building data pipelines, with strong Python, PySpark, SparkSQL, and SQL skills. Experience with Azure Data Factory, ADLS, Synapse, and Databricks, and building pipelines for Data Lakehouses and Warehouses. Strong understanding of data structures, governance, and data quality principles, with effective communication skills for technical and non‑technical audiences.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.