Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
LP
Principal Databricks Data Engineer
Posted via LinkedIn Recruiter (not a company profile)
Posted 3 months ago
About the role
- Hiring a Principal Databricks Data Engineer in Toronto, ON for a full-time permanent role. Requires 12-18 years of data engineering experience and expertise in Databricks and Spark.
Responsibilities
- We are hiring a Principal Databricks Data Engineer for a full-time permanent role in Toronto, ON. The role involves modernizing legacy Cloudera platforms to Databricks Lakehouse, redesigning ingestion and transformation patterns, refactoring legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines, ensuring data reconciliation and audit integrity during migration, and designing enterprise Data Warehouse and Lakehouse architectures.
Requirements
- 12–18 years of overall data engineering experience; 8+ years in enterprise Data Warehouse and Data Lake platforms; 5+ years hands-on with Databricks and Spark at scale; strong experience in modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse; ability to redesign ingestion, transformation, and consumption patterns from HDFS-based architecture to cloud object storage and Delta Lake; refactor legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines; ensure data reconciliation, audit integrity, and consistency during migration; design and govern enterprise Data Warehouse and Data Lake/Lakehouse architectures.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.
Senior Data Engineer owning Databricks lakes, pipelines, and AI data infrastructure. Building Quandri’s AI operating system for insurance agencies and brokerages.
Senior Data Engineer architecting Azure and Databricks data platforms for TTEC Digital’s client experience solutions. Building governed pipelines, APIs, MCP integrations, and agentic AI data services.
Senior Data Engineer building Palantir Foundry data solutions for Unit8, a Swiss AI and data analytics consultancy. Supporting client delivery and establishing its Canadian market presence.
Staff Software Engineer building AWS data infrastructure and integrations for Solink’s cloud video - security platform. Driving scalability, architecture, and engineering mentorship.