Principal Databricks Data Engineer

Posted via LinkedIn Recruiter (not a company profile)

Posted 6 days ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Hiring a Principal Databricks Data Engineer in Toronto, ON. Requires 12-18 years of experience with Databricks, Spark, and Cloudera modernization.

Responsibilities

  • We are hiring a Principal Databricks Data Engineer for a full-time permanent role in Toronto, ON. The ideal candidate has 12-18 years of overall data engineering experience, 8+ years in enterprise Data Warehouse and Data Lake platforms, and 5+ years of hands-on experience with Databricks and Spark at scale. Responsibilities include modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse, redesigning ingestion, transformation, and consumption patterns from HDFS-based architecture to cloud object storage and Delta Lake, and refactoring legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines.

Requirements

  • 12–18 years of overall data engineering experience; 8+ years of experience in enterprise Data Warehouse and Data Lake platforms; 5+ years of hands-on experience with Databricks and Spark at scale; strong experience in modernizing legacy Cloudera platforms (CDH/CDP, Hive, HBase, Impala, Spark) to Databricks Lakehouse; experience redesigning ingestion, transformation, and consumption patterns from HDFS-based architecture to cloud object storage and Delta Lake; experience refactoring legacy Hive/Impala logic into PySpark and Spark SQL ELT pipelines.

Job title

Job type

Full Time

Experience level

Senior

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

DatabricksSparkClouderaHiveHBaseImpalaPySparkSpark SQLDelta LakeHDFS

Location requirements

Linkedin Recruiter PostTorontoOntario Toronto

Report this job

Found something wrong with the page? Please let us know by submitting a report below.