Databricks Engineer

Posted 8 hours ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Senior Databricks Engineer building production data pipelines for V4C’s enterprise consultancy clients. Owning data quality, PySpark transformations, monitoring, debugging, and Lakehouse performance.

Responsibilities

  • Build, optimize, and maintain robust data pipelines using SQL, dbt, and Python
  • Implement data-quality checks and automated testing frameworks within dbt to catch anomalies
  • Monitor production workflows and manage alerts
  • Debug pipeline failures from root cause through permanent fix
  • Write efficient PySpark transformations for large-scale datasets in a Lakehouse environment
  • Translate complex data issues into clear action plans for technical teammates and business stakeholders
  • Maintain end-to-end production ownership of data platforms, ensuring high data quality and robust system performance

Requirements

  • Expert-level SQL skills and extensive hands-on experience building modular models, snapshots, and custom schema tests in dbt
  • Strong proficiency in writing clean, maintainable Python scripts for data manipulation, automation, and API integrations
  • Decent, practical experience utilizing PySpark for data transformation and basic performance tuning, including joins and the DataFrame API
  • Functional understanding of Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations
  • Exceptional written and spoken communication skills
  • Superior troubleshooting skills with a methodical approach to identifying root causes and validating fixes
  • Experience owning pipelines end-to-end, including CI/CD deployment, monitoring, and handling schema drift

Job title

Job type

Contract

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

PySparkPythonSQL

Location requirements

RemoteCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.