Senior Data Engineer focused on Databricks to deliver scalable data pipelines at BDO Digital. Leading client engagements and collaborating with cross-functional teams.
Responsibilities
Design, build, and optimize robust data pipelines using Databricks, Delta Lake, and Apache Spark
Develop scalable ETL processes for structured and unstructured data
Implement data integration solutions across cloud and on-premises sources
Automate data ingestion, transformation, and validation workflows
Monitor, troubleshoot, and enhance data pipeline performance
Serve as a primary technical lead for client engagements focused on data engineering
Translate business requirements into scalable data architectures
Collaborate with cross-functional teams to integrate data solutions
Requirements
A Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline
A minimum of 5 years of hands-on experience in data engineering
At least 3 years of direct experience with Databricks, Apache Spark, and cloud data platforms
In-depth knowledge of the Microsoft Azure ecosystem
Very strong proficiency with Databricks
Advanced programming skills in Python and/or Scala
Solid understanding of CI/CD practices
Familiarity with infrastructure-as-code tools such as Terraform or ARM templates
Excellent written and verbal communication skills
Benefits
competitive total cash compensation that recognizes and rewards your contribution
flexible benefits from day one
market leading personal time off policy
reimbursement for wellness initiatives that fit your lifestyle
Staff Data Engineer building pipelines, models, and infrastructure for exacare ai’s post - acute care AI platform. Turning healthcare data into reliable foundations for product, analytics, and ML workflows.
Senior Data Engineer architecting cloud data platforms and pipelines for Arc’teryx supply chain analytics. Leading migrations, governance, observability, and engineering mentorship.
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.