Senior Databricks Engineer building production data pipelines for V4C’s enterprise consultancy clients. Owning data quality, PySpark transformations, monitoring, debugging, and Lakehouse performance.
Responsibilities
Build, optimize, and maintain robust data pipelines using SQL, dbt, and Python
Implement data-quality checks and automated testing frameworks within dbt to catch anomalies
Monitor production workflows and manage alerts
Debug pipeline failures from root cause through permanent fix
Write efficient PySpark transformations for large-scale datasets in a Lakehouse environment
Translate complex data issues into clear action plans for technical teammates and business stakeholders
Maintain end-to-end production ownership of data platforms, ensuring high data quality and robust system performance
Requirements
Expert-level SQL skills and extensive hands-on experience building modular models, snapshots, and custom schema tests in dbt
Strong proficiency in writing clean, maintainable Python scripts for data manipulation, automation, and API integrations
Decent, practical experience utilizing PySpark for data transformation and basic performance tuning, including joins and the DataFrame API
Functional understanding of Delta Lake or similar Lakehouse technologies, including ACID transactions and MERGE operations
Exceptional written and spoken communication skills
Superior troubleshooting skills with a methodical approach to identifying root causes and validating fixes
Experience owning pipelines end-to-end, including CI/CD deployment, monitoring, and handling schema drift
Hydrogeologist supporting groundwater investigations, modelling, and mine water studies at BGC, an international applied earth sciences firm. Collaborating on multidisciplinary mining projects and field programs.
Traffic Analysis Engineer supporting sustainable transportation projects for Arcadis. Modeling traffic operations, analyzing field data, and preparing studies for roads, intersections, parking, and complete streets.
Building Envelope Engineer leading building science assessments, design, and reporting for Rimkus, a built environment consulting firm. Supporting sustainable, resilient construction and asset management.
Waste engineer designing landfill, transfer - station, and composting solutions for GHD, a global environmental services company. Supporting permitting, field monitoring, project delivery, and client development across Canada.
Ingénieur(e) en génie routier chez AtkinsRéalis, concevant des infrastructures et soutenant le projet de train à grande vitesse Alto au Canada. Analyses techniques, CAO/BIM et collaboration multidisciplinaire.
Forward Deployed Engineer designing and deploying production software for Cognizant's end clients. Building backend systems, cloud solutions, APIs, and integrations to solve complex business challenges.
Facility Engineer reviewing facility, environmental, and process engineering aspects of in situ oil sands applications. Supporting risk - informed regulatory decisions for Alberta’s energy regulator.
Bridge Engineer designing and rehabilitating bridges, culverts, and transportation structures for Arcadis. Performing structural analysis, construction liaison, inspections, mentoring, and project delivery across Canada.