Senior Snowflake Engineer responsible for designing, building, and optimizing cloud data platform. Collaborating with stakeholders to deliver secure data solutions powering analytics and decision - making.
About the role
- Lead Databricks Engineer designing, building, and scaling cloud-based lakehouse platform. Collaborating with data teams for ML and analytical workloads.
Responsibilities
- Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake.
- Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards.
- Optimize Spark jobs and cluster configurations for performance and cost, including partitioning, caching, and autoscaling strategies.
- Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing.
- Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines.
- Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products.
- Establish engineering best practices, conduct code reviews, and mentor junior data engineers.
- Monitor production pipelines, troubleshoot failures, and drive root-cause analysis and continuous improvement.
Requirements
- 5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark.
- Expert proficiency in Python (PySpark) and advanced SQL.
- Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern.
- Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services.
- Proven track record optimizing Spark performance and managing cluster cost.
- Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets.
- Proficiency with Git-based version control, CI/CD, and infrastructure-as-code.
- Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
Benefits
- Accommodation provided during hiring process
- Willingness to sponsor employment visas
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Intermediate Consultant focusing on water stewardship and mine water management solutions. Collaborating with mining clients on diverse projects including hydrologic and engineering analyses.
LP
Senior Facilities Engineer
LinkedIn Recruiter Post
Senior Facilities Engineer needed to lead facilities projects and support operations across multiple locations.
Senior Business Engineer driving AdTech integrations and managing partnerships for Reddit's advertising platform. Collaborating with teams to enhance developer experience and technical solutions.
Senior Water Resources Engineer managing mine water resources projects throughout the life of the mine in Canada. Collaborating within multidisciplinary teams and engaging with clients on water quality issues.
Senior HVDC Project Engineer supporting global HVDC and FACTS projects with engineering design, technical specifications, and commissioning activities. Join a leading design firm in building a clean energy future.
Ingénieur en régulation automatique responsable de la conception et gestion de projets chez Stantec. Établir des relations avec les clients et participer à la mise en service de systèmes.
Ingénieur(e) en mécanique industrielle chez AtkinsRéalis, déterminant les besoins des projets et concevant des solutions techniques. Évaluant les coûts et soutenant le développement d’équipe dans divers domaines.
Urban Engineer designing infrastructure projects including water and sewage networks for Quebec development team. Collaborating on plans, studies, and specifications with a hybrid working option.
Unit Cell Engineer designing and developing electrochemical cell components for flow batteries. Focused on performance optimization and cost reduction in energy storage solutions.