Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company.
Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.
Responsibilities
Design, build, and maintain scalable data pipelines and ETL/ELT processes
Architect and optimize data models and storage solutions for analytics and operational use
Collaborate with data scientists, analysts, and engineers to deliver trusted, high-quality datasets
Own and evolve parts of the data platform using Databricks and Spark
Implement observability, alerting, and data quality monitoring for critical pipelines
Drive data engineering best practices, including documentation, testing, and CI/CD
Drive long-term architectural vision and mentor the team on engineering best practices
Partner with stakeholders to ensure data solutions support business outcomes
Contribute to the design and evolution of the next-generation data lakehouse architecture
Requirements
8+ years of experience as a Data Engineer or similar backend engineering role
Bachelor’s degree in Computer Science, Engineering, or related technical field
Databricks optimization, including tuning Spark jobs, optimizing joins, and managing Delta Lake architecture
Experience with AI-assisted development tools and AI/ML technologies
Strong programming skills in Python, Scala, or Java
Hands-on experience with distributed data systems such as Spark or Kafka
Proficiency writing and optimizing complex SQL and NoSQL queries
Experience building and maintaining robust production ETL/ELT pipelines
Understanding of data modeling techniques, including star schema and dimensional modeling
Familiarity with software supply chain, cybersecurity, or large-scale software ecosystem data
Track record improving data platform reliability, scalability, performance, and cost efficiency
Familiarity with workflow orchestration tools such as Airflow or Dagster
Hands-on experience with cloud data platforms, particularly AWS
Familiarity with Delta Lake, Apache Iceberg, or Apache Hudi
Experience implementing data observability, lineage, governance, and automated data quality frameworks
Experience designing real-time or streaming data architectures using data lake technologies
Architecte de données sénior concevant des architectures analytiques et gouvernance des données pour les transformations numériques de Wepoint. Travail flexible à Montréal ou Québec, en mode hybride, distant ou sur site.
Streaming Data Engineer building scalable Bronze, Silver, and Gold data pipelines for PLATO’s public sector clients. Managing real - time ingestion, processing, security, and data quality.
Senior Data Architect designing governed, event - driven healthcare data platforms for Wepoint. Leading Fabric, Power BI, ETL, and analytics architecture for Québec health - network transformations.
Staff Data Engineer building pipelines, models, and infrastructure for exacare ai’s post - acute care AI platform. Turning healthcare data into reliable foundations for product, analytics, and ML workflows.
Senior Data Engineer architecting cloud data platforms and pipelines for Arc’teryx supply chain analytics. Leading migrations, governance, observability, and engineering mentorship.
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.