Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company.
Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.
Responsibilities
Design, build, and maintain scalable data pipelines and ETL/ELT processes
Architect and optimize data models and storage solutions for analytics and operational use
Collaborate with data scientists, analysts, and engineers to deliver trusted, high-quality datasets
Own and evolve parts of the data platform using Databricks and Spark
Implement observability, alerting, and data quality monitoring for critical pipelines
Drive data engineering best practices, including documentation, testing, and CI/CD
Drive long-term architectural vision and mentor the team on engineering best practices
Partner with stakeholders to ensure data solutions support business outcomes
Contribute to the design and evolution of the next-generation data lakehouse architecture
Requirements
8+ years of experience as a Data Engineer or similar backend engineering role
Bachelor’s degree in Computer Science, Engineering, or related technical field
Databricks optimization, including tuning Spark jobs, optimizing joins, and managing Delta Lake architecture
Experience with AI-assisted development tools and AI/ML technologies
Strong programming skills in Python, Scala, or Java
Hands-on experience with distributed data systems such as Spark or Kafka
Proficiency writing and optimizing complex SQL and NoSQL queries
Experience building and maintaining robust production ETL/ELT pipelines
Understanding of data modeling techniques, including star schema and dimensional modeling
Familiarity with software supply chain, cybersecurity, or large-scale software ecosystem data
Track record improving data platform reliability, scalability, performance, and cost efficiency
Familiarity with workflow orchestration tools such as Airflow or Dagster
Hands-on experience with cloud data platforms, particularly AWS
Familiarity with Delta Lake, Apache Iceberg, or Apache Hudi
Experience implementing data observability, lineage, governance, and automated data quality frameworks
Experience designing real-time or streaming data architectures using data lake technologies
Senior Fabric Data Engineer modernizing learning - platform data for Cornerstone Galaxy. Building Microsoft Fabric pipelines, curated datasets, governance, and analytics - ready integrations.
GCP Data Platform Engineer maintaining and optimizing production data platforms for Innodata, a global data engineering and AI services company. Supporting Airflow pipelines, GCP infrastructure, reliability, and troubleshooting.
Senior Data Engineer building finance data pipelines and models for Instacart’s grocery delivery platform. Owning financial data infrastructure supporting accounting, billing, invoicing, and reporting.
Senior Data Architect modernizing Alberta justice data marts into an integrated enterprise data warehouse. Designing ETL, Power BI testing, data models, governance, and reporting architecture.
Senior Data Architect integrating Alberta court data marts into an enterprise data warehouse. Designing ETL, data models, governance practices, and Power BI validation reports.
Data & Analytics Engineer building scalable data platforms for Ledgebrook, an insurance company. Designing pipelines, governance, and cloud data systems while partnering with technical and insurance teams.
Data Engineer building scalable pipelines for SumerSports’ football intelligence platform. Supporting deep learning, video, LLM, analytics, and AI - driven products across sports.
Data Platform Engineer building ingestion pipelines, storage, governance, and observability systems for Movable Ink’s AI - driven marketing personalization platform. Supporting scalable, secure, multi - tenant data services.
Senior Data Engineer building AWS and dbt data pipelines for Tango’s cloud real - estate and facilities SaaS platform. Managing databases, warehouses, data quality, and analytics - ready datasets.