Senior Data Engineer responsible for data infrastructure in Cost Engineering. Enabling cost optimization and sustainability initiatives while collaborating across teams.
Responsibilities
Be responsible for the design, implementation, and evolution of scalable, reliable data infrastructure that underpins Spotify’s cost and carbon intelligence.
Own end-to-end data pipelines for cloud cost, usage, and emissions data: spanning ingestion, transformation, modeling, and serving layers.
Partner deeply with Data Scientists, Engineering, Finance, and Procurement to translate sophisticated analytical and business needs into robust data architectures.
Set technical direction and standards for data modeling, orchestration, testing, and observability within the Cost Engineering domain.
Build and maintain curated, analytics-ready datasets that power executive reporting, forecasting, and optimization initiatives.
Ensure data accuracy, consistency, and timeliness for high-stakes cost and emissions reporting used to guide strategic infrastructure investments.
Proactively identify opportunities to improve the scalability, reliability, and cost efficiency of the data platform itself.
Mentor other engineers and act as a technical sounding board, raising the overall bar for data engineering perfection on the team.
Work across all Missions at Spotify to embed cost and climate awareness into decision-making, with a focus on accurate attribution of spend and carbon impact.
Requirements
A senior data engineer with a strong track record of owning and operating production-critical data systems end to end.
Hold a degree in computer science, engineering, or a related technical field, or equivalent proven experience.
Experienced in designing data architectures that scale with both data volume and organizational complexity.
Comfortable leading technical discussions, influencing build decisions, and aligning partners around long-term solutions.
Thrive in environments with evolving requirements, balancing speed of delivery with adaptability and correctness.
Strong communicator who can explain sophisticated technical concepts clearly to both technical and non-technical audiences.
Familiar with financial, billing, or usage data, and able to connect infrastructure metrics to real business and sustainability impact.
Hands-on experience with cloud data platforms (GCP preferred).
Highly proficient with Python, SQL, DBT, and modern orchestration frameworks and experienced with data quality and observability tooling.
Experience with at least one data processing framework such as Spark, Flink, or Dataflow
Senior Data Engineer improving General Motors vehicle data pipelines, monitoring, and observability. Supporting reliable fleet software operations across Oshawa and Markham hybrid offices.
Senior software engineer building General Motors’ vehicle data platform across ECUs and cloud. Developing control, data, logging, and SDK software for connected vehicles.
Senior Data Architect integrating Alberta’s environmental regulatory, Databricks, and geospatial platforms. Designing governed data flows for regulators, decision - makers, and Albertans.
Senior Data Architect leading secure, scalable data architecture for Manulife’s financial services organization. Designing cloud, lakehouse, analytics, machine learning, and generative AI data platforms.
Data engineering advisor developing scalable data platforms and pipelines for Desjardins. Designing, integrating, and improving data systems aligned with business needs.
Senior Data Engineer owning NimbleRx’s compliant healthcare data platform. Building scalable pipelines, warehouse models, and AI tooling for pharmacy and patient engagement operations.
Administrateur principal de plateformes de données chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Conception, exploitation et gouvernance de plateformes de données infonuagiques.
Senior Data Platform Administrator shaping and operating EDC’s secure enterprise data platforms. Supporting Canadian businesses through Export Development Canada’s trade - finance solutions.
Staff full - stack engineer architecting GitLab’s data products, integrations, and knowledge graph. Building APIs, marketplace data access, and AI - powered developer intelligence.
Data Governance Architect shaping governance strategies and cloud data architectures for Lovelytics’ enterprise data and AI consulting clients. Leading technical delivery, presales, migrations, and governance implementations on Databricks.