Senior Data Engineer responsible for data infrastructure in Cost Engineering. Enabling cost optimization and sustainability initiatives while collaborating across teams.
Responsibilities
Be responsible for the design, implementation, and evolution of scalable, reliable data infrastructure that underpins Spotify’s cost and carbon intelligence.
Own end-to-end data pipelines for cloud cost, usage, and emissions data: spanning ingestion, transformation, modeling, and serving layers.
Partner deeply with Data Scientists, Engineering, Finance, and Procurement to translate sophisticated analytical and business needs into robust data architectures.
Set technical direction and standards for data modeling, orchestration, testing, and observability within the Cost Engineering domain.
Build and maintain curated, analytics-ready datasets that power executive reporting, forecasting, and optimization initiatives.
Ensure data accuracy, consistency, and timeliness for high-stakes cost and emissions reporting used to guide strategic infrastructure investments.
Proactively identify opportunities to improve the scalability, reliability, and cost efficiency of the data platform itself.
Mentor other engineers and act as a technical sounding board, raising the overall bar for data engineering perfection on the team.
Work across all Missions at Spotify to embed cost and climate awareness into decision-making, with a focus on accurate attribution of spend and carbon impact.
Requirements
A senior data engineer with a strong track record of owning and operating production-critical data systems end to end.
Hold a degree in computer science, engineering, or a related technical field, or equivalent proven experience.
Experienced in designing data architectures that scale with both data volume and organizational complexity.
Comfortable leading technical discussions, influencing build decisions, and aligning partners around long-term solutions.
Thrive in environments with evolving requirements, balancing speed of delivery with adaptability and correctness.
Strong communicator who can explain sophisticated technical concepts clearly to both technical and non-technical audiences.
Familiar with financial, billing, or usage data, and able to connect infrastructure metrics to real business and sustainability impact.
Hands-on experience with cloud data platforms (GCP preferred).
Highly proficient with Python, SQL, DBT, and modern orchestration frameworks and experienced with data quality and observability tooling.
Experience with at least one data processing framework such as Spark, Flink, or Dataflow
Senior Software Engineer focusing on data engineering and machine learning for Workday. Involves data ingestion, governance, and collaboration using modern technologies.
Hiring Data Warehouse Tester/Developer in Toronto, ON (Hybrid). Requires 6 - 8 years exp in Databricks, PySpark, Python, SQL, Azure, ADF, DevOps, Informatica.
Lead Data Engineering and Analytics team to oversee data infrastructure design and governance for robotic deliveries. Collaborate cross - functionally to enable data - driven decision - making across departments.
Senior Data Architect delivering enterprise - scale data and analytics solutions at 3Pillar. Leading design and delivery of analytics platforms in mixed prem and cloud environments.
Cloud Data Engineer responsible for modern Data & AI solutions on Microsoft Azure. Collaborating with clients and teams to develop production - ready data platforms and support analytics.
Senior Data Engineer at Solana Foundation collaborating with blockchain engineers on data indexing and pipeline creation. Ensuring efficient data processing and metrics formulation for decentralized applications.
Senior Data Engineer responsible for designing and maintaining event streaming pipelines at Movable Ink. Working with modern technologies to enhance data availability and reliability.
Senior Engineer on Data Platform team designing and building systems for data flow at Movable Ink. Collaborating with engineering, analytics, and infrastructure teams to power data ingestion and processing.
Senior Data Engineer architecting and owning Snowflake layer for Knak’s Data Infrastructure and AI enablement. Collaborating across departments to ensure data accessibility and governance standards.
Data Engineer designing and implementing cloud - native data ecosystem for sports analytics. Building scalable infrastructure to transform raw data into valuable consent assets.