Data Engineering Developer building scalable Azure data pipelines for an agile tech development firm. Advising clients, implementing governance, and improving cloud data engineering standards.
About the role
- Senior Data Engineer responsible for data infrastructure in Cost Engineering. Enabling cost optimization and sustainability initiatives while collaborating across teams.
Responsibilities
- Be responsible for the design, implementation, and evolution of scalable, reliable data infrastructure that underpins Spotify’s cost and carbon intelligence.
- Own end-to-end data pipelines for cloud cost, usage, and emissions data: spanning ingestion, transformation, modeling, and serving layers.
- Partner deeply with Data Scientists, Engineering, Finance, and Procurement to translate sophisticated analytical and business needs into robust data architectures.
- Set technical direction and standards for data modeling, orchestration, testing, and observability within the Cost Engineering domain.
- Build and maintain curated, analytics-ready datasets that power executive reporting, forecasting, and optimization initiatives.
- Ensure data accuracy, consistency, and timeliness for high-stakes cost and emissions reporting used to guide strategic infrastructure investments.
- Proactively identify opportunities to improve the scalability, reliability, and cost efficiency of the data platform itself.
- Mentor other engineers and act as a technical sounding board, raising the overall bar for data engineering perfection on the team.
- Work across all Missions at Spotify to embed cost and climate awareness into decision-making, with a focus on accurate attribution of spend and carbon impact.
Requirements
- A senior data engineer with a strong track record of owning and operating production-critical data systems end to end.
- Hold a degree in computer science, engineering, or a related technical field, or equivalent proven experience.
- Experienced in designing data architectures that scale with both data volume and organizational complexity.
- Comfortable leading technical discussions, influencing build decisions, and aligning partners around long-term solutions.
- Thrive in environments with evolving requirements, balancing speed of delivery with adaptability and correctness.
- Strong communicator who can explain sophisticated technical concepts clearly to both technical and non-technical audiences.
- Familiar with financial, billing, or usage data, and able to connect infrastructure metrics to real business and sustainability impact.
- Hands-on experience with cloud data platforms (GCP preferred).
- Highly proficient with Python, SQL, DBT, and modern orchestration frameworks and experienced with data quality and observability tooling.
- Experience with at least one data processing framework such as Spark, Flink, or Dataflow
Benefits
- Flexible work arrangements
- Professional development
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Ingénieur(e) données concevant des pipelines et architectures analytiques Azure. Collaboration client et amélioration des standards de gouvernance, qualité et performance des données.
Junior Data Engineer building reliable ETL pipelines and data solutions for PLATO, Canada’s Indigenous - owned technology services company. Improving data quality, accessibility, governance, and pipeline performance.
Senior Data Engineer building scalable, AI - powered data infrastructure for CloudBlue, HostPapa’s cloud commerce platform. Developing real - time pipelines, APIs, and production analytics systems.
Senior Fabric Data Engineer modernizing enterprise data for Canadian IT consulting clients. Building Microsoft Fabric pipelines, curated datasets, security controls, and analytics - ready models.
Staff Data Engineer building scalable pipelines and lakehouse architecture for Sonatype, a software supply chain security company. Driving trusted analytics, ML, and business intelligence data with Databricks, Spark, and modern cloud technologies.
Senior Fabric Data Engineer modernizing learning - platform data for Cornerstone Galaxy. Building Microsoft Fabric pipelines, curated datasets, governance, and analytics - ready integrations.
GCP Data Platform Engineer maintaining and optimizing production data platforms for Innodata, a global data engineering and AI services company. Supporting Airflow pipelines, GCP infrastructure, reliability, and troubleshooting.
Senior Data Engineer building finance data pipelines and models for Instacart’s grocery delivery platform. Owning financial data infrastructure supporting accounting, billing, invoicing, and reporting.
Senior Data Architect modernizing Alberta justice data marts into an integrated enterprise data warehouse. Designing ETL, Power BI testing, data models, governance, and reporting architecture.