Product Manager – ML/AI Platform

Posted 6 days ago

Apply Now

About the role

  • Product Manager overseeing AI observability and evaluation within the ML/AI Platform team at Spotify. Collaborating with engineering leaders to enhance AI workloads and user experiences.

Responsibilities

  • Own the product roadmap for Spotify’s AI observability capabilities across instrumentation, data contracts, and debugging workflows.
  • Collaborate with stakeholders to develop the roadmap for Spotify’s AI/Agentic evaluation capabilities via LLM-as-judges and other approaches.
  • Build golden path instrumentation defaults (SDKs/libraries/templates) that make LLM workloads observable by default.
  • Partner with engineering to deliver root-cause workflows across LLM chains/agents (what changed, where time/cost is spent, which step fails, which prompt/template/model version regressed).
  • Drive adoption with internal teams through discovery, pilots, documentation, and ongoing enablement.
  • Define and track success metrics (coverage, time-to-first-trace, regressions caught pre-prod, MTTR, cost anomalies detected early).
  • Partner with Privacy/Security to establish safe logging and retention guidance that supports both compliance and debuggability.

Requirements

  • 2+ years of experience as a Product Manager, Technical Product Manager, or equivalent product ownership role.
  • Familiar with ML and AI development flows, and comfortable reasoning about LLM application patterns (prompting, RAG/agents, evaluation basics).
  • Aware of LLM evaluation approaches (golden datasets, regression testing, human-in-the-loop review, LLM-as-a-judge).
  • Comfortable partnering with engineers on technical tradeoffs and system design, even if you are not writing production code.
  • Strong product fundamentals: discovery, prioritization, roadmap communication, and stakeholder alignment.
  • Metrics-oriented and pragmatic; you can define outcomes and iterate based on evidence.

Benefits

  • Equity
  • Flexibility to work where you work best!
  • Accessibility accommodations during the interview process

Job title

Job type

Full Time

Experience level

JuniorMid level

Salary

CA$98,155 - CA$140,222 per year

Degree requirement

Bachelor's Degree

Location requirements

HybridTorontoCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.