Software Engineer I – LLM Observability

Posted 5 hours ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Software Engineer building AI observability features for Honeycomb’s developer tools. Developing data infrastructure and product experiences to help customers debug LLM agents.

Responsibilities

  • Deliver AI observability capabilities end to end, from ingestion to in-product visualizations
  • Contribute to the data model and infrastructure for observing agents and their ecosystems across the Honeycomb product
  • Build systems that analyze and surface AI-specific signals, including cost, token usage, errors, and anomalies
  • Collaborate with product and design partners to create usable, intuitive features and meaningful user workflows
  • Share learnings about exploring and understanding AI system behavior across conversations and workloads
  • Iterate through fast feedback loops and experimentation, sharing both wins and failures
  • Work in a small, cross-functional engineering group with a dedicated product manager and designer
  • Ship features customers use in production

Requirements

  • 3+ years of software engineering experience
  • Experience shipping customer-facing features at a SaaS company, beyond internal tooling
  • Proficiency in backend development with Go and/or Python
  • Proficiency in frontend development with TypeScript and React
  • Experience working with product managers and designers
  • Regular, hands-on use of AI tools in day-to-day engineering work
  • Experience being on call; joining the rotation after about 90 days
  • Ability to navigate ambiguity in a fast-moving field where requirements shift and experimentation is core
  • Must verify identity and eligibility to work
  • Honeycomb cannot currently sponsor or support visa transfers
  • Bonus: Experience building LLM or agent-powered features in production
  • Bonus: Hands-on experience with observability tooling, such as OpenTelemetry

Benefits

  • Generous equity with employee-friendly stock program
  • Transparent pay based on levels relative to experience
  • Unlimited PTO
  • Distributed-first mindset and culture
  • Home office, co-working, and internet stipend
  • Full benefits coverage for employees, with additional coverage available for dependents
  • Up to 16 weeks of paid parental leave, regardless of path to parenthood
  • Annual development allowance
  • Reasonable accommodations during the hiring process

Job type

Full Time

Experience level

Mid levelSenior

Salary

CA$218,891 - CA$245,946 per year

Degree requirement

No Education Requirement

Tech skills

PythonReactTypeScriptGo

Location requirements

RemoteCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.