About the role

Staff+ Software Engineer building model routing, evaluation, and agent infrastructure for Aleph’s AI-native FP&A platform. Shipping production AI features and observability across the Americas.

Responsibilities

Own the AI foundation product teams build on: model selection and routing, the model proxy layer, context management, and tool design
Own eval infrastructure and work with customers and finance domain experts to define excellent output and encode it in reusable evals
Ship agentic features end to end, from v0 through the optimization loop, including prompt and context engineering, caching, parallel tool calls, and subagent patterns
Build observability into agent behavior to profile it, find bottlenecks, and decide what to fix with data
Track changes in agentic systems and incorporate proven practices into engineering processes

You've shipped production LLM systems - evals, context management, multi-model or multi-provider routing - and can talk concretely about what broke and what you changed
You build proof of concepts, decide quickly, and ship v0s. Evals drive your quality bar
Strong judgment about abstractions: opinionated about design, pragmatic about shipping incrementally
Experience with LLM APIs and agent frameworks, and shipped user-facing products
You want to ship production systems, not do research
Adoption: teams you don't manage have picked up systems you built - because they were that good
Strong fundamentals: you can trace requests from UI to data store and make good technical decisions at every layer
High agency: background as a founder, engineering lead, or startup builder. You have a builder's mindset and find creative ways to ship
Pragmatism: you choose the fewest and simplest tools that will actually work
Craft: you care deeply about code quality and write code that's correct and easy to understand
Communication: clear, direct, and persuasive across technical and non-technical audiences
Experience: you've built complex B2B products, ideally from scratch