Technical lead building safe, evaluable LLM agents and AI infrastructure for OpenLoop’s telehealth platform. Setting architecture, observability, retrieval, and model operations direction.
About the role
- Senior AI Engineer at Supernal building AI Employee software solutions for SMB customers with a focus on production deployments and technical delivery.
Responsibilities
- Build production software with code and Supernal's proprietary platform, including backend services, data models, and CRUD applications
- Build and maintain integrations with external systems (APIs, webhooks, third-party tools, and data sources) that AI Employees can safely act on
- Design, implement, and deploy conversational agents, including multi-turn flows, state management, and tool usage
- Own end-to-end technical delivery for high-priority customer implementations, from architecture through production launch
- Translate customer requirements and SOWs into clear technical designs, execution plans, and deliverables
- Make and own architectural decisions across application design, API integrations, LLM orchestration, RAG design, and workflow decomposition
- Handle real-world voice system challenges including latency, interruptions, fallbacks, error handling, and failure recovery
- Write automated tests — unit tests for isolated logic and end-to-end tests for full system and user journey validation
- Apply solid error handling: distinguish retryable vs. fatal failures, surface meaningful error messages, and avoid silent failures
- Actively debug complex production issues across agent logic, prompts, integrations, and external dependencies
- Partner with delivery and product leadership to manage timelines, scope, and technical tradeoffs during implementation
- Review technical work for quality, scalability, and maintainability, setting a high bar for engineering excellence
- Define, document, and evolve best practices for building and delivering reliable AI Employees
Requirements
- Have **4+ years** of experience as a software engineer, automation engineer, or systems builder shipping production systems
- Understand **multi-turn conversation design**: state management, context windows, interruption handling, and graceful recovery
- Have tackled **real-time constraints** in production: latency budgets, streaming audio, fallback paths, and API chaos
- Have hands-on experience deploying **voice agents** using leading platforms (e.g., ElevenLabs, Retell, Nextiva), including telephony and streaming audio integration patterns
- Write **automated tests** as a matter of course — unit tests, integration tests, and end-to-end workflow validation — and treat testing as part of shipping, not an afterthought
- Apply **solid engineering fundamentals**: error handling, retry strategies, separation of concerns, and clean interfaces between components
- Are comfortable owning delivery outcomes end-to-end — not just writing code — including timelines, reliability, and client success
- Have deep experience with agentic architectures and APIs, and have shipped real integrations in production
- Understand LLM orchestration, prompt engineering, function calling, and retrieval-augmented generation (RAG)
- Can prototype fast *and* finish the job to production quality — with tests, error handling, monitoring, and runbooks
- Are an elite debugger who can reason through edge cases, flaky agents, and real-world API failures
- **Communicate clearly and fluently in English** — both in writing and verbally — especially when articulating technical decisions, tradeoffs, and implementation choices to technical and non-technical stakeholders alike
- Provide your own computer with reliable, high-speed internet. Be willing to work in Americas time zones.
- Can run meetings, drive decisions, write crisp updates, and ask the right questions early — without needing heavy process
- Thrive in fast-paced, ambiguous startup environments and take ownership without being asked
- Bring a low-ego, high-integrity approach to collaboration and leadership.
Job title
Job type
Experience level
Salary
Degree requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer evaluating AI coding agents such as Codex and Claude Code. Providing rigorous written and video feedback on engineering quality.
Senior software engineer evaluating AI coding agents for G2i. Assessing engineering judgment, explanations, and trustworthiness across Codex, Claude Code, and Cursor.
Senior engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering judgment, reasoning, and interaction quality.
Forward Deployed Engineer building full - stack AI solutions on AWS and Azure for Huron’s consulting clients. Partnering daily with business users to deliver tested features.
Staff AI Security Engineer securing EQ Bank’s enterprise AI, machine learning, and cloud platforms. Building guardrails, controls, automation, and detection capabilities for Canada’s Challenger Bank.
Staff Software Engineer owning OAuth, authorization, and agent delegation systems. Building governed identity infrastructure for Redpanda’s enterprise AI data platform.
Senior software engineer evaluating AI coding agents for G2i’s engineering team. Assessing reasoning, explanations, and engineering judgment in Codex, Claude Code, and Cursor interactions.
Senior software engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering quality.
Senior engineer evaluating Codex, Claude Code, and Cursor interactions for G2i. Providing rigorous written and video feedback on AI - generated engineering work.