Technical lead building safe, evaluable LLM agents and AI infrastructure for OpenLoop’s telehealth platform. Setting architecture, observability, retrieval, and model operations direction.
About the role
- Senior AI Engineer defining architecture for complex agent workflows in the insurance sector. Collaborate with SMEs, design prototypes, and set evaluation standards for AI tools.
Responsibilities
- Define and drive the architecture for complex agentic flows
- Work closely with subject matter experts on insurance logic and agentic reasoning
- Design and oversee high-fidelity prototypes for validating business relevance
- Set standards for evaluating agentic behavior and build rigorous testing frameworks
- Implement monitoring and tracing for decision-making processes
- Collaborate with engineering to build necessary infrastructure
- Conduct research into agentic AI patterns
- Mentor engineers on agentic design patterns
Requirements
- 8+ years implementing ML/AI technologies
- at least 2 years focused on building and scaling LLM-driven applications
- Proven track record of building and deploying agentic workflows
- Deep expertise in orchestration frameworks (e.g., LangGraph)
- Expertise in teaching models to use external APIs, databases, and legacy tools effectively
- Demonstrated experience taking AI models from notebooks to high-availability environments in regulated industries (e.g., P&C Insurance, Banking, or Healthcare)
- Advanced Python skills; deep familiarity with state-of-the-art LLMs (OpenAI, Anthropic)
- Strong experience with AWS or similar cloud providers
- Creative builder mindset capable of architecting solutions in ambiguous projects
- Exceptional ability to explain AI decisions to stakeholders
Benefits
- health, dental, and vision insurance
- paid time off
- company sponsored retirement plan
- annual company bonus plan
- commissions
- long term incentive awards
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer evaluating AI coding agents such as Codex and Claude Code. Providing rigorous written and video feedback on engineering quality.
Senior software engineer evaluating AI coding agents for G2i. Assessing engineering judgment, explanations, and trustworthiness across Codex, Claude Code, and Cursor.
Senior engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering judgment, reasoning, and interaction quality.
Forward Deployed Engineer building full - stack AI solutions on AWS and Azure for Huron’s consulting clients. Partnering daily with business users to deliver tested features.
Staff AI Security Engineer securing EQ Bank’s enterprise AI, machine learning, and cloud platforms. Building guardrails, controls, automation, and detection capabilities for Canada’s Challenger Bank.
Staff Software Engineer owning OAuth, authorization, and agent delegation systems. Building governed identity infrastructure for Redpanda’s enterprise AI data platform.
Senior software engineer evaluating AI coding agents for G2i’s engineering team. Assessing reasoning, explanations, and engineering judgment in Codex, Claude Code, and Cursor interactions.
Senior software engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering quality.
Senior engineer evaluating Codex, Claude Code, and Cursor interactions for G2i. Providing rigorous written and video feedback on AI - generated engineering work.