Technical lead building safe, evaluable LLM agents and AI infrastructure for OpenLoop’s telehealth platform. Setting architecture, observability, retrieval, and model operations direction.
About the role
- Staff Engineer building production AI agent systems for Trulioo’s digital identity verification platform. Improving identity, fraud, risk, and commerce workflows with reliable, observable agent orchestration.
Responsibilities
- Report to the Director of Software Engineering
- Design, build, and own agent systems end-to-end from design through production for identity, fraud, risk, and commerce workflows
- Own evaluation harnesses and observability for shipped systems
- Build reliable, steerable, multi-step agent workflows involving planning, execution, outcome observation, iterative improvement, tool use, and human-in-the-loop patterns
- Troubleshoot non-deterministic failures across models, tools, orchestration, and infrastructure
- Work in a compliance-heavy, globally regulated domain emphasizing auditability, correctness, and human oversight
- Set and communicate technical vision to teammates and directed agents
- Leverage AI and emerging technologies to improve productivity, streamline workflows, and identify continuous-improvement opportunities
- Orchestrate AI agents in daily engineering work, verify outputs, and remain accountable for results
- Participate in recruiter, hiring manager, technical, and final leadership interviews as part of the hiring process
Requirements
- 8+ years of software engineering experience with demonstrated impact on production systems
- Fluency using AI agents in an engineering workflow
- Demonstrated ability to own features end-to-end and communicate trade-offs clearly to technical and non-technical stakeholders
- Experience working on challenging, novel, or ambiguous projects where the problem had to be defined
- Hands-on experience building with LLMs, including prompt engineering, RAG, tool use, and at least one agent framework such as LangGraph, CrewAI, or AutoGen
- Experience with evaluation frameworks for agent behavior
- Nice to have: experience in financial services, identity, fraud, risk, or other compliance-heavy environments
- Nice to have: multi-agent orchestration patterns and production-grade evaluation harnesses
- Nice to have: AI observability tooling and MLOps practices
- Nice to have: vector databases, knowledge graphs, or structured retrieval for agent memory
- Must be legally eligible to work in Canada or the USA
Benefits
- Health, dental, and vision coverage
- Retirement plans with company match
- Paid time off
- Parental leave
- Annual education & training stipend equivalent to $1,000 in local currency
- Flexible hybrid working environment
- Weekly lunches
- Quality coffee
- Regular social events
- Parent rooms at many locations
- On-site gyms at many locations
- Comfortable lounges
- Adaptable workstations
- Wellness workshops and events
- Complimentary Headspace subscription
- Employee Resource Groups
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer evaluating AI coding agents such as Codex and Claude Code. Providing rigorous written and video feedback on engineering quality.
Senior software engineer evaluating AI coding agents for G2i. Assessing engineering judgment, explanations, and trustworthiness across Codex, Claude Code, and Cursor.
Senior engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering judgment, reasoning, and interaction quality.
Forward Deployed Engineer building full - stack AI solutions on AWS and Azure for Huron’s consulting clients. Partnering daily with business users to deliver tested features.
Staff AI Security Engineer securing EQ Bank’s enterprise AI, machine learning, and cloud platforms. Building guardrails, controls, automation, and detection capabilities for Canada’s Challenger Bank.
Staff Software Engineer owning OAuth, authorization, and agent delegation systems. Building governed identity infrastructure for Redpanda’s enterprise AI data platform.
Senior software engineer evaluating AI coding agents for G2i’s engineering team. Assessing reasoning, explanations, and engineering judgment in Codex, Claude Code, and Cursor interactions.
Senior software engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering quality.
Senior engineer evaluating Codex, Claude Code, and Cursor interactions for G2i. Providing rigorous written and video feedback on AI - generated engineering work.