Technical lead building safe, evaluable LLM agents and AI infrastructure for OpenLoop’s telehealth platform. Setting architecture, observability, retrieval, and model operations direction.
About the role
- Senior AI Engineer leading design and development of AI agent capabilities at Fullsteam. Building production-ready solutions that empower clients in the alcohol industry with seamless automation.
Responsibilities
- Design and implement production-grade agentic systems; autonomous agents that leverage LLMs to reason, use tools, manage context, and orchestrate complex multi-step workflows on behalf of users.
- Build scalable backend services, APIs, and data pipelines that support real-time AI inference, conversation state, and tool execution with robust error handling and recovery.
- Architect systems for scale, designing AI infrastructure that handles growing inference demands, evolving agent complexity, and production reliability requirements.
- Build and maintain RAG pipelines, including embeddings, vector search, and retrieval strategies, to power knowledge-driven features and contextual AI responses.
- Bring foundational ML understanding to inform decisions around model selection, fine-tuning, embeddings, and evaluation and knowing when to use off-the-shelf models versus more custom approaches.
- Collaborate with product, engineering, DevOps, and QA teams to define requirements and deliver AI-powered features, leading technical direction while pulling in the right people at the right stages.
- Evaluate emerging agentic frameworks, LLM providers, and AI tooling; recommend adoptions that move the team’s capabilities forward.
- Establish and document AI engineering standards, covering reliability, safety, observability, and prompt management and building institutional knowledge as the AI function grows.
- Maintain engineering excellence. Write clean, well-tested code; conduct thorough code reviews; champion best practices across the team
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical field
- 6+ years of professional software engineering experience
- 2+ years of hands-on experience designing and building applications that integrate agentic systems in production environments
- Experience with cloud platforms, preferably AWS (Lambda, Bedrock, OpenSearch)
- Proven track record of shipping and operating production systems with reliability and observability
- Strong debugging, troubleshooting, and problem-solving skills
- Ability to work independently with a high degree of ownership, driving projects forward with limited direct oversight
- Strong communication skills with the ability to collaborate effectively across engineering, product, and non-technical stakeholders.
Benefits
- Medical
- Extended Health and LTD plan
- Dental
- Vision
- RRSP (with employer match)
- Health Spending Account
- Flexible paid time off
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Senior software engineer evaluating AI coding agents such as Codex and Claude Code. Providing rigorous written and video feedback on engineering quality.
Senior software engineer evaluating AI coding agents for G2i. Assessing engineering judgment, explanations, and trustworthiness across Codex, Claude Code, and Cursor.
Senior engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering judgment, reasoning, and interaction quality.
Forward Deployed Engineer building full - stack AI solutions on AWS and Azure for Huron’s consulting clients. Partnering daily with business users to deliver tested features.
Staff AI Security Engineer securing EQ Bank’s enterprise AI, machine learning, and cloud platforms. Building guardrails, controls, automation, and detection capabilities for Canada’s Challenger Bank.
Staff Software Engineer owning OAuth, authorization, and agent delegation systems. Building governed identity infrastructure for Redpanda’s enterprise AI data platform.
Senior software engineer evaluating AI coding agents for G2i’s engineering team. Assessing reasoning, explanations, and engineering judgment in Codex, Claude Code, and Cursor interactions.
Senior software engineer evaluating AI coding agents such as Codex, Claude Code, and Cursor. Providing rigorous written and video feedback on engineering quality.
Senior engineer evaluating Codex, Claude Code, and Cursor interactions for G2i. Providing rigorous written and video feedback on AI - generated engineering work.