Forward Deployed AI Engineer industrializing GenAI and agentic AI solutions for Keyrus Canada clients. Deploying measurable, governed AI systems across enterprise environments.
About the role
- Applied AI Engineer building evaluation pipelines, production agents, and reliable clinical AI for Tali’s healthcare platform. Owning models, retrieval, routing, and observability across ambient scribe, billing, search, and clinical workflows.
Responsibilities
- Own AI systems end to end, including models, prompts, retrieval, data, evaluations, and debugging
- Build evaluation pipelines, automated judges, regression suites, human review processes, and supporting datasets
- Measure audio-path quality using word and speaker error rates and audio-quality metrics
- Diagnose and fix failure modes across prompts, retrieval, routing, models, audio capture, and fine-tuning
- Build production agents with tool use, orchestration, guardrails, and failure recovery
- Build supporting search, vector storage, and agent harness infrastructure
- Debug visits end to end from audio to delivered clinical note and identify systemic issues
- Analyze warehouse data to size problems and validate fixes
- Manage model routing, staged rollouts, and attribution
- Own AI systems in production, respond to quality alerts, identify causes, and determine fixes
- Translate clinical complaints into problem statements, metrics, and actionable plans
- Establish applied AI evaluation standards across Tali
- Build evaluation tooling, debug traces, engage clinicians about failures, and improve infrastructure
- Drive AI capability improvements and productionize the next generation of agents
Requirements
- 5+ years in production ML, applied AI, or research engineering
- Experience owning production systems used by real users
- Deep evaluation experience, including graders, regression suites, or judge pipelines
- Experience with agentic systems involving multiple models, tool calls, retrieval, and failure recovery
- Strong systems engineering skills in backend services, data pipelines, and observability
- Data-centric approach to improving AI systems and feedback loops
- Proficiency in Python and modern ML tooling
- Ability to provide and receive candid technical feedback
- Ability to make and communicate engineering and business cases and own outcomes
- Ability to improve systems through code reviews and mentoring
- Speech recognition or real-time audio experience is a bonus
- Experience in a regulated domain such as healthcare or finance is a bonus
- Clinical experience is a bonus
- Experience with Python and TypeScript
- Experience with GCP and Cloud Run
- Experience with Vertex AI, Claude, and other frontier LLM and ASR providers
Benefits
- Flexible work hours
- Comprehensive health and wellness coverage from day one
- Unmetered wellness days
- Competitive PTO
- Winter shutdown Dec 25 - Jan 1
- Birthdays and Taliversaries
- 'Extra long' long weekends
- $2000 annually in "Knowledge Dollars" to learn, grow, and level up
- Quarterly socials & company outings
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
LP
GenAI Developer
LinkedIn Recruiter Post
TCS Canada is hiring recent graduates for GenAI Developer roles, focusing on Generative AI, LLMs, RAG, and AI Agents. Candidates will work on real - world AI solutions in an Agile environment.
Staff AI Engineer building and deploying enterprise AI applications for EQ Bank. Designing scalable systems, integrating LLMs, and delivering production solutions in Toronto.
Staff AI Engineer scaling safe, evaluated agentic AI across Maple’s Canadian on - demand healthcare platform. Defining architecture, governance, observability, and cost controls for product squads.
Staff AI Engineer leading Calix’s enterprise agent platform for broadband providers. Building agentic workflows, RAG pipelines, integrations, and governance across product development.
LP
AI Engineer-Banking
LinkedIn Recruiter Post
Design, build, and deploy AI/ML solutions for banking, including LLM fine - tuning, MLOps, and scalable production systems.
LP
Senior Mainframe Developer (COBOL)
LinkedIn Recruiter Post
Senior Mainframe Developer (COBOL) needed for banking domain in Toronto. Hybrid role, 3 days onsite, 7+ years experience required.
LP
AI & GenAI Professionals
LinkedIn Recruiter Post
Hiring AI & GenAI professionals in Toronto: AI Architect, AI Engineer, Full Stack AI Developer. Roles involve GenAI, Azure AI Foundry, Databricks, and RAG.
Advanced Analytics / AI Engineer developing Azure and MS Dynamics analytics solutions for PLATO, Canada’s Indigenous - owned software testing and technology services company. Applying machine learning and AI to improve operational efficiency and strategic decision - making.
Senior AI Engineer developing secure AI models and data pipelines integrated with Azure and MS Dynamics. Supporting PLATO, Canada’s Indigenous - owned software testing and technology services company.