AI Model Testing Engineer at CoVet designing and maintaining testing pipelines and collaborating with medical teams. Focused on enhancing AI models for veterinary applications.
Responsibilities
Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models.
Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases.
Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs.
Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage.
Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability.
Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes.
Requirements
Demonstrable experience building and shipping software or projects that incorporate AI models (LLMs and/or transcription models), with specific examples of past work.
Experience or familiarity with AI model integration.
Proficiency with Node.js and TypeScript.
Familiarity with APIs from providers such as OpenAI, Google, or Anthropic.
Excellent problem-solving skills with a scrappy, innovative mindset—able to devise effective solutions under resource constraints.
Strong collaboration and communication skills to effectively partner with cross-functional teams, including medical professionals.
Benefits
Flexible remote work environment, with optional office presence at our HQ in Waterdown, Ontario.
Senior Mobile Quality Engineer at CBC focusing on quality across mobile platforms. Collaborating with teams to enhance mobile app testing and architecture development.
AI Quality Assurance Developer developing testing strategies for AI - integrated products at CBC/Radio - Canada. Collaborating with teams to ensure high - quality, reliable software solutions.
QA Analyst with accounting expertise at Tecsys, a provider of supply chain solutions for healthcare. Responsible for ensuring software quality through testing and collaboration with teams.
Senior Quality Engineer leading the design and execution of test strategies for Equitable Bank. Collaborating with cross - functional teams to ensure quality in innovative banking solutions.
Underwriting File Review & Education Specialist at Northbridge Financial strengthening quality and consistency. Leading the review process and contributing to effective underwriting education across brands.
Quality assurance role in software testing within Digital Information team. Focusing on manual and automated testing, collaboration, and process governance.
Competitive Systems Tester living inside the game to ensure balance and quality for a competitive card battler. Collaborating with AI balance outputs, designers, and engineers to enhance gameplay.
Senior QA Lead ensuring platform quality for a SaaS company handling loyalty and ordering processes. Building test strategies and automation to prevent production issues while leading a team.
Quality Engineer Intern at TD providing software testing and collaborating with teams on application quality assurance. Contributing to various quality engineering activities with world - class training.