AI Model Testing Engineer at CoVet designing and maintaining testing pipelines and collaborating with medical teams. Focused on enhancing AI models for veterinary applications.
Responsibilities
Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models.
Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases.
Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs.
Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage.
Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability.
Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes.
Requirements
Demonstrable experience building and shipping software or projects that incorporate AI models (LLMs and/or transcription models), with specific examples of past work.
Experience or familiarity with AI model integration.
Proficiency with Node.js and TypeScript.
Familiarity with APIs from providers such as OpenAI, Google, or Anthropic.
Excellent problem-solving skills with a scrappy, innovative mindset—able to devise effective solutions under resource constraints.
Strong collaboration and communication skills to effectively partner with cross-functional teams, including medical professionals.
Benefits
Flexible remote work environment, with optional office presence at our HQ in Waterdown, Ontario.
Quality Assurance Technician at JBS Ontario conducting food safety checks in the seafood division. Collaborating with production teams and monitoring compliance to quality standards in Belleville, ON.
Quality Assurance Analyst supporting process improvement and Quality Management System at BioScript Solutions. Overseeing corrective actions and collaborating with cross - functional teams.
Quality Engineer II responsible for automated testing and quality assurance in the financial technology sector. Collaborating with agile teams to maintain testing standards and optimize automation methodologies.
Hiring QA Functional Lead in Toronto, ON (Hybrid). Requires 3+ years Test Lead experience, banking domain knowledge, and HP ALM, JIRA, Confluence skills.
Manager, QA responsible for technology services quality assurance standards and team leadership in a not - for - profit organization. Leading processes to maximize benefits in digital transformation strategy.
Quality Assurance Administrator supporting franchise quality assurance across 340 locations in North America. Ensuring compliance with insurance carrier standards and managing claims effectively.
FSQA Intern providing analytical and administrative support to Quality & Food Safety team at Sysco. Involves data collection, analysis, and reporting related to food safety and quality programs.
Linguist (UAT Tester) ensuring high - quality Canadian French content for AI systems. Responsible for localization QA and UAT testing with editing and reviewing tasks.