AI Model Testing Engineer

Posted 3 weeks ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • AI Model Testing Engineer at CoVet designing and maintaining testing pipelines and collaborating with medical teams. Focused on enhancing AI models for veterinary applications.

Responsibilities

  • Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models.
  • Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases.
  • Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs.
  • Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage.
  • Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability.
  • Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes.

Requirements

  • Demonstrable experience building and shipping software or projects that incorporate AI models (LLMs and/or transcription models), with specific examples of past work.
  • Experience or familiarity with AI model integration.
  • Proficiency with Node.js and TypeScript.
  • Familiarity with APIs from providers such as OpenAI, Google, or Anthropic.
  • Excellent problem-solving skills with a scrappy, innovative mindset—able to devise effective solutions under resource constraints.
  • Strong collaboration and communication skills to effectively partner with cross-functional teams, including medical professionals.

Benefits

  • Flexible remote work environment, with optional office presence at our HQ in Waterdown, Ontario.

Job title

Job type

Full Time

Experience level

Mid levelSenior

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

JavaScriptNode.jsTypeScript

Location requirements

HybridWaterdownCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.