Quality Assurance Analyst testing Ava Industries’ cloud - based EMR software. Validating clinic workflows, releases, defects, and user experience for Canadian healthcare providers.
About the role
- AI Model Testing Engineer at CoVet designing and maintaining testing pipelines and collaborating with medical teams. Focused on enhancing AI models for veterinary applications.
Responsibilities
- Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models.
- Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases.
- Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs.
- Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage.
- Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability.
- Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes.
Requirements
- Demonstrable experience building and shipping software or projects that incorporate AI models (LLMs and/or transcription models), with specific examples of past work.
- Experience or familiarity with AI model integration.
- Proficiency with Node.js and TypeScript.
- Familiarity with APIs from providers such as OpenAI, Google, or Anthropic.
- Excellent problem-solving skills with a scrappy, innovative mindset—able to devise effective solutions under resource constraints.
- Strong collaboration and communication skills to effectively partner with cross-functional teams, including medical professionals.
Benefits
- Flexible remote work environment, with optional office presence at our HQ in Waterdown, Ontario.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
EC
Ingénieur qualité logicielle chez EDC, société canadienne aidant les entreprises à réussir à l’étranger. Automatisation des tests, validation assistée par l’IA et intégration de bout en bout.
QA Analyst testing Creator.co’s influencer marketing platform across web and mobile. Applying AI tools to manual testing, bug reporting, and emerging test automation.
Quality Engineer supporting medical device and combination - product quality for BlueRock Therapeutics’ cell therapy programs. Managing clinical readiness, complaints, suppliers, CAPAs, and design controls.
FCRM Quality Assurance Analyst reviewing high - risk customers and EDD compliance for TD, a major North American bank. Supporting AML controls, regulatory reporting and financial crime risk programs.
QA Audio Rater auditing production audio ratings and correcting calibration issues. Supporting Welo Data’s AI services program remotely from Canada for 10 hours weekly.
Senior QA Analyst testing Nelson’s digital K - 12 learning products across frontend, backend, API, and database layers. Building automation and investigating accessibility, performance, and infrastructure quality issues.
IT quality assurance specialist supporting Desjardins, a financial - services cooperative. Developing test strategies, executing manual and automated tests, and improving Agile quality practices.
QA Engineer advancing AI - first testing for Quest Software’s enterprise identity recovery products. Automating quality validation across Azure SaaS and Windows enterprise applications.
Senior QA Engineer II leading manual and automated testing for Prenuvo’s proactive healthcare scanning platform. Improving API, mobile, accessibility, CI/CD, and release quality.