QA Lead – Agentic AI Platform

Posted 2 weeks ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • QA Lead ensuring end-to-end quality assurance for an advanced Agentic AI platform at Workiy. Responsible for defining standards, leading test strategy, and collaborating with various teams.

Responsibilities

  • Drive end-to-end quality assurance for an advanced Agentic AI platform
  • Define quality standards and develop automated evaluation frameworks
  • Lead test strategy and ensure release readiness for AI-powered conversational solutions
  • Build evaluation harnesses and create test plans
  • Execute regression testing and validate data quality
  • Conduct AI safety and prompt injection testing
  • Manage defect triage and lead a team of QA and Data Testers
  • Collaborate closely with engineering, product, architecture, and data teams to ensure delivery of reliable and high-quality AI solutions

Requirements

  • QA Leadership
  • Python
  • Test Automation
  • AI/LLM Testing
  • Conversational AI Testing
  • RAG (Retrieval-Augmented Generation) Testing
  • LLM Evaluation Frameworks
  • Golden Dataset & Regression Testing
  • Intent & Context Validation
  • Multi-Turn Dialogue Testing
  • Data Quality Testing
  • Prompt Injection & AI Safety Testing
  • Release Readiness & Quality Gates
  • Defect Management & Test Strategy
  • CI/CD Integrated Testing
  • Team Leadership & Mentoring

Benefits

  • Flexible working hours

Job title

Job type

Contract

Experience level

Senior

Salary

Not specified

Degree requirement

No Education Requirement

Tech skills

Python

Location requirements

RemoteCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.