Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • QA Analyst ensuring high-quality delivery across AI-driven applications. Validating core features, conducting testing, and collaborating in a fast-paced Agile environment.

Responsibilities

  • Perform manual testing of web applications, including UI, functional, exploratory, and regression testing
  • Validate AI-driven features , including prompt-based outputs, recommendations, and decision workflows
  • Test and verify agent-based systems and integrations , ensuring accuracy, reliability, and edge-case handling
  • Create and execute test plans, test cases, and test scenarios with clear coverage of AI behaviors and expected outcomes
  • Design, develop, and maintain automated test scripts using Playwright
  • Identify and document defects with detailed steps, logs, and supporting evidence
  • Collaborate with developers, product managers, and stakeholders to understand requirements and clarify expected AI behavior
  • Participate in Agile ceremonies (daily stand-ups, sprint planning, retrospectives, defect triage)
  • Validate backend data flows and integrations where applicable
  • Continuously improve QA processes, especially around AI testing strategies and automation coverage
  • Perform risk analysis for AI-related features (e.g., unexpected outputs, inconsistencies, performance concerns)

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
  • 3+ years of experience in software QA (manual + automation)
  • Strong experience in manual testing (functional, regression, exploratory)
  • Hands-on experience with Playwright (preferred) or similar automation frameworks
  • Experience testing modern web applications (UI + backend integration)
  • Basic understanding of AI/ML concepts , LLMs, or prompt-based systems
  • Experience testing AI features, recommendations, or conversational systems is a strong asset
  • Familiarity with agent-based workflows or automation tools involving AI is highly desirable
  • Experience with API testing (preferred) (Postman or Swagger)
  • Working knowledge of SQL and data validation
  • Familiarity with CI/CD pipelines and automated test execution
  • Experience with Agile methodologies and tools such as Azure DevOps.

Job title

Job type

Contract

Experience level

Mid levelSenior

Salary

CA$76,000 - CA$93,000 per year

Degree requirement

Bachelor's Degree

Tech skills

AzureSQL

Location requirements

HybridTorontoCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.