Senior QA Automation Engineer – AI Applications

Posted last week

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Senior QA Automation Engineer at Autodesk working on quality assurance for AI applications. Designing automated test suites and frameworks while collaborating with global teams.

Responsibilities

  • Design and maintain automated test suites, evaluation scenarios, metrics, and test datasets for AI-powered features.
  • Automate QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins), leveraging AI-powered testing tools to improve test development, maintenance, and coverage.
  • Create and maintain test harnesses for AI services, applications, and APIs.
  • Perform API testing for AI services and backend systems.
  • Define quality strategy and acceptance criteria for AI-powered applications across functional, API, integration, and AI/ML features.
  • Test AI/ML applications and machine learning models from a product and user perspective.
  • Evaluate AI/ML model outputs for correctness, consistency, and expected application behavior.
  • Define structured rubrics that translate qualitative findings into measurable evaluation gates.
  • Build quality gates for CI/CD and deployment pipelines, including automated regression and integration testing.
  • Mentor teams on QA automation best practices and consistent quality standards for AI-powered applications.
  • Contribute to multi-team projects and codebases, ensuring code quality and consistency.
  • Participate in code reviews and provide constructive feedback to peers.
  • Document and present findings and ideas across the company.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or equivalent experience
  • 5+ years of professional experience in software quality assurance, test automation, or software engineering
  • Strong programming skills in Python, with experience in test automation
  • Hands-on experience using AI-powered testing tools or AI coding assistants to improve test automation, productivity, and quality
  • Experience with CI/CD tools and processes
  • Familiarity with popular CAD environments and tooling
  • Proficient in automation and UAT test suites/frameworks
  • Experience designing QA frameworks or platforms used by multiple teams
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
  • Understanding of software architecture and design patterns
  • Ability to work in an Agile development environment.

Benefits

  • Annual cash bonuses
  • Commissions for sales roles
  • Stock grants
  • Comprehensive benefits package

Job title

Job type

Full Time

Experience level

Senior

Salary

CA$84,000 - CA$123,200 per year

Degree requirement

Bachelor's Degree

Tech skills

JenkinsPython

Location requirements

RemoteCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.