Senior Machine Learning QA Engineer

Posted last month

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Senior ML QA Engineer in Autodesk's Research Enablement team ensuring quality standards for ML systems and collaborating with cross-functional teams.

Responsibilities

  • Define ML quality strategy and acceptance criteria across data, model, and system levels
  • Design and maintain model evaluation suites, metrics, and test datasets
  • Evaluating CAD RL model outputs for geometric validity or policy stability
  • Defining structured rubrics that translate qualitative findings into measurable evaluation gates
  • Testing ML Models from product side API Testing
  • Automate ML QA workflows using Python and CI/CD (e.g., GitHub Actions, Jenkins)
  • Create and maintain test harnesses for ML services and APIs
  • Mentor teams on ML QA best practices and consistent evaluation standards
  • Build quality gates for training and deployment pipelines (e.g., regression checks, drift detection)
  • Contribute to multi-team projects and codebases, ensuring code quality and consistency
  • Participate in code reviews and provide constructive feedback to peers
  • Document and present findings and ideas across the company

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or equivalent experience
  • 7+ years of professional experience in software engineering or QA for ML/AI systems
  • Strong programming skills in Python, with experience in test automation
  • Familiarity with popular CAD environments tooling
  • Proficient in Automation and UAT test suite/framework
  • Experience designing QA frameworks or platforms used by multiple teams
  • Excellent problem-solving skills and attention to detail
  • Strong communication and collaboration skills
  • Understanding of software architecture and design patterns
  • Ability to work in an agile development environment

Benefits

  • Health insurance
  • 401(k) matching
  • Flexible work hours
  • Paid time off
  • Remote work options

Job title

Job type

Full Time

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

JenkinsPython

Location requirements

HybridTorontoCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.