Principal Machine Learning Engineer, Evaluation

Posted 17 hours ago

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Principal Machine Learning Engineer evaluating ML models at Autodesk for CAD/BIM workflows. Collaborating with teams to ensure quality, reliability and customer impact in ML-powered products.

Responsibilities

  • Design and execute evaluation protocols (datasets, metrics, statistical analysis) that reflect real user workflows for CAD/BIM and production conditions
  • Develop reproducible evaluation tools and automations to support model development, regression testing, and release-readiness decisions
  • Collect, process, and analyze data from multiple sources to assess model behavior and customer outcomes
  • Validate end-to-end ML-based product experiments and translate product requirements into measurable evaluation criteria
  • Communicate findings and recommendations clearly to researchers, engineers, product teams, and leadership
  • Document model quality issues discovered in production

Requirements

  • BS or MS in Mechanical Engineering, Architecture, Computer Engineering, Computer Science, Applied Mathematics, Statistics, or equivalent professional experience
  • 4+ years of professional experience in ML model evaluation, ML QA, or applied ML engineering
  • Strong software engineering skills, including Python, data pipelines, testable and maintainable code, version control, and cloud-based workflows
  • Strong written communication skills to document evaluation methods, results, and recommendations

Benefits

  • Base salary
  • Annual cash bonuses
  • Commissions for sales roles
  • Equity grants
  • Comprehensive benefits package

Job type

Full Time

Experience level

Lead

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

CloudFluxPython

Location requirements

HybridTorontoCanada

Report this job

Found something wrong with the page? Please let us know by submitting a report below.