About the role

Principal AI Quality Developer at Autodesk focusing on quality for AI systems in Fusion Industry Cloud. Leading testing strategy and collaborating with cross-functional teams.

Responsibilities

Define and drive the quality strategy for applied AI and agentic features
Test planning, acceptance criteria, and release readiness for AI-powered capabilities
Design and build automated evaluation frameworks for LLM and ML outputs
Create repeatable evaluation metrics and scoring approaches for AI behavior
Validate retrieval-augmented generation workflows
Lead AI safety and abuse testing in partnership with Security
Establish production monitoring and post-deployment validation for AI features
Perform deep issue triage and root-cause analysis for AI-related defects
Mentor engineers and QA practitioners on AI testing approaches
Collaborate with cross-functional partners to ensure responsible AI practices are embedded into development workflows

7+ years of experience in quality engineering, test automation, or software engineering
Strong programming skills in Python
Experience with test frameworks such as pytest or unittest
Hands-on experience testing AI or ML systems
Practical experience validating LLM-based systems
Proven ability to debug complex cross-stack issues
Strong communication skills
Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience