Principal AI Quality Developer at Autodesk focusing on quality for AI systems in Fusion Industry Cloud. Leading testing strategy and collaborating with cross-functional teams.
Responsibilities
Define and drive the quality strategy for applied AI and agentic features
Test planning, acceptance criteria, and release readiness for AI-powered capabilities
Design and build automated evaluation frameworks for LLM and ML outputs
Create repeatable evaluation metrics and scoring approaches for AI behavior
Validate retrieval-augmented generation workflows
Lead AI safety and abuse testing in partnership with Security
Establish production monitoring and post-deployment validation for AI features
Perform deep issue triage and root-cause analysis for AI-related defects
Mentor engineers and QA practitioners on AI testing approaches
Collaborate with cross-functional partners to ensure responsible AI practices are embedded into development workflows
Requirements
7+ years of experience in quality engineering, test automation, or software engineering
Strong programming skills in Python
Experience with test frameworks such as pytest or unittest
Hands-on experience testing AI or ML systems
Practical experience validating LLM-based systems
Proven ability to debug complex cross-stack issues
Strong communication skills
Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience
Hiring SRE Lead for 12 - month hybrid contract in Toronto, ON. Requires deep expertise in Observability, Dynatrace, and large - scale enterprise systems.
AI Engineering Intern developing AI agents and supporting real - world deployments for customer environments at Cresta, utilizing Large Language Models and innovative solutions.
Applications Development Senior Programmer Analyst at Citi enhancing application systems and contributing to programming activities in team - oriented environment.
HVAC application programmer at BBP Énergie, specializing in intelligent building systems. Collaborate with a dynamic team to enhance building automation and efficiency.
Développeur Analyste participant à des projets d’indemnisation au sein de l’équipe TI chez Beneva. Collaborant avec divers partenaires, il développe des solutions tout en suivant les meilleures pratiques.
Composite Stress Engineering Specialist analyzing composite and hybrid structures for aerospace projects in Canada. Requires strong background in engineering with relevant software skills for compliance and testing.
Airframe Stress Engineering Specialist working on composite structures in a hybrid role with Expleo. Analyze structures for compliance and collaborate with various stakeholders.