Principal AI Quality Developer at Autodesk focusing on quality for AI systems in Fusion Industry Cloud. Leading testing strategy and collaborating with cross-functional teams.
Responsibilities
Define and drive the quality strategy for applied AI and agentic features
Test planning, acceptance criteria, and release readiness for AI-powered capabilities
Design and build automated evaluation frameworks for LLM and ML outputs
Create repeatable evaluation metrics and scoring approaches for AI behavior
Validate retrieval-augmented generation workflows
Lead AI safety and abuse testing in partnership with Security
Establish production monitoring and post-deployment validation for AI features
Perform deep issue triage and root-cause analysis for AI-related defects
Mentor engineers and QA practitioners on AI testing approaches
Collaborate with cross-functional partners to ensure responsible AI practices are embedded into development workflows
Requirements
7+ years of experience in quality engineering, test automation, or software engineering
Strong programming skills in Python
Experience with test frameworks such as pytest or unittest
Hands-on experience testing AI or ML systems
Practical experience validating LLM-based systems
Proven ability to debug complex cross-stack issues
Strong communication skills
Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience
Multiple IT roles in Toronto including Python Developer, Application Support Analyst, AWS Connect Engineer, Technical Delivery Lead, and Triage Manager. Contractor positions.
Software Developer contractor needed in Toronto with 10+ years experience designing provincial financial systems using .NET, Azure Power Platform, and reporting tools like Power BI and Crystal Reports.
Human Resource Coordinator role in Fredericton, NB. Perfect for someone who loves variety, thrives in fast - paced environments, and wants to own HR initiatives.
Technical Staff member building and managing data pipelines for AI model training at Moonvalley. Seeking candidates with data engineering expertise and ML knowledge.
Materials Developer I focusing on technical developments in high - performance materials. Joining Arc'teryx's team to enhance supply chain goals and product success.
Materials Developer focused on seasonal developments of high - performance trim materials at Arc'teryx. Collaborate with cross - functional teams to drive product success and sustainability in the supply chain.
Engineering Intern in Hydropower & Dams team, assisting in design and analysis tasks. Gaining hands - on experience in civil engineering projects focused on renewable energy.
Regional Study Budget Developer overseeing and managing study budgets aligned with compliance for AstraZeneca. Collaborating globally while ensuring budget accuracy throughout clinical trials.
Senior Mainframe Developer building next - gen Payment Processing Platforms at TD Securities. Overseeing application development, support, and technical solution creation.