Systems programmer analyst developing, testing, deploying, and maintaining Desjardins IT software and infrastructure solutions. Analyzing complex incidents and coordinating standardized technology solutions with business partners and architects.
About the role
- Principal AI Quality Developer at Autodesk focusing on quality for AI systems in Fusion Industry Cloud. Leading testing strategy and collaborating with cross-functional teams.
Responsibilities
- Define and drive the quality strategy for applied AI and agentic features
- Test planning, acceptance criteria, and release readiness for AI-powered capabilities
- Design and build automated evaluation frameworks for LLM and ML outputs
- Create repeatable evaluation metrics and scoring approaches for AI behavior
- Validate retrieval-augmented generation workflows
- Lead AI safety and abuse testing in partnership with Security
- Establish production monitoring and post-deployment validation for AI features
- Perform deep issue triage and root-cause analysis for AI-related defects
- Mentor engineers and QA practitioners on AI testing approaches
- Collaborate with cross-functional partners to ensure responsible AI practices are embedded into development workflows
Requirements
- 7+ years of experience in quality engineering, test automation, or software engineering
- Strong programming skills in Python
- Experience with test frameworks such as pytest or unittest
- Hands-on experience testing AI or ML systems
- Practical experience validating LLM-based systems
- Proven ability to debug complex cross-stack issues
- Strong communication skills
- Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent experience
Benefits
- Annual cash bonuses
- Comprehensive benefits package
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Développeur mobile créant des produits numériques innovants chez Mirego, agence de développement logiciel. Conception d'applications iOS et Android multiplateformes avec React Native ou Kotlin Multiplatform.
UiPath Developer supporting and enhancing production automations for Paralucent. Troubleshooting UiPath workflows and maintaining continuous shift - based support across Canada or India.
ABAP/ODATA Developer designing, developing, and supporting SAP ABAP and OData solutions. Delivering S/4HANA customizations, integrations, and technical project support.
Software Engineer building full - stack AI healthcare workflow products at exacare ai. Developing scalable systems, integrations, and customer - facing features for post - acute care teams.
Principal CRM Developer building Dynamics 365 and Azure solutions for Ontario’s condominium authority. Leading CRM delivery, integrations, CI/CD, testing, and engineering standards.
LabWare Developer implementing and enhancing LabWare LIMS for CSols Canada, a laboratory informatics consultancy. Configuring modules, instrument interfaces, integrations, and reporting solutions.
Desjardins programmer analyst developing, maintaining, and supporting enterprise IT systems and infrastructure. Applying software, data, and security practices to standardize solutions.
Principal EDC Programmer leading EDC programming, analytics, and vendor - data solutions for ICON’s global clinical research organization. Mentoring programmers and driving automation across clinical trials.
Principal Statistical Programmer embedded with a pharmaceutical client, developing SAS/R clinical - trial outputs. Supporting regulatory submissions, CDISC standards, and CRO programming oversight.