AI Quality Assurance Intern at Cresta evaluating AI behavior and quality for customer interactions. Collaborating with AI Delivery team on quality assurance processes and model validation.
Responsibilities
Execute structured test plans for AI Agent implementations
Validate that intents, entities, and workflows trigger correctly
Identify behavioral inconsistencies, misclassifications, or hallucinations
Review and validate AI-generated suggestions, summaries, and classifications
Provide actionable feedback to improve intent models and redaction/PII handling
Run bias, redaction, and transcription accuracy checks
Spot patterns or emerging issues across test sets
Contribute ideas for improving internal QA processes and tools
Requirements
AI/ML, NLP, or chatbots
Product quality and user experience
Linguistics, conversation analysis, or human–AI interaction
Exploring a career in AI evaluation, AI ops, or product QA
No advanced ML experience is required — just strong analytical thinking and curiosity about how intelligent systems behave.
Benefits
Lunch can be expensed (up to $25) while working in the office.
Quality Assurance Inspector verifying manufactured nuclear components against customer, regulatory, and quality standards. Conducting inspections, surveillance, testing, and document control at Westinghouse’s Peterborough facility.
Senior QA Data Analyst creating Looker telemetry dashboards for Warner Bros. Discovery’s Montréal AAA game studio. Verifying game data and delivering actionable insights to QA and development teams.
Quality Assurance Analyst testing software for Computershare’s global customer communications solutions. Validating releases, tracking defects, and supporting a major internal transformation initiative.
Freelance QA testers testing apps and websites for Tester Work in Ontario, Canada. Executing functional, exploratory, and usability tests for customer projects.
Senior QA Analyst validating nesto Cloud's mortgage technology end to end before client UAT. Coordinating test coverage, automation review, bug triage, and client issue resolution.
Senior QA Analyst validating nesto's cloud mortgage platform before client UAT. Designing end - to - end coverage, investigating automation failures, and coordinating bug resolution.
Accessibility Test Analyst validating web applications and digital documents for PLATO, Canada’s Indigenous - owned software testing company. Ensuring WCAG 2.1 and EN 301 549 compliance through manual testing and defect reporting.
Mobile Application Tester manually testing web, iOS, and Android applications for Symbiotic Digital, an IT consulting and recruitment company. Supporting agile Scrum teams through regression testing, bug documentation, test scenarios, and Azure DevOps workflow monitoring.