Manual Mobile QA testing iOS and Android music - learning apps for Gismart’s Radiotech. Validating releases, A/B tests, configurations, and product quality.
About the role
- QA Lead ensuring end-to-end quality assurance for an advanced Agentic AI platform at Workiy. Responsible for defining standards, leading test strategy, and collaborating with various teams.
Responsibilities
- Drive end-to-end quality assurance for an advanced Agentic AI platform
- Define quality standards and develop automated evaluation frameworks
- Lead test strategy and ensure release readiness for AI-powered conversational solutions
- Build evaluation harnesses and create test plans
- Execute regression testing and validate data quality
- Conduct AI safety and prompt injection testing
- Manage defect triage and lead a team of QA and Data Testers
- Collaborate closely with engineering, product, architecture, and data teams to ensure delivery of reliable and high-quality AI solutions
Requirements
- QA Leadership
- Python
- Test Automation
- AI/LLM Testing
- Conversational AI Testing
- RAG (Retrieval-Augmented Generation) Testing
- LLM Evaluation Frameworks
- Golden Dataset & Regression Testing
- Intent & Context Validation
- Multi-Turn Dialogue Testing
- Data Quality Testing
- Prompt Injection & AI Safety Testing
- Release Readiness & Quality Gates
- Defect Management & Test Strategy
- CI/CD Integrated Testing
- Team Leadership & Mentoring
Benefits
- Flexible working hours
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
QA Team Lead overseeing Nestlé Canada’s Toronto food manufacturing laboratory. Leading testing, food safety, audits, traceability, and laboratory staff development.
Bilingual software tester validating French online applications and phone systems for PLATO, a Canadian Indigenous - owned software testing services company. Testing CYARA Contact Centre and AWS Connect systems for finance - sector clients.
Senior Manual QA Engineer testing InvestEngine’s ETF investing platform and pensions integrations. Validating web, backend, API, SQL, and mobile features remotely.
Ingénieur principal en qualité chez EDC, société d’État aidant les entreprises canadiennes à réussir à l’étranger. Modernisation de l’automatisation des tests et intégration de l’IA aux plateformes commerciales numériques.
Senior Quality Engineer/Lead modernizing AI - enabled testing at EDC, Canada’s export - finance corporation. Building Python and Robot Framework automation across enterprise software delivery.
Senior QA engineer preventing software defects across Ford’s electric vehicle platforms. Leading root - cause analysis, audits, quality metrics, and engineering process improvements.
Senior Quality Engineer building automated testing for Just Eat Takeaway.com’s courier logistics systems. Improving reliability, scalability, and release quality across its global online delivery platform.
Senior Quality Engineer building automated testing and quality frameworks for Just Eat Takeaway.com’s global courier logistics platform. Driving CI/CD, API, distributed - systems, and AI - assisted testing quality.
Lead QA Engineer owning AI - driven testing and reliability for Social Discovery Group’s global social discovery platforms. Building automation, CI/CD quality gates, and coverage for critical financial flows.