QA Audio Rater auditing production audio ratings and correcting calibration issues. Supporting Welo Data’s AI services program remotely from Canada for 10 hours weekly.
Responsibilities
Audit 30% of production output generated during the initial phase (Pilot)
Identify and flag miscalibration or inconsistent scoring across raters
Provide clear, actionable feedback and corrections to raters
Complete onboarding and training ahead of the production pool's rollout
Ensure rating quality and consistency during the initial phase of the audio rating program
Audit rater output, catch calibration issues early, and help keep the rating pool aligned and accurate
Requirements
Strong attention to detail and consistency in judgment
Ability to spot patterns of miscalibration and articulate clear feedback
Comfortable working independently during a pilot/early-stage phase
Prior experience in QA, auditing, or rating work is a plus
Quality Assurance Analyst testing Ava Industries’ cloud - based EMR software. Validating clinic workflows, releases, defects, and user experience for Canadian healthcare providers.
Ingénieur qualité logicielle chez EDC, société canadienne aidant les entreprises à réussir à l’étranger. Automatisation des tests, validation assistée par l’IA et intégration de bout en bout.
QA Analyst testing Creator.co’s influencer marketing platform across web and mobile. Applying AI tools to manual testing, bug reporting, and emerging test automation.
FCRM Quality Assurance Analyst reviewing high - risk customers and EDD compliance for TD, a major North American bank. Supporting AML controls, regulatory reporting and financial crime risk programs.
Senior QA Analyst testing Nelson’s digital K - 12 learning products across frontend, backend, API, and database layers. Building automation and investigating accessibility, performance, and infrastructure quality issues.
IT quality assurance specialist supporting Desjardins, a financial - services cooperative. Developing test strategies, executing manual and automated tests, and improving Agile quality practices.
QA Engineer advancing AI - first testing for Quest Software’s enterprise identity recovery products. Automating quality validation across Azure SaaS and Windows enterprise applications.
Senior QA Engineer II leading manual and automated testing for Prenuvo’s proactive healthcare scanning platform. Improving API, mobile, accessibility, CI/CD, and release quality.
Test Manager leading QA strategy, teams, and certification for Escape Velocity’s AAA game development project. Managing testing, risk, releases, and quality across global remote teams.