Professional services practitioners auditing AI - generated work products for Mercor, which trains frontier AI models. Reviewing realism, domain accuracy, grading, and practitioner usability.
About the role
- Quality Reviewer auditing personalization features in maps/search experience and ensuring compliance with formatting and guideline requirements. Reviewing rater work for logical alignment and accuracy in outputs.
Responsibilities
- Review rater worksheets for compliance with formatting requirements.
- Verify that responses are logically correct and aligned with the assigned scenarios.
- Assess ratings and rationales for accuracy, consistency, and completeness.
- Confirm that required screenshots, retrievals, and personalization evidence meet project guidelines.
- Provide clear, concise, and actionable feedback; request corrections where needed.
- Flag ambiguous cases, systemic issues, or guideline gaps to the project team.
Requirements
- Must be located in and legally authorized to work in Canada.
- An existing, actively used Gmail account.
- Proven experience in quality audit or QA review (content evaluation, relevance, or similar).
- Familiarity with maps/local search user experiences and personalization concepts.
- Strong proficiency with spreadsheets (Google Sheets or equivalent).
- Excellent attention to detail and consistent application of guidelines.
- Clear written communication and a constructive feedback style.
- Please note:
- • This project requires opt-in, consent-based access to limited elements of your activity history. A consent form will be provided for you to review and sign before participation.
- • A desktop or laptop computer is required to complete the application and onboarding process. Mobile devices are not supported.
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
Professional - services practitioners auditing AI work products for Mercor’s frontier - model training. Evaluating task realism, domain accuracy, grader judgments, and practical usability.
Professional services practitioners auditing AI - generated work products for Mercor, which trains frontier AI models with human expertise. Reviewing realism, accuracy, grading, and practitioner usability.
Disbursements Reviewer verifying settlement statements, lien searches, and reconciliations for RB Global’s global equipment marketplace. Supporting accounting teams on an 18 - month contract.
Disbursement Reviewer reviewing and approving settlement statements at Ritchie Bros. Collaborating with finance staff and supporting accounting departments worldwide.