Clinicians needed to evaluate AI models and provide feedback on responses for Prolific's human data platform. Join and get paid for reliable evaluation of AI tasks.
Responsibilities
Reviewing AI-generated responses to clinical scenarios and rating them for accuracy, clinical appropriateness, safety, and reasoning quality
Comparing multiple model answers and selecting/justifying the best response
Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Requirements
Verified status as a clinician (e.g., current license/registration in good standing; board certification or equivalent where applicable)
Recent clinical experience and comfort evaluating clinical reasoning and decision-making
Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
Strong attention to detail and the ability to focus on complex tasks for up to one hour
A reliable, fast internet connection and access to a computer
Willingness to self-declare earnings (participants are self-employed)
A PayPal account to receive payments from our clients
Director of People Intelligence and AI Innovation at iA Financial Group. Leading advanced analytics and people intelligence strategy to support executive decision - making.
Senior Full - Stack AI Engineer developing AI - driven software at Manulife. Focusing on cloud - native systems and intelligent applications leveraging modern AI capabilities.
Senior People Systems & AI Specialist at Docebo transforming HR with AI and automation. Responsible for enhancing People workflows and experiences across the organization.
Senior Engineering Manager leading Automation and AI Team for General Motors. Driving innovative solutions and managing team capabilities to optimize engineering tools and systems.
Deployment Manager overseeing customer experience operations for AI agents. Managing complex deployments from kick - off to automation performance across multiple stakeholders.
AI Product Builder at Abnormal Security developing internal AI - powered solutions for operational efficiency. Owning AI transformation strategy and collaborating with executive leadership to drive impact.
Data & Trust Manager driving TELUS’ initiatives for responsible data use and ethical AI implementation. Collaborating across teams to ensure adherence to privacy and data governance standards.
AI Trainer providing native - level Estonian language vetting and QA for specialized AI project. Evaluate, annotate, and validate data to ensure high - quality human - like communication.
Language Alignment & Resource Partner providing native Arabic language QA for AI data project. Reviewing outputs for accuracy and cultural appropriateness while developing resources.