AI Safety Red Teamer stress - testing Mercor’s frontier AI models. Identifying vulnerabilities, jailbreaks, hallucinations, and policy failures through adversarial evaluation.
About the role
- Clinicians needed to evaluate AI models and provide feedback on responses for Prolific's human data platform. Join and get paid for reliable evaluation of AI tasks.
Responsibilities
- Reviewing AI-generated responses to clinical scenarios and rating them for accuracy, clinical appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Requirements
- Verified status as a clinician (e.g., current license/registration in good standing; board certification or equivalent where applicable)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
AVP leading AI transformation, including fraud detection, for Manulife, a global financial services provider. Driving secure, governed Classical, Generative, and Agentic AI solutions across Corporate Functions.
Generative AI Analyst validating Canadian French translations for Welo Data, a global AI data company. Reviewing and annotating multilingual AI - generated content for training and quality improvement.
Senior engineers evaluating AI coding - agent interactions for G2i. Assessing reasoning, explanations, outputs, and engineering judgment across Codex, Claude Code, and Cursor.
Manager integrating workforce management with AI transformation at TD, a major North American bank. Connecting financial, operational, and workforce planning across customer operations.
Search +AI Discovery Manager leading enterprise SEO, AI - search strategy, and client advisory for dentsu, a global integrated marketing agency. Mentoring North American SEO teams and shaping innovative search methodologies.
Director leading Homebase’s data engineering, data science, and applied AI teams. Building trusted data infrastructure and AI - powered tools for 150,000+ small businesses.
AI Solution Specialist helping greenhouse growers adopt Source.ag’s AI - powered crop technology. Building dashboards, automations, and custom tools while translating greenhouse insights into product improvements.
Senior Advisor designing and integrating generative AI solutions for Desjardins, North America’s largest cooperative financial group. Driving adoption through training, change management and scalable AI practices.
Strategy and management consultant creating complex business scenarios and evaluating AI outputs. Supporting Gramian Consultancy’s IT talent solutions through rigorous consulting analysis and executive deliverables.