Audiologists training and evaluating AI models at Prolific. Join as a Domain Expert participant for paid tasks.
About the role
- Clinicians needed to evaluate AI models and provide feedback on responses for Prolific's human data platform. Join and get paid for reliable evaluation of AI tasks.
Responsibilities
- Reviewing AI-generated responses to clinical scenarios and rating them for accuracy, clinical appropriateness, safety, and reasoning quality
- Comparing multiple model answers and selecting/justifying the best response
- Writing improved exemplars, rationales, or structured feedback to help models learn where they fall short
Requirements
- Verified status as a clinician (e.g., current license/registration in good standing; board certification or equivalent where applicable)
- Recent clinical experience and comfort evaluating clinical reasoning and decision-making
- Willingness to complete a short skills/eligibility screener to join our Domain Expert pool
- Strong attention to detail and the ability to focus on complex tasks for up to one hour
- A reliable, fast internet connection and access to a computer
- Willingness to self-declare earnings (participants are self-employed)
- A PayPal account to receive payments from our clients
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Location requirements
Report this job
Found something wrong with the page? Please let us know by submitting a report below.
AIOps Engineer at Praetorian developing an AI - native infrastructure for their SaaS offerings. Leading automation and security within an elite offensive security company.
Global SVP, Data & AI at Endava advising banking clients on strategic implications of data and AI. Engaging with executives and translating vision into actionable initiatives.
AI Process Engineer enhancing operational efficiency and workflow optimization using AI solutions at Tag Software Group. Focusing on automation and technology - driven business problem - solving.
Freelance online annotator for various AI projects aimed at improving artificial intelligence. Involves reviewing, labeling, and classifying data as per project guidelines.
AI Trainer evaluating AI models for Prolific, collaborating as a clinician for improving AI model responses. Review, compare, and provide feedback on clinical scenarios.
Australian English speakers needed for AI LLM evaluation project improving language models. Engage with AI chatbots and rate interactions using your own devices remotely.
Senior Data Privacy & AI Analyst supporting the development and implementation of privacy policies for Docker. Collaborating with cross - functional teams to ensure compliance with data protection regulations.
AI Strategy Practice Leader working on data valorization and AI strategy for Desjardins Group. Collaborating with various sectors to align AI opportunities with business objectives.
Director of HR Advisory Services focusing on HR Tech and AI at McLean & Company. Offering expertise in facilitating client workshops and HR technology guidance.