Physician Reviewer evaluating EHR vignettes, reasoning, diagnoses, and treatments for Mindrift’s medical AI projects. Flexible task-based contract for US-licensed physicians.
Responsibilities
Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor “trap” answers across diagnosis and treatment tasks
Score clinical reasoning quality, including vignette accuracy and completeness, answer disclosure, answer correctness and gradeability, and trap quality
Check whether reasoning chains reach answers from vignette facts alone
Correct reasoning traces and write short rationales
Participate in a process involving three independent blind reads followed by physician adjudication
Complete project qualification(s) and submit tasks through the platform
Complete tasks according to project acceptance criteria
Improve medical AI tools through clinical case evaluation
Requirements
Medical degree (MD or DO)
Active, unrestricted US medical license, verified at onboarding and re-checked monthly
Board certification or completed residency training
Direct patient care experience; attending-level experience preferred
Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine
Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines
Strong written English (C1+)
Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus
Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare titles
Benefits
Earnings per approved task: a fixed rate for each task, set in advance
Fully self-scheduled: no minimum hours and no set schedule; contributors choose which tasks to take and when
Remote work
No patient contact and no malpractice exposure
$50 one-time onboarding reward, paid once the first task on the project is approved
Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines
Flexible, time-limited project participation
No time tracking or hour logging
No tiers or speed adjustments to the rate
Higher per-task rate for QA and adjudication tasks
P&C insurance professionals converting underwriting, reinsurance, pricing, reserving, and claims expertise into AI training datasets. Fully remote, flexible contractor project.
Practicing economists creating and evaluating training data for advanced AI systems. Focusing on forecasting, antitrust, trade policy, public policy, and economic impact analysis.
Head of AI building Momentum’s self - improving ecommerce platform. Designing AI systems that identify retail opportunities, recommend improvements, and learn from experiments.
Freelance KI - Management lecturer delivering practice - oriented digital courses for Learning Digital GmbH, a certified continuing - education provider. Supporting and individually mentoring students worldwide.
AI technical expert building enterprise AI agents and learning tools for Equinix’s Digital University. Teaching engineers practical AI use, prompt engineering, and responsible AI practices.
US - licensed physicians evaluate clinical EHR cases and reasoning to test Mindrift’s medical AI systems. Flexible, task - based independent contractor project with no patient contact.
AI Agent Evaluation Engineer defining quality standards and evaluation systems for Cresta’s conversational AI receptionist. Analyzing multilingual calls, calibrating LLM judges, and maintaining regression suites.
Economists translating applied economic analysis into AI training tasks for Terac. Evaluating model outputs and creating prompts on forecasting, antitrust, trade, and policy.
AI Tutor refining Grok’s Maltese voice and language capabilities for SpaceXSI. Annotating multilingual audio and localizing English content into natural, culturally accurate Maltese.
Temporary Irish AI Tutor refining Grok’s Irish voice and language capabilities for SpaceXSI. Annotating audio, localizing text, and improving speech datasets for AI products.