Healthcare Subject Matter Expert – AI Model Evaluation

Posted yesterday

Apply Now

Resume Score

Check how well your resume matches this job before you apply.

Sign in to check score

About the role

  • Healthcare SMEs evaluating AI-generated medical content for Volga Partners. Applying clinical judgment to assess accuracy, reasoning, safety, and evidence-based recommendations.

Responsibilities

  • Evaluate AI-generated medical content for clinical accuracy, completeness, relevance, and consistency with accepted medical standards
  • Analyze whether AI-generated assessments, differential diagnoses, and treatment recommendations are supported by appropriate clinical evidence
  • Identify inaccurate medical information, unsupported conclusions, missing clinical considerations, and potential patient safety concerns
  • Validate medical information using authoritative medical literature, established clinical guidelines, and evidence-based healthcare practices
  • Provide expert feedback, explain findings, identify improvement opportunities, and recommend clinically appropriate corrections
  • Apply evaluation guidelines, scoring criteria, and project-specific quality standards to support AI quality improvement
  • Complete independent evaluations using designated online platforms accurately and within established project timelines

Requirements

  • Minimum of three years of relevant professional clinical experience in an applicable specialty
  • Recognized medical degree, advanced-practice qualification, or equivalent professional credential appropriate to the specialty and country
  • Demonstrated experience applying clinical judgment, diagnostic reasoning, or evidence-based medical practices
  • Strong understanding of medical terminology, clinical guidelines, and healthcare standards relevant to the candidate's specialization
  • Ability to critically evaluate complex medical information and distinguish accurate clinical reasoning from unsupported conclusions
  • Strong analytical, research, and problem-solving abilities
  • Excellent written English communication skills, including the ability to clearly explain clinical findings and professional assessments
  • Comfort using digital platforms, web-based applications, and online research tools
  • Ability to work independently, follow detailed instructions, and meet established quality standards
  • Must be comfortable with and understand this is a task-based role
  • Preferred: current or previous professional licensure or registration relevant to the candidate's specialty
  • Preferred: experience reviewing medical records, clinical research, medical guidelines, or healthcare quality assessments
  • Preferred: familiarity with U.S. healthcare standards or clinical practices in the United Kingdom, Canada, Australia, or New Zealand
  • Preferred: experience evaluating clinical documentation, medical literature, or complex healthcare cases
  • Preferred: previous exposure to AI model evaluation, medical content review, clinical research, or healthcare technology
  • Experience with AI model evaluation, large language models (LLMs), research, or structured quality assessments is beneficial but not required

Benefits

  • Remote work from an eligible location
  • Project-based assignments with variable schedules and workloads
  • Supplemental-income opportunity
  • Opportunity to contribute to advanced AI model evaluation without direct patient care
  • Experience contributing to advanced AI technology and healthcare AI
  • No AI background required

Job type

Contract

Experience level

Mid levelSenior

Salary

$35 - $140 per hour

Degree requirement

Professional Certificate

Location requirements

RemoteNew Zealand

Report this job

Found something wrong with the page? Please let us know by submitting a report below.