Clinical AI trainer evaluating frontier models on real healthcare workflows. Creating scenarios and rubrics for Aston Carter’s corporate talent solutions projects.
Responsibilities
Evaluate how frontier AI models handle real clinical work
Assess clinical outputs such as assessment and plans, medication reconciliations with interaction checks, triage decisions, discharge summaries, patient education, and clinical protocols
Assemble realistic professional files and scenarios from personal clinical experience
Build compact tasks or larger multi-day scenarios that test whether AI models complete professional work correctly
Explain why model results are wrong, not only identify that they are incorrect
Interpret feedback and apply it to task development and evaluation
Write grading rubrics and ramp up on unfamiliar work using written instructions
Work independently with cloud files, desktop applications, and everyday file formats
Requirements
Active or recent clinical license: RN, NP, PA, MD or DO, PharmD, or an allied health license with independent clinical judgment
2+ years of hands-on experience in your field preferred; candidates with less experience considered where the practical work is real
Hands-on practitioner currently or recently performing the work at an individual contributor level, not solely in a managerial capacity
Full professional or native-level written and spoken English
Strong written communication and ability to explain complex professional reasoning clearly and concisely
Comfort with ambiguity and attention to detail
Ability to verify document claims against underlying numbers, sources, or facts
Ability to interpret feedback, judge its correctness, and apply it independently
Ability to ramp quickly on unfamiliar work from written material and instructions alone
General familiarity with AI and LLM tools such as Claude or ChatGPT
Baseline technology literacy, including cloud file tools, browser profiles, desktop app installation, file handling, Excel, Google Sheets, and zipping files
Available at least 10 hours per week, with no weekly maximum
Based in the United States, Canada, or the UK
Benefits
Pay: $40-$125/hr USD
Paid via PayPal on a regular cadence
Fully remote work
Flexible scheduling
Multi-day task timers allow work to be spread across days
Access to Claude and ChatGPT provided through the project
Nurse Practitioner delivering remote obesity and weight - management care through Felix, Canada’s digital healthcare provider. Assessing patients asynchronously and supporting virtual treatment across multiple health categories.
Nurse Practitioner providing remote obesity and weight - management care through Felix’s digital healthcare platform. Delivering asynchronous patient support across Canada.
Nurse Practitioner delivering asynchronous menopause and women’s health care through Felix’s digital healthcare platform. Supporting Canadian patients with remote assessments, laboratory testing, and ongoing updates.
Nurse Practitioner delivering preventative primary care for children and parents at Sprout Family Health. Combining in - person clinic work with virtual, lifestyle - focused family care.
Virtual Nurse Practitioner assessing, diagnosing, and treating patients through telephone and video care. Fonemed provides telehealth services across North America with flexible work - from - home scheduling.
Virtual Nurse Practitioner assessing, diagnosing, prescribing, and coordinating follow - up care through telephone and video telehealth. Fonemed provides telehealth services across North America.
Virtual Nurse Practitioner assessing, diagnosing, and treating patients by phone and video. Providing remote telehealth care for Fonemed, a North American healthcare services company.
Medical AI Evaluator reviewing clinical scenarios and AI - generated healthcare content for Volga Partners. Applying medical education and evidence - based reasoning to improve healthcare AI accuracy.
Nurse Practitioner delivering primary, withdrawal - management, and harm - reduction care across Halton communities. ADAPT supports people affected by alcohol, drugs, gambling, and mental - health concerns.
Remote Nurse Practitioner providing primary care and telemedicine assessments for substance use, mental health, and gambling concerns. Supporting clients, families, staff, and interprofessional care teams.