Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Licensed Physician (MD/DO) - Freelance AI Trainer

$70 per hour
Part-time

Mindrift (Toloka)

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for  

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations 

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted. 

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Licensed Physician (MD/DO) - Freelance AI Trainer in Remote vacancy
  •  ...Evaluate AI clinical reasoning with real medical scenarios and expertise. About Us Based in San Francisco, California, Turing...  ...to improve model performance Candidate Requirements: Licensed physician in active clinical practice (any specialty) Experience with... 
    Licensed
    Part time
    Remote work
    Flexible hours

    Turing

    Remote
    16 days ago
  •  ...Job Application for Registered Nurse - Freelance AI Trainer Project at Meridial Back to jobs Registered Nurse - Freelance AI Trainer Project...  ...prompt engineering and evaluation metrics. An active RN license and associate’s, bachelor’s, or master’s degree in nursing or... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  • $39 per hour

     ...About the role  Help train and evaluate AI agents on expert-level fluid simulation tasks. You'll take CAD geometry, set up and run...  ...different earning levels based on their requirements. Why this freelance opportunity might be a great fit for you?  Work fully remote on... 
    Freelance
    Hourly pay
    Remote work
    10 hours per week

    Mindrift (Toloka)

    Remote
    6 days ago
  • $35 per hour

     ...some take longer. Within 2 weeks ~25% Within 6 weeks ~60% Within 3 months ~80% Why this role This Freelance English Writer – AI Trainer role runs entirely remote at $35/hr, so your location stops being a factor in whether you can do Writing work for an... 
    Freelance
    Hourly pay
    Contract work
    Remote work

    Ethos

    Remote
    9 days ago
  •  ...Job Application for Religion Specialist – Freelance AI Trainer Project at Meridial Back to jobs Religion Specialist – Freelance AI Trainer Project World Wide - Remote Are you knowledgeable about religion or religious studies and eager to shape the future of AI?... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Medicine Specialist (Fluent in Japanese) - Freelance AI Trainer Project at Meridial Back to jobs Medicine Specialist (...  ...prompt engineering and evaluation metrics. A medical degree (MD, DO) or a master’s/PhD in a health sciences field is ideal;... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Investment Specialist – Freelance AI Trainer Project at Meridial Back to jobs Investment Specialist – Freelance AI Trainer Project World Wide - Remote Are you knowledgeable about investments and eager to shape the future of AI? Large-scale language... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    Worldwide

    Invisible Technologies

    Remote
    16 days ago
  • $11 - $30.65 per hour

    Responsibilities Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including: Flight bookings and travel support Financial services Telecommunications and technical support...
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Tutoring Specialist - Freelance AI Trainer Project at Meridial Back to jobs Tutoring Specialist - Freelance AI Trainer Project World Wide - Remote Are you an experienced instructional professional with hands-on knowledge of pedagogy, complex... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a C# Coding Specialist - Freelance AI Trainer Project based in Canada. This freelance opportunity is designed for experienced C# developers who want to apply their software... 
    Freelance
    Full time
    Remote work
    Worldwide
    Flexible hours

    Jobgether

    Remote
    2 days ago
  •  ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Fulah Language Specialist - Freelance AI Trainer Project based in Canada. Help shape the next generation of artificial intelligence by applying your Fulah language expertise to... 
    Freelance
    Full time
    Remote work
    Worldwide

    Jobgether

    Remote
    2 days ago
  • $60 per hour

     ...Job Application for Kubernetes AI Task Auditor - Freelance AI Trainer Project at Meridial Back to jobs Kubernetes AI Task Auditor - Freelance AI Trainer Project World Wide - Remote Project Overview We are sorcing experienced technical specialists in Kubernetes... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Georgian Language Specialist - Freelance AI Trainer Project at Meridial Back to jobs Georgian Language Specialist - Freelance AI Trainer Project World Wide - Remote Are you a Georgian language expert eager to shape the future of AI? Large-scale... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  • $75 per hour

     ...Why this role Few outlets pay Software Engineering specialists what the leading AI labs pay for direct judgment. At $75/hr, this Mechanical Engineer & Python Expert – Freelance AI Trainer role prices in the expertise itself, separate from hours billed or clients managed... 
    Freelance
    Hourly pay
    Contract work
    Manual labor
    Remote work

    Ethos

    Remote
    9 days ago
  •  ...a partner company, who manages all applications and next steps. Our partner is looking for an Arabic (Gulf) Language Expert – Freelance AI Trainer Project based in Canada. We are seeking an Arabic (Gulf) Language Expert to help shape the next generation of artificial intelligence... 
    Freelance
    Full time
    Remote work

    Jobgether

    Remote
    4 days ago
  • $240 per day

     ...Fully remote, project-based work checking how well frontier AI does real clinical work, from assessment and planning to...  ...least 10 hours a week, as an independent contractor. For licensed clinicians (RN, NP, PA, MD or DO, PharmD, or allied health) in the US, UK, Ireland, Canada... 
    Licensed
    Full time
    Contract work
    Part time
    For contractors
    Remote work
    10 hours per week

    Sovrano AI

    Remote
    21 days ago
  •  ...partner company, who manages all applications and next steps. Our partner is looking for a Portuguese Audio Evaluations Specialist – Freelance AI Trainer Project based in Canada. Contribute to the development of advanced conversational AI by evaluating audio-based models in... 
    Freelance
    Hourly pay
    Full time
    For contractors
    Remote work
    Flexible hours

    Jobgether

    Remote
    6 days ago
  • $22 per hour

     ...Job Application for 3D Modeling & Python Specialist - Freelance AI Trainer Project at Meridial Back to jobs 3D Modeling & Python Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent 3D Modeling and Python Specialists... 
    Freelance
    Hourly pay
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Arabic (Iraqi) Language Expert - Freelance AI Trainer Project at Meridial Back to jobs Arabic (Iraqi) Language Expert - Freelance AI Trainer Project World Wide - Remote Are you an Arabic (Iraqi) language expert eager to shape the future of AI... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Insurance Specialist (Fluent in French) - Freelance AI Trainer Project at Meridial Back to jobs Insurance Specialist (Fluent in French) - Freelance AI Trainer Project Canada Are you a master of insurance fluent in French eager to shape the future... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  •  ...Job Application for Language Alignment & Resource Partner (Czech) - Freelance AI Trainer Project at Meridial Back to jobs Language Alignment & Resource Partner (Czech) - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent... 
    Freelance
    Hourly pay
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  • $15 - $30 per hour

     ...Job Application for Audio Editor for Dialogue / Audio Post-Production - Freelance AI Trainer Project at Meridial Back to jobs Audio Editor for Dialogue / Audio Post-Production - Freelance AI Trainer Project World Wide - Remote Audio Editor for Dialogue / Audio Post... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Internship
    Remote work

    Invisible Technologies

    Remote
    16 days ago
  • $40 - $125 per hour

     ...confident answers that no clinician would sign off on. As a Physician you'll evaluate AI clinical reasoning against current standards of care and...  ...backgrounds: Physician, Clinician. What we look for MD, DO, or equivalent, with clinical experience. Comfort explaining... 
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Remote
    11 days ago
  •  ...for improving the quality, safety, and intelligence of cutting-edge AI models. Key Responsibilities Create High-Quality Training...  ...grammar, and communication skills. Proven experience as an AI Trainer, Data Annotator, or in a similar role involving interaction with large... 
    Hourly pay
    Remote work

    RemoExperts

    Remote
    16 days ago
  •  ...Assurance About micro1 micro1 is the leading AI data lab for training frontier models and...  ...frontier AI. Role Title: Hospitalist Physician Role Type: Contractor Location:...  ...findings. Preferred Qualifications MD or DO, board certified in Internal Medicine, Pediatrics... 
    Part time
    For contractors
    Remote work

    micro1

    Remote
    10 days ago
  •  ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Trainers Network – Arabic based in Canada. Join a global network of language professionals and culturally aware contributors helping shape the... 
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    5 days ago
  •  ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Trainers Network - Basque contributor based in Canada. Join a global network of language professionals and culturally aware contributors helping... 
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    2 days ago
  •  ...This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Trainers Network – Bosnian based in Canada. Join a global contributor network helping shape the future of artificial intelligence through... 
    Full time
    Immediate start
    Remote work
    Flexible hours

    Jobgether

    Remote
    4 days ago
  •  ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Trainers Network - Afrikaans contributor based in Canada. Join a global network of language professionals and culturally aware contributors... 
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    2 days ago
  • $110 per hour

    Compensation up to $110 USD / audio hour transcribed Additional performance-based incentives may be available Technical Requirements A reliable computer and stable internet connection Headphones or earphones recommended for accurate audio review A quiet environment...
    Hourly pay
    Contract work

    Babel Audio

    Remote
    16 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Licensed Physician (MD/DO) - Freelance AI Trainer. Be the first to apply!