Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Licensed Physician (MD/DO) - Freelance AI Trainer

$100 per hour
Part-time

Mindrift (Toloka)

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
  • Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for  

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
  • Board certification or completed residency training, with recent direct patient care (attending-level preferred);
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations 

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted. 

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $100/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Licensed Physician (MD/DO) - Freelance AI Trainer in Remote vacancy
  • $100 per hour

     ...proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing,...  ...involves We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation... 
    Freelance
    Licensed
    Hourly pay
    Permanent employment
    Part time
    10 hours per week

    Mindrift (Toloka)

    Remote
    2 days ago
  •  ...Evaluate AI clinical reasoning with real medical scenarios and expertise. About Us Based in San Francisco, California, Turing...  ...to improve model performance Candidate Requirements: Licensed physician in active clinical practice (any specialty) Experience with... 
    Licensed
    Part time
    Remote work
    Flexible hours

    Turing

    Remote
    24 days ago
  •  ...on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Biology Specialist – Freelance AI Trainer Project based remotely in Canada. Help shape the future of AI by applying your biology expertise to the training and evaluation... 
    Freelance
    Full time
    Remote work

    Jobgether

    Remote
    1 day ago
  •  ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Photoshop Specialist – Freelance AI Trainer Project based remotely in Canada. Help shape the future of AI by applying your Adobe Photoshop expertise to the training and evaluation... 
    Freelance
    Full time
    Remote work

    Jobgether

    Remote
    1 day ago
  • $39 per hour

     ...About the role  Help train and evaluate AI agents on expert-level fluid simulation tasks. You'll take CAD geometry, set up and run...  ...different earning levels based on their requirements. Why this freelance opportunity might be a great fit for you?  Work fully remote on... 
    Freelance
    Hourly pay
    Part time
    Remote work
    10 hours per week

    Mindrift (Toloka)

    Remote
    9 hours ago
  •  ...Job Application for Voice Actor - Freelance AI Trainer Project at Meridial Back to jobs Voice Actor - Freelance AI Trainer Project Canada Are you an experienced voice actor eager to shape the future of AI? Large-scale language models and speech technologies are... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    7 days ago
  •  ...Job Application for Registered Nurse - Freelance AI Trainer Project at Meridial Back to jobs Registered Nurse - Freelance AI Trainer Project...  ...prompt engineering and evaluation metrics. An active RN license and associate’s, bachelor’s, or master’s degree in nursing or... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  • $35 per hour

     ...some take longer. Within 2 weeks ~25% Within 6 weeks ~60% Within 3 months ~80% Why this role This Freelance English Writer – AI Trainer role runs entirely remote at $35/hr, so your location stops being a factor in whether you can do Writing work for an... 
    Freelance
    Hourly pay
    Contract work
    Remote work

    Ethos

    Remote
    17 days ago
  •  ...Job Application for Investment Specialist – Freelance AI Trainer Project at Meridial Back to jobs Investment Specialist – Freelance AI Trainer Project World Wide - Remote Are you knowledgeable about investments and eager to shape the future of AI? Large-scale language... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work
    Worldwide

    Invisible Technologies

    Remote
    24 days ago
  • $11 - $30.65 per hour

    Responsibilities Create and execute role-play–based evaluation scenarios that simulate realistic customer service interactions across multiple domains, including: Flight bookings and travel support Financial services Telecommunications and technical support...
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  •  ...of a partner company, who manages all applications and next steps. Our partner is looking for an Umbundu Language Specialist – Freelance AI Trainer Project based remotely in Canada. Help shape the future of artificial intelligence by bringing your Umbundu language expertise... 
    Freelance
    Hourly pay
    Full time
    Contract work
    For contractors
    Remote work

    Jobgether

    Remote
    1 day ago
  •  ...Job Application for Religion Specialist – Freelance AI Trainer Project at Meridial Back to jobs Religion Specialist – Freelance AI Trainer Project World Wide - Remote Are you knowledgeable about religion or religious studies and eager to shape the future of AI?... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  •  ...of a partner company, who manages all applications and next steps. Our partner is looking for an Occitan Language Specialist – Freelance AI Trainer Project based in Canada. Put your Occitan language expertise to work shaping the next generation of artificial intelligence. In... 
    Freelance
    Full time
    Remote work

    Jobgether

    Remote
    4 days ago
  •  ...behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Web Development Specialist – Freelance AI Trainer Project based in Canada. As a Web Development Specialist – AI Trainer, you will use your front-end development expertise to... 
    Freelance
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    4 days ago
  •  ...Job Application for Tutoring Specialist - Freelance AI Trainer Project at Meridial Back to jobs Tutoring Specialist - Freelance AI Trainer Project World Wide - Remote Are you an experienced instructional professional with hands-on knowledge of pedagogy, complex... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  •  ...partner company, who manages all applications and next steps. Our partner is looking for a Visual & Digital Arts Specialist – Freelance AI Trainer Project based in Canada. As a Visual & Digital Arts Specialist – AI Trainer, you will use your creative expertise to improve the... 
    Freelance
    Full time
    Remote work

    Jobgether

    Remote
    4 days ago
  •  ...partner company, who manages all applications and next steps. Our partner is looking for a German Audio Evaluations Specialist – Freelance AI Trainer Project based remotely in Canada. Contribute to the development of advanced AI systems by evaluating their ability to... 
    Freelance
    Hourly pay
    Full time
    For contractors
    Remote work
    Flexible hours

    Jobgether

    Remote
    1 day ago
  • $60 per hour

     ...Job Application for Kubernetes AI Task Auditor - Freelance AI Trainer Project at Meridial Back to jobs Kubernetes AI Task Auditor - Freelance AI Trainer Project World Wide - Remote Project Overview We are sorcing experienced technical specialists in Kubernetes... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  • $10 - $65 per hour

     ...partner company, who manages all applications and next steps. Our partner is looking for a Language Alignment & Resource Partner – Freelance AI Trainer Project based remotely in Canada. Help improve the quality, naturalness, and cultural accuracy of AI-generated content by... 
    Freelance
    Hourly pay
    Full time
    For contractors
    Remote work

    Jobgether

    Remote
    1 day ago
  • $60 per hour

     ...on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a GPU Kernels AI Task Auditor – Freelance AI Trainer Project based remotely in Canada. Join a specialized AI training project focused on improving the technical accuracy and... 
    Freelance
    Hourly pay
    Full time
    Contract work
    For contractors
    Remote work

    Jobgether

    Remote
    1 day ago
  •  ...Job Application for Georgian Language Specialist - Freelance AI Trainer Project at Meridial Back to jobs Georgian Language Specialist - Freelance AI Trainer Project World Wide - Remote Are you a Georgian language expert eager to shape the future of AI? Large-scale... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  • $75 per hour

     ...Why this role Few outlets pay Software Engineering specialists what the leading AI labs pay for direct judgment. At $75/hr, this Mechanical Engineer & Python Expert – Freelance AI Trainer role prices in the expertise itself, separate from hours billed or clients managed... 
    Freelance
    Hourly pay
    Contract work
    Manual labor
    Remote work

    Ethos

    Remote
    17 days ago
  • $240 per day

     ...Fully remote, project-based work checking how well frontier AI does real clinical work, from assessment and planning to...  ...least 10 hours a week, as an independent contractor. For licensed clinicians (RN, NP, PA, MD or DO, PharmD, or allied health) in the US, UK, Ireland, Canada... 
    Licensed
    Full time
    Contract work
    Part time
    For contractors
    Remote work
    10 hours per week

    Sovrano AI

    Remote
    29 days ago
  •  ...Job Application for Arabic (Levantine) Language Expert - Freelance AI Trainer Project at Meridial Back to jobs Arabic (Levantine) Language Expert - Freelance AI Trainer Project World Wide - Remote Are you an Arabic (Levantine) language expert eager to shape the... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  • $22 per hour

     ...Job Application for 3D Modeling & Python Specialist - Freelance AI Trainer Project at Meridial Back to jobs 3D Modeling & Python Specialist - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing independent 3D Modeling and Python Specialists... 
    Freelance
    Hourly pay
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  •  ...Job Application for Insurance Specialist (Fluent in French) - Freelance AI Trainer Project at Meridial Back to jobs Insurance Specialist (Fluent in French) - Freelance AI Trainer Project Canada Are you a master of insurance fluent in French eager to shape the future... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  • $15 - $30 per hour

     ...Job Application for Audio Editor for Dialogue / Audio Post-Production - Freelance AI Trainer Project at Meridial Back to jobs Audio Editor for Dialogue / Audio Post-Production - Freelance AI Trainer Project World Wide - Remote Audio Editor for Dialogue / Audio Post... 
    Freelance
    Hourly pay
    Contract work
    Part time
    For contractors
    Internship
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  •  ...Job Application for Language Alignment & Resource Partner (Belarusian) - Freelance AI Trainer Project at Meridial Back to jobs Language Alignment & Resource Partner (Belarusian) - Freelance AI Trainer Project World Wide - Remote Project Overview We are sourcing... 
    Freelance
    Hourly pay
    Part time
    For contractors
    Remote work

    Invisible Technologies

    Remote
    24 days ago
  • $40 - $125 per hour

     ...confident answers that no clinician would sign off on. As a Physician you'll evaluate AI clinical reasoning against current standards of care and...  ...backgrounds: Physician, Clinician. What we look for MD, DO, or equivalent, with clinical experience. Comfort explaining... 
    Weekly pay
    Full time
    Contract work
    For contractors
    Remote work
    Flexible hours

    DataAnnotation

    Remote
    19 days ago
  •  ...Assurance About micro1 micro1 is the leading AI data lab for training frontier models and...  ...frontier AI. Role Title: Hospitalist Physician Role Type: Contractor Location:...  ...findings. Preferred Qualifications MD or DO, board certified in Internal Medicine, Pediatrics... 
    Part time
    For contractors
    Remote work

    micro1

    Remote
    18 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Licensed Physician (MD/DO) - Freelance AI Trainer. Be the first to apply!