Physician (MD/DO) - Medical AI Evaluation
Mindrift
About the company
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.
Project Highlights
- Earnings per approved task: a fixed rate for each task, set in advance
- Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
- Remote: open to US-licensed physicians based in eligible US states
- No patient contact, no malpractice exposure: you review written clinical cases
- All contributors are license-verified physicians
- $50 one-time onboarding reward, paid once your first task on the project is approved
What this project involves
We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:
- Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
- Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
- Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.
Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.
What we look for
This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:
- Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
- Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
- Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
- Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
- Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
- Strong written English (C1+).
This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.
How it works
Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks
Flexibility
You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project’s acceptance criteria.
Earnings
Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.
- $50 one-time onboarding reward, paid once your first task on the project is approved.
- Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
$115.5k - $132.75k per year
...About Dialpad Dialpad is the AI platform for customer experience, built to resolve customer problems in real time across voice and... ...Optimistic, Persistent, and Empathetic . Your role As an AI Evaluation Engineer, you'll be an integral part of our AI Evaluation team, owning...SuggestedInternshipWork at office- ...employee retention. We support the pharmaceutical, biotech, and medical device industries with our proven scientific approach to complex... ...clinical and safety teams. Job Requirements ~ Medical degree (MD, DO, or international equivalent), ~ Experience with protocol amendments...MedicalRemote jobFull timeLocal area
- ...Job Summary Job Title: Family Physician Work Site: Various Locations Status: Permanent and Locum Start Date: Flexible... ...Long Term Care, Palliative Care, Substance Use Services, Medical Assistance in Dying, as well as Urgent and Primary Care Centres....MedicalLong term contractPermanent employmentFull timeContract workTemporary workPart timeLocumImmediate startFlexible hours
- ...Job Summary Job Title: Hospitalist Physician Work Site: Vancouver General Hospital Status: Part Time, Locum Start... ...group of dedicated physicians providing care to an average of 135 medically complex elderly patients daily. We are looking for Full Time...MedicalFull timePart timeLocumImmediate start
$116.68k - $166.68k per year
...Medical Science Liaison (Cardiometabolic) Medical & Regulatory | Novo Canada Location: Greater Vancouver Area, British Columbia Your... ...will bring: ~ An advanced scientific or healthcare degree (PhD, MD or PharmD), or a Master’s degree in a science-related field combined...MedicalLong term contractTemporary workNight shift- ...Job Summary Job Title: Physician, UPCC Work Site: Vancouver Community Status: Permanent - Part-Time or Full-Time Start... ...Current College of Physicians of BC (CPSBC) – Full Canadian Medical Protective Association (CMPA) - Mandatory Closing Statement...MedicalPermanent employmentFull timeContract workPart timeImmediate startWeekend workAfternoon shift
- ...Job Summary Job Title: EDiCare Physician, Geriatrics (VGH) Work Site: Vancouver General Hospital Status: Locum - Full Time... ...home when it can be safely facilitated with community and medical supports. The EDiCare Physician role presents a unique opportunity...MedicalFull timeLocumImmediate start
- ...Job Summary Job Title: Palliative Care Physician - Multiple Positions Available Work Site: Vancouver Community Palliative Care... ...care setting. Qualifications Education & Experience A Medical Degree, current license or eligible for licensure with the College...MedicalPermanent employmentContract workImmediate startFlexible hours
- ...Description Vancouver Breast Centre (X-Ray 505) - Medical Imaging Technologist Location: 750 W Broadway #505, Vancouver, BC V5Z 1H2... ...are essential for patient diagnosis and treatment. What you'll do: The Medical Imaging Technologist will be responsible for performing...MedicalCasual workInternship
- ...Job Summary Job Title: Vancouver UBC UPCC Physician Work Site: 6165 Agronomy Road, Vancouver Status: Permanent Part-time... ...Canadian College of Family Practitioners (CCFP) - Eligible Canadian Medical Protective Association (CMPA) - Mandatory In addition:...MedicalPermanent employmentFull timeContract workPart timeImmediate startWeekend workAfternoon shift
- ...Job Summary Job Title: Physician (Consultant) in Allergy and Immunology Work Site: Vancouver General Hospital Status: Full... ...Medicine providing clinical care for patients atopic disease, medication allergies and immunodeficiencies. We work closely with other...MedicalFull timeImmediate start
- ..., ensuring high-quality deliverables meet deadlines. ~ Generative AI Integration: Utilize Gen AI platforms and tools where applicable... ...channels. Here’s What You’ll Need: Minimum of 3 years of medical copy development expertise, with success in crafting persuasive content...MedicalHourly payFull timeManual laborWork at officeLocal area
$350k per year
...exceptional opportunity to join our client’s brand-new, modern medical clinic in Vancouver, BC – extremely sought after!!... ...equipped exam rooms, shared lunchroom, and private physician office space. Smart Tech Integration – AI-powered Tali AI’s Ambient Scribe to streamline...MedicalLong term contractFull timeWork at officeLocal areaRelocationVisa sponsorshipRelocation packageFlexible hours- ...Job Summary Job Title: Physician, Inherited Metabolic Diseases Work Site: Vancouver General Hospital Status: Full-Time... ...Current College of Physicians of BC (CPSBC) - Provisional Canadian Medical Protective Association (CMPA) - Mandatory Closing Statement...MedicalFull timeImmediate start
$221.93k - $277.42k per year
...Staff - Non Union Job Category M&P - AAPS Job Profile AAPS Salaried - Physician Job Title Physician, Student Health Services Department Medical | Student Health and Wellbeing | VP Students Compensation Range See details below.The Compensation...MedicalWork at officeWeekend workAfternoon shift- ...business operations. We work with multilingual professionals to support AI development, data quality, and language-related projects. ##... ...multilingual language specialists to join our Audio Caption Evaluation Project. Selected contributors will evaluate audio captions for accuracy...For contractorsRemote workMonday to friday
$118k - $150k per year
...unknown. We are looking for a skilled, detail-oriented Senior Medical Writer with extensive experience contributing to nonclinical, clinical... ...and medical writing practices Leading the adoption of AI-assisted writing tools to accelerate document preparation Building...MedicalFull timeInternship- ...Job Summary Job Title: Medical Coordinator, Primary Care Work Site: Various Status: Part-Time Start Date: As Soon... ...Coastal Health (VCH) Primary Care is seeking qualified Family Physicians and/or Nurse Practitioners to work as Medical Coordinator(s), providing...MedicalContract workPart timeImmediate start
- ...Job Summary Job Title: Family Physician Work Site: Various Locations Status: Permanent and Locum Start Date: Flexible... ...Care Teams Community Palliative Care (including hospice) Medical Assistance in Dying (MAiD) If you are interested in splitting...MedicalLong term contractPermanent employmentFull timeContract workTemporary workPart timeLocumImmediate startFlexible hours
- ...Ipsen seeks a Medical Science Liaison for Western Canada to build peer relationships with medical experts in neuroscience, facilitate scientific... ...conventions Requirements Advanced degree in life sciences (MD, PhD, PharmD preferred); MSc with MSL experience considered Two...Medical
$146k - $161k per year
...currently accepting applications for full time Canadian or US Certified Physician Assistants (current and in good standing) for future travel... ...may be considered based on an assessment by the Corporate Medical Director provided they complete the course within six-months of...MedicalLong term contractFull timeRemote workRelocation packageShift work$29.72 per hour
...Salary Details The salary range for this position is CAD $29.72/Hr. - CAD $29.72/Hr. Job Summary Come work as a Medical Transcriptionist with Vancouver Coastal Health (VCH) on the Medical Imaging Transcription team at Vancouver General Hospital in Vancouver, B.C....MedicalImmediate start- ...delighted to be representing our client in the recruitment of Family Physicians for a progressive and rapidly expanding group of primary care... ...plus potential bonuses. Extended health coverage, including medical, dental, and vision benefits. State-of-the-art clinic...MedicalPermanent employmentFull timePart timeLocumFlexible hours
- ...Job Summary Job Title: Program Medical Director, Medical Assistance in Dying (MAID) Work Site: 520 West 6th Ave, other VCH facilities... ...quality and clinical services delivered by medical providers (physicians and nurse practitioners), while operating within a shared...MedicalImmediate start
- ...Job Summary Come work as a Senior Medical Director, with Vancouver Coastal Health (VCH... ...Develops effective processes to implement and evaluate the quality and safety goals of the... ...regulatory colleges, such as the College of Physicians and Surgeons of British Columbia and the...MedicalLong term contractContract workWork at officeLocal area
$46.39 - $66.68 per hour
...Quality Improvement Leader, Medical Quality Leadership & Practice... ...Coastal Health (VCH)! The Physician Quality Improvement initiative... ..., test, measure, monitor and evaluate initiatives designed to improve... ..., system monitoring and evaluation, PDSA cycles, data display with...MedicalLocal areaImmediate start- ...role is Fee-for-Service Come work as General Internal Medicine Physician with Vancouver Coastal Health (VCH)! The Department of... ...Qualifications Education, Licensing, & Experience: Canadian Medical Protective Association (CMPA) – Mandatory Completed postgraduate...MedicalImmediate start
- ...Staffmax is helping our healthcare client hire a compassionate and organized Medical Receptionist for a 4-month contract. In this role, you’ll be the first point of contact for patients and play a crucial part in maintaining a smooth, professional medical office environment...MedicalContract workTemporary workWork at office
$43.32 - $54.04 per hour
...CAD $43.32/Hr. - CAD $54.04/Hr. Job Summary Come work as a Medical Diagnostic Sonographer with Vancouver Coastal Health (VCH) on... ...and deal effectively with clients and their families, co-workers, physicians, other health care staff, and staff of external agencies. Demonstrated...MedicalImmediate startShift workWeekend work- ...Job Summary Come work as a Regional Medical Director, Renal with Vancouver Coastal Health (VCH)! Vancouver Coastal Health (VCH) is... ...Director, Renal provides strategic senior medical leadership, and evaluates the planning and delivery of the regional renal services. This...MedicalInternshipLocal areaRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physician (MD/DO) - Medical AI Evaluation. Be the first to apply!
- critical care physician Vancouver, BC
- médecin du travail Vancouver, BC
- hospitalist physician Vancouver, BC
- internal medicine physician Vancouver, BC
- doctor Vancouver, BC
- pain management physician Vancouver, BC
- physician extender Vancouver, BC
- médecin Vancouver, BC
- physician recruiter Vancouver, BC
- sports medicine physician Vancouver, BC
