Physician (MD/DO) - Medical AI Evaluation
Mindrift
- Remote job
About the company
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.
Project Highlights
- Earnings per approved task: a fixed rate for each task, set in advance
- Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
- Remote: open to US-licensed physicians based in eligible US states
- No patient contact, no malpractice exposure: you review written clinical cases
- All contributors are license-verified physicians
- $50 one-time onboarding reward, paid once your first task on the project is approved
What this project involves
We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:
- Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
- Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
- Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.
Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.
What we look for
This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:
- Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
- Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
- Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
- Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
- Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
- Strong written English (C1+).
This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.
How it works
Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks
Flexibility
You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project's acceptance criteria.
Earnings
Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.
- $50 one-time onboarding reward, paid once your first task on the project is approved.
- Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
- ...nurse practitioner, or patient. As the Physician Liaison, you’ll promote, facilitate, and... ...understanding of and interest in the Patient’s Medical Home model for primary care. This role... ...the gathering and analysis of program evaluation data. Facilitate physician...MedicalPermanent employmentFull timeWork at officeWork from homeMonday to fridayFlexible hours
$17 - $19 per hour
...Full-Time Medical Office Administrator (leave coverage) - National Spine & Wellness, Calgary... ...Required Criteria Please do not apply if you do not have medical/rehab office experience... ...for all patients, staff and physicians in accordance with the Health Information...MedicalHourly payFull timeWork at officeImmediate start$250k per year
...Responsibilities Tasks Collect medical information from patients, family members... ...Consult with other medical practitioners to evaluate patients' physical and mental health Prescribe... ..., and courses College of Family Physicians Certification (CCFP) Licentiate of the...MedicalPrivate practiceRemote work- ...leading employee retention. We support the pharmaceutical biotech and medical device industries with our proven scientific approach to complex... ...and safety teams. Job Requirements ~ Medical degree (MD DO or international equivalent) ~ Experience with protocol amendments...MedicalFull timeLocal areaRemote work
$25 per hour
...physical location. There is no option to work remotely. Responsibilities Tasks Assist health care professionals Assist physicians in the assessment of patients Develop information materials for patients Clean and maintain equipment Record vital signs...MedicalPermanent employmentFull timeRemote work- ...Medical Office Assistant WELL Health Diagnostic Centres (previously C-health) is looking for a Medical Office Assistant to support our physicians and other healthcare professionals by performing a wide variety of clerical and administrative tasks. At WELL Health Diagnostic...MedicalInternshipWork at officeFlexible hours
$231.41k per year
Overview Languages English Education ~ Degree in medicine, dentistry, veterinary medicine or optometry Experience 1 year to less than 2 years On site Work must be completed at the physical location. There is no option to work remotely. Benefits...Remote work- ..., ensuring high-quality deliverables meet deadlines. ~ Generative AI Integration: Utilize Gen AI platforms and tools where applicable... ...channels. Here’s What You’ll Need: Minimum of 3 years of medical copy development expertise, with success in crafting persuasive content...MedicalHourly payFull timeManual laborWork at officeLocal area
- ...Ipsen seeks a Medical Science Liaison for Western Canada to build peer relationships with medical experts in neuroscience, facilitate scientific... ...conventions Requirements Advanced degree in life sciences (MD, PhD, PharmD preferred); MSc with MSL experience considered Two...Medical
$22.41 - $26.19 per hour
...functional awareness of MHS - West Operational Guidelines, and AHS medical control guidelines. Participates actively in MHS - West Quality... ...Agreement * While Medavie may use automated tools, including AI, to support application screening, candidates are expected to complete...MedicalHourly payCasual workShift work$43 per hour
...Description Job Description Job Title: Medical Radiation Technologist (Nuclear Medicine... ...are co-located to enhance support for physicians and the quality of care for patients.... ...in a fast paced environment. Self-evaluate performance, establish personal objectives...MedicalHourly payPermanent employmentFull timeFlexible hoursShift workWeekend workAfternoon shift- ...Johnson & Johnson seeks an Associate Director of Field Medical for Hematology to lead and develop a team of Medical Science Liaisons across... ...experience University degree in science or health-related field; PhD or MD strongly preferred Demonstrated experience leading and...MedicalLocal area
- ...Calgary and are looking for an exceptional full-time nanny/household manager to become a valued member of our family. We are both physicians with demanding careers and have two young children. We are seeking someone who genuinely enjoys caring for children while also helping...Long term contractFull timeLive InLive outRelocationNight shiftAfternoon shift
$38 per hour
Overview Languages English Education ~ College, CEGEP or other non-university certificate or diploma from a program of 1 year to 2 years Experience 2 years to less than 3 years On site Work must be completed at the physical location. There is ...MedicalRemote work- ...creating communities where seniors live with dignity, connection, and joy. Position Summary Reporting to the Director of Care, the Medical Office Assistant supports daily care services operations by coordinating resident documentation, scheduling appointments and clinics,...MedicalLong term contractWork at officeShift work
- Education: Master's degree. Screening questions: Do you have experience working in this field?. Do you have the required certifications listed in the job posting?. Employment terms options: Evening. Experience: 5 years or more. Employment terms options: Day. Health benefits...MedicalHourly payMinimum wagePermanent employmentImmediate startAfternoon shift
- LANGUAGE : Yoruba US-Based Interpreter As a remote interpreter, you play a significant role in facilitating communication between Yoruba and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It ...MedicalRemote workWork from homeHome office
- ...Staffmax is working with a respected healthcare client to hire a compassionate, organized Medical Office Assistant for a 4-month contract. As the first point of contact for patients, you’ll help create a welcoming atmosphere while ensuring the front office runs smoothly and...MedicalContract workTemporary workWork at office
$20 - $28 per hour
Job Responsibility: Who We Are CCE Medical Equipment is Canada's largest distributor of diagnostic ultrasound equipment. We are a diverse team with ranging expertise, working together to deliver excellent products and services to our communities. With locations in Mississauga...MedicalHourly payDaily paidPart timeCasual workMonday to fridayFlexible hoursShift work- Greet people and direct them to contacts or service areas Provide basic information to clients and the public Obtain and process information required to provide customer service Order office supplies Perform clerical duties, such as filing and sorting and distributing...MedicalFull timeWork at office
- ...employee retention rate. We support the pharmaceutical, biotech, and medical device industries with our proven, scientific approach to... ...Under minimal supervision, the Medical Writer will critically evaluate, analyze, and interpret the medical literature to select primary...MedicalRemote jobFull time
- ...Located inside Foothills Medical Centre, Good Earth Coffeehouse serves healthcare professionals, patients, visitors, and hospital staff around the clock. Our overnight team plays an important role in supporting the hospital community during the late-night and early-...MedicalFull timeShift workNight shiftDay shiftEarly shift
$39 - $52 per hour
...Prosperity Workforce Solutions is currently hiring on behalf of a physician-led, community-based diagnostic imaging organization in Calgary... ...Qualifications Required Diploma or Degree in Medical Radiologic Technology or CLXT from an accredited institution...MedicalFull timePrivate practiceWork at officeTrial periodRelocation packageFlexible hoursShift workWeekend workAfternoon shift- ...AI Solutions Lead WHO WE ARE Our Power, Your Possibilities At TransAlta , we don’t just generate electricity-we generate... ...using Microsoft and other emerging AI technologies. Evaluate solutions based on business value, feasibility, data readiness, risk...Long term contractFull timeWork at officeFlexible hours
- ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- ...takes off. Position Overview: The AI Governance Lead is accountable for governing... ...are designed, trained, configured, evaluated, deployed, monitored and retired. They are... ...require re-review. Confirm required evaluations, documentation, human oversight and controls...Permanent employmentFull timeFlexible hours
- ...Medical Office Assistant Employer: GLENWOOD MEDICAL CENTRE This busy family practice and walk-in clinic in the SW is looking for a part-time Medical Duties and Responsibilities: Opening/Closing duties Greeting patients arriving for their appointment Verifying...MedicalHourly payPart timeWork at office
- ...story takes off. Overview of the role: The Senior Developer, AI / ML is accountable for designing, building, testing, deploying... ...solutions throughout their lifecycle, including experimentation, evaluation, updates, scaling, retraining, maintenance, recovery and retirement...RemplacementPermanent employmentFull timeInternshipFlexible hours
$39 - $52 per hour
...Medical Radiation Technologist TAPP Workforce Solutions is seeking, on behalf of our client, X-ray Technologists / Combined Laboratory... ...factors to obtain accurate diagnostic images Assist physicians with interventional procedures by preparing the fluoroscopic suite...MedicalHourly payPermanent employmentFull timeWork at officeTrial periodRelocation package- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will... ...Familiarity with AI observability, monitoring, telemetry, and evaluation platforms. Strong knowledge of software engineering best practices...InternshipRemote workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physician (MD/DO) - Medical AI Evaluation. Be the first to apply!
- sports medicine physician Calgary, AB
- physician recruiter Calgary, AB
- internal medicine physician Calgary, AB
- médecin Calgary, AB
- medical doctor Calgary, AB
- medecin interniste Calgary, AB
- physician neurology Calgary, AB
- physician extender Calgary, AB
- pain management physician Calgary, AB
- critical care physician Calgary, AB


