Physician (MD/DO) - Medical AI Evaluation
Mindrift
About the company
Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.
Project Highlights
- Earnings per approved task: a fixed rate for each task, set in advance
- Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
- Remote: open to US-licensed physicians based in eligible US states
- No patient contact, no malpractice exposure: you review written clinical cases
- All contributors are license-verified physicians
- $50 one-time onboarding reward, paid once your first task on the project is approved
What this project involves
We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:
- Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
- Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
- Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.
Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.
What we look for
This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:
- Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
- Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
- Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
- Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
- Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
- Strong written English (C1+).
This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.
How it works
Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks
Flexibility
You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project’s acceptance criteria.
Earnings
Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.
- $50 one-time onboarding reward, paid once your first task on the project is approved.
- Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
$73.7k - $92.12k per year
...Type: Full time Employee Group: Staff Job Category: Medical Health and Wellness Employment Type: Temporary... ...Job Description: Primary Purpose The Health Promotion & Evaluation Specialist is responsible for planning, implementing and evaluating...MedicalFull timeContract workTemporary workWork at office$73.7k - $92.12k per year
...This position is being offered as a temporary contract. Term:18 months Job Description: Primary Purpose The Data Analyst and Evaluation Specialist supports the maintenance of data infrastructure while providing data analysis and insights to support operational and...SuggestedFull timeTemporary workWork at office$18 - $21 per hour
...customer service Perform basic bookkeeping tasks Experience and specialization Computer and technology knowledge Electronic medical records Switchboard 1-25 lines Word processing software MS Office MS Excel MS Outlook MS Word MS Windows Area...MedicalPermanent employmentFull timeWork at officeRemote work- ...offers an exciting opportunity to apply critical thinking to risk evaluation while contributing to our Purpose of helping clients achieve... ...life and critical illness insurance applications Review complex medical information to determine risk classification Communicate with...MedicalPermanent employmentFull timeWork at officeImmediate startWorldwideFlexible hours
- ...IT – Platforms and Engineering Domain is looking for a Principal AI Engineer with at least 10 years of engineering experience. This role... ...Actively shape squad adoption of industry advancements, evaluating and recommending emerging technologies and practices Provide post...SuggestedWork at officeWork from home
- ...sustainable operations. We are looking for a collaborative and technical AI Automation Developer to partner across value streams and... ...deploy AI-enabled automated workflows. In this role, you will evaluate operational models, build robust data-driven solutions across corporate...Permanent employmentFull timeContract workCasual workWork at officeFlexible hours
$158.3k - $237.5k per year
...Staff Technical Program Manager - AI/ML Waterloo, ON Do you... ...-effectively deploying and evaluating very large-scale machine learning... ...delivery (labeling, compute, evaluation tooling), including production... ...package that includes medical, dental, vision, matching 401(...MedicalInternship$180k - $230k per year
...AI Engineer (Portless) Location : Remote, North America (~6h overlap ET) Engagement : Full-time, remote Salary : $180,000... ...AI-powered features Own the full ML lifecycle: data, training, evaluation, deployment Monitor and improve model performance in production...Remote jobFull time$114.9k - $172.3k per year
...Software Development Engineer In Test, ML/AI At SIE, we believe in making play safer... ...AI quality, including automation for model evaluation, LLM-assisted test generation, and... ...s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time...MedicalInternship- ...operational complexity into predictable and profitable performance, ensuring resilient and more sustainable operations. We are seeking an AI Automation Specialist to drive operational efficiency by analyzing business processes and designing streamlined, low-code AI solutions....Permanent employmentFull timeContract workCasual workWork at officeFlexible hours
usd180k - usd247.5k per year
...At the heart of this mission is Compass — Faire’s user facing AI bet within the Discovery Pillar — building an always-present, context... ...lead for this product — driving agent quality through data, evaluation, and modeling, while shipping product features end-to-end with high...InternshipWork at officeLocal areaImmediate startRemote workWork from homeMonday to fridayFlexible hours3 days per weekusd180k - usd247.5k per year
...work location. The base pay range provided is subject to change and may be modified in the future. Faire uses Artificial Intelligence (AI) to screen and select applicants for this position. This job posting is for an existing vacancy. Hybrid Faire employees currently...InternshipWork at officeLocal areaRemote workWork from homeMonday to fridayFlexible hours3 days per week- ...can make a difference in the lives of individuals, families and communities around the world. Job Description: Role Summary The AI Enablement & Acceleration team is seeking a Senior Consultant, AI Strategy & Program Execution to support in shaping, driving, and...Work at officeWork from homeShift work
$70.5k - $117.5k per year
...every employee thrive. The Opportunity At Manulife, we are reimagining how colleagues and leaders access People Services through AI-enabled experiences. As our People Services AI capabilities evolve, this role will help shape how HR processes and services are delivered...Long term contractTemporary workWork at officeLocal areaWorldwideFlexible hours$127k - $225k per year
...customer value. Research focuses on key areas such as authentication & authorization, kernel & hardware security, data security, ai agent security, advancement of agentic ai for product security. The lab supports deep research and encourages publications in leading journals...Permanent employmentFull timeInternshipImmediate startWorldwideShift work$123.66k - $154.58k per year
...Employee Group: Staff Job Category: Medical Health and Wellness Employment Type:... ...to facilitate the delivery and ongoing evaluation of UWaterloo crisis response including... ...in the recruitment and retention of physicians Medicine and Primary Health Care Medical...MedicalLong term contractFull timeContract workTemporary workWork at officeLocal area1 day per week$67.69k - $84.61k per year
...Campus Wellness Director and the University Medical Director, the Manager supports all units... ...a balanced approach, combining formal evaluations, informal feedback, one-on-one coaching,... ...other methods for payment. Oversee physician’s renumeration systems, including fee-for...MedicalLong term contractPermanent employmentFull timeWork at officeImmediate startShift work$104k - $154k per year
...with cross-functional partners — including Medical Science Liaisons, Medical Education... ...building skills with healthcare professionals, physicians, and hospital stakeholders Proven ability... .... GSK uses artificial intelligence (AI) tools as part of the recruitment process...MedicalLong term contractFull timeTemporary workInternshipWork at officeLocal areaImmediate start- ...average of two to three days per week. Your Key Responsibilities DO: Project Delivery Serve as Project Technical Lead for water... ...Conduct alternative analyses to support business case evaluations for project decisions Effectively apply industry standards as...For contractorsWork at officeRemote work2 days per week3 days per week
$67.69k - $84.61k per year
...Type: Full time Employee Group: Staff Job Category: Medical Health and Wellness Employment Type: Temporary... ...various members of the Health Care team, including Sports Medicine Physicians, surgeons, chiropractors, etc, Communicates with other members...MedicalFull timeContract workTemporary workWork at officeLocal areaImmediate start$188.2k - $282.2k per year
...artifacts, supported by policy checks and evaluation suites. Partner with client, design system... .... Experience applying generative AI or agentic workflows to software or content... ...s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time...MedicalLong term contractContract workInternshipManual labor$73.6k - $103.5k per year
...affordable benefits including coverage for medical, dental, vision, life, disability... ...Intelligence: We do not use artificial intelligence (AI) to screen, assess, or select applicants... ...of our recruitment process. All applications are reviewed and evaluated by our hiring team.MedicalFull timeInternshipWork at officeLocal areaImmediate start- ...healthcare and scientific discovery to powering AI and the technologies people rely on every... ...engineering productivity Critically evaluate AI-generated code and analysis for... ...to age, ancestry, color, marital status, medical condition, mental or physical disability,...MedicalFull timeInternship
- ...the people who manage them. Our powerful, AI infused platform provides full... ...skills, employee and program insights to evaluate impact, identify emerging needs, influence... ...when we see store shelves stocked, when medications are available for our loved ones, and so...Long term contractWork at officeRemote workFlexible hours
$9.69k per year
...presentations, and reading lists. Assessment and Evaluation: Create, administer, and grade... ...research directly involving the use of AI/ML in those areas. Experience/Qualifications... ...insights across biomedical, health, and medical contexts. Through case studies, practical...MedicalManual laborWork at officeRemote work$51.98k - $86.63k per year
...audits together in one place, supported by AI-assisted tools that help specialists find,... ...requires an expert in travel claims (medical, trip cancellation/interruption, baggage,... ...documentation is an asset. You think big and can evaluate alternatives and assess risks in making...MedicalLong term contractContract workTemporary workWork at officeLocal areaFlexible hours- ...artificial intelligence or ML/AI engineering and are looking for... ...and bias/fairness testing. Evaluate models; move experiments to... ...CatBoost; feature engineering; model evaluation; time-based validation;... ...physical or mental disability, or medical condition. If you are...MedicalInternship
$73.6k - $96.6k per year
...industries including automotive, medical devices, industrial controls,... ...stakeholders understand and evaluate QNX. Acting as both a trusted... ...software-defined vehicles, physical AI, safety-critical edge... ...Manage participation in analyst evaluations, market guides, vendor assessments...MedicalFull timeInternshipImmediate start$85k - $100k per year
...ensure effective communication with staff, patients, families, physicians, and other members of the healthcare team. Knowledgeable in... ...departmental needs, develop, and implement planned interventions, and evaluate the effectiveness of applied interventions. Basic management...Long term contractFull timeTraineeshipDirect hireWork at officeRelocationWeekend work$17.6 - $23.1 per hour
...levels of drugs and supplies, checking for and pulling expired medications at least monthly, cleaning up Will Call Bin of 'stale'... ...To support resume screening, interviews and other candidate evaluations, we may use artificial intelligence-powered tools, including internal...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physician (MD/DO) - Medical AI Evaluation. Be the first to apply!
