Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physician (MD/DO) - Medical AI Evaluation

Part-time

Mindrift

About the company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.

Project Highlights

  • Earnings per approved task: a fixed rate for each task, set in advance
  • Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
  • Remote: open to US-licensed physicians based in eligible US states
  • No patient contact, no malpractice exposure: you review written clinical cases
  • All contributors are license-verified physicians
  • $50 one-time onboarding reward, paid once your first task on the project is approved

What this project involves

We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.

Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.

What we look for

This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
  • Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

How it works

Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks

Flexibility

You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project’s acceptance criteria.

Earnings

Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.

  • $50 one-time onboarding reward, paid once your first task on the project is approved.
  • Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Physician (MD/DO) - Medical AI Evaluation in Waterloo, ON vacancy
  • $73.7k - $92.12k per year

     ...Type: Full time Employee Group: Staff Job Category: Medical Health and Wellness Employment Type: Temporary...  ...Job Description: Primary Purpose  The Health Promotion & Evaluation Specialist is responsible for planning, implementing and evaluating... 
    Medical
    Full time
    Contract work
    Temporary work
    Work at office

    University of Waterloo

    Waterloo, ON
    6 days ago
  • $73.7k - $92.12k per year

     ...This position is being offered as a temporary contract. Term:18 months Job Description: Primary Purpose The Data Analyst and Evaluation Specialist supports the maintenance of data infrastructure while providing data analysis and insights to support operational and... 
    Suggested
    Full time
    Temporary work
    Work at office

    University of Waterloo

    Waterloo, ON
    6 days ago
  • $18 - $21 per hour

     ...customer service Perform basic bookkeeping tasks Experience and specialization Computer and technology knowledge Electronic medical records Switchboard 1-25 lines Word processing software MS Office MS Excel MS Outlook MS Word MS Windows Area... 
    Medical
    Permanent employment
    Full time
    Work at office
    Remote work

    Home Sleep Care

    Waterloo, ON
    5 days ago
  •  ...offers an exciting opportunity to apply critical thinking to risk evaluation while contributing to our Purpose of helping clients achieve...  ...life and critical illness insurance applications Review complex medical information to determine risk classification Communicate with... 
    Medical
    Permanent employment
    Full time
    Work at office
    Immediate start
    Worldwide
    Flexible hours

    Sun Life

    Waterloo, ON
    4 days ago
  •  ...IT – Platforms and Engineering Domain is looking for a Principal AI Engineer with at least 10 years of engineering experience. This role...  ...Actively shape squad adoption of industry advancements, evaluating and recommending emerging technologies and practices  Provide post... 
    Suggested
    Work at office
    Work from home

    Sun Life of Canada - Corporate

    Waterloo, ON
    6 days ago
  •  ...sustainable operations. We are looking for a collaborative and technical AI Automation Developer to partner across value streams and...  ...deploy AI-enabled automated workflows. In this role, you will evaluate operational models, build robust data-driven solutions across corporate... 
    Permanent employment
    Full time
    Contract work
    Casual work
    Work at office
    Flexible hours

    Airbus

    Waterloo, ON
    9 days ago
  • $158.3k - $237.5k per year

     ...Staff Technical Program Manager - AI/ML Waterloo, ON Do you...  ...-effectively deploying and evaluating very large-scale machine learning...  ...delivery (labeling, compute, evaluation tooling), including production...  ...package that includes medical, dental, vision, matching 401(... 
    Medical
    Internship

    Sony Interactive Entertainment

    Waterloo, ON
    11 days ago
  • $180k - $230k per year

     ...AI Engineer (Portless) Location : Remote, North America (~6h overlap ET) Engagement : Full-time, remote Salary : $180,000...  ...AI-powered features Own the full ML lifecycle: data, training, evaluation, deployment Monitor and improve model performance in production... 
    Remote job
    Full time

    Cross Border Talents

    Waterloo, ON
    a month ago
  • $114.9k - $172.3k per year

     ...Software Development Engineer In Test, ML/AI At SIE, we believe in making play safer...  ...AI quality, including automation for model evaluation, LLM-assisted test generation, and...  ...s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time... 
    Medical
    Internship

    PlayStation Global

    Waterloo, ON
    4 hours ago
  •  ...operational complexity into predictable and profitable performance, ensuring resilient and more sustainable operations. We are seeking an AI Automation Specialist to drive operational efficiency by analyzing business processes and designing streamlined, low-code AI solutions.... 
    Permanent employment
    Full time
    Contract work
    Casual work
    Work at office
    Flexible hours

    Airbus

    Waterloo, ON
    9 days ago
  • usd180k - usd247.5k per year

     ...At the heart of this mission is Compass — Faire’s user facing AI bet within the Discovery Pillar — building an always-present, context...  ...lead for this product — driving agent quality through data, evaluation, and modeling, while shipping product features end-to-end with high... 
    Internship
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Waterloo, ON
    7 days ago
  • usd180k - usd247.5k per year

     ...work location. The base pay range provided is subject to change and may be modified in the future. Faire uses Artificial Intelligence (AI) to screen and select applicants for this position. This job posting is for an existing vacancy. Hybrid Faire employees currently... 
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Waterloo, ON
    7 days ago
  •  ...can make a difference in the lives of individuals, families and communities around the world. Job Description: Role Summary The AI Enablement & Acceleration team is seeking a Senior Consultant, AI Strategy & Program Execution to support in shaping, driving, and... 
    Work at office
    Work from home
    Shift work

    Sun Life of Canada - Corporate

    Waterloo, ON
    6 days ago
  • $70.5k - $117.5k per year

     ...every employee thrive. The Opportunity At Manulife, we are reimagining how colleagues and leaders access People Services through AI-enabled experiences. As our People Services AI capabilities evolve, this role will help shape how HR processes and services are delivered... 
    Long term contract
    Temporary work
    Work at office
    Local area
    Worldwide
    Flexible hours

    Manulife

    Waterloo, ON
    6 days ago
  • $127k - $225k per year

     ...customer value.   Research focuses on key areas such as authentication & authorization, kernel & hardware security, data security, ai agent security, advancement of agentic ai for product security. The lab supports deep research and encourages publications in leading journals... 
    Permanent employment
    Full time
    Internship
    Immediate start
    Worldwide
    Shift work

    Huawei Technologies Canada Co., Ltd.

    Waterloo, ON
    28 days ago
  • $123.66k - $154.58k per year

     ...Employee Group: Staff Job Category: Medical Health and Wellness Employment Type:...  ...to facilitate the delivery and ongoing evaluation of UWaterloo crisis response including...  ...in the recruitment and retention of physicians Medicine and Primary Health Care Medical... 
    Medical
    Long term contract
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    1 day per week

    University of Waterloo

    Waterloo, ON
    6 days ago
  • $67.69k - $84.61k per year

     ...Campus Wellness Director and the University Medical Director, the Manager supports all units...  ...a balanced approach, combining formal evaluations, informal feedback, one-on-one coaching,...  ...other methods for payment.  Oversee physician’s renumeration systems, including fee-for... 
    Medical
    Long term contract
    Permanent employment
    Full time
    Work at office
    Immediate start
    Shift work

    University of Waterloo

    Waterloo, ON
    6 days ago
  • $104k - $154k per year

     ...with cross-functional partners — including Medical Science Liaisons, Medical Education...  ...building skills with healthcare professionals, physicians, and hospital stakeholders Proven ability...  .... GSK uses artificial intelligence (AI) tools as part of the recruitment process... 
    Medical
    Long term contract
    Full time
    Temporary work
    Internship
    Work at office
    Local area
    Immediate start

    GSK

    Waterloo, ON
    6 hours ago
  •  ...average of two to three days per week. Your Key Responsibilities DO: Project Delivery Serve as Project Technical Lead for water...  ...Conduct alternative analyses to support business case evaluations for project decisions Effectively apply industry standards as... 
    For contractors
    Work at office
    Remote work
    2 days per week
    3 days per week

    Stantec

    Waterloo, ON
    6 days ago
  • $67.69k - $84.61k per year

     ...Type: Full time Employee Group: Staff Job Category: Medical Health and Wellness Employment Type: Temporary...  ...various members of the Health Care team, including Sports Medicine Physicians, surgeons, chiropractors, etc, Communicates with other members... 
    Medical
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Immediate start

    University of Waterloo

    Waterloo, ON
    4 days ago
  • $188.2k - $282.2k per year

     ...artifacts, supported by policy checks and evaluation suites. Partner with client, design system...  .... Experience applying generative AI or agentic workflows to software or content...  ...s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time... 
    Medical
    Long term contract
    Contract work
    Internship
    Manual labor

    PlayStation Global

    Waterloo, ON
    4 hours ago
  • $73.6k - $103.5k per year

     ...affordable benefits including coverage for medical, dental, vision, life, disability...  ...Intelligence: We do not use artificial intelligence (AI) to screen, assess, or select applicants...  ...of our recruitment process. All applications are reviewed and evaluated by our hiring team.
    Medical
    Full time
    Internship
    Work at office
    Local area
    Immediate start

    BlackBerry

    Waterloo, ON
    9 days ago
  •  ...healthcare and scientific discovery to powering AI and the technologies people rely on every...  ...engineering productivity Critically evaluate AI-generated code and analysis for...  ...to age, ancestry, color, marital status, medical condition, mental or physical disability,... 
    Medical
    Full time
    Internship

    AMD

    Waterloo, ON
    1 day ago
  •  ...the people who manage them. Our powerful, AI infused platform provides full...  ...skills, employee and program insights to evaluate impact, identify emerging needs, influence...  ...when we see store shelves stocked, when medications are available for our loved ones, and so... 
    Long term contract
    Work at office
    Remote work
    Flexible hours

    Kinaxis

    Waterloo, ON
    18 days ago
  • $9.69k per year

     ...presentations, and reading lists. Assessment and Evaluation: Create, administer, and grade...  ...research directly involving the use of AI/ML in those areas. Experience/Qualifications...  ...insights across biomedical, health, and medical contexts. Through case studies, practical... 
    Medical
    Manual labor
    Work at office
    Remote work

    University of Waterloo

    Waterloo, ON
    6 days ago
  • $51.98k - $86.63k per year

     ...audits together in one place, supported by AI-assisted tools that help specialists find,...  ...requires an expert in travel claims (medical, trip cancellation/interruption, baggage,...  ...documentation is an asset. You think big and can evaluate alternatives and assess risks in making... 
    Medical
    Long term contract
    Contract work
    Temporary work
    Work at office
    Local area
    Flexible hours

    Manulife

    Waterloo, ON
    6 days ago
  •  ...artificial intelligence or ML/AI engineering and are looking for...  ...and bias/fairness testing. Evaluate models; move experiments to...  ...CatBoost; feature engineering; model evaluation; time-based validation;...  ...physical or mental disability, or medical condition. If you are... 
    Medical
    Internship

    Zurich

    Waterloo, ON
    26 days ago
  • $73.6k - $96.6k per year

     ...industries including automotive, medical devices, industrial controls,...  ...stakeholders understand and evaluate QNX. Acting as both a trusted...  ...software-defined vehicles, physical AI, safety-critical edge...  ...Manage participation in analyst evaluations, market guides, vendor assessments... 
    Medical
    Full time
    Internship
    Immediate start

    BlackBerry

    Waterloo, ON
    9 days ago
  • $85k - $100k per year

     ...ensure effective communication with staff, patients, families, physicians, and other members of the healthcare team. Knowledgeable in...  ...departmental needs, develop, and implement planned interventions, and evaluate the effectiveness of applied interventions. Basic management... 
    Long term contract
    Full time
    Traineeship
    Direct hire
    Work at office
    Relocation
    Weekend work
    Waterloo, ON
    7 days ago
  • $17.6 - $23.1 per hour

     ...levels of drugs and supplies, checking for and pulling expired medications at least monthly, cleaning up Will Call Bin of 'stale'...  ...To support resume screening, interviews and other candidate evaluations, we may use artificial intelligence-powered tools, including internal... 

    Walmart Canada

    Waterloo, ON
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physician (MD/DO) - Medical AI Evaluation. Be the first to apply!