Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physician (MD/DO) - Put Medical AI to the Test, Remote

Part-time

Mindrift

About the company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.

Project Highlights

  • Earnings per approved task: a fixed rate for each task, set in advance
  • Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
  • Remote: open to US-licensed physicians based in eligible US states
  • No patient contact, no malpractice exposure: you review written clinical cases
  • All contributors are license-verified physicians
  • $50 one-time onboarding reward, paid once your first task on the project is approved

What this project involves

We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.

Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.

What we look for

This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
  • Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

How it works

Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks

Flexibility

You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project’s acceptance criteria.

Earnings

Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.

  • $50 one-time onboarding reward, paid once your first task on the project is approved.
  • Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Physician (MD/DO) - Put Medical AI to the Test, Remote in Waterloo, ON vacancy
  • $70.5k - $117.5k per year

     ...reimagining how colleagues and leaders access People Services through AI-enabled experiences. As our People Services AI capabilities evolve...  ...As People Services, AI Solutions Specialist, Business Analysis & Test Lead, you will support the delivery of People Services AI... 
    Suggested
    Long term contract
    Temporary work
    Work at office
    Local area
    Worldwide
    Flexible hours

    Manulife

    Waterloo, ON
    5 days ago
  • $114.9k - $172.3k per year

     ...excellence and creativity. Sr. Software Development Engineer In Test, ML/AI At SIE, we believe in making play safer for everyone. Within...  ...is eligible for SIE’s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time off, wellness... 
    Medical
    Internship

    PlayStation Global

    Waterloo, ON
    22 days ago
  • $18 - $21 per hour

     ...completed at the physical location. There is no option to work remotely. Work setting Private sector Various locations General...  ...Computer and technology knowledge Electronic medical records Switchboard 1-25 lines Word processing software... 
    Remote work
    Medical
    Permanent employment
    Full time
    Work at office

    Home Sleep Care

    Waterloo, ON
    4 days ago
  •  ...environmental monitoring, electronics design and development, oceanographic research, deepwater oil and gas exploration and production, medical imaging and pharmaceutical research.​ We are looking for individuals who thrive on making an impact and want the excitement of... 
    Medical
    Minimum wage
    Local area

    Teledyne Digital Imaging, Inc.

    Waterloo, ON
    5 days ago
  • $95k - $135k per year

     ...track record as an innovator, our in-depth medical knowledge and our strategic guidance to help...  ...develop, implement, and maintain automated test solutions Integrate automated testing...  ...in Agile environments ~ Experience with AI-assisted testing ~ Knowledge of Kubernetes... 
    Medical
    Contract work
    Internship
    Live In

    AGFA

    Waterloo, ON
    26 days ago
  •  ...Software Developer in Test Co-op - University of Toronto. This is for PEY 12 - 16 month co-op Why PlayStation? PlayStation isn’t...  ...currently offering a hybrid work environment, with some folks working remotely and others working from the office. You can choose what suits you... 
    Remote work
    Full time
    Casual work
    Internship
    Work at office
    Immediate start

    PlayStation Waterloo Co-Op

    Waterloo, ON
    22 days ago
  •  ...Conduct individual assessments of insurability for personal health, life and critical illness insurance applications Review complex medical information to determine risk classification Communicate with various sources to gather and evaluate evidence of insurability... 
    Medical
    Permanent employment
    Full time
    Work at office
    Immediate start
    Worldwide
    Flexible hours

    Sun Life

    Waterloo, ON
    3 days ago
  •  ...experiences under the PlayStation brand, a name synonymous with entertainment excellence and creativity. Software Development Engineer in Test II Contract, 12 months   Do you have a passion for test-driven development? Want to work at a company where customers have... 
    Contract work
    Internship
    Immediate start

    PlayStation Global

    Waterloo, ON
    18 days ago
  • $114k - $143k per year

     ...heard, all input is valued, and our members have the creative freedom to make their ideas real.  Sr Software Development Engineer in Test , ML Locations: Madison, WI and Waterloo, Ontario Canada P layStation is seeking a Sr Software Development Engineer in Test, ML... 
    Internship

    PlayStation Global

    Waterloo, ON
    11 days ago
  • usd180k - usd247.5k per year

     ...next. Ship to live traffic and let A/B tests, not opinions, settle what works. Raise...  ...future. Faire uses Artificial Intelligence (AI) to screen and select applicants for this...  ...roles will have the flexibility to work remotely up to 4 weeks per year. Specific Workplace... 
    Remote work
    Internship
    Work at office
    Local area
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Waterloo, ON
    5 days ago
  • $180k - $230k per year

     ...AI Engineer (Portless) Location : Remote, North America (~6h overlap ET) Engagement : Full-time, remote Salary : $180,000 – $230,000 (EUR 155,615 – EUR 198,842) Industry : E-commerce / logistics / AI About the role Portless is transforming e-commerce logistics... 
    Remote job
    Full time

    Cross Border Talents

    Waterloo, ON
    a month ago
  •  ...experience and operational efficiency.    Role Summary:  Canada IT – Platforms and Engineering Domain is looking for a Principal AI Engineer with at least 10 years of engineering experience. This role will be instrumental in driving innovation, implementing cloud... 
    Work at office
    Work from home

    Sun Life of Canada - Corporate

    Waterloo, ON
    5 days ago
  • $158.3k - $237.5k per year

     ...entertainment excellence and creativity. Staff Technical Program Manager - AI/ML Waterloo, ON Do you want to join an AI/Machine Learning...  ...is eligible for SIE’s top-tier benefits package that includes medical, dental, vision, matching 401(k), paid time off, wellness program... 
    Medical
    Internship

    Sony Interactive Entertainment

    Waterloo, ON
    10 days ago
  •  ...operational complexity into predictable and profitable performance, ensuring resilient and more sustainable operations. We are seeking an AI Automation Specialist to drive operational efficiency by analyzing business processes and designing streamlined, low-code AI solutions.... 
    Permanent employment
    Full time
    Contract work
    Casual work
    Work at office
    Flexible hours

    Airbus

    Waterloo, ON
    8 days ago
  •  ...predictable and profitable performance, ensuring resilient and more sustainable operations. We are looking for a collaborative and technical AI Automation Developer to partner across value streams and business units to identify, design, and deploy AI-enabled automated workflows.... 
    Permanent employment
    Full time
    Contract work
    Casual work
    Work at office
    Flexible hours

    Airbus

    Waterloo, ON
    8 days ago
  • usd180k - usd247.5k per year

     ...At the heart of this mission is Compass — Faire’s user facing AI bet within the Discovery Pillar — building an always-present, context...  ..., hybrid in-office roles will have the flexibility to work remotely up to 4 weeks per year. Specific Workplace and Information Technology... 
    Remote work
    Internship
    Work at office
    Local area
    Immediate start
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Waterloo, ON
    5 days ago
  •  ...can make a difference in the lives of individuals, families and communities around the world. Job Description: Role Summary The AI Enablement & Acceleration team is seeking a Senior Consultant, AI Strategy & Program Execution to support in shaping, driving, and... 
    Work at office
    Work from home
    Shift work

    Sun Life of Canada - Corporate

    Waterloo, ON
    5 days ago
  • $127k - $225k per year

     ...customer value.   Research focuses on key areas such as authentication & authorization, kernel & hardware security, data security, ai agent security, advancement of agentic ai for product security. The lab supports deep research and encourages publications in leading journals... 
    Permanent employment
    Full time
    Internship
    Immediate start
    Worldwide
    Shift work

    Huawei Technologies Canada Co., Ltd.

    Waterloo, ON
    27 days ago
  •  ...To help us review applications efficiently, we ask that you apply to only one Remote Virtual Executive Assistant role at a time. Zirtual is a work-life balanced company that provides clients with experienced, highly skilled remote assistants for both personal and professional... 
    Remote work
    Contract work
    For contractors
    Internship
    Work at office
    Immediate start
    Monday to friday

    Zirtual

    Waterloo, ON
    a month ago
  • $100 per hour

     ...Licensed Clinical Professional Counselor (LCPC) Valid NPI Must be licensed in Maine Must be able to provide telehealth Work Remotely Yes ME, US Have office space? New Rula providers can receive a $20 increase to base pay for every in-person session, for... 
    Remote work
    Hourly pay
    For contractors
    Private practice
    Work at office

    Rula

    Waterloo, ON
    20 hours ago
  • The opportunity: Location requirement: This opportunity is only open to providers with office space for in-person sessions. Demand for in-person sessions is growing. Providers offering in-person care receive 33% more referrals on average. Individual pay rates vary based...
    Remote work
    Live In
    Work at office

    Rula

    Waterloo, ON
    22 hours ago
  • $67.69k - $84.61k per year

     ...Employee Group: Staff Job Category: Medical Health and Wellness Employment Type:...  ...pre-season and follow-up neurocognitive testing and protocols regarding concussion...  ...Health Care team, including Sports Medicine Physicians, surgeons, chiropractors, etc, Communicates... 
    Medical
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Immediate start

    University of Waterloo

    Waterloo, ON
    3 days ago
  • $85k - $100k per year

     ...for developing, implementing, testing, and continuously improving the...  ...requirements. Develop, maintain, and test business continuity, emergency...  ...’ve been organizing staff-led medical care and clinics in countries...  ...Artificial Intelligence (AI) features to enhance process efficiency... 
    Medical
    Full time
    For subcontractor
    Work at office
    Local area
    Work from home

    CarePartners

    Waterloo, ON
    a month ago
  •  ...with research organizations, academic institutions, and brands seeking genuine consumer feedback. We connect individuals with flexible remote work from home research opportunities that help shape products, services, and user experiences. Role Overview We’re inviting... 
    Remote work
    Part time
    Casual work
    Work from home
    Flexible hours

    ApexFocusGroup

    Waterloo, ON
    more than 2 months ago
  • $9.69k per year

     ...directly involving the use of AI/ML in those areas. Experience...  ...machine learning methods, they will test different approaches, compare...  ...applications in areas such as remote sensing, species and habitat...  ...across biomedical, health, and medical contexts. Through case studies,... 
    Remote work
    Medical
    Manual labor
    Work at office

    University of Waterloo

    Waterloo, ON
    5 days ago
  • $67.69k - $84.61k per year

     ...Campus Wellness Director and the University Medical Director, the Manager supports all units...  ...software systems, including end-user testing, workflow mapping, training, and troubleshooting...  ...or other methods for payment.  Oversee physician’s renumeration systems, including fee-for... 
    Medical
    Long term contract
    Permanent employment
    Full time
    Work at office
    Immediate start
    Shift work

    University of Waterloo

    Waterloo, ON
    5 days ago
  • $70.5k - $117.5k per year

     ...experiences through simplified and intuitive design; putting Canadians needs first by providing the...  ...level - Brain Storm, protype and test solutions. 15% Planning where you will define...  ...technologies, such as artificial intelligence (AI), and automated processing tools, to... 
    Long term contract
    Full time
    Temporary work
    Local area
    Flexible hours

    Manulife

    Waterloo, ON
    5 days ago
  •  ...hybrid work environment that blends in-person collaboration with remote flexibility. As a technical mentor, you can expect to be in the office...  ...of two to three days per week. Your Key Responsibilities DO: Project Delivery Serve as Project Technical Lead for water infrastructure... 
    Remote work
    For contractors
    Work at office
    2 days per week
    3 days per week

    Stantec

    Waterloo, ON
    5 days ago
  •  ...certificate or diploma. or equivalent experience. Work setting: Remote location. Various locations. Tasks: Arrange travel, related...  ...validity licence check. Driving record check (abstract). Drug test. Medical exam. Transportation/travel information: Drive manual transmission... 
    Remote work
    Medical
    Hourly pay
    Minimum wage
    Permanent employment
    Local area
    Immediate start
    Flexible hours
    Night shift
    Day shift
    Afternoon shift
    Early shift

    MICHAEL DUFF INC

    Waterloo, ON
    5 days ago
  • $110k - $214.5k per year

     ...the foundation for innovation, including AI capabilities, and we're looking for someone...  ...design, and participate in user acceptance testing. Collaborate across business...  ...level these benefits may improve: Flexible medical & dental coverage to meet your household's... 
    Medical
    Full time
    Live out
    Local area
    Flexible hours

    Gallagher

    Waterloo, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physician (MD/DO) - Put Medical AI to the Test, Remote. Be the first to apply!