Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Physician (MD/DO) - Medical AI Evaluation

Full-time

Mindrift

Calgary, AB
  • Remote job

About the company

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based, independent contractor opportunity, not an employment relationship. Participation is limited to this project.

Project Highlights

  • Earnings per approved task: a fixed rate for each task, set in advance
  • Fully self-scheduled: no minimum hours and no set schedule; you choose which tasks to take and when
  • Remote: open to US-licensed physicians based in eligible US states
  • No patient contact, no malpractice exposure: you review written clinical cases
  • All contributors are license-verified physicians
  • $50 one-time onboarding reward, paid once your first task on the project is approved

What this project involves

We're looking for physicians (MD/DO) with an active, unrestricted US medical license to evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the main focus. Each task is a written clinical case, assessed against the project's acceptance criteria. Contributors may:

  • Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor "trap" answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
  • Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
  • Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales.

Each case receives three independent blind reads, followed by physician adjudication. Real clinical complexity only. You're improving the AI tools you'll eventually use yourself.

What we look for

This project is a good fit for US-licensed physicians looking for a flexible, time-limited project they can fit around their other commitments. Ideally, contributors will have:

  • Medical degree (MD or DO) and an active, unrestricted US medical license (verified at onboarding and re-checked monthly);
  • Board certification or completed residency training, with direct patient care experience (attending-level preferred). Practising or retired physicians welcome;
  • Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
  • Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
  • Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
  • Strong written English (C1+).

This project is not suitable for medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

How it works

Apply → Pass qualification(s) → Join the project → Complete tasks → Get paid for approved tasks

Flexibility

You decide whether, when, and how much to contribute. There are no minimum hours, set schedules, or required availability. Task availability varies with project phases. Tasks are submitted through the platform and are approved when they meet the project's acceptance criteria.

Earnings

Earnings are paid only for completed and approved tasks. Each task type has a fixed rate. There is no time tracking and no hour logging. There are no tiers or speed adjustments to the rate. QA and adjudication tasks have a higher per-task rate.

  • $50 one-time onboarding reward, paid once your first task on the project is approved.
  • Quality incentives: additional earnings for high-quality approved tasks, on terms set out in the project guidelines.
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Physician (MD/DO) - Medical AI Evaluation in Calgary, AB vacancy
  •  ...nurse practitioner, or patient. As the Physician Liaison, you’ll promote, facilitate, and...  ...understanding of and interest in the Patient’s Medical Home model for primary care. This role...  ...the gathering and analysis of program evaluation data. Facilitate physician... 
    Medical
    Permanent employment
    Full time
    Work at office
    Work from home
    Monday to friday
    Flexible hours

    Calgary West Central Primary Care Network

    Calgary, AB
    10 days ago
  • $17 - $19 per hour

     ...Full-Time Medical Office Administrator (leave coverage) - National Spine & Wellness, Calgary...  ...Required Criteria Please do not apply if you do not have medical/rehab office experience...  ...for all patients, staff and physicians in accordance with the Health Information... 
    Medical
    Hourly pay
    Full time
    Work at office
    Immediate start

    CBI Health

    Calgary, AB
    10 days ago
  • $250k per year

     ...Responsibilities Tasks Collect medical information from patients, family members...  ...Consult with other medical practitioners to evaluate patients' physical and mental health Prescribe...  ..., and courses  College of Family Physicians Certification (CCFP) Licentiate of the... 
    Medical
    Private practice
    Remote work

    Southcentre Family Medical Clinic | Autism Exists Diagnosis ...

    Calgary, AB
    3 days ago
  •  ...leading employee retention. We support the pharmaceutical biotech and medical device industries with our proven scientific approach to complex...  ...and safety teams. Job Requirements ~ Medical degree (MD DO or international equivalent) ~ Experience with protocol amendments... 
    Medical
    Full time
    Local area
    Remote work

    MMS

    Calgary, AB
    6 days ago
  • $25 per hour

     ...physical location. There is no option to work remotely. Responsibilities Tasks Assist health care professionals Assist physicians in the assessment of patients Develop information materials for patients Clean and maintain equipment Record vital signs... 
    Medical
    Permanent employment
    Full time
    Remote work

    Blue Diamond Medical

    Calgary, AB
    4 days ago
  •  ...Medical Office Assistant WELL Health Diagnostic Centres (previously C-health) is looking for a Medical Office Assistant to support our physicians and other healthcare professionals by performing a wide variety of clerical and administrative tasks. At WELL Health Diagnostic... 
    Medical
    Internship
    Work at office
    Flexible hours

    WELL Health Diagnostic Centres

    Calgary, AB
    10 days ago
  • $231.41k per year

    Overview Languages English Education ~ Degree in medicine, dentistry, veterinary medicine or optometry Experience 1 year to less than 2 years On site Work must be completed at the physical location. There is no option to work remotely. Benefits...
    Remote work

    Full Health Medical Clinic Inc.

    Calgary, AB
    4 days ago
  •  ..., ensuring high-quality deliverables meet deadlines. ~ Generative AI Integration: Utilize Gen AI platforms and tools where applicable...  ...channels. Here’s What You’ll Need: Minimum of 3 years of medical copy development expertise, with success in crafting persuasive content... 
    Medical
    Hourly pay
    Full time
    Manual labor
    Work at office
    Local area

    Accenture Global

    Calgary, AB
    14 days ago
  •  ...Ipsen seeks a Medical Science Liaison for Western Canada to build peer relationships with medical experts in neuroscience, facilitate scientific...  ...conventions Requirements Advanced degree in life sciences (MD, PhD, PharmD preferred); MSc with MSL experience considered Two... 
    Medical

    Ipsen

    Calgary, AB
    22 days ago
  • $22.41 - $26.19 per hour

     ...functional awareness of MHS - West Operational Guidelines, and AHS medical control guidelines. Participates actively in MHS - West Quality...  ...Agreement * While Medavie may use automated tools, including AI, to support application screening, candidates are expected to complete... 
    Medical
    Hourly pay
    Casual work
    Shift work

    Guardian Ambulance Ltd.

    Calgary, AB
    10 days ago
  • $43 per hour

     ...Description Job Description   Job Title: Medical Radiation Technologist (Nuclear Medicine...  ...are co-located to enhance support for physicians and the quality of care for patients....  ...in a fast paced environment. Self-evaluate performance, establish personal objectives... 
    Medical
    Hourly pay
    Permanent employment
    Full time
    Flexible hours
    Shift work
    Weekend work
    Afternoon shift

    MyHealth Centre

    Calgary, AB
    more than 2 months ago
  •  ...Johnson & Johnson seeks an Associate Director of Field Medical for Hematology to lead and develop a team of Medical Science Liaisons across...  ...experience University degree in science or health-related field; PhD or MD strongly preferred Demonstrated experience leading and... 
    Medical
    Local area

    Johnson & Johnson

    Calgary, AB
    18 days ago
  •  ...Calgary and are looking for an exceptional full-time nanny/household manager to become a valued member of our family. We are both physicians with demanding careers and have two young children. We are seeking someone who genuinely enjoys caring for children while also helping... 
    Long term contract
    Full time
    Live In
    Live out
    Relocation
    Night shift
    Afternoon shift

    CanadianNanny.ca

    Calgary, AB
    25 days ago
  • $38 per hour

    Overview Languages English Education ~ College, CEGEP or other non-university certificate or diploma from a program of 1 year to 2 years Experience 2 years to less than 3 years On site Work must be completed at the physical location. There is ...
    Medical
    Remote work

    Evanston Physio Inc

    Calgary, AB
    3 days ago
  •  ...creating communities where seniors live with dignity, connection, and joy. Position Summary Reporting to the Director of Care, the Medical Office Assistant supports daily care services operations by coordinating resident documentation, scheduling appointments and clinics,... 
    Medical
    Long term contract
    Work at office
    Shift work

    Optima Living

    Calgary, AB
    10 days ago
  • Education: Master's degree. Screening questions: Do you have experience working in this field?. Do you have the required certifications listed in the job posting?. Employment terms options: Evening. Experience: 5 years or more. Employment terms options: Day. Health benefits...
    Medical
    Hourly pay
    Minimum wage
    Permanent employment
    Immediate start
    Afternoon shift

    Pine Creek Medical Clinic

    Calgary, AB
    10 days ago
  • LANGUAGE : Yoruba US-Based Interpreter As a remote interpreter, you play a significant role in facilitating communication between Yoruba and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It ...
    Medical
    Remote work
    Work from home
    Home office

    GLS

    Calgary, AB
    14 days ago
  •  ...Staffmax is working with a respected healthcare client to hire a compassionate, organized Medical Office Assistant for a 4-month contract. As the first point of contact for patients, you’ll help create a welcoming atmosphere while ensuring the front office runs smoothly and... 
    Medical
    Contract work
    Temporary work
    Work at office

    Staffmax Staffing & Recruiting

    Calgary, AB
    16 days ago
  • $20 - $28 per hour

    Job Responsibility: Who We Are CCE Medical Equipment is Canada's largest distributor of diagnostic ultrasound equipment. We are a diverse team with ranging expertise, working together to deliver excellent products and services to our communities. With locations in Mississauga... 
    Medical
    Hourly pay
    Daily paid
    Part time
    Casual work
    Monday to friday
    Flexible hours
    Shift work

    CCE Medical Equipment

    Calgary, AB
    4 days ago
  • Greet people and direct them to contacts or service areas Provide basic information to clients and the public Obtain and process information required to provide customer service Order office supplies Perform clerical duties, such as filing and sorting and distributing...
    Medical
    Full time
    Work at office

    Seva Medical Clinic

    Calgary, AB
    27 days ago
  •  ...employee retention rate. We support the pharmaceutical, biotech, and medical device industries with our proven, scientific approach to...  ...Under minimal supervision, the Medical Writer will critically evaluate, analyze, and interpret the medical literature to select primary... 
    Medical
    Remote job
    Full time

    MMS

    Calgary, AB
    20 days ago
  •  ...Located inside Foothills Medical Centre, Good Earth Coffeehouse serves healthcare professionals, patients, visitors, and hospital staff around the clock. Our overnight team plays an important role in supporting the hospital community during the late-night and early-... 
    Medical
    Full time
    Shift work
    Night shift
    Day shift
    Early shift

    Sodexo Canada Ltd

    Calgary, AB
    1 day ago
  • $39 - $52 per hour

     ...Prosperity Workforce Solutions is currently hiring on behalf of a physician-led, community-based diagnostic imaging organization in Calgary...  ...Qualifications Required Diploma or Degree in Medical Radiologic Technology or CLXT from an accredited institution... 
    Medical
    Full time
    Private practice
    Work at office
    Trial period
    Relocation package
    Flexible hours
    Shift work
    Weekend work
    Afternoon shift

    Prosperity Workforce Solutions

    Calgary, AB
    more than 2 months ago
  •  ...AI Solutions Lead WHO WE ARE Our Power, Your Possibilities At TransAlta , we don’t just generate electricity-we generate...  ...using Microsoft and other emerging AI technologies. Evaluate solutions based on business value, feasibility, data readiness, risk... 
    Long term contract
    Full time
    Work at office
    Flexible hours

    TransAlta

    Calgary, AB
    9 days ago
  •  ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess...  ...in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    Calgary, AB
    more than 2 months ago
  •  ...takes off. Position Overview: The AI Governance Lead is accountable for governing...  ...are designed, trained, configured, evaluated, deployed, monitored and retired. They are...  ...require re-review. Confirm required evaluations, documentation, human oversight and controls... 
    Permanent employment
    Full time
    Flexible hours

    WestJet

    Calgary, AB
    10 hours ago
  •  ...Medical Office Assistant Employer: GLENWOOD MEDICAL CENTRE This busy family practice and walk-in clinic in the SW is looking for a part-time Medical Duties and Responsibilities: Opening/Closing duties Greeting patients arriving for their appointment Verifying... 
    Medical
    Hourly pay
    Part time
    Work at office

    GLENWOOD MEDICAL CENTRE busy family practice and walk-in cli...

    Calgary, AB
    more than 2 months ago
  •  ...story takes off. Overview of the role: The Senior Developer, AI / ML is accountable for designing, building, testing, deploying...  ...solutions throughout their lifecycle, including experimentation, evaluation, updates, scaling, retraining, maintenance, recovery and retirement... 
    Remplacement
    Permanent employment
    Full time
    Internship
    Flexible hours

    WestJet

    Calgary, AB
    10 hours ago
  • $39 - $52 per hour

     ...Medical Radiation Technologist TAPP Workforce Solutions is seeking, on behalf of our client, X-ray Technologists / Combined Laboratory...  ...factors to obtain accurate diagnostic images Assist physicians with interventional procedures by preparing the fluoroscopic suite... 
    Medical
    Hourly pay
    Permanent employment
    Full time
    Work at office
    Trial period
    Relocation package
    Calgary, AB
    25 days ago
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will...  ...Familiarity with AI observability, monitoring, telemetry, and evaluation platforms. Strong knowledge of software engineering best practices... 
    Internship
    Remote work
    Relocation

    Miratech

    Calgary, AB
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Physician (MD/DO) - Medical AI Evaluation. Be the first to apply!