Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Medical AI Evaluation Physician

Mindrift

Evaluate medical AI through clinical reasoning and EHR vignette review, contributing remotely from anywhere outside the United States. Choose your schedule around clinical practice.

Mindrift seeks actively practicing, US-licensed MDs or DOs living outside the US for a project-based evaluation project. Reviewers assess diagnosis and treatment items across multiple body systems, checking accuracy, answer quality, and reasoning. General and internal medicine are the main focus.

Key Responsibilities:

  • Evaluate clinical EHR vignettes with proposed and trap answers
  • Score vignette accuracy, completeness, answer correctness, and trap quality
  • Check reasoning chains against facts presented in each vignette
  • Write short rationales supporting clinical evaluation decisions
  • Complete independent blind reads and physician adjudication

Requirements:

  • Medical degree and active, unrestricted US medical license
  • Recent direct patient care; attending-level experience preferred
  • Board certification or completed residency training
  • Broad diagnostic and treatment experience across multiple systems
  • Strong clinical reasoning and written English at C1+ level

Apply your diagnostic expertise, evidence-based reasoning, and physician judgment to improve medical AI systems through flexible evaluation work.

#J-18808-Ljbffr
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Medical AI Evaluation Physician in Montréal, QC vacancy
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...~ Remote: open to US-licensed physicians based in eligible US states...  ...with an active, unrestricted US medical license to evaluate clinical EHR... 
    Medical
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Montréal, QC
    5 hours ago
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...~ Remote: open to US-licensed physicians based in eligible US states...  ...with an active, unrestricted US medical license to evaluate clinical EHR... 
    Medical
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Montréal, QC
    3 days ago
  • $100 per hour

     ...reviewers are license-verified physicians ~$50 one-time onboarding...  ...specialists with project-based AI opportunities for leading tech...  ...companies, focused on testing, evaluating, and improving AI systems....  ...with an active, unrestricted US medical license, to evaluate clinical... 
    Medical
    Price work
    10 hours per week
    Flexible hours

    Mindrift

    Montréal, QC
    5 hours ago
  •  ...Evaluate clinical EHR vignettes for Mindrift’s medical AI project using strong diagnostic reasoning and evidence-based treatment knowledge. Contribute remotely...  ...This project suits actively practicing, US-licensed physicians living outside the United States. You will review diagnosis... 
    Medical
    Remote work

    Mindrift

    Montréal, QC
    5 hours ago
  •  ...Shape Generative AI for medical research as a physician-researcher with clinical research and evidence synthesis expertise. Work flexibly through asynchronous...  ...workflows, publication standards, and scientific evaluation. Key Responsibilities: Guide product and workflow... 
    Medical
    Freelance

    Cactus Communications Pvt. Ltd.

    Montréal, QC
    5 hours ago
  •  ...Description RESPONSIBILITIES Per Diem Case Coverage Consultation with Physicians and Institutions: Cover Men's Health surgical procedures as...  ...Bachleor’s Degree, RN, Physician Assistant or Certified Medical Technician Two years of medical device or Operating Room experience... 
    Medical
    Daily paid
    Relief
    Flexible hours

    ConsignMed Inc.

    Montréal, QC
    19 days ago
  •  ..., ensuring high-quality deliverables meet deadlines. ~ Generative AI Integration: Utilize Gen AI platforms and tools where applicable...  ...channels. Here’s What You’ll Need: Minimum of 3 years of medical copy development expertise, with success in crafting persuasive content... 
    Medical
    Hourly pay
    Full time
    Manual labor
    Work at office
    Local area

    Accenture Global

    Montréal, QC
    1 day ago
  • Job Responsibility: Summary Medical Education Manager - Cardio-renal-metabolic (CRM) Location: Montreal, Toronto, #LI-Hybrid Novartis is...  ...Work with Medical Experts (ME) and accrediting bodies to 1) evaluate medical education needs, 2) develop accredited and non-accredited... 
    Medical
    Permanent employment
    Full time
    Local area
    Relocation package
    Shift work

    Novartis

    Montréal, QC
    3 days ago
  • $30 per hour

     ..................................................... Position: Medical Secretary Location: Ville Saint-Laurent - hybrid Salary: $30 per...  ...team, and hiring decisions are made by people. We may also use AI-enabled tools to support parts of the application review process.... 
    Medical
    Hourly pay
    Permanent employment
    Contract work
    Temporary work
    Work at office
    Monday to friday

    Services de Gestion Quantum Ltée

    Montréal, QC
    4 days ago
  •  ...Staffmax is helping our healthcare client hire a compassionate and organized Medical Receptionist for a 4-month contract. In this role, you’ll be the first point of contact for patients and play a crucial part in maintaining a smooth, professional medical office environment... 
    Medical
    Contract work
    Temporary work
    Work at office

    Staffmax Staffing & Recruiting

    Montréal, QC
    3 days ago
  • $25 - $36 per hour

    Overview Languages Bilingual Education ~ College/CEGEP Experience Experience an asset On site Work must be completed at the physical location. There is no option to work remotely. Work setting ~ Dental practice Additional information...
    Medical
    Permanent employment
    Full time
    Remote work

    CENTRE DENTAIRE PEDIATRIQUE ET PROSTHODONTIQUE DE MONTREAL I...

    Montréal, QC
    2 days ago
  • $25 - $36 per hour

    Education: Expérience: Education College/CEGEP Work setting ~ Dental practice Work conditions and physical capabilities ~ Attention to detail Personal suitability Accurate Efficient interpersonal skills Organized Reliability Team player...
    Medical
    Permanent employment

    CENTRE DENTAIRE PEDIATRIQUE ET PROSTHODONTIQUE DE MONTREAL I...

    Montréal, QC
    2 days ago
  •  ...solutions that solve serious health issues today and address the medical challenges of tomorrow. We strive to have a remarkable impact on...  ...strong collaborative relationships with key opinion leaders, physicians, and other health care decision makers. Essential Skills & Abilities... 
    Medical
    Full time
    Work at office

    AbbVie

    Montréal, QC
    5 hours ago
  • LANGUAGE : French US-Based Interpreter As a remote interpreter, you play a significant role in facilitating communication between French and English speakers. The interpreter needs to be able to process information quickly and with accuracy in a professional manner. It ...
    Medical
    Remote work
    Work from home
    Home office

    GLS

    Montréal, QC
    1 day ago
  •  ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers... 
    Work at office
    Flexible hours

    Totem recruteur de talent

    Montréal, QC
    4 days ago
  •  ...employee retention rate. We support the pharmaceutical, biotech, and medical device industries with our proven, scientific approach to...  ...Under minimal supervision, the Medical Writer will critically evaluate, analyze, and interpret the medical literature to select primary... 
    Medical
    Remote job
    Full time

    MMS

    Montréal, QC
    7 days ago
  •  ...leur conception ( safe-by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le départ pour être à la fois...  ...les modèles de langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante chaque affirmation concernant... 
    Apprenticeship
    Work at office
    Flexible hours
    Day shift

    LoiZéro

    Montréal, QC
    a month ago
  •  ...Johnson & Johnson seeks an Associate Director of Field Medical for Hematology to lead and develop a team of Medical Science Liaisons across Canada. This role develops field medical strategy, oversees MSL team performance, and ensures scientific excellence while maintaining... 
    Medical
    Local area

    Johnson & Johnson

    Montréal, QC
    5 days ago
  •  ...AbbVie seeks a Pipeline Medical Science Liaison for its Dermatology team, based in Ontario or Quebec. The role involves building relationships with external experts, supporting clinical trials (phases 1–3), and delivering scientific information to stakeholders across Canada... 
    Medical

    AbbVie

    Montréal, QC
    10 days ago
  • $180k - $230k per year

     ...better enabling teams to deliver complex capital projects.  The AI buildout runs on physical things: data centers, power, and the...  ...timeline amelioration for major projects.  ~ Continuous improvement: Evaluate models repeatedly and prototype methods and new models to improve... 
    Full time
    For contractors
    Internship
    Work at office

    Foresight Works Ltd

    Montréal, QC
    5 hours ago
  •  ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation...  ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between... 
    Daily paid
    Full time
    Temporary work
    Work at office
    Remote work

    JLL

    Montréal, QC
    3 hours ago
  • $140k - $160k per year

     ...Artefact is a next-generation data and AI consulting firm dedicated to accelerating the...  ...behavior. Set SMART objectives, run proper evaluations, and keep the team engaged. Coach...  ...competitive benefits package that includes medical, dental, and vision coverage, a 401(k) plan... 
    Full time

    Artefact

    Montréal, QC
    5 hours ago
  •  ...Artefact is a next-generation data and AI consulting firm dedicated to accelerating the...  ...it, the RAG pipeline feeding it, and the evaluations proving it works. This role combines breadth...  ...benefits package that includes medical, dental, and vision coverage, a 401(k) plan... 
    Full time

    Artefact

    Montréal, QC
    5 hours ago
  •  ...job Artefact is a next-generation data and AI consulting firm dedicated to accelerating...  ...engagement; fine-tuning experiments and LLM evaluation on the next. You will own your models: the...  ...benefits package that includes medical, dental, and vision coverage, a 401(k) plan... 
    Full time

    Artefact

    Montréal, QC
    5 hours ago
  •  ...Career Land Center is hiring for a Medical-Surgical Registered Nurse for an inpatient medical center in Denver, CO. You will provide direct care to adult patients on a medical-surgical unit, with varied medical and post-surgical needs. Your duties include assessment,... 
    Medical
    Full time
    EB3
    Relocation package

    Career Land Center, LLC

    Montréal, QC
    a month ago
  •  ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes... 
    Permanent employment
    Apprenticeship
    Work at office

    Veriforce

    Montréal, QC
    8 days ago
  •  ...tirant parti d’informations exactes. En tant que membre de l’équipe Évaluation, voilà ce que vous contribuerez à rendre possible. Vous serez...  ..., une couverture complète de soins médicaux, de médicaments d’ordonnance et de soins dentaires, un régime de retraite à cotisations... 
    Daily paid
    Weekend work

    Ernst & Young

    Montréal, QC
    3 days ago
  •  ...Conseiller en gestion de programmes au sein du Décanat des études de l’ÉTS? Vous soutiendrez le doyen des études dans la création, l’évaluation et l’amélioration continue des programmes d’études, en accompagnant les directions des départements, les directions de programmes,... 
    Daily paid
    Full time
    Temporary work

    École de technologie supérieure (ÉTS)

    Montréal, QC
    3 days ago
  • $114.75k - $162k per year

     ...into reliable foundations for AI-enabled applications. As part...  ...structure, contextualize, govern, and evaluate content from multiple sources,...  ..., RAG, and datasets used for evaluation. The ability to collaborate...  ...for health, inclusive of medical, dental, vision, basic life,... 
    Medical
    Full time
    Temporary work
    Direct hire
    Flexible hours

    Schneider Electric

    Montréal, QC
    5 hours ago
  • $114.75k - $162k per year

     ...foundations required to bring AI solutions into production reliably...  ...governance needed to develop, evaluate, release, deploy, and operate...  ...for model development, evaluation, packaging, release, and deployment...  ...for health, inclusive of medical, dental, vision, basic life, accident... 
    Medical
    Full time
    Temporary work
    Direct hire
    Flexible hours

    Schneider Electric

    Montréal, QC
    5 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Medical AI Evaluation Physician. Be the first to apply!