Radiologist AI Safety Evaluator
AfterQuery Experts
Apply radiology expertise to AI safety evaluation remotely and asynchronously, creating prompts that test boundaries between safe and unsafe requests.
AfterQuery hires radiology and radiation sciences experts as contractors supporting expert evaluation data for frontier AI labs. You will author scenarios, assess other experts’ prompts, and explain judgments through domain analysis. The work focuses on making AI models safer in radiology and related fields.
Key Responsibilities:
- Author prompts probing safe and unsafe request boundaries
- Review and classify prompts from other experts
- Explain why prompts are acceptable or cross a line
- Revise work using structured reviewer feedback
Requirements:
- Master’s degree or higher in a relevant discipline
- Radiology, medical physics, radiation science, or related background
- Citizen of the United States, United Kingdom, Canada, Australia, or New Zealand
- Physically located in a Five Eyes country while working
- Board certification or radiation-source experience is a plus
Use radiology knowledge, prompt evaluation, and domain analysis to help AfterQuery improve safer AI models.
#J-18808-LjbffrVacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Radiologist AI Safety Evaluator in Montréal, QC vacancy
- ...Apply nuclear engineering expertise to AI safety evaluation remotely, reviewing model responses and identifying dual-use risks across eligible locations. This contract project seeks scientific and technical professionals for nuclear-related AI content evaluation. Tier 1 annotators...SuggestedContract workRemote work
Pasiflora AI
Montréal, QC22 hours ago - ...AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe, and Australia We are seeking qualified scientific and technical professionals to support an AI safety evaluation project focused on nuclear-related content. The work involves reviewing...SuggestedContract workRemote work
Pasiflora AI
Montréal, QC22 hours ago - ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...SuggestedPart timeFor contractorsRemote workFlexible hours
$150 per hour
...AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We are hiring radiology and radiation sciences experts as contractors to help make AI models safer in their domain. What You Will Actually Do Author prompts and scenarios...SuggestedContract workFor contractorsRemote workAfterQuery Experts
Montréal, QC9 hours ago$125 per hour
...DataAnnotation is seeking an experienced Radiologist to help train AI models by evaluating how frontier models interpret medical images, with reads, impressions and rationale shaping future versions. Open to radiologists and imaging technologists; you will review de-identified...SuggestedRemote workFlexible hoursDataAnnotation
Montréal, QC22 hours ago$125 per hour
...We’re looking for an experienced Radiologist to help train AI models. You’ll measure how well frontier models interpret medical images, check their reasoning, and help raise the quality of each new version. This is a new and growing area: teaching AI to read diagnostic images...Full timeRemote workFlexible hoursDataAnnotation
Montréal, QC22 hours ago- Elevate AI in medicine as a Radiologist Trainer at DataAnnotation. Help teach AI systems to interpret diagnostic images, ensuring high-quality outputs and accuracy in medical assessments. DataAnnotation seeks an experienced Radiologist to review medical imaging studies and...
DataAnnotation
Montréal, QC22 hours ago - ...leader in the development and certification of safety-critical systems in the aerospace,... ...with expertise in Artificial Intelligence (AI), Large Language Models (LLMs), and software... ...tools, including Jira, Jama, and Polarion. Evaluate the accuracy and coverage of automated...Permanent employmentFull timeContract workFlexible hours
$70k - $90k per year
...expertise ~ Engineer Tasks Conduct studies to determine optimum inventory levels and utilization of machinery and resources Evaluate or assess industrial facilities to ensure that all opportunities for improvement have been explored Find ways to eliminate...Permanent employmentFull timeFor contractorsWork from homeRelocationGroupe Sector Canada Incorporation
Montréal, QC6 days ago- ...developers and enterprises who are building AI systems to power magical experiences like... ...?As a Member of Technical Staff in the Safety for Agents team, you will make a meaningful... ...generation, post-training algorithms, and evaluation methods to ensure Safety in the next generation...Full timeWork at officeRemote workFlexible hours
- ...Description The Senior Manager, Safety Management System & Safety Culture serves... ...activities including safety audits, assessments, evaluations, inspections, and effectiveness reviews... ...As part of our process, we may use AI‑supported tools to help review applications...Long term contractWorldwide
- ...leur conception ( safe-by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le départ pour être à la fois... ...les modèles de langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante chaque affirmation concernant...ApprenticeshipWork at officeFlexible hoursDay shift
- ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation... ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between...Daily paidFull timeTemporary workWork at officeRemote work
- ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers...Work at officeFlexible hours
- ...Description CS Group Canada, a subsidiary of CS Group (part of the Sopra Steria Group), is a leader in the development and certification of safety-critical systems in the aerospace, electric, and autonomous driving industries. Joining CS Group Canada means taking part in complex,...Permanent employmentFull timeRelocationFlexible hours
- ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes...Permanent employmentApprenticeshipWork at office
- ...who we are by visiting Context Reporting to the Health and Safety Manager, the coordinator oversees the implementation and... ...the merits and abilities of candidates and personnel. We use AI-enabled tools in our recruitment platform (iCIMS) for tasks like resume...For contractorsImmediate start
- ...Description École de technologie supérieure – ETS Conseillère ou Conseiller en gestion et en évaluation de programmes d’études NUMÉRO D'AFFICHAGE: 26-27/176 CATÉGORIE D'EMPLOI: Professionnel STATUT D'EMPLOI: Remplacement- 12 mois avec possibilité de prolongation...Daily paidRemplacementMonday to friday
$23 - $28 per hour
...Compensation: $23.00–$28.00 per hour, based on experience Position Overview We are seeking a detail-oriented and proactive Safety & Compliance Officer to support our growing operations. This position will play an important role in maintaining workplace safety standards...Hourly payFull timeWork at office$180k - $230k per year
...better enabling teams to deliver complex capital projects. The AI buildout runs on physical things: data centers, power, and the... ...timeline amelioration for major projects. ~ Continuous improvement: Evaluate models repeatedly and prototype methods and new models to improve...Full timeFor contractorsInternshipWork at office- ...Description CS Group Canada, a subsidiary of CS Group (part of the Sopra Steria Group), is a leader in the development and certification of safety-critical systems in the aerospace, electric, and autonomous driving industries. Joining CS Group Canada means taking part in complex,...Permanent employmentFull timeFlexible hours
- ...Job Description Overview Join AtkinsRéalis as a Manager, Fire Safety & Protection Engineering and play a key leadership role in the growth and delivery of fire protection and life safety projects across Eastern Canada. In this strategic position, you will lead a growing...Long term contractFull timeInternshipWork at officeFlexible hours
- ...consiste principalement à prendre des décisions judicieuses en tirant parti d’informations exactes. En tant que membre de l’équipe Évaluation, voilà ce que vous contribuerez à rendre possible. Vous serez un membre important de notre équipe diversifiée et hautement expérimentée...Daily paidWeekend work
$131.7k - $278.1k per year
...deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around... ..., policy-based routing, tool invocation, evaluation harnesses, and lifecycle observability.... ...metrics to measure agent accuracy, latency, safety, and cost effectiveness Process large-...Full timeWork at officeLocal area3 days per week- ...sécurité des personnes de calibre mondial, permettant d’identifier, d’évaluer et d’atténuer les risques à travers toutes les installations et... ...is a global leader in physical security, but our commitment to safety starts at home. We are looking for a visionary Manager of Global...Full timeWork from homeWorldwideFlexible hours
$69.45k - $119.45k per year
...reinvent their business with Data & Advanced AI — backed by a $3B investment and... ...knowledge integration, workflow automation, evaluation, observability and AI Ops. You will integrate... ...performance, accuracy, alignment, reliability, safety and business relevance. Develop and...Full timeManual laborWork at officeLocal area- ...efficient and enjoyable world. Role overview As an Applied AI Scientist, you design, build, and ship AI solutions that solve real... ...) Turn experiments into production-ready components (evaluation, monitoring, iteration) Coach colleagues on applied AI best practices...Work at officeFlexible hours
- ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
$114.75k - $162k per year
...into reliable foundations for AI-enabled applications. As part... ...structure, contextualize, govern, and evaluate content from multiple sources,... ..., RAG, and datasets used for evaluation. The ability to collaborate... ...our commitment to ethics, safety, sustainability, quality and...Full timeTemporary workDirect hireFlexible hours- ...Responsibilities: Design, develop, and deploy autonomous and semi autonomous AI agents to automate complex tasks across the software development... ...of AI agents in production (monitoring, tracing, output evaluation). Actively monitor technological developments in LLMs, agent...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Radiologist AI Safety Evaluator. Be the first to apply!
Related searches
- évaluateur-estimateur Montréal, QC
- admissions evaluator Montréal, QC
- remote social media evaluator Montréal, QC
- estimateur en bâtiment Montréal, QC
- estimateur - dessinateur Montréal, QC
- estimateur industriel Montréal, QC
- chargé de projet estimateur Montréal, QC
- test evaluator Montréal, QC
- estimateur structure Montréal, QC
- estimateur automobile Montréal, QC