Radiology Residents: Medical Image Evaluation for AI Benchmarks
Temporary
Terac
What You'll Do
Review de-identified medical images and patient clinical cases Provide structured expert reads for assigned clinical scenarios Complete standardized scoring rubrics to benchmark diagnostic findings Articulate diagnostic reasoning and clinical confidence levels clearly
Who Should Apply
Current radiology resident or fellow Comfortable interpreting complex medical images and clinical case notes Familiar with standard diagnostic reporting formats and medical terminology Able to complete detailed analytical tasks independently in a remote setting
Contract & Payment Terms
You will be engaged as an independent contractor. This is a fully remote opportunity that can be completed on your own schedule. Opportunities can be extended, shortened, or concluded early depending on needs and performance. Your participation will not involve access to confidential or proprietary information from any employer, client, or institution. Payments are processed weekly based on services rendered. We are unable to support H1-B or STEM OPT candidates at this time.
Pay: $105
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Radiology Residents: Medical Image Evaluation for AI Benchmarks in Remote vacancy
- ...You'll Do Review and analyze de-identified medical images Provide expert diagnostic reads for complex clinical... ...Complete structured scoring rubrics for each evaluation Establish reference evaluations for diagnostic benchmarks Who Should Apply Currently enrolled in a...ResidentMedicalContract workFor contractorsRemote work
- ...What You'll Do Evaluate de-identified medical images across multiple modalities Provide expert diagnostic reads and clinical interpretations Apply... ...Document findings to serve as reference evaluations for benchmarks Who Should Apply Practicing radiologist or specialized...MedicalContract workFor contractorsRemote work
$210 per day
...What You'll Do Review de-identified medical images across various clinical modalities Provide expert clinical... ...rubrics based on your findings Establish reference evaluations to serve as ground truth for algorithmic benchmarks Who Should Apply Active practice as a...MedicalContract workFor contractorsRemote work- ...Type: Independent contractor Remote · Contract · Radiological Science · Health Physics · AI Safety · CBRN What this pays Rates are set by the... ...we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK,...SuggestedHourly payContract workFor contractorsRemote work
$70 per hour
...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. Participation... ...clinical EHR vignettes for a medical AI evaluation program. General... ...clinical reasoning quality of benchmark items: vignette accuracy and...MedicalHourly payPermanent employmentPart time10 hours per week- ...Key Responsibilities Train and improve AI models through meticulous data... ...reliability. Provide domain expertise in radiological health to enhance AI model performance.... ...Bachelor's degree in Radiological Health, Medical Imaging, or a related field. Strong understanding...MedicalHourly payContract work
$1 350 per unit
...+ 23 more Bring your expertise to the problems today’s most advanced AI agents still struggle to solve. We’re looking for experienced professionals to develop challenging tasks for an AI benchmark. You’ll draw on problems from your own field and turn them into clearly...Contract work$85 per hour
...What You'll Do Review pairs of images presented on our digital platform. Evaluate each image against a specific set of brand guidelines. Select the most... ...written brand guidelines Ability to make clear, decisive evaluations between similar visual assets Access to a reliable...Ongoing contractContract workFor contractorsRemote work- ...Research and build benchmark tasks to expose AI model weaknesses. About Turing: Based in San Francisco, California, Turing is the world’s... ...and reasoning paths. Your work will directly shape AI evaluation frameworks, ensuring next-generation frontier models are tested...Part timeFor contractorsLocal area
- ...identified clinical cases and pharmaceutical product images. Develop scoring rubrics based on standard clinical practices. Provide written expert evaluations to serve as reference benchmarks. Assess the accuracy of various medical data interpretations. Who Should Apply...MedicalContract workFor contractorsRemote work
$55 - $100 per hour
...take 30–45 minutes per volume. Skills & requirements DICOM image handling Segmentation mask drawing Anatomical structure recognition... ...ITK-SNAP or OHIF Viewer Attention to fine boundary detail Medical annotation guideline compliance Category: Vision Annotation...MedicalContract work- ...This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Canada. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and...Full timeRemote work
- ...Design evaluation methods to enhance AI clinical reasoning in real scenarios. About Us Based in San Francisco, California, Turing is the world... ...design evaluation methods that test AI performance on real medical problems where clinical expertise makes the difference....ResidentMedicalPart timeRemote workFlexible hours
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About... ...Description: This project supports the evaluation and improvement of safety behavior in large... ...centers on evaluating single-turn image edit requests against detailed safety guidelines...Ongoing contractPart timeFor contractors
$13 per hour
...Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from... ...guidelines for consistent, confidential evaluation work. Important account-access... ...What we’re looking for • Currently resident in Canada. • Bachelor’s degree or equivalent...ResidentHourly payContract workFor contractorsRemote work- © 2026 Smart Ecosystems. All rights reserved.Contract work
- ...'ll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your... ...complex scientific work Prior AI training, evaluation, benchmarking, or LLM experience is a plus Flexible, remote contract...Contract workImmediate startRemote workFlexible hours
- ...the intersection of human creativity and AI. We partner with leading AI labs and product... ...through. What You May Work On Evaluate AI-generated visual outputs across a wide... ...aesthetic quality Help define creative benchmarks and taste standards for what visually compelling...Full timeContract work
usd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type... ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours- ...photography, composition, lighting, and visual quality. # Skills evaluation - You’ll complete a structured photography submission designed... ..., and everyday objects Deliver organized, clearly labeled image files on time and to spec Maintain consistent quality across...Full timeContract work
- ...About the Role Join our global AI Community as a Bioinformatics AI Expert specializing in advanced benchmark dataset creation and AI model evaluation. In this role, you will design complex, reasoning-intensive, "information-reversal" evaluation tasks to measure the...Part time
- ...Join a leading AI lab's cutting-edge GenAI team to be at the core... ..." looks like, and build the benchmarks that show whether the model is... ...challenging finance tasks and evaluation sets, and help build finance-specific... ...health decisions, or related medical conditions), sexual...MedicalFull timeContract workPart timeFreelanceLive InManual laborRelocationRelocation package
- ...Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students,... ...scenarios Responsible AI behaviour Domain-Specific AI Evaluation Healthcare & Medicine Law Finance, Economics &...Part time
- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Contract work
$40 per hour
...review your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible...Part timeRemote workFlexible hours$90 per hour
...SME Careers is assembling a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each... ...you apply This role is open only to citizens or residents of the US, UK, Canada, Australia, New Zealand and the European...ResidentContract work$55 - $100 per hour
...Pay: $55–100/hour You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural questions, and litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate...Contract work$75 - $90 per hour
...States | Canada + 21 more Help a top AI lab evaluate and improve large language models... ...coding prompts and reference answers for benchmark-style problems. Evaluate model outputs... ...Build or configure coding environments for evaluation and reinforcement learning. Follow...Long term contractContract workRemote work- ...the intersection of human creativity and AI. We partner with leading AI labs and product... ...through. What You May Work On Evaluate AI-generated advertisements and marketing... ...overall creative effectiveness. Help define benchmarks for what makes advertising creative...Full timeContract work
- ...What You'll Do Evaluate pairs of photographs to determine which best meets specific quality standards Assess various images for strict adherence to provided brand guidelines Complete a remote calibration task to demonstrate your visual assessment skills Participate in a...Contract workFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Radiology Residents: Medical Image Evaluation for AI Benchmarks. Be the first to apply!
