Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

STEM PhD Expert for AI Reasoning & Evaluation

$50 - $150 per hour
Temporary

Braintrust

  • Rate: $50 – $150/hr
  • Hours: 35 hours / week
  • Experience: 3 - 5 years
  • Location: United States | Canada + 6 more

We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic expertise directly shapes how cutting-edge models reason, answer, and improve. You'll review AI-generated content in your field, identify where the model gets things right or wrong, and help raise the quality bar on technical reasoning.

This is a short-term engagement running through the end of June, with potential to extend depending on project needs.

Key Responsibilities

You may contribute your expertise by:

  • Assessing the factuality and relevance of domain-specific text produced by AI models
  • Crafting and answering questions related to Machine Learning and AI
  • Evaluating and ranking domain-specific responses generated by AI models

What We're Looking For

  • A PhD (completed or in final stages) in one of the following fields: Machine Learning / AI, Computer Science, Engineering, Statistics, or a closely related quantitative subdomain such as Mathematics or Physics
  • Strong analytical and critical-thinking skills, with the ability to spot subtle errors in technical reasoning
  • Fluent written English and the ability to communicate complex ideas clearly

Nice to Have

  • Research experience (academic or industry)
  • Prior experience with data annotation or AI model evaluation
  • Experience reviewing or publishing research papers

Compensation

Up to $150/hr , depending on your area of expertise, depth of experience, and assessment performance.

Location

This role is fully remote. We are currently accepting applicants based in:

United States, Canada, Puerto Rico, Mexico, United Kingdom, Australia, New Zealand, and Argentina.

Company: Outlier

Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the STEM PhD Expert for AI Reasoning & Evaluation in Remote vacancy
  • $30 - $90 per hour

     ...re looking for detail-oriented reviewers with strong STEM backgrounds to support quality control on AI reasoning datasets. This role requires professional fluency in...  ...coordination Requirements Master's or PhD in a STEM field (Science, Technology, Engineering, or... 
    For phd
    Contract work
    Remote work
    10 hours per week
    Flexible hours

    Braintrust

    Remote
    12 days ago
  •  ...Create and evaluate board game tasks to enhance AI reasoning skills. About Turing Turing is one of the world’s fastest-growing AI companies, accelerating...  ...Role Overview We are seeking Board Game Reasoning Experts to help train and evaluate next-generation AI models.... 
    Suggested
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    12 days ago
  • $55 - $100 per hour

     ...Pay: $55–100/hour You'll evaluate AI-generated responses to legal questions — covering case...  ...a model's answer reflects sound legal reasoning, accurate doctrinal knowledge, and appropriate...  ...anything that could mislead a non-expert relying on the output. Day-to-day work... 
    Suggested
    Contract work

    Claru

    Remote
    8 days ago
  •  ...your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging...  ...of expertise Assess AI-generated reasoning for technical accuracy and identify subtle...  ...For Master's degree required; PhD strongly preferred in Physics, Chemistry... 
    For phd
    Contract work
    Immediate start
    Remote work
    Flexible hours

    Rise Data Labs

    Remote
    12 days ago
  • $80 - $150 per hour

     ...Biology About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real... 
    Suggested
    Part time
    For contractors
    Immediate start
    Remote work
    Flexible hours

    micro1

    Remote
    12 days ago
  •  ...TELUS Digital is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for university students,...  ...Learning AI/ML concepts and technical outputs Model reasoning and performance Data and technical accuracy... 
    Part time

    TELUS International

    Remote
    13 days ago
  •  ...future of software development. As a expert in our Core Engineering & AI Development Community , you are the...  ...Responsibilities): Algorithmic Reasoning Validation: Audit and refine "Chain...  ...Code Quality & Security Auditing: Evaluate AI-generated code for security vulnerabilities... 
    Part time

    TELUS International

    Remote
    13 days ago
  • $50 - $150 per hour

     .../ week Experience: 3 - 5 years Location: United States | Canada + 6 more We're hiring PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial and quantitative reasoning. This is remote, flexible contract work where your... 
    For phd
    Contract work
    Temporary work
    Internship
    Remote work
    Flexible hours

    Braintrust

    Remote
    12 days ago
  •  ...About the Role: Do you have a background in Physics or Mechanical Engineering ? AI models are getting smarter, but they often struggle with "common sense" physics—like how gravity works, how objects move, or how much force is needed to lift something. At TELUS Digital... 
    Part time

    TELUS International

    Remote
    13 days ago
  •  ...Join a leading AI lab's cutting-edge GenAI team to be at the core...  ...a senior finance domain expert to work directly with a leading...  ...improving how frontier AI models reason about real financial work....  ...challenging finance tasks and evaluation sets, and help build finance-specific... 
    For phd
    Full time
    Contract work
    Part time
    Freelance
    Live In
    Manual labor
    Relocation
    Relocation package

    Mercor

    Remote
    12 days ago
  •  ...and solve complex Physics problems for evaluating language models. About Turing: Based...  ...research accelerator for frontier AI labs and a trusted partner for global enterprises...  ...researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and... 
    For phd
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    12 days ago
  •  ...Computational Fluency About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real... 
    For phd
    Part time
    For contractors
    Internship
    Remote work
    Worldwide
    Flexible hours
    Weekend work

    micro1

    Remote
    12 days ago
  •  ...ll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic...  ...evaluate AI-generated work for accuracy, reasoning, completeness, and professional quality...  ...training will be provided to selected experts. Who You Are We're looking for... 
    Contract work

    Rise Data Labs

    Remote
    12 days ago
  •  ...Design and build AI workflows for advanced mathematical reasoning tasks. Turing is seeking a Senior AI Systems Engineer with deep expertise...  ...architectural frameworks, tooling, and memory systems for STEM-focused AI agents. Evaluate and iterate on agent performance, ensuring high... 
    Contract work
    Part time
    For contractors
    Freelance

    Turing

    Remote
    12 days ago
  •  ...leading research accelerator for frontier AI labs and a trusted partner for global enterprises...  ...AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and...  ...Chemistry, comparable to the level required for PhD-level programs. You should be able to... 
    For phd
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    12 days ago
  •  ...Mercor is seeking Clinical Mental Health Experts to support an AI research initiative focused on evaluating the realism and quality of simulated clinical conversations...  ...without regard to legally protected characteristics and provide reasonable accommodations upon request.... 
    Temporary work
    Part time
    Remote work

    Mercor

    Remote
    12 days ago
  •  ...world tasks that test how well AI agents handle database engineering...  ...regressions where relevant. Evaluate performance measures such as...  ...experience, or a database-systems PhD. Deep experience with...  ...task after selection Selected experts will complete one task, with approximately... 
    For phd
    Contract work
    Immediate start

    Mercor

    Remote
    9 days ago
  •  ...Design tests to evaluate AI safety and identify model failures. About Turing: Based in San Francisco, California, Turing is the...  ...pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying... 
    Ongoing contract
    Part time
    For contractors

    Turing

    Remote
    12 days ago
  •  ...Radiological Science · Health Physics · AI Safety · CBRN What this pays...  ...About the Role AI Safety Evaluation Project | Remote | Contract...  ...Master's degree in a relevant STEM or technical field. Strong...  ...Tier 2 - Senior SMEs and Auditors PhD or equivalent advanced industry... 
    For phd
    Hourly pay
    Contract work
    For contractors
    Remote work

    Pasiflora AI

    Remote
    7 days ago
  •  ...identification About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real... 
    For phd
    Part time
    For contractors
    Remote work
    Flexible hours
    Weekend work

    micro1

    Remote
    12 days ago
  •  ...Key Responsibilities Train and improve AI models through comprehensive data annotation and labeling. Review and validate AI-generated...  .... Provide domain expertise to enhance AI model performance in STEM-related projects. Collaborate with cross-functional teams on... 
    Hourly pay
    Contract work
    Remote work
    Flexible hours

    Rise Data Labs

    Remote
    12 days ago
  •  ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios...  ...findings and recommendations Ideal Candidate: • PhD or Masters in Computer Science, ML, or related field • 5+ years... 
    For phd
    Contract work

    Rise Data Labs

    Remote
    12 days ago
  •  ...Job Application for STEM Specialist (Fluent in French) - Freelance AI Trainer Project at Meridial Back to jobs...  ...Luxembourg Are you a computer science expert fluent in French, eager to shape...  ...optimization, model training and evaluation, network protocols, distributed systems... 
    For phd
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Immediate start
    Remote work

    Invisible Technologies

    Remote
    12 days ago
  •  ...Job Application for Geospatial Reasoning Specialist (Senior) - Freelance AI Trainer Project at Meridial Back to...  ...expertise will guide model development and evaluation, laying the foundation for future...  ...applications. We’re looking for experts with deep experience in geospatial... 
    Hourly pay
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Invisible Technologies

    Remote
    12 days ago
  •  ...Review real user interaction traces with an AI shopping assistant Identify logical...  ...response quality Commit to 20+ hours per week of evaluation work on our internal platform Who...  ...rendered. We are unable to support H1-B or STEM OPT candidates at this time. Pay: $30... 
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    12 days ago
  •  ...and develop systems to enhance frontier AI capabilities. About Turing: Based in...  ...AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents...  ...labs and enterprises. Our environments evaluate and improve AI models on complex, long-range... 
    For phd
    Contract work
    Part time
    For contractors

    Turing

    Remote
    12 days ago
  •  ...numerics About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter knowledge across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real... 
    For phd
    Part time
    For contractors
    Remote work
    Flexible hours
    Weekend work

    micro1

    Remote
    12 days ago
  •  ...leading research accelerator for frontier AI labs and a trusted partner for global...  ...AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents...  ...are seeking Life Sciences Subject Matter Experts to design advanced scientific-reasoning tasks... 
    Contract work
    Part time
    For contractors
    Freelance
    Remote work
    Flexible hours

    Turing

    Remote
    6 days ago
  • $40 per hour

     ...All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr...  ...generated responses, sharing your honest preferences and reasoning Provide clear written feedback that helps AI... 
    Part time
    Remote work
    Flexible hours

    Handshake

    Remote
    1 day ago
  • usd16 per hour

     ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type...  ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality... 
    Hourly pay
    Daily paid
    Full time
    Freelance
    Immediate start
    Remote work
    Flexible hours

    Rws

    Remote
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to STEM PhD Expert for AI Reasoning & Evaluation. Be the first to apply!