Inscrivez-vous pour accéder à toutes les fonctionnalités de notre service.
  • Recherche d'offres d'emploi
  • Favoris
  • Créer un CV
    Nouveau
  • Salaires
  • Souscriptions

Chemistry PhD LLM Evaluation Specialist

$73 par heure
Temps plein

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Chemistry AI Evaluator

Type: Contract

Compensation: $73/hour

Location: Remote

Role Responsibilities

  • Write and refine prompts to guide model behavior in chemistry contexts.
  • Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and mechanistic correctness.
  • Conduct fact-checking using authoritative public sources and domain knowledge.
  • Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
  • Assess clarity, structure, and appropriateness of explanations for different audiences.
  • Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.

Qualifications

Must-Have

  • PhD in Chemistry or a closely related field
  • Deep expertise in Organic & Biological Chemistry , Inorganic & Materials Chemistry , Physical & Theoretical Chemistry , or Analytical & Instrumental Chemistry
  • Significant experience using large language models (LLMs)
  • Excellent writing skills and ability to clearly explain complex chemistry concepts
  • Strong attention to detail
  • Experience reviewing or editing technical or academic writing

Preferred

  • Prior experience with RLHF , model evaluation, or data annotation work
  • Experience teaching, mentoring, or explaining chemistry concepts to non-expert audiences
  • Familiarity with evaluation rubrics, benchmarks, or structured review frameworks

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

L'offre d'emploi a été publiée il y a 23 heures
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Chemistry PhD LLM Evaluation Specialist à Toronto, ON
  • $73 par heure

     ...Dorsey . Position: Life Sciences AI Specialist Type: Contract...  ...behavior in the life sciences context. Evaluate LLM-generated responses to biology-related queries...  ...Qualifications Must-Have PhD in Biology or a closely related life sciences... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $15 - $20 par heure

     ...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone... 
    Suggéré
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $73 par heure

     ...Position: Mathematics AI Evaluator Type: Full-time or Part...  ...mathematical contexts. Evaluate LLM-generated responses to...  ...Qualifications Must-Have PhD in Mathematics or a closely...  ...with RLHF , model evaluation, or data annotation work.... 
    Pour phd
    Temps plein
    Сontrat
    Temps partiel
    Travail d'été

    Mercor

    Toronto, ON
    il y a 15 heures
  • $73 par heure

     .... Position: Physics AI Evaluator Type: Full-time or Part...  ...contexts. Evaluate LLM-generated responses to physics...  ...audiences. Apply consistent evaluation standards by following clear...  ...Qualifications Must-Have PhD in Physics or closely related... 
    Pour phd
    Temps plein
    Сontrat
    Temps partiel
    Travail d'été

    Mercor

    Toronto, ON
    il y a 15 heures
  • $70 par heure

     ...include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Recrutement immédiat
    Travail à distance

    Mercor

    Toronto, ON
    il y a 4 jours
  • $55 - $80 par heure

     ...Jack Dorsey . Position: Phylogenetics PhDs & Domain Experts — Zion (Arches)...  ...language models using domain expertise. Evaluate and improve AI model outputs through rigorous...  ...Qualifications Must-Have PhD or advanced degree in Evolutionary Biology... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $66 - $84 par heure

     ...Jack Dorsey . Position: Applied Computer Science Benchmark Specialist Type: Contract Compensation: $66–$84/hour...  ...precision, or solvability. Qualifications Must-Have PhD or doctoral candidate in Computer Science , Electrical... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $61 - $77 par heure

     ...and Jack Dorsey . Position: Applied Mathematics Benchmark Specialist Type: Contract Compensation: $61–$77/hour...  ...justify any edits made. Qualifications Must-Have PhD or doctoral candidate in Mathematics , Applied Mathematics ,... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $60 - $80 par heure

     ...and Jack Dorsey . Position: STEM PhDs Type: Contract Compensation...  ...to enhance AI model training . Evaluate and improve AI model outputs through rigorous...  ...Must-Have STEM PhD from a US, UK, Canadian, or European university... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $50 - $60 par heure

     ...communications effectively. Demonstrate high agency and strong organizational skills. Apply an analytical mindset to improve LLM training projects . Own unfamiliar problems from start to finish. Qualifications Must-Have Strong... 
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $77 - $98 par heure

     ...Dorsey . Position: Applied Economics & Finance Benchmark Specialist Type: Contract Compensation: $77$98/hour...  ...justify any edits made. Qualifications Must-Have PhD or doctoral candidate in Economics Finance or a closely related... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $80 - $120 par heure

     ...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Temps plein
    Сontrat
    Travail d'été
    Travail au bureau
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $80 - $120 par heure

     ..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Temps plein
    Сontrat
    Travail d'été
    Travail au bureau
    Travail à distance
    Horaires flexibles

    Mercor

    Toronto, ON
    il y a 15 heures
  • $100 par heure

     ...$100–$500/hour Location: Remote Role Responsibilities Build and operate LLM agents in production environments. Ensure agent reliability and evaluate performance improvements. Manage long-running processes like scheduled jobs and cloud sandboxes... 
    Travail à distance
    Сontrat
    Travail d'été

    Mercor

    Toronto, ON
    il y a 13 jours
  • $80 - $150 par heure

     ..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour...  ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform... 
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $90 par heure

     ...impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic... 
    Temps plein
    Сontrat
    Travail d'été
    Zone locale
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $70k - $73.85k par année

     ...Posting will be closed on July 29, 2026 at 5:00 pm and this posting is for an existing vacancy.   Objective:   The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will enhance Friendship... 
    Temps plein
    Stage

    Ofifc

    Toronto, ON
    il y a 15 heures
  • $80 - $120 par heure

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Temps plein
    Сontrat
    Travail d'été
    Travail au bureau
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $14 - $42 par heure

     ...Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics with published songs... 
    Temps plein
    Сontrat
    Travail d'été
    Recrutement immédiat
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $70 - $100 par heure

     ...Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of two candidate... 
    Temps plein
    Сontrat
    Travail d'été
    Travail au bureau
    Recrutement immédiat
    Travail à distance

    Mercor

    Toronto, ON
    il y a 15 heures
  • $25 - $45 par heure

     ...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring... 
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures
  • $25 - $35 par heure

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35/hour Commitment: 20 hours/week Role Responsibilities... 
    Temps plein
    Сontrat
    Pour les contractants
    Travail d'été

    Mercor

    Toronto, ON
    il y a 23 heures
  • $70 - $100 par heure

     ...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and PowerPoint formats. Perform pairwise comparisons of candidate responses... 
    Travail à distance
    Сontrat
    Travail d'été
    Travail au bureau
    Recrutement immédiat

    Mercor

    Toronto, ON
    il y a 11 jours
  • $91.27k - $97.17k par année

     ...Position Title: Curriculum Specialist (Intermediate/Senior Physics & Chemistry) Employment Type: Full-time Contract (12-Month) | Union Salary range: $91,270.73 - $97,165.35 Division: Education Reports To: Manager, Curriculum Location: Toronto, Yonge... 
    Temps plein
    Сontrat
    Recrutement immédiat

    TVO Career

    Toronto, ON
    il y a 23 heures
  • $70 - $100 par heure

     ...PowerPoint (.pptx) formats. Perform side-by-side pairwise comparisons of two candidate responses and select the stronger one. Evaluate both the content and rendering of each document—layout, formatting, visual structure, formulas, and overall presentation against the... 
    Travail à distance
    Сontrat
    Travail d'été
    Travail au bureau
    Recrutement immédiat

    Mercor

    Toronto, ON
    il y a 15 jours
  • $120 - $170 par heure

     ...comfortable having your judgment reviewed and calibrated against peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your resume or relevant technical... 
    Travail à distance
    Сontrat
    Travail d'été

    Mercor

    Toronto, ON
    il y a 3 jours
  • $70 - $100 par heure

     ...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of... 
    Travail à distance
    Сontrat
    Travail d'été
    Travail au bureau
    Recrutement immédiat

    Mercor

    Toronto, ON
    il y a 20 jours
  • $80 - $120 par heure

     ...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour...  ...Work independently and asynchronously to ensure high-quality evaluations. Collaborate with AI research teams to enhance training... 
    Travail à distance
    Сontrat
    Travail d'été
    Travail au bureau

    Mercor

    Toronto, ON
    il y a 23 jours
  • $70 - $90 par heure

     ...Preferred Experience across multiple computational domains or specialized software packages. Familiarity with benchmark or evaluation design. Background in scientific teaching or exam/problem-set design. Experience with computational reproducibility and... 
    Pour phd
    Travail à distance
    Сontrat
    Travail d'été

    Mercor

    Toronto, ON
    il y a 11 jours
  • $85 par heure

     ...against three frontier language models until at least one fails. Evaluate the accuracy and depth of AI-generated content in aerodynamics...  ...model performance . Qualifications Must-Have ~ PhD in Aerospace Engineering or Mechanical Engineering with a... 
    Pour phd
    Temps plein
    Сontrat
    Travail d'été
    Travail à distance

    Mercor

    Toronto, ON
    il y a 23 heures

Voulez-vous recevoir plus d'offres d'emploi ?

S'abonner et recevoir des offres d'emploi similaires à Chemistry PhD LLM Evaluation Specialist. Soyez parmi les premiers à postuler !