Chemistry PhD LLM Evaluation Specialist
$73 par heureTemps plein
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Chemistry AI Evaluator
Type: Contract
Compensation: $73/hour
Location: Remote
Role Responsibilities
- Write and refine prompts to guide model behavior in chemistry contexts.
- Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and mechanistic correctness.
- Conduct fact-checking using authoritative public sources and domain knowledge.
- Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
- Assess clarity, structure, and appropriateness of explanations for different audiences.
- Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must-Have
- PhD in Chemistry or a closely related field
- Deep expertise in Organic & Biological Chemistry , Inorganic & Materials Chemistry , Physical & Theoretical Chemistry , or Analytical & Instrumental Chemistry
- Significant experience using large language models (LLMs)
- Excellent writing skills and ability to clearly explain complex chemistry concepts
- Strong attention to detail
- Experience reviewing or editing technical or academic writing
Preferred
- Prior experience with RLHF , model evaluation, or data annotation work
- Experience teaching, mentoring, or explaining chemistry concepts to non-expert audiences
- Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Voir email sur jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
L'offre d'emploi a été publiée il y a 23 heures
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Chemistry PhD LLM Evaluation Specialist à Toronto, ON
$73 par heure
...Dorsey . Position: Life Sciences AI Specialist Type: Contract... ...behavior in the life sciences context. Evaluate LLM-generated responses to biology-related queries... ...Qualifications Must-Have PhD in Biology or a closely related life sciences...Pour phdTemps pleinСontratTravail d'étéTravail à distance$15 - $20 par heure
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...SuggéréTemps pleinСontratTravail d'étéTravail à distance$73 par heure
...Position: Mathematics AI Evaluator Type: Full-time or Part... ...mathematical contexts. Evaluate LLM-generated responses to... ...Qualifications Must-Have PhD in Mathematics or a closely... ...with RLHF , model evaluation, or data annotation work....Pour phdTemps pleinСontratTemps partielTravail d'été$73 par heure
.... Position: Physics AI Evaluator Type: Full-time or Part... ...contexts. Evaluate LLM-generated responses to physics... ...audiences. Apply consistent evaluation standards by following clear... ...Qualifications Must-Have PhD in Physics or closely related...Pour phdTemps pleinСontratTemps partielTravail d'été$70 par heure
...include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks...Pour phdTemps pleinСontratTravail d'étéRecrutement immédiatTravail à distance$55 - $80 par heure
...Jack Dorsey . Position: Phylogenetics PhDs & Domain Experts — Zion (Arches)... ...language models using domain expertise. Evaluate and improve AI model outputs through rigorous... ...Qualifications Must-Have PhD or advanced degree in Evolutionary Biology...Pour phdTemps pleinСontratTravail d'étéTravail à distance$66 - $84 par heure
...Jack Dorsey . Position: Applied Computer Science Benchmark Specialist Type: Contract Compensation: $66–$84/hour... ...precision, or solvability. Qualifications Must-Have PhD or doctoral candidate in Computer Science , Electrical...Pour phdTemps pleinСontratTravail d'étéTravail à distance$61 - $77 par heure
...and Jack Dorsey . Position: Applied Mathematics Benchmark Specialist Type: Contract Compensation: $61–$77/hour... ...justify any edits made. Qualifications Must-Have PhD or doctoral candidate in Mathematics , Applied Mathematics ,...Pour phdTemps pleinСontratTravail d'étéTravail à distance$60 - $80 par heure
...and Jack Dorsey . Position: STEM PhDs Type: Contract Compensation... ...to enhance AI model training . Evaluate and improve AI model outputs through rigorous... ...Must-Have STEM PhD from a US, UK, Canadian, or European university...Pour phdTemps pleinСontratTravail d'étéTravail à distance$50 - $60 par heure
...communications effectively. Demonstrate high agency and strong organizational skills. Apply an analytical mindset to improve LLM training projects . Own unfamiliar problems from start to finish. Qualifications Must-Have Strong...Temps pleinСontratTravail d'étéTravail à distance$77 - $98 par heure
...Dorsey . Position: Applied Economics & Finance Benchmark Specialist Type: Contract Compensation: $77$98/hour... ...justify any edits made. Qualifications Must-Have PhD or doctoral candidate in Economics Finance or a closely related...Pour phdTemps pleinСontratTravail d'étéTravail à distance$80 - $120 par heure
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Temps pleinСontratTravail d'étéTravail au bureauTravail à distance$80 - $120 par heure
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Temps pleinСontratTravail d'étéTravail au bureauTravail à distanceHoraires flexibles$100 par heure
...$100–$500/hour Location: Remote Role Responsibilities Build and operate LLM agents in production environments. Ensure agent reliability and evaluate performance improvements. Manage long-running processes like scheduled jobs and cloud sandboxes...Travail à distanceСontratTravail d'été$80 - $150 par heure
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Temps pleinСontratTravail d'étéTravail à distance$90 par heure
...impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic...Temps pleinСontratTravail d'étéZone localeTravail à distance$70k - $73.85k par année
...Posting will be closed on July 29, 2026 at 5:00 pm and this posting is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will enhance Friendship...Temps pleinStage$80 - $120 par heure
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Temps pleinСontratTravail d'étéTravail au bureauTravail à distance$14 - $42 par heure
...Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics with published songs...Temps pleinСontratTravail d'étéRecrutement immédiatTravail à distance$70 - $100 par heure
...Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of two candidate...Temps pleinСontratTravail d'étéTravail au bureauRecrutement immédiatTravail à distance$25 - $45 par heure
...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring...Temps pleinСontratTravail d'étéTravail à distance$25 - $35 par heure
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35/hour Commitment: 20 hours/week Role Responsibilities...Temps pleinСontratPour les contractantsTravail d'été$70 - $100 par heure
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and PowerPoint formats. Perform pairwise comparisons of candidate responses...Travail à distanceСontratTravail d'étéTravail au bureauRecrutement immédiat$91.27k - $97.17k par année
...Position Title: Curriculum Specialist (Intermediate/Senior Physics & Chemistry) Employment Type: Full-time Contract (12-Month) | Union Salary range: $91,270.73 - $97,165.35 Division: Education Reports To: Manager, Curriculum Location: Toronto, Yonge...Temps pleinСontratRecrutement immédiat$70 - $100 par heure
...PowerPoint (.pptx) formats. Perform side-by-side pairwise comparisons of two candidate responses and select the stronger one. Evaluate both the content and rendering of each document—layout, formatting, visual structure, formulas, and overall presentation against the...Travail à distanceСontratTravail d'étéTravail au bureauRecrutement immédiat$120 - $170 par heure
...comfortable having your judgment reviewed and calibrated against peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your resume or relevant technical...Travail à distanceСontratTravail d'été$70 - $100 par heure
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of...Travail à distanceСontratTravail d'étéTravail au bureauRecrutement immédiat$80 - $120 par heure
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently and asynchronously to ensure high-quality evaluations. Collaborate with AI research teams to enhance training...Travail à distanceСontratTravail d'étéTravail au bureau$70 - $90 par heure
...Preferred Experience across multiple computational domains or specialized software packages. Familiarity with benchmark or evaluation design. Background in scientific teaching or exam/problem-set design. Experience with computational reproducibility and...Pour phdTravail à distanceСontratTravail d'été$85 par heure
...against three frontier language models until at least one fails. Evaluate the accuracy and depth of AI-generated content in aerodynamics... ...model performance . Qualifications Must-Have ~ PhD in Aerospace Engineering or Mechanical Engineering with a...Pour phdTemps pleinСontratTravail d'étéTravail à distance
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à Chemistry PhD LLM Evaluation Specialist. Soyez parmi les premiers à postuler !
Recherches connexes
- crisis intervention specialist Toronto, ON
- leasing specialist Toronto, ON
- visual specialist Toronto, ON
- child life specialist Toronto, ON
- lead generation specialist Toronto, ON
- spécialiste en amélioration continue Toronto, ON
- spécialiste paie Toronto, ON
- literacy specialist Toronto, ON
- building performance specialist Toronto, ON
- employment specialist Toronto, ON