Chemistry PhD LLM Evaluation Specialist
$73 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Chemistry AI Evaluator
Type: Contract
Compensation: $73/hour
Location: Remote
Role Responsibilities
- Write and refine prompts to guide model behavior in chemistry contexts.
- Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and mechanistic correctness.
- Conduct fact-checking using authoritative public sources and domain knowledge.
- Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
- Assess clarity, structure, and appropriateness of explanations for different audiences.
- Apply consistent evaluation standards by following clear taxonomies, benchmarks, and detailed evaluation guidelines.
Qualifications
Must-Have
- PhD in Chemistry or a closely related field
- Deep expertise in Organic & Biological Chemistry , Inorganic & Materials Chemistry , Physical & Theoretical Chemistry , or Analytical & Instrumental Chemistry
- Significant experience using large language models (LLMs)
- Excellent writing skills and ability to clearly explain complex chemistry concepts
- Strong attention to detail
- Experience reviewing or editing technical or academic writing
Preferred
- Prior experience with RLHF , model evaluation, or data annotation work
- Experience teaching, mentoring, or explaining chemistry concepts to non-expert audiences
- Familiarity with evaluation rubrics, benchmarks, or structured review frameworks
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Chemistry PhD LLM Evaluation Specialist in Toronto, ON vacancy
$40 - $90 per hour
...with clarity, completeness, precision, or solvability. Justify any edits made. Qualifications Must-Have MD , DO , PhD , or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field. Master's degree considered...For phdFull timeContract workSummer workRemote work$55 - $80 per hour
...Jack Dorsey . Position: Phylogenetics PhDs & Domain Experts — Zion (Arches)... ...language models using domain expertise. Evaluate and improve AI model outputs through rigorous... ...Qualifications Must-Have PhD or advanced degree in Evolutionary Biology...For phdFull timeContract workSummer workRemote work$50 - $60 per hour
...communications effectively. Demonstrate high agency and strong organizational skills. Apply an analytical mindset to improve LLM training projects . Own unfamiliar problems from start to finish. Qualifications Must-Have Strong...SuggestedFull timeContract workSummer workRemote work$60 - $80 per hour
...and Jack Dorsey . Position: STEM PhDs Type: Contract Compensation... ...to enhance AI model training . Evaluate and improve AI model outputs through rigorous... ...Must-Have STEM PhD from a US, UK, Canadian, or European university...For phdFull timeContract workSummer workRemote work$25 - $45 per hour
...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring...SuggestedFull timeContract workSummer workRemote work$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...Contract workSummer workRemote work$25 - $35 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–$35/hour Commitment: 20 hours/week Role Responsibilities...Full timeContract workFor contractorsSummer work$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$91.27k - $97.17k per year
...Position Title: Curriculum Specialist (Intermediate/Senior Physics & Chemistry) Employment Type: Full-time Contract (12-Month) | Union Salary range: $91,270.73 - $97,165.35 Division: Education Reports To: Manager, Curriculum Location: Toronto, Yonge...Full timeContract workImmediate start$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$70 - $90 per hour
...Summers , and Jack Dorsey . Position: Computer Science PhD Researchers Type: Contract Compensation: $70–$... ...quality data by developing difficult problems in your domain. Evaluate and improve AI model performance through rigorous tasks....For phdRemote jobContract workSummer work$68k - $72k per year
...work together as a community—and you can be a part of that. Our team is looking to fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35 hours per week anywhere in Canada. Please apply by August 18th, 2026. Discover. Innovate...Full timeInternshipWork at officeFlexible hoursWeekend work- ...week Affiliation: L79 Full-time Number of Positions Open: 1 Posting Period: 06-Aug-2026 to 20-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator works collaboratively on multidisciplinary teams to provide continuous quality...Hourly payFull timeTemporary workPart timeInternshipMonday to friday
- ...multiple academic and industry research awards from Google, Amazon, Facebook, and VMware. About the Position: As a member of the LLM inference team, you will help build state-of-the-art software with the goal of enabling LLM inference to become more efficient,...Full timeInternshipFlexible hours
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently and asynchronously to ensure high-quality evaluations. Utilize Microsoft Office and Google Workspace ,...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80k - $180k per year
...re building the platforms that help regulated organizations adopt AI responsibly and at scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable, safe, and production-ready within regulated banking environments. The role...Full time$55 - $80 per hour
...and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type:... ...challenging problems in your domain. Evaluate and improve AI model training and outputs... ...Qualifications Must-Have PhD or advanced degree in Medicine / Healthcare...For phdRemote jobContract workSummer work$122k - $192k per year
...Resource Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In this role, you will provide technical support and project management services within the Advisory Services Group business unit, focusing on energy efficiency program...Full timeInternshipWork at officeLocal area$85 per hour
...Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms , Kubernetes ,...Full timeContract workSummer workRemote work$70 - $100 per hour
...reasoning and toxicity interpretation . Qualifications Must-Have ~ PhD , PharmD , DVM , MD , or MS with significant industry experience in Medicinal Chemistry , Pharmacology , Toxicology , Chemical Biology , Molecular Biology , Pharmaceutical...For phdFull timeContract workSummer workRemote work$73 per hour
...Position: Engineering AI Evaluator Type: Contract... ...engineering scenarios . Evaluate LLM-generated responses for technical... ...Must-Have PhD in Engineering or a closely related... ...experience with RLHF , model evaluation, or data annotation work...For phdFull timeContract workSummer workRemote work$73 per hour
...Position: Mathematics AI Evaluator Type: Full-time or Part... ...mathematical contexts. Evaluate LLM-generated responses to... ...Qualifications Must-Have PhD in Mathematics or a closely... ...with RLHF , model evaluation, or data annotation work....For phdFull timeContract workPart timeSummer workRemote work$120 - $170 per hour
...comfortable having your judgment reviewed and calibrated against peers. Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete) Submit your resume or relevant technical...Remote jobContract workSummer work$80 - $150 per hour
...quickly on work. Work independently and asynchronously to evaluate and improve AI model performance . Qualifications... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$55 - $80 per hour
.... Position: Automated CS Planning PhDs & Domain Experts — Zion (Arches) Type... ...creating complex problems in your domain. Evaluate and improve AI model performance through... ...Qualifications Must-Have PhD or advanced degree in Computer Science,...For phdRemote jobContract workSummer work$70 - $90 per hour
..., Larry Summers , and Jack Dorsey . Position: Physics PhD Experts (General Relativity, Astrophysics & Cosmology) Type... ...in General Relativity , Astrophysics , and Cosmology . Evaluate and refine AI model training to enhance future AI innovations...For phdRemote jobContract workSummer work$70 - $90 per hour
...Summers , and Jack Dorsey . Position: Mathematics, Biology, Chemistry, and Physics Professional Type: Freelance... ...Qualifications Must-Have Bachelor's , Master's , or PhD in Physics , Chemistry , Mathematics , Biochemistry , or...For phdFull timeSummer workFreelanceImmediate start$73 per hour
.... Position: Physics AI Evaluator Type: Full-time or Part... ...contexts. Evaluate LLM-generated responses to physics... ...audiences. Apply consistent evaluation standards by following clear... ...Qualifications Must-Have PhD in Physics or closely related...For phdFull timeContract workPart timeSummer workRemote work$37.85 - $47.31 per hour
...presentations and grant submissions; summarizing data and education of multidisciplinary staff. Duties Plan and execute technology evaluation studies using validated frameworks such as the Technology Acceptance Model (TAM) and related implementation science models....Hourly payLong term contractRemplacementFull timeContract workTemporary workInternshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Chemistry PhD LLM Evaluation Specialist. Be the first to apply!
Related searches
- spécialiste service client Toronto, ON
- member banking specialist Toronto, ON
- member engagement specialist Toronto, ON
- spécialiste talent Toronto, ON
- order management specialist Toronto, ON
- solution specialist Toronto, ON
- building performance specialist Toronto, ON
- public health specialist Toronto, ON
- access control specialist Toronto, ON
- rbc credit specialist Toronto, ON