PhD Mathematician AI Assessment Specialist
$73 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Mathematics AI Evaluator
Type: Full-time or Part-time Contract Work
Compensation: $73/hour
Location: USA, UK, Canada, EU
Role Responsibilities
- Write and refine prompts to guide model behavior in mathematical contexts.
- Evaluate LLM-generated responses to mathematics-related queries for correctness, rigor, and logical coherence.
- Verify mathematical claims, derivations, and proofs using domain expertise.
- Conduct fact-checking using authoritative public sources and domain knowledge.
- Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies.
- Ensure model responses align with expected conversational behavior and system guidelines.
Qualifications
Must-Have
- PhD in Mathematics or a closely related field .
- Demonstrated experience in Probability & Statistics .
- Significant experience using large language models (LLMs).
- Excellent writing skills for explaining complex mathematical concepts.
- Strong attention to detail with the ability to notice subtle issues.
- Experience reviewing or editing technical or academic writing.
Preferred
- Prior experience with RLHF , model evaluation, or data annotation work.
- Experience teaching, mentoring, or explaining mathematical concepts to non-expert audiences.
- Familiarity with evaluation rubrics, benchmarks, or structured review frameworks.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the PhD Mathematician AI Assessment Specialist in Toronto, ON vacancy
$66 - $84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Applied Computer Science Benchmark Specialist Type: Contract Compensation... ...Qualifications Must-Have PhD or doctoral candidate in Computer Science...For phdFull timeContract workSummer workRemote work$73 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...strengths and areas of improvement. Assess clarity, structure, and appropriateness of... ...Qualifications Must-Have PhD in Physics or closely related field ....For phdFull timeContract workPart timeSummer work$73 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Life Sciences AI Specialist Type: Contract... ...conceptual inaccuracies. Assess clarity, structure, and appropriateness... ...Qualifications Must-Have PhD in Biology or a closely related...For phdFull timeContract workSummer workRemote work$50 - $63 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Applied Psychology Benchmark Specialist Type: Contract Compensation... ...Qualifications Must-Have PhD , PsyD , or doctoral candidate in Psychology...For phdRemote jobContract workSummer work$60 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: STEM PhDs Type: Contract... ...Qualifications Must-Have STEM PhD from a US, UK, Canadian, or European university...For phdFull timeContract workSummer workRemote work$73 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...factual or conceptual inaccuracies. Assess clarity, structure, and appropriateness of... ...Qualifications Must-Have PhD in Chemistry or a closely related field...For phdFull timeContract workSummer workRemote work$94 - $119 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Applied Health & Medicine Benchmark Specialist Type: Contract Compensation... ...Must-Have MD , DO , PhD , or doctoral candidate in Medicine, Biomedical...For phdFull timeContract workSummer workRemote work$55 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Dorsey . Position: Phylogenetics PhDs & Domain Experts — Zion (Arches) Type... ...Qualifications Must-Have PhD or advanced degree in Evolutionary Biology...For phdFull timeContract workSummer workRemote work$25 - $30 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and cultural conventions. Run prompts through models and assess outputs for accuracy, fluency, and cultural fit in Simplified Chinese...Full timeSummer workFreelance$55 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type:... ...Qualifications Must-Have PhD or advanced degree (or equivalent industry...For phdRemote jobContract workSummer work$100k - $165k per year
...remediation business with specific expertise in environmental assessments, permitting, regulatory and compliance services, active/passive... ...environmental problems. Senior Environmental Assessment Specialist I Regular Full-Time – Vancouver, BC; Saskatoon, SK; Toronto,...Remote jobFull timeWork at office- ...(BBBST), our vision is to build thriving communities by empowering lives through mentorship. Job Title : Intake Specialist - Enrollment & Assessment (12 months contract - possibility of extension) Reports to : Manage of Enrollment & Assessment and Director of Service...Contract workWork at officeTrial periodFlexible hoursAfternoon shift
$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/...For phdRemote jobContract workSummer workImmediate start$120k - $170k per year
...Your role and responsibilities: As an AI Specialist at Xanadu, you will play a crucial role in... ...qualifications and experience: PhD/MSc in Computer Science, Engineering, Physics... ...AI) tools to assist in the screening and assessment of applicants for this position. These tools...For phdFull time- ...Position: Privacy Impact Assessment (PIA) Specialist Location: Toronto, ON Job ID#: RQ11155 â Duration: 9 Months Role... ...statutes, policies, directives, standards, and guidelines. Assess privacy risks and recommend appropriate mitigation strategies...Full time
- ...of 3 years' health privacy experience conducting privacy impact assessments (PIAs) on medium to high complexity projects ~ Minimum 5 years... ...in response to recommendations from PIAs ~ Identify and assess privacy risks ~ Provide privacy advisory and support to business...Full timeContract workWork at officeRemote work
- ...We do have a job opening for \ Privacy Impact Assessment (PIA) Specialist - Senior \\ for our direct client Province of Ontario. The position details are given below: \ \\ \\ Job Details: \\ \\\ Job ID: RQ11096 - Privacy Impact Assessment (PIA) Specialist - Senior \ \...Full time
$140k - $190k per year
...Your role and responsibilities: As an AI Specialist at Xanadu, you will drive applied AI initiatives... ...qualifications and experience: MSc/PhD in Computer Science, Engineering, Physics... ...AI) tools to assist in the screening and assessment of applicants for this position. These...For phdFull time- ...online, and you are fascinated by how AI and automation can supercharge... ...What you will do As a AI GTM Specialist you’ll be responsible for... ...Tools”) to assist in screening, assessing, or evaluating candidates. These tools may assess job-related qualifications such as...Full time
- ...Required to lead or support the development of a privacy impact assessment that evaluates whether new technologies, information systems,... ...M4C"}],"headerName":"RQ10402 \- Privacy Impact Assessment (PIA) Specialist \- Senior","widgetId":"383123000000072311","isJobBoard":"false"...Contract work
- ...Lead and support creation of change Security and Privacy impact assessments for system changes Liaison between users and other team members... ...","uitype":1,"value":"M4C"}],"headerName":"RQ10341 \- Security Specialist \- Threat Risk Assessment \- Senior","widgetId":"...Contract workFlexible hours
$90k - $130k per year
...Zafin is an AI platform company helping regulated institutions... ...The AI Knowledge Operations Specialist is responsible for preparing,... ...reviews and quarterly maturity assessments, in a regulated environment.... ...automated technology to screen and/or assess applicants for this position....Full time- ...WeirFoulds is seeking an AI Enablement & Operations Specialist to support the practical adoption, administration, governance, and continuous improvement... ...across the firm. Innovation & Value: Identify, assess, and prioritize practical AI use cases with practice groups...Permanent employmentFull timeWork at officeMonday to friday3 days per week
$80k - $105k per year
...Description ABOUT THE ROLE As an AI Adoption Specialist, you will play a pivotal role in helping law firms unlock the full potential of LEAP’s AI-powered solutions. Acting as a trusted advisor and strategic partner, you will guide clients throughout their journey—from...Long term contractFull timeWork at officeWork from home$50 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., difficulty, or language. Support benchmarking efforts to assess model capabilities. Qualifications Must-Have ~2+...Full timeSummer workFreelanceImmediate start$70 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Process Complete a short interview and questionnaire to assess domain expertise. Paid for up to 1 hour of onboarding time,...Full timeContract workSummer workRemote workFlexible hours- ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...AI-generated outputs related to threat analysis, vulnerability assessment, and security architecture recommendations. Create realistic...Hourly payFull timeContract workSummer workRemote work
$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Conduct model testing and grading. Run prompts through models and assess outputs against expectations. Support benchmarking and...Full timeContract workSummer workRemote work$95k - $145k per year
AI Governance Specialist Position Description Are you an experienced AI professional with expertise... ...to end: triage, risk classification, assessment of value, data suitability,... ...recruitment team, AI tools may be used to help assess applications though they never replace...$100k - $120k per year
...for a Business Transformation Specialist for our global IT SaaS client... ...: Innovation and Applied AI (50%): Partner with senior... ...Organization, etc. Market Assessment and Analysis (20%): Conduct thorough... ...M&A, and portfolio teams Assess organic growth opportunities...Long term contractPermanent employmentFull timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to PhD Mathematician AI Assessment Specialist. Be the first to apply!
