Mathematics PhD - AI Evaluation Expert
$70 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Mathematics PhD Coding Experts
Type: Contract
Compensation: $70/hour
Location: Remote
Duration: 6 weeks
Commitment: 20+ hours/week
Role Responsibilities
- Source original material from published papers, Kaggle datasets, open-source repositories, or self-designed scenarios.
- Write scientific prompts based on sourced input to challenge frontier models.
- Build grading criteria that define correct answers for scientific tasks.
- Calibrate tasks against frontier models, ensuring tasks ship only when strong models fail more often than succeed.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- PhD in mathematics , applied mathematics , computational mathematics , or a closely related field.
- Demonstrated depth in at least two subdomains: numerical linear algebra, computational mechanics, computational finance.
- Working proficiency in Python or R for scientific computing.
- Comfortable with Git/GitHub and running code in Docker .
Preferred
- Publications in peer-reviewed journals.
- Prior scientific software or research engineering experience.
Start Date
- Immediate
Interview Process
- Upload your resume and application form.
- A 25-minute conversational interview covering your background, experience, and motivations.
- Follow up within a few days with next steps and onboarding.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$61 - $77 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: Applied Mathematics Benchmark Specialist... ...Hard (advanced undergraduate), or Expert (post-graduate and above).... ...Qualifications Must-Have PhD or doctoral candidate in Mathematics...For phdFull timeContract workSummer workRemote work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedFull timeContract workSummer workRemote work$66 - $84 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...question's difficulty as Medium, Hard, or Expert. Provide 1 correct answer and 9... ...Qualifications Must-Have PhD or doctoral candidate in Computer Science...For phdFull timeContract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$60 - $80 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...Hourly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...experience with AI training , evaluation, or human-data projects....Full timeContract workSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$60 - $80 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: STEM PhDs Type: Contract... ...enhance AI model training . Evaluate and improve AI model outputs... ...Qualifications Must-Have STEM PhD from a US, UK, Canadian, or...For phdFull timeContract workSummer workRemote work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Full timeContract workSummer workRemote work- ...collaboration with other disciplines - all foundational ingredients in successful digital experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team in a forward-leaning role that proves the platform actually...Full timeImmediate start
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... ...detailed written justifications for evaluations and scores to maintain transparency and accountability...Full timeContract workSummer workRemote work$67 - $75 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ..., and Jack Dorsey . Position: Mathematics Chart Analysis Expert Type: Contract... ...review, and annotate technical tasks to evaluate AI model performance on mathematics...For phdHourly payFull timeContract workFor contractorsSummer workRemote workFlexible hours$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Full timeContract workSummer workRemote work$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Full timeContract workSummer workRemote work$65 - $85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Role Responsibilities Review and evaluate AI-generated outputs related to solution... ...workshops, requirements gathering, and vendor evaluation. Annotate, label, and validate data across...Full timeContract workSummer workRemote work$70 - $90 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Cybersecurity Experts Type: Contract Compensation: $70–$90/hour...Full timeContract workSummer workRemote workFlexible hours$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated frontend...Full timeContract workSummer workRemote work$30 - $80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...and prioritize effectively. Run the agent against scenarios, evaluate performance, and guide it to success through structured hints....Full timeContract workSummer workRemote work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex machine learning and AI engineering tasks....Full timeContract workSummer workRemote work$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: Computational Statistics and Applied Mathematics Expert (R, Python, and Matlab/Scilab) Type... ...packages. Familiarity with benchmark or evaluation design. Background in scientific...For phdRemote jobContract workSummer work$70 - $90 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: Computational Statistics and Applied Mathematics Expert (R Python and Matlab/Scilab) Type:... ...mathematical or scientific software packages. Evaluate AIs ability to compute reproducible...For phdFull timeContract workSummer workRemote work$85 per hour
...technical talent with leading AI research labs. Headquartered in... ...scenarios. Write complete expert-level solutions for each problem... ...until at least one fails. Evaluate the accuracy and depth of AI-generated... ...Must-Have ~ PhD in Aerospace Engineering or...For phdFull timeContract workSummer workRemote work$70 - $85 per hour
...technical talent with leading AI research labs. Headquartered in... ...Computational Seismology & Geophysics Expert Type: Contract... ...challenging computational problems to evaluate AI capabilities in solving... ...in a relevant STEM field ( MS PhD or equivalent research...For phdFull timeContract workSummer workRemote work$55 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract... ...Qualifications Must-Have PhD or advanced degree (or equivalent industry...For phdRemote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Education / school Evaluator Type: Contract Compensation... ...deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Mathematics PhD - AI Evaluation Expert. Be the first to apply!

