Data Science Expert - Evaluation Specialist
$120 - $170 per hourFull-time
Mercor
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate with AI research teams to improve training data quality and downstream performance.
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design, A/B testing , metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: View email address on jobs.jobcopilot.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Data Science Expert - Evaluation Specialist in Toronto, ON vacancy
$100 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts...SuggestedContract workSummer workWork at officeRemote work$120 - $170 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...SuggestedFull timeContract workSummer workRemote work$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedFull timeContract workSummer workWork at officeRemote work$100 per hour
...candidates based in Canada. Pay: $100$200/hr Role Title: AI Data Science Domain Expert Role Type: Contractor (Part Time) Location: Remote... ...knowledge is what matters. This contract is ideal for specialists who routinely develop or review research papers analytical...SuggestedFull timeContract workPart timeFor contractorsRemote work$60 - $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities...SuggestedFull timeContract workSummer workRemote work$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables, including exploratory... ...A/B test write-ups . Evaluate AI-generated or human-... ...detailed written justifications for evaluations and scores to maintain...Full timeContract workSummer workRemote work$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities...Full timeContract workSummer workWork at officeRemote work$68.55 - $82.26 per hour
...RQ00745 -Requisition TitleData Science Developer Location:... ...infrastructure that turns public health data into timely analytics,... ...Data Engineer / Data Science Specialist builds and automates the data... ...qualifications. The client will evaluate candidates based on both rate...Full time$78.95k - $118.42k per year
...We seek a talented and driven Data Scientist passionate about accelerating... ...to our mission of open science and pre-competitive drug... ...or in collaboration with other experts in the Haibe-Kains and Schapira... ...preprocessing through model training, evaluation, and production deployment....RemplacementPermanent employmentFull timeInternshipManual laborFlexible hoursShift workDay shift$90 - $110 per hour
...Larry Summers , and Jack Dorsey . Position: Software & Data Science Expert Type: Contract Compensation: $90–$110/hour... ...to test AI reasoning over technical documentation. Evaluate AI models on professional document understanding. Develop...Full timeContract workSummer workRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Contract workSummer workWork at officeRemote work- ...new phase of growth and modernization, with a focus on stronger data visibility, better decision-making, improved operational discipline... .... About the Role We are creating a new Head of Data Science & Analytics role to build and lead the data function across Big Viking...Full timeWork at office
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at office$150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-... ...written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Contract workSummer workWork at officeRemote work$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or... ...experience with AI training , evaluation, or human-data projects....Full timeContract workSummer workRemote work$70k - $73.85k per year
...vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development... ...organizes, analyzes, and communicates data in the form of research findings to... ...to social research; evaluation; social sciences graduate preferred Minimum of 3 years...Full timeInternship$80 - $150 per hour
...check your spam folder. This is a fully remote position open to candidates based in Canada. Pay: $80$150/hr Materials Science Expert Pay: $80$150/hour Location: Global fully remote Job Type: Contractor (15 hours per week) Schedule: Flexibleyou choose...Full timeFor contractorsImmediate startRemote work$40 - $90 per hour
...based in Canada. Pay: $40$90/hr Role Title: Research Evaluation Specialist (PhD / Researcher / Professor) Role Type: Contractor Location... ...Specialists (PhD / Researcher / Professor) to contribute expert insight in developing rigorous test material for advanced AI...Full timeFor contractorsRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$40 - $90 per hour
...candidates based in Canada. Pay: $40$90/hr Role Title: Medical Evaluation Specialist (students residents physicians) Role Type: Contractor... ...Compensation Structure Compensation is output-based; experts are paid per task that meets the project specifications. The...Full timeFor contractorsRemote work$45 - $48 per hour
...members belong and have the opportunity to thrive. Lyft’s Data Science Team builds mathematical models underpinning the platform’s core... ...and ML models to enable better decisions, and developing and evaluating algorithmic policies in our pricing, dispatch, and incentives...Hourly paySummer workInternshipSummer internshipWork at office3 days per week$80 - $120 per hour
...Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour... .... Collaborate with AI research teams to improve training data quality and model performance. Qualifications Must-Have...Remote jobContract workSummer workWork at office$200k per year
...DESCRIPTION The Department of Statistical Sciences in the Faculty of Arts and Science at the... ...tenure stream position in the area of Data Science Computation or adjacent fields.... ...course materials, and ~ teaching evaluations ~ Applicants must also arrange to...Permanent employmentFull time$94 - $119 per hour
...Position: Applied Health & Medicine Benchmark Specialist Type: Contract... ...question's difficulty: Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible... ...doctoral candidate in Medicine , Biomedical Sciences , Public Health , or a closely related...Remote jobContract workSummer work$150k - $180k per year
...The position of Senior Consultant - Data Science & AI is within the TTEC Digital Analytics... ...Generative AI Solutions: Architect fine-tune and evaluate enterprise Gen AI systemsincluding... ...control automated deployment pipelines LLM evaluation and model monitoring tools ~ Personal...Long term contractFull timeFlexible hours$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...Full timeContract workSummer workImmediate startRemote work$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and...Full timeContract workSummer workWork at officeImmediate startRemote work- ...employees know they can thrive. The position of Senior Consultant - Data Science & AI is within the TTEC Digital Analytics team. The Analytics... ...& Deploy Generative AI Solutions: Architect, fine-tune, and evaluate enterprise Gen AI systems—including Retrieval-Augmented Generation...Long term contractFull time
$85 - $93 per hour
...Summers , and Jack Dorsey . Position: Basic Medical Sciences Expert Type: Contract Compensation: $85–$93/hour... ...Responsibilities Author and review technical tasks to evaluate AI model performance on basic medical sciences problems....Hourly payFull timeContract workFor contractorsSummer workRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - Evaluation Specialist. Be the first to apply!
Related searches