Data Science Expert - Evaluation Specialist
$120 - $170 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against established criteria with detailed, well-reasoned written justifications.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Collaborate with AI research teams to improve training data quality and downstream performance.
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design, A/B testing , metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Data Science Expert - Evaluation Specialist in Toronto, ON vacancy
$120 - $170 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...SuggestedRemote jobContract workSummer work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities...SuggestedFull timeContract workSummer workWork at officeRemote work$60 - $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-... ...written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$80 - $120 per hour
...Market research / competitive intelligence Evaluator Type: Contract... ...with AI research teams to enhance training data quality. Work independently to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...to meet deadlines while improving evaluation processes. Qualifications Must-Have... ...with AI training , evaluation, or human-data projects. Application Process (Takes...Remote jobContract workSummer work$80 - $120 per hour
...Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour... .... Collaborate with AI research teams to improve training data quality and model performance. Qualifications Must-Have...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs. Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet...Remote jobContract workSummer workWork at officeFlexible hours$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$70 - $100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location:...Remote jobContract workSummer workInternship$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete...Remote jobContract workSummer work$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...Full timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...Larry Summers and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50$70... ...Location: Remote Role Responsibilities Review and evaluate documents slides spreadsheets and similar materials for quality...Full timeContract workSummer workRemote workFlexible hours$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... ...Score the quality of musical training data to ensure high standards in model outputs...Remote jobContract workSummer workImmediate start$70 - $100 per hour
...Jack Dorsey . Position: Office-Suite Experts Type: Contract... ...responses and select the stronger one. Evaluate both the content and rendering of each document... ...Excel/Spreadsheets —financial modeling, data analysis, pivot tables, complex formulas,...Remote jobContract workSummer workWork at officeImmediate start$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance .... ...Prior experience with AI training , evaluation, or human-data projects. Application Process (...Remote jobContract workSummer work$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and...Remote jobContract workSummer workWork at officeImmediate start$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-... ...written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$11 - $19 per hour
...Larry Summers and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11$19... ...on quality creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word choice slang and regional...Full timeContract workSummer workImmediate startRemote work$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...Remote jobContract workSummer workImmediate start- We are seeking a skilled Senior Data Science Developer to provide technical analytics support, build cloud-based data models, and develop robust... .... Conduct root-cause analysis on complex technical issues, evaluate alternate pipeline architectures, and recommend optimal data...Contract workWork at officeFlexible hours
$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word...Remote jobContract workSummer workWork at officeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - Evaluation Specialist. Be the first to apply!
Related searches