Data Science Expert - AI Evaluation
$120 - $170 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables such as analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against criteria with detailed written justifications for every score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Data Science Expert - AI Evaluation in Toronto, ON vacancy
$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour...SuggestedRemote jobContract workSummer workWork at office- ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models. About the opportunity: We are seeking detail-oriented English speakers to review AI...SuggestedHourly payContract workFor contractorsFreelanceInternshipRemote workWork from homeNight shift
$120 - $170 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...SuggestedRemote jobContract workSummer work$120 - $180 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Senior Data Scientist and Data Engineering Experts Type: Contract... ...Design realistic, challenging data science and data engineering tasks, including...SuggestedRemote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ..., Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120...Remote jobContract workSummer workWork at office$108k - $135k per year
...where all team members belong and have the opportunity to thrive. Data and analytics are at the heart of Lyft's products and decision-... ...solving, and skilled communication. You will report to a Data Science Manager. Responsibilities Own one or more domain datasets...Hourly payWork at officeFlexible hours3 days per week$108k - $135k per year
...connect. We aim to achieve this by cultivating a work environment where all team members belong and have the opportunity to thrive. Data Science is at the heart of Lyft’s products and decision-making. You will leverage data and rigorous, analytical thinking to shape our...Hourly payWork at officeFlexible hours3 days per week$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables, including exploratory... ...A/B test write-ups . Evaluate AI-generated or human-created...Remote jobContract workSummer work$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: French Linguistic Experts Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ...linguistic annotation, or NLP data work in French. Strong understanding...Remote jobContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location...Remote jobContract workSummer workImmediate start$70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/...Remote jobContract workSummer work$39 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer work$57 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobHourly payContract workFor contractorsSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging...Remote jobContract workSummer workImmediate start$68.55 - $82.26 per hour
...RQ00745 -Requisition TitleData Science Developer Location: Toronto... ...that turns public health data into timely analytics, surveillance... ...prioritize use cases and integrate AI techniques (machine learning,... .... The client will evaluate candidates based on both rate expectations...- ...Opportunity ShyftLabs is a fast-growing data and technology company partnering with... ...Senior Data Analyst, Advanced Analytics & Data Science to support Retail Media Network (RMN)... ...modeling, and data science techniques to evaluate advertising performance, uncover actionable...
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging...Remote jobContract workSummer workImmediate startFlexible hours$94 - $119 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...each question's difficulty: Medium, Hard, or Expert. Provide 1 correct answer and 9 plausible... ...candidate in Medicine , Biomedical Sciences , Public Health , or a closely related...Remote jobContract workSummer work$45 - $48 per hour
...members belong and have the opportunity to thrive. Lyft’s Data Science Team builds mathematical models underpinning the platform’s core... ...and ML models to enable better decisions, and developing and evaluating algorithmic policies in our pricing, dispatch, and incentives...Hourly paySummer workInternshipSummer internshipWork at office3 days per week$30 per hour
...out here: Loom Video Overview Join our expert annotation team to create training data for the world's most advanced AI models. No previous AI experience is necessary... ...have 200+ roles open! What Will I Be Doing? Evaluating the quality of AI-generated code, including...Hourly payWeekly payLong term contractContract workInternshipRemote workFlexible hours$200k per year
...DESCRIPTION The Department of Statistical Sciences in the Faculty of Arts and Science at the... ...tenure stream position in the area of Data Science Computation or adjacent fields.... ...course materials, and ~ teaching evaluations ~ Applicants must also arrange to...Permanent employmentFull time$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...English Language and Literature Expert Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ..., language evaluation, or NLP data work in English. Strong understanding...Remote jobContract workSummer work$120k - $240k per year
...Job Description: #Cosmos #Solana #DataScience About the Role: We're looking for a Data Science Associate to join our team, supporting Research, Trading, Risk, and Operations functions in the blockchain space. You'll work closely with a small team of blockchain engineers...Full timeRelocation- ...We Are: At Data Society Group, we provide the highest quality, leading-edge, industry-tailored data and AI training and solutions for Fortune 1,000 companies and federal, state... ...sharing your real-world experience in data science and AI and based in Toronto, Canada? Join...Contract workPart timeFor contractorsLocal area
$140k - $175k per year
...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build... ...repeatable experiments, separate evaluation data from model development, and make results... ...stakeholders. ~ Bachelor's degree in Computer Science, Engineering, or a related field, or...Full timeInternshipWork at officeLocal areaFlexible hours- ...No. R2873670 Position Title: Data Scientist Location: Toronto... ...Sanofi We’re an R&D-driven, AI-powered biopharma company... ...Together, we chase the miracles of science to improve people’s lives. Main... ...related to performance evaluation. Information collected and processed...Work from home3 days per week
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - AI Evaluation. Be the first to apply!
