Data Science Expert - AI Evaluation
$120 - $170 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables such as analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against criteria with detailed written justifications for every score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Data Science Expert - AI Evaluation in Toronto, ON vacancy
$120 - $170 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...SuggestedFull timeContract workSummer workRemote work$120 - $170 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...SuggestedFull timeContract workSummer workRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables, including exploratory... ...A/B test write-ups . Evaluate AI-generated or human-created...SuggestedFull timeContract workSummer workRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location...Remote jobContract workSummer workImmediate start$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Full timeContract workSummer workRemote work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Larry Summers and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$80k - $180k per year
...Zafin is an AI platform company helping regulated institutions modernize... ...platform that connects data, systems, and workflows across... ...What’s the Opportunity? The AI Evaluation Engineer ensures AI agent... ...levels. Degree in Computer Science, Software Engineering, Data Science...$78.95k - $118.42k per year
...We seek a talented and driven Data Scientist passionate about accelerating... ...through machine learning and AI to join our team at the... ...contribute to our mission of open science and pre-competitive drug discovery... ...or in collaboration with other experts in the Haibe-Kains and Schapira...RemplacementPermanent employmentFull timeInternshipManual laborFlexible hoursShift workDay shift$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk.... ...infrastructure, cybersecurity, data platforms, developer tools, or...Full timeContract workSummer workRemote work$90 - $110 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Software & Data Science Expert Type: Contract Compensation: $90–$110/hour...Full timeContract workSummer workRemote work$60 - $80 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...Hourly payFull timeContract workFor contractorsSummer workRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work- ...digital experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated and... ...4+ years in QA / test engineering, with exposure to data/ML systems. ~ Strong Python and data-science techniques for measuring factual grounding and answer...Full timeImmediate start
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work- ...and modernization, with a focus on stronger data visibility, better decision-making,... ...operational discipline, and practical adoption of AI across the business. This is a hybrid... ...Role We are creating a new Head of Data Science & Analytics role to build and lead the data...Full timeWork at office
$68.55 - $82.26 per hour
...RQ00745 -Requisition TitleData Science Developer Location: Toronto... ...that turns public health data into timely analytics, surveillance... ...prioritize use cases and integrate AI techniques (machine learning,... .... The client will evaluate candidates based on both rate expectations...Full time$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...English Language and Literature Expert Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ..., language evaluation, or NLP data work in English. Strong understanding...Remote jobContract workSummer work$60 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/...Full timeContract workSummer workRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Humanities / arts / culture Evaluator Type: Contract Compensation... .... Collaborate with subject matter experts to ensure consistency and quality. Work...Remote jobContract workSummer workWork at office- ...Software Engineers to support an AI training project by creating... ...reinforcement learning environments that evaluate AI models on complex software... ...of algorithms and data structures . Experience with... ...Availability Selected experts should be prepared to begin their...Remote jobFor contractors
$125k - $135k per year
...Manager to own how Caseware builds, evaluates, and raises the quality of AI across the platform. You are the product... ...scientists, engineering, domain experts, and external partner firms. You own... ...outcome and the quality bar; the applied science team owns the science underneath it....Permanent employmentFull timeWork at officeRemote workFlexible hours3 days per week$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office- ...and solve challenging problems and make significant and lasting impact on Canadians. We are seeking an experienced Manager of Data Science & Engineering to lead our Budget Optimization, Forecasting, and Analytics initiatives in our Media & Advertising domain. There would...Permanent employmentFull timeTemporary workInternship
$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation... ...question in understandable language for non-experts. Detect sycophancy in AI interactions...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: B2B Sales Expert Type: Contract... ...meet deadlines while improving evaluation processes. Qualifications... ...training , evaluation, or human-data projects. Application Process...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - AI Evaluation. Be the first to apply!
Related searches