Data Science Expert - AI Evaluation
$120 - $170 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data Science Expert
Type: Contract
Compensation: $120–$170/hour
Location: Remote
Role Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables such as analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against criteria with detailed written justifications for every score.
- Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers and iterate quickly on your work.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of professional data science experience in industry.
- Background in business operations, product, or growth data science at top-tier technology companies.
- Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
- Exceptionally strong written communication.
- Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.
Preferred
- Prior experience with AI training , evaluation, or human-data projects.
Application Process (Takes 20–30 mins to complete)
- Submit your resume or relevant technical background to get started.
- Qualified applicants may be asked to complete a brief technical assessment or submit additional information.
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Data Science Expert - AI Evaluation in Toronto, ON vacancy
$120 - $170 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ..., Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Larry Summers and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables including exploratory... ...and A/B test write-ups . Evaluate AI-generated or human-created...Full timeContract workSummer workRemote work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location...Remote jobContract workSummer workImmediate start$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Full timeContract workSummer workRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: B2B Sales Expert Type: Contract... ...meet deadlines while improving evaluation processes. Qualifications... ...training , evaluation, or human-data projects. Application Process...Remote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Finance operations / audit support Evaluator Type: Contract Compensation... ...AI research teams to improve training data quality and model performance. Qualifications...Remote jobContract workSummer workWork at office$70 - $100 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...Remote jobContract workSummer workInternship$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk.... ...infrastructure, cybersecurity, data platforms, developer tools, or...Remote jobContract workSummer work- ...Software Engineers to support an AI training project by creating... ...reinforcement learning environments that evaluate AI models on complex software... ...of algorithms and data structures . Experience with... ...Availability Selected experts should be prepared to begin their...Remote jobFor contractors
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation... ...with AI research teams to enhance training data quality. Work independently and...Remote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents slides spreadsheets and similar...Full timeContract workSummer workRemote workFlexible hours$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Design Expert Type: Contract Compensation... ...Prior experience with AI training , evaluation, or human-data projects. Application Process (...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... .... Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$14 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Music Audio Expert - Telugu Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics , voice... ...the quality of musical training data to ensure high standards in...Remote jobContract workSummer workImmediate start- ...Responsibilities Run human and automated evaluations across large question sets and datasets. Statistically measure... ...QA or test engineering experience with exposure to data or ML systems. Strong Python and data-science techniques for measuring factual grounding and...
$70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/...Remote jobContract workSummer work$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance... ...training , evaluation, or human-data projects. Application Process...Remote jobContract workSummer work$70 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Generalist Expert Type: Contract... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...feedback to improve training data quality and downstream performance...Remote jobContract workSummer work$70 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Generalist Expert Type: Contract... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...feedback to improve training data quality and downstream performance...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$11 - $19 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word...Full timeContract workSummer workImmediate startRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Science Expert - AI Evaluation. Be the first to apply!
Related searches