Data Science Expert - AI Evaluation

$120 - $170 par heure

Mercor

Travail à distance

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Data Science Expert

Type: Contract

Compensation: $120–$170/hour

Location: Remote

Role Responsibilities

Design precise, task-specific grading criteria for real-world data science deliverables such as analyses, models, dashboards, and experiment readouts.
Score AI-generated and human work samples against criteria with detailed written justifications for every score.
Apply consistent, evidence-based judgment to ensure scores are reproducible and defensible.
Incorporate structured feedback from senior reviewers and iterate quickly on your work.
Work independently and asynchronously to meet deadlines while improving AI model performance .

Qualifications

Must-Have

5+ years of professional data science experience in industry.
Background in business operations, product, or growth data science at top-tier technology companies.
Deep fluency in experiment design and A/B testing, metric definition, SQL/Python analysis, and communicating findings to executive stakeholders.
Exceptionally strong written communication.
Detail-oriented, consistent, and comfortable having your judgment reviewed and calibrated against peers.

Preferred

Prior experience with AI training , evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

Submit your resume or relevant technical background to get started.
Qualified applicants may be asked to complete a brief technical assessment or submit additional information.

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: Montrer un mail

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

L'offre d'emploi a été publiée Il y a 2 mois

Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Data Science Expert - AI Evaluation à Toronto, ON

Senior Consultant, Data Science & AI
$150k - $180k par année
...know they can thrive. The position of Senior Consultant - Data Science & AI is within the TTEC Digital Analytics team. The Analytics... ...Design & Deploy Generative AI Solutions: Architect, fine-tune, and evaluate enterprise Gen AI systems—including Retrieval-Augmented...
Suggéré
Contrat Longue Durée
Temps plein
Horaires flexibles
Ttec Digital
Toronto, ON
il y a 17 jours
Data Scientist - AI Evaluation
$100 - $150 par heure
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables, including exploratory... ...A/B test write-ups . Evaluate AI-generated or human-created...
Suggéré
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Data Science Evaluator - Expert
$100 - $150 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour...
Suggéré
Travail à distance
Сontrat
Travail d'été
Travail au bureau
Mercor
Toronto, ON
il y a 3 heures
Data Engineer - AI Model Evaluation
$80 par heure
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...
Suggéré
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Software Engineering Evaluator - Expert
$100 - $150 par heure
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...
Suggéré
Сontrat
Travail d'été
Travail au bureau
Travail à distance
Mercor
Toronto, ON
il y a 19 jours
AI Evaluation Engineer (QA)
...digital experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated and... ...4+ years in QA / test engineering, with exposure to data/ML systems. ~ Strong Python and data-science techniques for measuring factual grounding and answer...
Temps plein
Recrutement immédiat
Appnovation Technologies
Toronto, ON
Il y a un mois
Privacy Compliance Evaluator - Expert
$80 - $120 par heure
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation... ...with AI research teams to enhance training data quality. Work independently and asynchronously...
Temps plein
Сontrat
Travail d'été
Travail au bureau
Travail à distance
Horaires flexibles
Mercor
Toronto, ON
Il y a 2 mois
Oncology Data Science Senior Innovation Specialist
$78.95k - $118.42k par année
...We seek a talented and driven Data Scientist passionate about accelerating... ...through machine learning and AI to join our team at the... ...contribute to our mission of open science and pre-competitive drug discovery... ...or in collaboration with other experts in the Haibe-Kains and Schapira...
Remplacement
Emploi permanent
Temps plein
Stage
Travail manuel
Horaires flexibles
Travail posté
Équipe de jour
University Health Network
Toronto, ON
Il y a un mois
Technical Product Manager, Applied Science AI Products
$125k - $135k par année
...Manager to own how Caseware builds, evaluates, and raises the quality of AI across the platform. You are the product... ...scientists, engineering, domain experts, and external partner firms. You own... ...outcome and the quality bar; the applied science team owns the science underneath it....
Emploi permanent
Temps plein
Travail au bureau
Travail à distance
Horaires flexibles
3 jours par semaine
Caseware
Toronto, ON
il y a 28 jours
Software Engineer - Data Science
$90 - $110 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: Software & Data Science Expert Type: Contract Compensation: $90–$110/hour...
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Sales Engineering Expert - Evaluator
$100 - $150 par heure
...technical talent with leading AI research labs. Headquartered in... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk.... ...infrastructure, cybersecurity, data platforms, developer tools, or...
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Privacy Compliance Expert - Evaluator
$80 - $120 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour...
Temps plein
Сontrat
Travail d'été
Travail au bureau
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Legal Compliance Expert - Evaluator
$80 - $120 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...
Temps plein
Сontrat
Travail d'été
Travail au bureau
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Business Operations Expert - Evaluator
$60 - $80 par heure
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...
Taux horaire
Temps plein
Сontrat
Pour les contractants
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a un mois
Data Science Expert - Evaluation Specialist
$120 - $170 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour...
Travail à distance
Сontrat
Travail d'été
Mercor
Toronto, ON
Il y a un mois
Customer Success Evaluator - Expert
$80 - $120 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...
Temps plein
Сontrat
Travail d'été
Travail au bureau
Travail à distance
Mercor
Toronto, ON
Il y a un mois
Enterprise Data Science Specialist
$60 - $70 par heure
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/...
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a un mois
RQ00745-Data Science Developer
$68.55 - $82.26 par heure
...RQ00745 -Requisition TitleData Science Developer Location: Toronto... ...that turns public health data into timely analytics, surveillance... ...prioritize use cases and integrate AI techniques (machine learning,... .... The client will evaluate candidates based on both rate expectations...
Temps plein
Source Code
Toronto, ON
Il y a 2 mois
Financial Compliance AI Evaluator
$80 - $120 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...
Temps plein
Сontrat
Travail d'été
Travail au bureau
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Senior Data/AI Engineer
$135k - $210k par année
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the... ...Best Practices: Collaborate with data science and engineering teams to establish and implement... ...for LLMOps, including automated evaluation using frameworks like LLM Judges or MLflow...
Temps plein
Le monde entier
Guidepoint
Toronto, ON
Il y a 2 mois
Data Science Intern, Algorithms (Summer 2027)
$45 - $48 par heure
...members belong and have the opportunity to thrive. Lyft’s Data Science Team builds mathematical models underpinning the platform’s core... ...and ML models to enable better decisions, and developing and evaluating algorithmic policies in our pricing, dispatch, and incentives...
Taux horaire
Travail d'été
Stage
Stage d'été
Travail au bureau
3 jours par semaine
Lyft
Toronto, ON
il y a 26 jours
Director, Data & AI (Hybrid)
...Starts Here We’re looking for a Director, Data & AI to lead our Data Engineering, Data & ML Platform, Data Science, and Applied AI teams. You'll own the strategy,... ...experimentation frameworks, guardrail metrics, and evaluation pipelines that drive confident product...
Taux horaire
Contrat Longue Durée
Temps plein
Travail temporaire
Stage
Travail au bureau
Zone locale
Travail à domicile
Relocation
Horaires flexibles
Homebase
Toronto, ON
Il y a un mois
Data Analysis Expert - Evaluator
$80 - $120 par heure
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ..., Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120...
Travail à distance
Сontrat
Travail d'été
Travail au bureau
Mercor
Toronto, ON
il y a 21 jours
Senior Data Engineer, AI & Agents
.... Endless possibilities. As a Senior Data Engineer, AI & Agents, you will prepare enterprise domain... ...stakeholders and subject-matter experts. The role centers on building and registering... ...’s or Master’s degree in Computer Science, Information Systems, Engineering, or a...
Temps plein
Сontrat
Appnovation Technologies
Toronto, ON
Il y a un mois
DevOps Engineer - AI Model Evaluator
$85 par heure
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Data Scientist - AI Evaluation
$100 - $150 par heure
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...specific grading criteria for data science deliverables. This includes exploratory... ..., and technical reports. Evaluate AI-generated or human-created...
Travail à distance
Сontrat
Travail d'été
Mercor
Toronto, ON
il y a 28 jours
IT Consulting Expert - AI/ML
$65 - $85 par heure
...and technical talent with leading AI research labs. Headquartered in San... ...Responsibilities Review and evaluate AI-generated outputs related to solution... ...requirements gathering, and vendor evaluation. Annotate, label, and validate data across IT services use cases like...
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois
Vice President, Data Analytics & AI
...managers and practiced subject matter experts. And in each area of our evolving business... ...Officer (CTIO), the Vice President, Data Analytics & AI is the executive leader responsible for... ...or postgraduate education in computer science, data science, engineering, mathematics...
Contrat Longue Durée
Temps plein
Stage
Travail au bureau
Mattamy Homes
Toronto, ON
Il y a 2 mois
Senior Software Engineer, AI-Native Data Warehouse
$165k - $190k par année
...300+ GPs, unifying technology, data, and fund administration services... ...JunieAI, our purpose-built AI platform, we’re reimagining how... ...technical design for complex projects, evaluating tradeoffs and proposing... ...~ Grow into a subject-matter expert in Dex, with a deep understanding...
Travail à distance
Temps plein
Stage
Travail au bureau
Zone locale
Travail à domicile
Juniper Square
Toronto, ON
il y a 27 jours
AI Scenario Designer - Creative Expert
$30 - $80 par heure
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... .... Run the agent against scenarios, evaluate performance, and guide it to success through... ...designer or UX researcher. Technical/data comfort with JSON , Jira/Asana , or exposure...
Temps plein
Сontrat
Travail d'été
Travail à distance
Mercor
Toronto, ON
Il y a 2 mois

Voulez-vous recevoir plus d'offres d'emploi ?

S'abonner et recevoir des offres d'emploi similaires à Data Science Expert - AI Evaluation. Soyez parmi les premiers à postuler !

Recherches connexes