Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote Data Science Expert: AI Evaluation & Experimentation

mercor

Mercor is seeking a Data Science Expert for a remote contract role. You will design precise grading criteria for real-world data science deliverables and score AI-generated and human work with detailed justifications.

You will apply evidence-based judgment to ensure scores are reproducible, incorporate feedback from senior reviewers, and work independently to meet deadlines while helping improve AI model performance.

#J-18808-Ljbffr
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Remote Data Science Expert: AI Evaluation & Experimentation in Toronto, ON vacancy
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Scientist Talent Network...  ...–$150/hour Location: Remote Role Responsibilities...  ...specific grading criteria for data science deliverables, including exploratory... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    13 days ago
  • $80 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Engineer (Coding Agent Experience...  ...$80/hour Location: Remote Role Responsibilities...  ...coding agents to complete and evaluate complex data engineering tasks... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...Starts Here We’re hiring a Manager, Data Science who’s excited to lead a team transforming...  ...wants to shape the future of applied AI at scale—leading everything from intelligent...  ..., sales/marketing targeting) Champion experimentation: design A/B and multivariate tests that... 
    Suggested
    Hourly pay
    Long term contract
    Temporary work
    Internship
    Work at office
    Local area
    Work from home
    Flexible hours

    Homebase

    Toronto, ON
    9 hours ago
  • $120 - $170 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Position: Software Engineer Expert Type: Contract Compensation...  ...$100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for... 
    Remote work
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $90 - $110 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Larry Summers , and Jack Dorsey . Position: Software & Data Science Expert Type: Contract Compensation: $90–$110/hour... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Sales Engineering Expert Type: Contract...  ...$150/hour Location: Remote Role Responsibilities...  ...supporting proofs of concept, and evaluating product fit and technical risk... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Privacy / regulatory compliance Evaluator Type: Contract...  ...–$120/hour Location: Remote Role Responsibilities...  ...research teams to enhance training data quality. Work independently... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office
    Flexible hours

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office
    Flexible hours

    Mercor

    Toronto, ON
    more than 2 months ago
  • $78.95k - $118.42k per year

     ...We seek a talented and driven Data Scientist passionate about accelerating...  ...through machine learning and AI to join our team at the...  ...contribute to our mission of open science and pre-competitive drug discovery...  ...or in collaboration with other experts in the Haibe-Kains and Schapira... 
    Remplacement
    Permanent employment
    Full time
    Internship
    Manual labor
    Flexible hours
    Shift work
    Day shift

    University Health Network

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $60 - $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $60 - $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting...  ...: $60–$80/hour Location: Remote Role Responsibilities Sign... 
    Remote work
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  .... Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Scientist Talent Network...  ...–$150/hour Location: Remote Role Responsibilities...  ...specific grading criteria for data science deliverables. This includes exploratory... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    3 days ago
  • $68.55 - $82.26 per hour

     ...RQ00745 -Requisition TitleData Science Developer Location: Toronto...  ...that turns public health data into timely analytics, surveillance...  ...prioritize use cases and integrate AI techniques (machine learning,...  .... The client will evaluate candidates based on both rate expectations... 
    Full time

    Source Code

    Toronto, ON
    more than 2 months ago
  • $125k - $135k per year

     ...Manager to own how Caseware builds, evaluates, and raises the quality of AI across the platform. You are the product...  ...scientists, engineering, domain experts, and external partner firms. You own...  ...outcome and the quality bar; the applied science team owns the science underneath it.... 
    Remote work
    Permanent employment
    Full time
    Work at office
    Flexible hours
    3 days per week

    Caseware

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote work
    Full time
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $45 - $48 per hour

     ...have the opportunity to thrive. Lyft’s Data Science Team builds mathematical models...  ...enable better decisions, and developing and evaluating algorithmic policies in our pricing, dispatch...  ...live traffic experiments Analyze experimental and observational data; communicate... 
    Hourly pay
    Summer work
    Internship
    Summer internship
    Work at office
    3 days per week

    Lyft

    Toronto, ON
    a month ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...Starts Here We’re looking for a Director, Data & AI to lead our Data Engineering, Data & ML Platform, Data Science, and Applied AI teams. You'll own the strategy...  ...intelligent automation. Own the MLOps lifecycle from experimentation to production. Drive data science rigor.... 
    Hourly pay
    Long term contract
    Full time
    Temporary work
    Internship
    Work at office
    Local area
    Work from home
    Relocation
    Flexible hours

    Homebase

    Toronto, ON
    more than 2 months ago
  • $85 - $93 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: Basic Medical Sciences Expert Type: Contract Compensation: $85–$93/hour Location: Remote Commitment: 20 hours/week Role... 
    Remote work
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...you ready to lead transformative AI initiatives and drive...  ...and maintenance. Integrate data (Metrics, Events, Logs, Traces)...  ...priorities and business objectives. Evaluate build‑vs‑buy decisions for AI infrastructure...  ...PhD degree in Computer Science, Engineering, Mathematics, or... 
    Full time

    RBC

    Toronto, ON
    3 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $70 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  .... Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment:... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    a month ago
  • $154k - $247k per year

     ...potential. Title and Summary Director, Data Science Mastercard is seeking a Director of Data...  ...the development and delivery of advanced AI and machine learning solutions for Consumer...  ...Incubate prototypes and proofs‑of‑concept to evaluate new methods before scaling into... 
    Worldwide

    Mastercard Inc.

    Toronto, ON
    3 days ago
  •  ...(~15 hours/week) Location: Remote Job Summary We are seeking...  ...Engineers to support an AI training project by creating reinforcement...  ...learning environments that evaluate AI models on complex software...  ...of algorithms and data structures . Experience with... 
    Remote job
    For contractors

    YO AI Labs

    Toronto, ON
    a month ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Position: Healthcare Expert Type: Contract...  ...$150/hour Location: Remote Commitment: 10–20 hours...  ...Role Responsibilities Evaluate and compare AI-generated responses... 
    Remote job
    Contract work
    Summer work
    Immediate start
    Flexible hours

    Mercor

    Toronto, ON
    11 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote Data Science Expert: AI Evaluation & Experimentation. Be the first to apply!