Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Analysis Expert - Evaluator

$80 - $120 per hour
Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Data analysis / quantitative readouts Evaluator

Type: Contract

Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines while enhancing domain quality.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Data analysis / quantitative readouts .
  • Native or professional fluency in English .
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides .

Preferred

  • Advanced degree ( Master's or higher ) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator in Toronto, ON vacancy
  • $120 - $170 per hour

     ..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation...  ..., metric definition, SQL/Python analysis, and communicating findings to executive...  ...Prior experience with AI training , evaluation, or human-data projects. Application... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    10 hours ago
  • $120 - $170 per hour

     ..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation...  ..., metric definition, SQL/Python analysis, and communicating findings to executive...  ...Prior experience with AI training , evaluation, or human-data projects. Application... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    10 hours ago
  • $100 - $150 per hour

     ...Position: Cybersecurity Labeling Expert Type: Contract...  ...harm across domains like scaled data exfiltration , ransomware ,...  ..., and exploits . Evaluate POC exploit development to determine...  ...background: red team, malware analysis, pen testing, or exploit... 
    Suggested
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $100 - $150 per hour

     ...Position: Sales Engineering Expert Type: Contract...  ...supporting proofs of concept, and evaluating product fit and technical risk...  ...infrastructure, cybersecurity, data platforms, developer tools, or...  ...experience with AI training , evaluation, or human-data projects.... 
    Suggested
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Suggested
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    10 hours ago
  • $80 - $120 per hour

     ...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour...  ...outputs. Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet deadlines... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work
    Flexible hours

    Mercor

    Toronto, ON
    10 hours ago
  • $80 - $120 per hour

     ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $60 - $80 per hour

     ...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:... 
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $80 - $120 per hour

     ..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    10 hours ago
  •  ...The Data Architect (Data & Analytics) will architect and deliver comprehensive data solutions using Microsoft Fabric . You will work...  ...Consultation: Engage with clients to gather requirements, provide expert advice, and recommend best practices for leveraging Microsoft... 
    Permanent employment
    Full time

    Toparo

    Toronto, ON
    10 hours ago
  • $100k - $140k per year

     ...problems, and literally change the world. And that is something to be excited about! Your role and responsibilities: As a Photonics Data Analysis Engineer, you will join our Test and Measurement team to build the software that drives the analysis and measurement of on-chip... 
    Full time

    Xanadu

    Toronto, ON
    10 hours ago
  • $100 - $150 per hour

     ...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type:...  ..., and A/B test write-ups . Evaluate AI-generated or human-created work against...  ...Provide detailed written justifications for evaluations and scores to maintain transparency and... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $80 per hour

     ...'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract...  ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $100 - $150 per hour

     ...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical Data Manager / CDISC Type: Contract Compensation: $100–$150/hour Location: Remote Commitment: 20–25... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    10 hours ago
  • $60 - $70 per hour

     ...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  • $80 - $120 per hour

     ...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities... 
    Full time
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Toronto, ON
    13 days ago
  •  ...Our Digital Expertise Transformation Experts: We transform traditional business models...  .... We have received many applications from Data Engineers with experience in other stacks...  ...complex SQL queries for data transformation and analysis Create and maintain XDM schemas for... 
    Full time

    Tribalscale

    Toronto, ON
    18 hours ago
  • $72 - $80 per hour

     ...Dorsey . Position: Physics Chart Analysis Expert Type: Contract Compensation...  ...Author and review technical tasks to evaluate AI model performance on physics...  ...original problem sets using experimental data plots, phase diagrams, spectra, and field... 
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work
    Flexible hours

    Mercor

    Toronto, ON
    18 hours ago
  • $67 - $75 per hour

     ...Dorsey . Position: Mathematics Chart Analysis Expert Type: Contract...  ...review, and annotate technical tasks to evaluate AI model performance on mathematics problems...  ...structured feedback to improve training data quality and downstream performance.... 
    Hourly pay
    Full time
    Contract work
    For contractors
    Summer work
    Remote work
    Flexible hours

    Mercor

    Toronto, ON
    18 hours ago
  • $85k - $135k per year

     ...for a Financial Planning and Analysis Manager to join our team and...  ...in building out their models, evaluating investment cases and leading...  ...modeling, investment case evaluation, and variance analysis (budget...  ...more information about how your data is processed, please contact... 
    Full time
    Flexible hours

    Routethis

    Toronto, ON
    18 hours ago
  • $130k - $180k per year

     ...assets, enabling a new era of data-driven exploration and innovation...  ...the Satellite Engineering and Analysis (SEA) team. As a Satellite...  ...to onboarding, peer evaluations, regular 1:1s, and team development...  ...Attributes: Problem-Solving: Expert in spacecraft-level... 
    Long term contract
    Full time
    Internship
    Work at office
    Relocation package

    Kepler Communications Inc.

    Toronto, ON
    18 hours ago
  • $50 per hour

     ...Commitment: 15–20 hours/week Role Responsibilities Evaluate AI models on visual document understanding and instruction-...  ...to enhance model outputs. Collaborate with subject matter experts to ensure task consistency and relevance. Work independently... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago
  •  ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated...  ...QA / test engineering, with exposure to data/ML systems. ~ Strong Python and data-science...  ...evaluation frameworks and statistical analysis. ~ Ability to build automated, large-... 
    Full time
    Immediate start

    Appnovation Technologies

    Toronto, ON
    10 hours ago
  • $70k - $73.85k per year

     ...an existing vacancy.   Objective:   The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy...  ...~ Collects, organizes, analyzes, and communicates data in the form of research findings to advance sector program... 
    Full time
    Internship

    Ofifc

    Toronto, ON
    18 hours ago
  • $100k - $130k per year

     ...The Opportunity This role sits at the intersection of finance, data, and strategy and is critical to delivering forward-looking...  ...reporting role. This role will help drive how Financial Planning & Analysis partners with the business, leveraging data, modeling, and storytelling... 
    Long term contract
    Full time
    Remote work
    Flexible hours

    Mawer Brand

    Toronto, ON
    18 hours ago
  • $90k - $110k per year

     ...our next Manager Business Performance and Analysis  located in our Etobicoke, ON Corporate...  ...presentations to support leadership in evaluating business initiatives and decisions. Lead...  ...technologies to build a culture of data-driven insights that facilitates informed... 
    Long term contract
    Full time
    Contract work
    For contractors
    Work at office
    Local area
    Flexible hours
    2 days per week

    Sodexo Canada

    Toronto, ON
    18 hours ago
  • $70k - $80k per year

     ...Finance Department, taking responsibility for the preparation and analysis of financial statements, budget development, and forecasting....  ...insightful financial reports for senior leadership, translating complex data into actionable recommendations. -Identify and recommend... 
    Full time
    Flexible hours

    Movati Athletic

    Toronto, ON
    18 hours ago
  • $80 - $160 per hour

     ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards...  ...in Excel , PowerPoint , and Word ~ Strong document analysis and review skills ~ Attention to detail and ability to follow... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    11 hours ago
  •  ...The Work   The purpose of the Manager, Financial Planning & Analysis is to conduct in-depth analysis to facilitate fact based, informed...  ...the candidate to collect, consolidate and analyze financial data and key performance metrics derived from various sources A high... 
    Permanent employment
    Full time

    Eq Bank

    Toronto, ON
    18 hours ago
  • $80 - $150 per hour

     ...Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation...  ...structured feedback to enhance document evaluation processes. Utilize MS Excel and...  ...Google Slides . ~ Strong document analysis and review skills. Preferred... 
    Full time
    Contract work
    Summer work
    Remote work

    Mercor

    Toronto, ON
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!