Data Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Data Evaluator - Fully Remote | Upto $120/hr in Toronto, ON vacancy
$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: FP&A / corporate finance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against...Remote jobDataContract workSummer workWork at office$120 per hour
...Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to enhance training data quality and domain relevance. Work independently...Remote jobDataContract workSummer workWork at office$120 per hour
...Position: General finance / accounting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...with AI research teams to enhance training data quality. Work independently and asynchronously...Remote jobDataContract workSummer workWork at office$120 per hour
...Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities... ...to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
...Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to enhance training data quality and performance. Work independently...Remote jobDataContract workSummer workWork at office$120 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Position: Legal Expert — Transactional / Corporate (Remote, Hourly) Type: Contract Compensation: $85–$120/hour Location: Remote Commitment... ...offerings. Familiarity with virtual data rooms like Intralinks or Datasite . Start...Remote jobDataHourly payContract workSummer workWork at officeImmediate start$120 per hour
...Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...to support AI model training . Evaluate the accuracy of AI-generated equity... ...research teams to enhance training data quality and performance. Work independently...Remote jobDataContract workSummer work$120 per hour
...Legal Expert — Specialist (Real Estate, Tax, Bankruptcy, Estates) Type: Contract Compensation: $85–$120/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Design realistic specialty scenarios from your...Remote jobHourly payContract workFor contractorsSummer workWork at officeImmediate start$60 per hour
...: Contract Compensation: $60/hour Location: Remote Role Responsibilities Shoot 10 input images of people... ...Work Trial: Selected candidates will complete a paid Work Trial ($120) . Successful candidates will be onboarded to the project and...Remote jobHourly payContract workSummer work$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$90 per hour
...Compensation: $70–$90/hour Location: Remote Commitment: 4–6 tasks/week... ...Responsibilities Develop high-quality data sets by creating challenging problems in... ..., Astrophysics , and Cosmology . Evaluate and refine AI model training to enhance...Remote jobDataContract workSummer work$20 per hour
...Contract Compensation: $15–$20/hour Location: Remote Role Responsibilities Conduct fact-checking using... ...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and...Remote jobDataContract workPart timeSummer work$100 per hour
...Compensation: $100/hour Location: Remote Commitment: 10+ hours/week... ...strategies for AI initiatives. Synthesize data into actionable insights using... ...planning, scenario modeling, and opportunity evaluation. Qualifications Must-Have...Remote jobDataContract workSummer work$80 per hour
...Compensation: $60–$80/hour Location: Remote Commitment: 15–20 hours/week... ...plans, reports, and presentations. Evaluate AI models on professional document... ...instruction following. Create objective evaluation rubrics for AI model assessment. Collaborate...Remote jobContract workSummer work$150 per hour
...Generalist) Type: Contract Compensation: $150/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week Role Responsibilities Evaluate AI model outputs for clinical accuracy, safety, and alignment with medical...Remote jobContract workSummer workImmediate start$120 per hour
...Larry Summers , and Jack Dorsey . Position: FP&A Experts Type: Contract Compensation: $85–$120/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct FP&A scenarios for public-company planning...Remote jobHourly payWeekly payContract workPart timeFor contractorsSummer work$110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities... ..., web search, and code execution. Create objective evaluation rubrics to assess AI performance in the Finance & Banking domain...Remote jobContract workSummer work$70 per hour
...Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning. Provide structured written feedback to...Remote jobContract workSummer work$90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Commitment: 4–6 tasks/week Role Responsibilities... ...Mechanics to inform future AI innovation . Create high-quality data sets to advance state-of-the-art large language models ....Remote jobDataContract workSummer work$100 per hour
...Jack Dorsey . Position: Nurse Practitioners Type: Contract Compensation: $80–$100/hour Location: Remote Duration: 3–4 weeks Commitment: 30–40 hours/week Role Responsibilities Create deliverables addressing common...Remote jobContract workSummer workImmediate startFlexible hours$22 per hour
...Contract Compensation: $20–$22/hour Location: Remote Role Responsibilities Red team conversational AI models... ...cases, and bias exploitation. Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic...Remote jobDataContract workSummer work$150 per hour
...Voice Actor: CX Agent Voice Cloning (Canadian French) Type: Contract Compensation: $50–$150/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Record high-quality voice samples across diverse scripts such...Remote jobContract workSummer work10 hours per week$90 per hour
...Contract Compensation: $90/hour Location: Remote Role Responsibilities Develop end-to-end... ...modeling approaches, validation strategies, and evaluation metrics. Perform exploratory data analysis, feature engineering, and data preprocessing....Remote jobDataContract workSummer work$90 per hour
...Compensation: $70–$90/hour Location: Remote Role Responsibilities Evaluate complex physics problems to inform AI model training... ...research teams to enhance model outputs and improve data quality. Work independently and asynchronously to...Remote jobDataContract workSummer work$90 per hour
...Jack Dorsey . Position: Cybersecurity Experts Type: Contract Compensation: $70–$90/hour Location: Remote Duration: ~2 months Role Responsibilities Analyze and review content for security vulnerabilities with a focus...Remote jobContract workSummer work$80 per hour
...Compensation: $55–$80/hour Location: Remote Role Responsibilities... ...language models . Create high-quality data to inform the future of AI innovation by... ...challenging problems in your domain. Evaluate and improve AI model training and outputs...Remote jobDataContract workSummer work$22 per hour
...Contract Compensation: $20–$22/hour Location: Remote Role Responsibilities Red team conversational AI models... ...cases, and bias exploitation. Generate high-quality human data. Annotate failures, classify vulnerabilities, and flag systemic...Remote jobDataContract workSummer work$100 per hour
...Suite Experts Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform...Remote jobContract workSummer workWork at officeImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- web search evaluator Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- remote social media evaluator Toronto, ON
- clinical data abstraction Toronto, ON