Data Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Data Evaluator - Fully Remote | Upto $120/hr in Toronto, ON vacancy
$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: FP&A / corporate finance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Summers , and Jack Dorsey . Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...to support AI model training . Evaluate the accuracy of AI-generated equity... ...research teams to enhance training data quality and performance. Work independently...Remote jobDataContract workSummer work$120 per hour
...Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to enhance training data quality and performance. Work independently...Remote jobDataContract workSummer workWork at office$60 per hour
...: Contract Compensation: $60/hour Location: Remote Role Responsibilities Shoot 10 input images of people... ...Work Trial: Selected candidates will complete a paid Work Trial ($120) . Successful candidates will be onboarded to the project and...Remote jobHourly payContract workSummer work$80 per hour
...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience)... ...Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobDataContract workSummer work$90 per hour
...Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop challenging... .... Collaborate with AI labs to create high-quality data for large language models. Evaluate and improve AI model outputs using domain expertise....Remote jobDataContract workSummer work$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex security engineering tasks . Review model-generated code and architectures...Remote jobContract workSummer work$70 per hour
...Position: Shopify Expert Type: Contract Compensation: $50–$70/hour Location: Remote Role Responsibilities Evaluate and optimize Shopify store performance to enhance user experience. Design and implement custom solutions...Remote jobContract workSummer work$180 per hour
...Contract Compensation: $180–$400/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment:... ...Cardiology practice, such as ACS management , arrhythmia evaluation , and heart failure optimization . Write "golden" reference...Remote jobWeekly payContract workSummer workWork at office$180 per hour
...Top 50 Program, US/UK/CA) Type: Contract Compensation: $70–$180/hour Location: Remote Role Responsibilities Solve and evaluate challenging physics problems across various subfields. Review AI-generated proofs , derivations,...Remote jobContract workSummer workImmediate start$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated code for correctness, quality, maintainability...Remote jobContract workSummer work$50 per hour
...Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $40–$50/hour Location: Remote Role Responsibilities Build MCP servers in Python using FastMCP . Integrate web or desktop applications into...Remote jobContract workSummer workLocal area$90 per hour
...ScreenSpot Plus (Screenshot Capture & UI Annotation) Type: Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Capture high-quality screenshots of professional CAD software during realistic, expert workflows....Remote jobContract workSummer work$180 per hour
...and Jack Dorsey . Position: Radiology Expert Type: Contract Compensation: $130–$180/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment: 20+ hours/week Role Responsibilities Design clinically...Remote jobWeekly payContract workSummer workWork at office$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile application code for correctness...Remote jobContract workSummer work$50 per hour
...Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy and depth of AI-generated... ...Radiology domain. Experience with AI model evaluation and visual document understanding ....Remote jobContract workPart timeSummer work$85 per hour
...Contract Compensation: $85/hour Location: Remote Commitment: 4–6 tasks/week Role Responsibilities... ...state-of-the-art large language models . Create high-quality data to inform the future of AI innovation . Collaborate with...Remote jobDataContract workSummer work$100 per hour
...STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type... ...: $70–$100/hour Location: Remote Commitment: 15–20 hours/week... ...strategies to recover hidden information from data, emphasizing strategic reasoning. Calibrate...Remote jobDataContract workSummer work$20 per hour
...Contract Compensation: $15–$20/hour Location: Remote Role Responsibilities Conduct fact-checking using... ...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and...Remote jobDataContract workPart timeSummer work$130 per hour
.... Position: Senior Software Engineer Expert Type: Contract Compensation: $80–$130/hour Location: Remote Role Responsibilities Design, develop, and maintain full-stack applications using Python . Build and integrate APIs...Remote jobContract workSummer work$110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Duration: 3–4 weeks Commitment: 30–40 hours/... .... Collaborate with AI research teams to improve training data quality. Qualifications Must-Have ~4+ years professional...Remote jobDataContract workSummer workImmediate start$150 per hour
...Voice Actor: CX Agent Voice Cloning (Standard French) Type: Contract Compensation: $50–$150/hour Location: Remote Commitment: 5–10 hours/week Role Responsibilities Record high-quality voice samples across diverse scripts such...Remote jobContract workSummer work10 hours per week$100 per hour
...Compensation: $100/hour Location: Remote Commitment: 10+ hours/week... ...strategies for AI initiatives. Synthesize data into actionable insights using... ...planning, scenario modeling, and opportunity evaluation. Qualifications Must-Have...Remote jobDataContract workSummer work$80 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Registered Nurses (Data labelling and training) Type: Contract Compensation: $60–$80/hour Location: Remote Role Responsibilities Review and assess clinical documentation...Remote jobDataContract workSummer work$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated frontend code for correctness, quality...Remote jobContract workSummer work$180 per hour
...Dorsey . Position: Emergency Medicine Expert Type: Contract Compensation: $130–$180/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment: 20+ hours/week Role Responsibilities Design clinically...Remote jobWeekly payContract workSummer workWork at office$90 per hour
...Compensation: $70–$90/hour Location: Remote Commitment: 4–6 tasks/week... ...Responsibilities Develop high-quality data sets by creating challenging problems in... ..., Astrophysics , and Cosmology . Evaluate and refine AI model training to enhance...Remote jobDataContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
Related searches
- estimateur en bâtiment Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- chargé de projet estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- data network cabling Toronto, ON
- gis data Toronto, ON