Data Quality Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data quality / CRM operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data quality / CRM operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Quality Expert - Evaluator in Toronto, ON vacancy
$120 - $170 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Position: Product management / roadmap / PRD Evaluator Type: Contract... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,... ...with AI research teams to enhance training data quality. Work independently and asynchronously...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Position: Privacy / regulatory compliance Evaluator Type: Contract... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,... ...with AI research teams to enhance training data quality. Work independently and asynchronously...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Incident management / reliability / SRE Evaluator Type: Contract Compensation... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic... ...Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Healthcare operations Evaluator Type: Contract Compensation... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic... ...asynchronously to ensure high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$14 per hour
...Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics , voice... ...standards to enhance musical quality. Score the quality of musical training data to ensure high standards in model...Remote jobContract workSummer workImmediate start$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$50 - $70 per hour
...and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness. Provide clear, well-reasoned...Remote jobContract workSummer workFlexible hours$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete...Remote jobContract workSummer work$85k - $156k per year
...and communities to enjoy the quality of life that comes with a sustainable... ...from deep subject matter experts through mentoring and on the... ...typical day look like? The Data Quality Management Lead is... ...against industry best practices. Evaluate emerging technologies and...Permanent employmentFlexible hours$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model performance .... ...Prior experience with AI training , evaluation, or human-data projects. Application Process (...Remote jobContract workSummer work$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...established criteria to ensure quality and consistency. Provide... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$80 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Remote jobContract workSummer work$60 - $65 per hour
Our client, a leading Canadian commercial property and casualty insurance provider, is seeking an experienced Data Quality Engineer (Contract) with 7+ years of hands-on experience in Data Quality, Data Warehouse testing, and ETL validation. In this key leadership role within...Permanent employmentContract workImmediate startFlexible hours2 days per week$19 per hour
...and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...identify similarities. Rate lyrics based on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice...Remote jobContract workSummer workImmediate start- ...-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator works... ...and statistical packages used for data analysis in evaluation. #Considerable... ...management, senior management and technical experts. ~Credentialed Evaluator designation,...Hourly payFull timeTemporary workPart timeInternshipMonday to friday
$68k - $72k per year
...team is looking to fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35 hours per week anywhere... ...enterprise planning processes, including workflow development, data tracking, analysis, and reporting. ~ Demonstrates organizational...Full timeInternshipWork at officeFlexible hoursWeekend work$14 per hour
...Dorsey . Position: Music Audio Expert - Punjabi Type: Contract... ...week Role Responsibilities Evaluate AI model output for lyrics and voice... ...music categories. Score the quality of musical training data to enhance model performance. Develop...Full timeContract workSummer workImmediate startRemote work$70 per hour
...Jack Dorsey . Position: Generalist Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...structured written feedback to improve training data quality and downstream performance. Develop...Remote jobContract workSummer work$61.25k - $76.53k per year
...Reporting to the QA Manager, the Quality Assurance Coordinator is... ...product analysis and sensory evaluations of McDonald's products.... ...Compile and report Monthly RFT data • Analyze and report all data... ...review • Train to become Sensory expert for VFC, and then take on annual...RemplacementContract workShift workWeekend work$14 - $42 per hour
...Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics...Remote jobContract workSummer workImmediate start$122k - $192k per year
...looking for an experienced DSM Evaluation Manager to join our expanding... ...reviewing deliverables to ensure quality for client submissions. You... ...staff, coordinating fieldwork, data collection, energy modeling,... ...energy efficiency programs. ~ Expert level understanding of...Full timeInternshipWork at officeLocal area$80k - $180k per year
..., an integration platform that connects data, systems, and workflows across complex enterprise... .... What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are... ...behaviour against defined business, quality, risk, performance, and regulatory criteria...Full time$22.63 per hour
...Our commitment to producing high-quality products starts with a strong quality team. Dart's... ...accurately within the computerized GainSeeker data collection system Conducting packaging... .... All applications are reviewed and evaluated by human decision-makers. Overview: Dart...InternshipShift work- ...opportunity to contribute to work that truly matters. Your New Role You are a senior, detail-oriented data professional with strong technical expertise in data quality, data governance, data cataloguing, stewardship, privacy, and security. You thrive in complex...Long term contractPermanent employmentWorldwide
$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word...Remote jobContract workSummer workWork at officeImmediate start$47k - $78k per year
...friends, families, and communities to enjoy the quality of life that comes with a sustainable... .... Learn from deep subject matter experts through mentoring and on the job coaching... ...and maintaining its accuracy through daily data entry Overseeing the workload distribution...Permanent employmentFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Quality Expert - Evaluator. Be the first to apply!
Related searches
- test evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- remote social media evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- data analytics Toronto, ON
- data Toronto, ON