Data Quality Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data quality / CRM operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data quality / CRM operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Data Quality Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$100 - $150 per hour
...Dorsey . Position: Software Engineer Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... ...matter expertise to grade outputs and enhance quality. Work independently and asynchronously...SuggestedContract workSummer workWork at officeRemote workMercor
Toronto, ON28 days ago$80 - $120 per hour
...Position: Privacy / regulatory compliance Evaluator Type: Contract... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,... ...with AI research teams to enhance training data quality. Work independently and asynchronously...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hoursMercor
Toronto, ONmore than 2 months ago$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or... ...experience with AI training , evaluation, or human-data projects....SuggestedFull timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hoursMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Position: Procurement / vendor management Evaluator Type: Contract... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Full timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...established criteria to ensure quality and consistency. Provide... ...detailed written justifications for evaluations and scores to maintain...Full timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Full timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$100 - $150 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated artifacts for usability... ...research teams to enhance training data quality. Work independently and asynchronously...Remote jobContract workSummer workWork at office$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote workMercor
Toronto, ONmore than 2 months ago$80 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Full timeContract workSummer workRemote workMercor
Toronto, ONa month ago$20 - $50 per hour
...Summers , and Jack Dorsey . Position: Quality Analyst Type: Contract... ...improve quality processes, checklists, and evaluation criteria. Collaborate asynchronously... ...Preferred Familiarity with data annotation, content review, or evaluation...Remote jobContract workSummer work$120 - $170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...teams to improve training data quality and downstream performance. Qualifications... ...Prior experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$120 - $170 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...Remote jobContract workSummer work$60 - $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities...Full timeContract workSummer workRemote workMercor
Toronto, ONa month ago$15 - $30 per hour
...individuals, from creative producers to technical experts to entrepreneurial leaders, who can help... .... Across strategy, engineering, design, data, and operations, we seek out teammates who... .... You'll be the person who keeps product quality tight so leadership can stay focused on...Remote jobHourly payFull timeContract workFor contractorsManual laborImmediate startFlexible hoursHuman Agency Inc
Toronto, ON19 days ago$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text... ...annotation, language evaluation, or NLP data work in English. Strong understanding...Remote jobContract workSummer work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours$180k - $220k per year
...BitGo is seeking a skilled Senior Data Engineer to join our Data... ...product managers, and security experts across multiple domains, gaining... ...systems. Ensure high data quality and auditability across all... ...scale data platform. Research, evaluate, and prototype new...Full timeWork at officeWorldwideBitgo
Toronto, ON8 days ago$90k - $100k per year
...Description The Quality and Compliance Manager is responsible for ensuring that Tayco's products, processes, and documentation comply... .... Continuous Improvement & Quality Culture Analyze quality data (defect rates, customer complaints, returns, scrap/rework) to identify...Full timeBrc Group Ltd
Toronto, ON22 days ago- ...Position: Data Scientist Location: Toronto, ON... ...digitization methodologies, data quality improvement practices, and management... ...Symbiotic Digital provides the IT Experts you need that solve problems... ...with proven Experts uniquely evaluated by our proven QMS- Quality Management...Full time
Symbiotic Digital
Toronto, ON24 days ago $14 - $42 per hour
...Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics...Full timeContract workSummer workImmediate startRemote workMercor
Toronto, ONmore than 2 months ago$30 per hour
...Dorsey . Position: Multimodal Image Expert Type: Contract... ...Remote Role Responsibilities Evaluate pairs of AI-generated images against original... ...images based on prompt alignment, visual quality, anatomy, structure, rendered text, and artifacts...Remote jobHourly payWeekly payContract workFor contractorsSummer work$80 - $120 per hour
...Position: Humanities / arts / culture Evaluator Type: Contract Compensation... ...artifacts against domain-specific quality rubrics. Identify factual, aesthetic... .... Collaborate with subject matter experts to ensure consistency and quality....Remote jobContract workSummer workWork at office$14 per hour
...Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics , voice... ...standards to enhance musical quality. Score the quality of musical training data to ensure high standards in model...Remote jobContract workSummer workImmediate start$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ..., and technical reports. Evaluate AI-generated or human-created... ...established criteria to ensure quality and accuracy. Provide detailed... ...written justifications for evaluations and scores to maintain transparency...Remote jobContract workSummer work- ...Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. Purpose The Data Management and Quality team is responsible for enterprise Data Quality Governance and Issue Management. The team establishes common standards, controls...Permanent employmentFull time
$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Remote jobContract workSummer workWork at office$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Quality Expert - Evaluator. Be the first to apply!
Related searches
- estimateur structure Toronto, ON
- admissions evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur - dessinateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur industriel Toronto, ON