Data Quality Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data quality / CRM operations Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data quality / CRM operations .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Data Quality Expert - Evaluator in Toronto, ON vacancy
$100 - $150 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...Role Responsibilities Evaluate AI-generated artifacts for usability... ...research teams to enhance training data quality. Work independently and asynchronously...SuggestedRemote jobContract workSummer workWork at office$120 - $170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...teams to improve training data quality and downstream performance. Qualifications... ...Prior experience with AI training , evaluation, or human-data projects....SuggestedRemote jobContract workSummer work$120 - $170 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20...SuggestedRemote jobContract workSummer work$20 - $50 per hour
...Summers , and Jack Dorsey . Position: Quality Analyst Type: Contract... ...improve quality processes, checklists, and evaluation criteria. Collaborate asynchronously... ...Preferred Familiarity with data annotation, content review, or evaluation...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$50 per hour
...Dorsey . Position: French Linguistic Experts Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated French text... ...editing, linguistic annotation, or NLP data work in French. Strong understanding...Remote jobContract workSummer work$150 per hour
...Jack Dorsey . Position: Healthcare Expert Type: Contract... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging... ...focusing on clinical accuracy, safety, and quality of medical reasoning. Provide written...Remote jobContract workSummer workImmediate start$39 per hour
...answering questions, and correcting errors. Rate the experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional healthcare standards. Work independently and asynchronously to meet...Remote job$39 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Healthcare...Full timeContract workSummer workRemote work$57 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobHourly payContract workFor contractorsSummer work- ...role. Job Description: CUSTOMER Perform data analysis and assist in assessing data... ...knowledge provided through data profiling, data quality reporting, and via the production of... ...acting as a project lead / subject matter expert for small scale projects / initiatives in...Full timeWork from home
$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ..., and technical reports. Evaluate AI-generated or human-created... ...established criteria to ensure quality and accuracy. Provide detailed... ...written justifications for evaluations and scores to maintain transparency...Remote jobContract workSummer work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours$80 - $120 per hour
...Position: Government / public administration Evaluator Type: Contract... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic... .... Collaborate with subject matter experts to ensure accuracy and domain quality....Remote jobContract workSummer workWork at office$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated English text... ...annotation, language evaluation, or NLP data work in English. Strong understanding...Remote jobContract workSummer work$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Remote jobContract workSummer workWork at office$14 per hour
...Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...Role Responsibilities Evaluate AI model output lyrics , voice... ...standards to enhance musical quality. Score the quality of musical training data to ensure high standards in model...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...Position: Finance operations / audit support Evaluator Type: Contract... ...generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic,... ...with AI research teams to enhance training data quality and domain relevance. Work independently...Remote jobContract workSummer workWork at office- ...contribute. To learn more about CIBC, please visit CIBC.com What you’ll be doing The Analyst will support the Director of Data Quality and Reconciliations team, Treasury Data Management to ensure the data integrity in Treasury owned applications. The role will ensure...Work at office3 days per week1 day per week
$30 per hour
...Dorsey . Position: Multimodal Image Expert Type: Contract... ...Remote Role Responsibilities Evaluate pairs of AI-generated images against original... ...images based on prompt alignment, visual quality, anatomy, structure, rendered text, and artifacts...Remote jobHourly payWeekly payContract workFor contractorsSummer work$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...cloud infrastructure , cybersecurity , data platforms , developer tools , or enterprise... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...to meet deadlines while improving evaluation processes. Qualifications Must-Have... ...with AI training , evaluation, or human-data projects. Application Process (Takes...Remote jobContract workSummer work$80 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30 mins to complete...Remote jobContract workSummer work$100 - $150 per hour
...Dorsey . Position: Software Engineer Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... ...matter expertise to grade outputs and enhance quality. Work independently and asynchronously...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics to ensure accuracy and rigor. Identify factual, aesthetic...Remote jobContract workSummer workWork at office$50 - $70 per hour
...and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for quality and correctness. Provide clear, well-reasoned...Remote jobContract workSummer workFlexible hours$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and presentation errors...Remote jobContract workSummer workWork at officeFlexible hours$120 - $180 per hour
...Summers , and Jack Dorsey . Position: Senior Data Scientist and Data Engineering Experts Type: Contract Compensation: $120–$180... ...and iterate on submitted work. Train and evaluate frontier AI models using expertise from top technology...Remote jobContract workSummer work$100 - $150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...established criteria to ensure quality and consistency. Provide... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$70 - $100 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location:...Remote jobContract workSummer workInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Quality Expert - Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON