User Research Expert - Evaluator

$80 - $120 per hour

Mercor

Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: User/customer research and feedback synthesis Evaluator

Type: Contract

Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts against domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
Provide clear, structured written feedback to improve AI model outputs .
Work independently and asynchronously to meet deadlines and enhance AI model performance .
Collaborate with subject matter experts to ensure consistency and quality across datasets.

Qualifications

Must-Have

5+ years of relevant professional experience in User/customer research and feedback synthesis .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace , especially Slides .

Preferred

Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: Show email

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 12 days ago

Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in Toronto, ON vacancy

Word Processing Specialist - Expert User
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...bullet points. Collaborate with team members for document evaluation and feedback. Qualifications Must-Have...
Suggested
Full time
Contract work
Summer work
Mercor
Toronto, ON
14 hours ago
Google Forms Specialist - Expert User
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...
Suggested
Full time
Summer work
Mercor
Toronto, ON
14 hours ago
Data Quality Expert - Evaluator
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
14 hours ago
Customer Success Evaluator - Expert
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
14 hours ago
Sales Engineering Expert - Evaluator
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....
Suggested
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Business Operations Expert - Evaluator
$60 - $80 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract...
Hourly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Legal Compliance Evaluator - Expert
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
14 hours ago
Legal Compliance Expert - Evaluator
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
14 hours ago
Research and Evaluation Specialist - Justice
$70k - $73.85k per year
...This Job Posting will be closed on July 29, 2026 at 5:00 pm and this posting is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will...
Full time
Internship
Ofifc
Toronto, ON
14 hours ago
Data Science Expert - Evaluation Specialist
$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Data Science Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Data Science Expert - AI Evaluation
$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Data Science Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Research Specialist - Domain Expert
$40 - $70 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: Generalist Search Expert Type: Contract... ...Role Responsibilities Evaluate the accuracy and depth of AI... ...downstream performance. Develop evaluation rubrics and benchmarks for...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
User Acquisition Manager
...We're looking for a passionate and data-driven User Acquisition Manager to join our fast-growing mobile gaming company. In this... ..., aligning the organization on growth strategy Conduct market research and competitor analysis to identify trends, growth opportunities,...
Full time
Stillfront
Toronto, ON
14 hours ago
UX DESIGNER (IT) (H/F) (remote)
...space/statement, the long and short -term business goals, and the user and business needs. \\ \\ \ \ o \ \\\\ Facilitate the... ...Challenges, Problem Statement \\ \\ o \ \\\\ Facilitate user research activities to produce such outputs as: \\ \\ o \ \\\\ User...
Long term contract
Full time
Contract work
Temporary work
Remote work
Yoush Consulting
Toronto, ON
14 hours ago
Head of User Acquisition
...and a mission that's making healthcare better for Canadians. About the Role We're looking for a strategic, data-driven Head of User Acquisition to own how Phoenix acquires customers across paid and organic channels. Paid media will be the core of this role - you'll...
Full time
Internship
Work at office
Remote work
Flexible hours
Shift work
The Phoenix
Toronto, ON
14 hours ago
Senior MixedMethods User Research Specialist | Spécialiste sénior·e en recherche utilisateur·rice mi
...protected characteristics as per applicable law. Behaviour is committed to creating player-first experiences, and the Senior User Research Specialist plays a pivotal role in ensuring our games resonate deeply with our audience. By conducting in-depth user studies and applying...
Full time
Worldwide
Behaviour Interactive
Toronto, ON
14 hours ago
Office Document Evaluation Specialist
$70 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Office-Suite Experts Type: Contract... .../week Role Responsibilities Evaluate AI-generated office artifacts in Excel...
Full time
Contract work
Summer work
Work at office
Immediate start
Remote work
Mercor
Toronto, ON
14 hours ago
Hindi Music Specialist - Evaluator
$14 - $42 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres....
Full time
Contract work
Summer work
Immediate start
Remote work
Mercor
Toronto, ON
14 hours ago
macOS Sonoma Expert - Power User
$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:... ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your...
Remote job
Contract work
Summer work
Mercor
Toronto, ON
3 days ago
IT User Training Coordinator
$60k per year
...community defined by opportunity, creativity, and growth. Who we need Reporting to the Director, IT Experience, we are hiring an IT User Training Coordinator to support the successful rollout, adoption, and day-to-day use of technology across the organization. As our new...
Full time
Remote work
Flexible hours
Yorkville University
Toronto, ON
14 hours ago
Financial Compliance AI Evaluator
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
14 hours ago
Engineering Manager, New User Experience
$185k - $231.5k per year
...design ensures easy navigation, making product discovery and checkout natural and frictionless. Join us in our mission to activate new users and convert first-time visitors into loyal customers through innovation, creativity, and a commitment to excellence. About the Role...
Long term contract
Full time
Manual labor
Local area
Doordash
Toronto, ON
14 hours ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ..., and A/B test write-ups . Evaluate AI-generated or human-created work against... ...detailed written justifications for evaluations and scores to maintain transparency and...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Evaluation Specialist - Fully Remote
$80 - $160 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Bilingual Evaluator - LLM Specialist
$15 - $20 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement,...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Public Procurement Evaluator - Expert
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour...
Remote job
Contract work
Summer work
Work at office
Mercor
Toronto, ON
4 days ago
Sales Evaluator - GTM Specialist
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour...
Full time
Contract work
Summer work
Work at office
Remote work
Flexible hours
Mercor
Toronto, ON
14 hours ago
Excel Specialist - Document Evaluator
$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation... ...structured feedback to enhance document evaluation processes. Utilize MS Excel and...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
14 hours ago
Frontend Code Evaluation Specialist
$90 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-...
Full time
Contract work
Summer work
Local area
Remote work
Mercor
Toronto, ON
14 hours ago
Education Evaluator - Domain Expert
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Education / school Evaluator Type: Contract Compensation... ...deadlines while ensuring high-quality evaluations. Qualifications Must-Have...
Remote job
Contract work
Summer work
Work at office
Mercor
Toronto, ON
10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!