User Research Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the User Research Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical... ...experience with AI training , evaluation, or human-data projects....SuggestedFull timeContract workSummer workRemote work- ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...bullet points. Collaborate with team members for document evaluation and feedback. Qualifications Must-Have...SuggestedFull timeContract workSummer work
- ...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...SuggestedSummer work
$25 - $35 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark... ...Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Contractor Type: Contract Compensation: $25–...Full timeContract workFor contractorsSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include... ...Summers and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include... .... Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco our... ...Incident management / reliability / SRE Evaluator Type: Contract... ...Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet deadlines...Full timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobContract workSummer workFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... .... Position: Education / school Evaluator Type: Contract Compensation... ...deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include... ...Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour...Full timeContract workSummer workWork at officeRemote work$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$14 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobContract workSummer workImmediate start$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: UI / UX Design Expert Type: Contract... ...independently and asynchronously to evaluate and improve AI model... ...experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$11 - $19 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco our... ...Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract... ...creativity prompt adherence and originality. Evaluate whether lyrics sound natural including...Full timeContract workSummer workImmediate startRemote work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Data Science Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$40 - $70 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: Generalist Search Expert Type: Contract... ...Role Responsibilities Evaluate the accuracy and depth of AI... ...downstream performance. Develop evaluation rubrics and benchmarks for...Full timeContract workSummer workRemote work$110 - $145 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: ML Research PhD Experts (ICML / NeurIPS / ICLR Publications... ...Responsibilities Evaluate the accuracy and depth of AI... ...performance. Develop evaluation rubrics and benchmarks for assessing...Full timeContract workSummer workRemote work$76 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., Larry Summers , and Jack Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation...Remote jobContract workSummer work- ...20-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator... ...Designs and tests evaluation and applied research strategies and tools ~Develops plans for... ..., senior management and technical experts. ~Credentialed Evaluator designation, is...Hourly payFull timeTemporary workPart timeInternshipMonday to friday
- ...space/statement, the long and short -term business goals, and the user and business needs. \\ \\ \ \ o \ \\\\ Facilitate the... ...Challenges, Problem Statement \\ \\ o \ \\\\ Facilitate user research activities to produce such outputs as: \\ \\ o \ \\\\ User...Long term contractFull timeContract workTemporary workRemote work
$73 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Position: Chemistry AI Evaluator Type: Contract... ...audiences. Apply consistent evaluation standards by following clear... ...explaining chemistry concepts to non-expert audiences Familiarity...Full timeContract workSummer workRemote work$14 - $42 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated music across various genres....Remote jobContract workSummer workImmediate start$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ..., and A/B test write-ups . Evaluate AI-generated or human-created work against... ...detailed written justifications for evaluations and scores to maintain transparency and...Full timeContract workSummer workRemote work$70 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Office-Suite Experts Type: Contract... ...responses and select the stronger one. Evaluate both the content and rendering of each document...Remote jobContract workSummer workWork at officeImmediate start$60k per year
...community defined by opportunity, creativity, and growth. Who we need Reporting to the Director, IT Experience, we are hiring an IT User Training Coordinator to support the successful rollout, adoption, and day-to-day use of technology across the organization. As our new...Full timeRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
Related searches
- expert automobile Toronto, ON
- expert batiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur automobile Toronto, ON
- estimateur structure Toronto, ON
- évaluateur-estimateur Toronto, ON