User Research Expert - Evaluator
$80 - $120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: User/customer research and feedback synthesis Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks .
- Provide clear, structured written feedback to improve AI model outputs .
- Work independently and asynchronously to meet deadlines and enhance AI model performance .
- Collaborate with subject matter experts to ensure consistency and quality across datasets.
Qualifications
Must-Have
- 5+ years of relevant professional experience in User/customer research and feedback synthesis .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Larry Summers , and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...research / competitive intelligence Evaluator Type: Contract Compensation... .... Collaborate with subject matter experts to ensure consistency and relevance...SuggestedRemote jobContract workSummer workWork at office$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...requests similar to those a real user would type. Collaborate with the AI assistant... ...concise notes on performance. Evaluate AI model interactions to ensure alignment...SuggestedRemote job$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include... ...Responsibilities Write short realistic requests similar to those a real user would type. Work with the AI assistant on tasks steering it...SuggestedFull timeContract workSummer workRemote work$57 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Write short, realistic requests, similar to what a real user would type. Work with the AI assistant on tasks. Steer it, answer...SuggestedRemote jobHourly payContract workFor contractorsSummer work$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: French Linguistic Experts Type: Contract Compensation... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...Remote jobContract workSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Healthcare Expert Type: Contract... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging...Remote jobContract workSummer workImmediate start$140k - $175k per year
...Reuters Labs is seeking a Lead Research Engineer to lead the design... ...artificial intelligence (AI) model evaluation and benchmarking. You will... ...versions, validate them with users, and improve them through iterative... ...Department at HR.Leave-Expert@thomsonreuters.com. Disability...Full timeInternshipWork at officeLocal areaFlexible hours$120 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Position: Market Research & Insights Experts Type: Contract... ...marketing strategy recommendations. Evaluate outputs from an end-user perspective focusing on relevance, strategic...Remote jobContract workSummer work- ...for our customers. Cohere is a team of researchers, engineers, designers, and more, who are... ...mission and shape the future! Why this role?Evaluation is critical to making progress in... ...infrastructure to measure LLM progress. As a Senior Research Scientist, Model Evaluation, you will:...Full timeWork at officeRemote workFlexible hours
$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Healthcare Expert Type: Contract... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging...Remote jobContract workSummer workImmediate startFlexible hours$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Data Science Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Remote jobContract workSummer workWork at office$60 - $70 per hour
...and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Application Users - macOS Sonoma 14.5 Expert - Professionals Type:... ...Remote Role Responsibilities Evaluate and utilize macOS Sonoma 14.5 as your...Remote jobContract workSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Software Engineer Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Remote jobContract workSummer workWork at office$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$70 - $100 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract...Remote jobContract workSummer workInternship$50 per hour
...technical talent with leading AI research labs. Headquartered in San... ...Language and Literature Expert Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of... ...linguistic annotation, language evaluation, or NLP data work in English...Remote jobContract workSummer work$14 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Music Audio Expert - Telugu Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobContract workSummer workImmediate start$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Sales Engineering Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobContract workSummer workFlexible hours$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Jack Dorsey . Position: Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour...Remote jobContract workSummer workImmediate start$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: UI / UX Design Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Data Science Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Dorsey . Position: Data Science Expert Type: Contract... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... .... Position: Machine Learning Expert Type: Contract Compensation... ...of 8 attempts. Focus on inference, evaluation, and systems work over heavy model...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to User Research Expert - Evaluator. Be the first to apply!
- expert batiment Toronto, ON
- expert automobile Toronto, ON
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
