Evaluation Specialist - Fully Remote | Upto $160/hr
$160 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist
Type: Contract
Compensation: $80–$160/hour
Location: Remote
Role Responsibilities
- Review and assess domain-specific documents to ensure quality and accuracy.
- Provide structured feedback to enhance document relevance and impact.
- Utilize strong analytical skills to contribute to high-impact evaluation projects.
- Collaborate with teams to improve document standards and guidelines.
- Work independently and asynchronously to meet project deadlines.
Qualifications
Must-Have
- Bachelor's degree (minimum)
- 2+ years of professional experience in a relevant domain
- Strong proficiency in Excel , PowerPoint , and Word
- Strong document analysis and review skills
- Attention to detail and ability to follow structured guidelines
Eligibility
- Based in the United States, Europe, UK or Canada
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$160 per hour
...Student Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess... ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and...Remote jobContract workSummer work$160 per hour
...Experts Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess... .... Utilize strong analytical skills to contribute to evaluation projects. Collaborate with teams to enhance document...Remote jobContract workSummer work$160 per hour
...Professionals Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess... ...strong analytical skills to contribute to high-impact evaluation projects. Work independently and follow structured...Remote jobContract workSummer work$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities... ...standards and outcomes. Analyze and evaluate grant writing and ESG strategy documents... ...with teams to enhance document evaluation processes. Work independently...Remote jobContract workSummer work$160 per hour
...Experts Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously to meet project...Remote jobContract workSummer workFlexible hours$42 per hour
...Type: Contract Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres for quality and creativity. Compare...Remote jobContract workSummer workImmediate start$160 per hour
...Experts Type: Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess... ...strong analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously to meet project...Remote jobContract workSummer work$120 per hour
...Investment analysis / valuation / credit Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$160 per hour
...Expert Type: Contract Compensation: $130–$160/hour Location: Remote Role Responsibilities Design precise, task-... ...Preferred ~ Prior experience with AI training, evaluation, or human-data projects. Application Process (...Remote jobContract workSummer work$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$100 per hour
...Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location: Remote Role Responsibilities Solve one realistic, domain-specific...Remote jobContract workSummer workInternship$100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs based on... ...AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PR & Communications to improve model outputs...Remote jobContract workSummer work$100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs based on... ...criteria distinguishing strong from weak responses. Review and evaluate AI agent attempts against established standards. Diagnose...Remote jobContract workSummer work$100 per hour
...Marketing Expert — Paid Growth (AI Agent Environments) Type: Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs from real paid acquisition work. Define the task's true test, planted issues, and...Remote jobContract workSummer work$120 per hour
...and Jack Dorsey . Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$170 per hour
...Contract Compensation: $120–$170/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities... .... Design prompts, golden outputs, and rubrics for AI agent evaluation. Evaluate exposure-response relationships to reconcile against...Remote jobContract workSummer workManual labor$190 per hour
...Jack Dorsey . Position: Medical Safety Expert Type: Contract Compensation: $140–$190/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities Generate and validate the safety layer of clinical data rooms,...Remote jobContract workSummer work$98 per hour
...Larry Summers , and Jack Dorsey . Position: Applied Business & Commerce Benchmark Specialist Type: Contract Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original...Remote jobContract workSummer work$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$130 per hour
...Domain Expert – Diagnostic Imaging (Visage 7 Research) Type: Contract Compensation: $90–$130/hour Location: Remote Role Responsibilities Confirm the patient's imaging record reflects actual acquisitions and conclusions, especially on...Remote jobContract workSummer work$19 per hour
...Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$85 per hour
...Compensation: $70–$85/hour Location: Remote Commitment: 15–20 hours/week... ...challenging computational problems to evaluate AI capabilities in solving scientific... ...Collaborate on AI model training, evaluation, and improvement in computational seismology...Remote jobContract workSummer work$98 per hour
...Larry Summers , and Jack Dorsey . Position: Applied Business & Commerce Benchmark Specialist Type: Contract Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original...Remote jobContract workSummer work$180 per hour
...Design Experts Type: Contract Compensation: $80–$180/hour Location: Remote Commitment: 15+ hours/week Role Responsibilities Evaluate product design decisions to align with professional taste preferences. Leverage...Remote jobContract workSummer work$27 per hour
...Compensation: $21–$27/hour Location: Remote Role Responsibilities... ...timing, and use of spatial language. Evaluate if the assistant provided timely warnings... ...linguistic QA, content moderation, or AI model evaluation. Training in linguistics,...Remote jobContract workSummer workImmediate start$80 per hour
...Contract Compensation: $30–$80/hour Location: Remote Role Responsibilities Review and assess domain-... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate asynchronously with teams to meet project...Remote jobContract workSummer work$150 per hour
...Contract Compensation: $150–$250/hour Location: Remote Role Responsibilities Conduct structured, recorded remote sessions to capture expert design thinking. Evaluate design quality, critique, and shipping standards in AI design tooling...Remote jobContract workSummer work$150 per hour
...Contract Compensation: $80–$150/hour Location: Remote Role Responsibilities Design precise, task-specific... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation Specialist - Fully Remote | Upto $160/hr. Be the first to apply!
- crisis intervention specialist Toronto, ON
- leasing specialist Toronto, ON
- visual specialist Toronto, ON
- child life specialist Toronto, ON
- lead generation specialist Toronto, ON
- spécialiste en amélioration continue Toronto, ON
- spécialiste paie Toronto, ON
- literacy specialist Toronto, ON
- building performance specialist Toronto, ON
- employment specialist Toronto, ON
