Evaluation Specialist - Fully Remote

$80 - $160 per hour

Full-time

Mercor

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Generalist

Type: Contract

Compensation: $80–$160/hour

Location: Remote

Role Responsibilities

Review and assess domain-specific documents to ensure quality and accuracy.
Provide structured feedback to enhance document relevance and impact.
Utilize strong analytical skills to contribute to high-impact evaluation projects.
Collaborate with teams to improve document standards and guidelines.
Work independently and asynchronously to meet project deadlines.

Qualifications

Must-Have

Bachelor's degree (minimum)
2+ years of professional experience in a relevant domain
Strong proficiency in Excel , PowerPoint , and Word
Strong document analysis and review skills
Attention to detail and ability to follow structured guidelines

Eligibility

Based in the United States, Europe, UK or Canada

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: View email address on jobs.jobcopilot.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Apply

Vacancy posted 6 hours ago

Similar jobs that could be interesting for youBased on the Evaluation Specialist - Fully Remote in Toronto, ON vacancy

Procurement Evaluator - Fully Remote
$80 - $120 per hour
...Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...
Remote work
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
13 hours ago
Data Evaluator - Fully Remote
$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...
Remote work
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
6 hours ago
CRM Operations Evaluator - Fully Remote
$80 - $120 per hour
..., Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...
Remote work
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
6 hours ago
Marketing Specialist - Fully Remote
$60 - $100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs based on... ...AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PR & Communications to improve model outputs...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
STEM Specialist - Fully Remote
$38 - $53 per hour
...Contract Compensation: $38–$53/hour Location: Remote Duration: 3–6 months Commitment: 20+ hours/... ...scientific accuracy and clear instructions. Define and document evaluation standards, creating rubrics that ensure scientific rigor and...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Investment Specialist - Fully Remote
$100 per hour
...Type: Contract Compensation: $100/hour Location: Remote Duration: Minimum four weeks Commitment: 10+ hours/week Role Responsibilities Evaluate and create board materials for venture capital projects. Conduct market...
Remote work
Hourly pay
Weekly pay
Full time
Contract work
For contractors
Summer work
Mercor
Toronto, ON
13 hours ago
SEO Specialist - Fully Remote
$60 - $100 per hour
...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design task briefs from real... ...from plausible-but-wrong ones. Review AI agent attempts and evaluate them against established standards. Diagnose issues from...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Agronomy Specialist - Fully Remote
$72 - $80 per hour
...Type: Contract Compensation: $72–$80/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Author and review technical tasks to evaluate AI model performance on agricultural sciences problems. Produce original...
Remote work
Hourly pay
Weekly pay
Full time
Contract work
For contractors
Summer work
Flexible hours
Mercor
Toronto, ON
13 hours ago
Spreadsheet Specialist - Fully Remote
$80 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Google Sheets Specialist Compensation: $80–$100/hour Role Responsibilities... .... Provide timestamped, non-AI generated content for evaluation. Collaborate with team members for document review and feedback...
Remote work
Full time
Summer work
Mercor
Toronto, ON
13 hours ago
Cardiology Specialist - Fully Remote
$180 per hour
...Contract Compensation: $180–$400/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment:... ...Cardiology practice, including ACS management , arrhythmia evaluation , and heart failure optimization . Write "golden"...
Remote work
Weekly pay
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
13 hours ago
Accounting Specialist - Fully Remote
$50 - $75 per hour
...Larry Summers , and Jack Dorsey . Position: AI Model Evaluator Type: Contract Compensation: $50–$75/hour... ...Provide written justifications with specific evidence for each evaluation. Qualifications Must-Have Master’s degree or...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Astrophysics Specialist - Fully Remote
$70 - $90 per hour
...Contract Compensation: $70–$90/hour Location: Remote Role Responsibilities Develop high-quality data by... ...General Relativity , Astrophysics , and Cosmology . Evaluate the impact of AI models on future innovations in the field....
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Banking Specialist - Fully Remote
$90 - $110 per hour
...Contract Compensation: $90–$110/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities... ..., web search, and code execution. Create objective evaluation rubrics to assess AI performance in the Finance & Banking domain...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Cosmology Specialist - Fully Remote
$70 - $100 per hour
...Jack Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract Compensation: $70–$100/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Geophysics Specialist - Fully Remote
$70 - $85 per hour
...Compensation: $70–$85/hour Location: Remote Commitment: 15–20 hours/week... ...challenging computational problems to evaluate AI capabilities in solving scientific... ...Collaborate on AI model training, evaluation, and improvement in computational seismology...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Design Specialist - Fully Remote
$150 per hour
...Contract Compensation: $150–$250/hour Location: Remote Role Responsibilities Conduct structured, recorded remote sessions to capture expert design thinking. Evaluate design quality, critique, and shipping standards in AI design tooling...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Coverage Specialist - Fully Remote
...Contract Compensation: $800/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities... ...severity, or coverage-sensitive insurance claims. ~ Experience evaluating coverage issues and developing claim strategies involving multiple...
Remote work
Full time
Contract work
Summer work
Immediate start
Home office
Mercor
Toronto, ON
13 hours ago
Staffing Specialist - Fully Remote
$45 - $65 per hour
...Project-based Role Responsibilities Review and evaluate AI-generated outputs related to job descriptions, compensation... ...Collaborate asynchronously with research teams to refine evaluation frameworks for HR-domain AI . Qualifications Must-Have...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Diligence Specialist - Fully Remote
$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...
Remote work
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
13 hours ago
Pharmacology Specialist - Fully Remote
$120 - $170 per hour
...Contract Compensation: $120–$170/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities... .... Design prompts, golden outputs, and rubrics for AI agent evaluation. Evaluate exposure-response relationships to reconcile against...
Remote work
Full time
Contract work
Summer work
Manual labor
Mercor
Toronto, ON
13 hours ago
Onboarding Specialist - Fully Remote
$80 - $120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...
Remote work
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
13 hours ago
Underwriting Specialist - Fully Remote
$50 per hour
...Document Understanding Type: Contract Compensation: $50/hour Location: Remote Commitment: 15–20 hours/week Role Responsibilities Evaluate the accuracy of AI models in visual document understanding within the Underwriting domain...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Buying Specialist - Fully Remote
...Position: Buyers and Purchasing Agents Type: Contract Compensation: $500–$1000 per completed task Location: Remote Duration: ~2 weeks Commitment: ~15 hours/week Role Responsibilities Create deliverables for common...
Remote work
Full time
Contract work
Summer work
Immediate start
Mercor
Toronto, ON
13 hours ago
Presentation Specialist - Fully Remote
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Google Slides Specialist Type: Contract Compensation: $80–$100/file Role Responsibilities Develop compelling Google Slides...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Audit Specialist - Fully Remote
$70 - $95 per hour
...and Jack Dorsey . Position: Accounting Experts Type: Contract Compensation: $70–$95/hour Location: Remote Commitment: 20+ hours/week Role Responsibilities Construct scenarios across F500 corporate accounting and...
Remote work
Hourly pay
Weekly pay
Full time
Contract work
For contractors
Summer work
Mercor
Toronto, ON
13 hours ago
Detective Specialist - Fully Remote
.... Position: Private Detectives and Investigators Type: Contract Compensation: $1500–$1700 Location: Remote Duration: 3–4 weeks Commitment: 20–40 hours/week Role Responsibilities Create deliverables for common requests...
Remote work
Hourly pay
Full time
Contract work
Summer work
Immediate start
Trial period
Flexible hours
Shift work
Mercor
Toronto, ON
13 hours ago
Sales Specialist - Fully Remote
...Wholesale and Manufacturing, Technical and Scientific Products Type: Contract Compensation: $1500/hour Location: Remote Duration: 4–5 weeks Commitment: 20–30+ hours/week Role Responsibilities Create tasks and deliverables...
Remote work
Hourly pay
Full time
Contract work
Summer work
Immediate start
Flexible hours
Mercor
Toronto, ON
13 hours ago
Radiology Specialist - Fully Remote
$130 - $180 per hour
...and Jack Dorsey . Position: Radiology Expert Type: Contract Compensation: $130–$180/hour Location: Remote Duration: Ongoing, reviewed monthly Commitment: 20+ hours/week Role Responsibilities Design clinically...
Remote work
Weekly pay
Full time
Contract work
Summer work
Work at office
Mercor
Toronto, ON
13 hours ago
Commerce Specialist - Fully Remote
$77 - $98 per hour
...Larry Summers , and Jack Dorsey . Position: Applied Business & Commerce Benchmark Specialist Type: Contract Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago
Pharmacovigilance Specialist - Fully Remote
$140 - $190 per hour
...Jack Dorsey . Position: Medical Safety Expert Type: Contract Compensation: $140–$190/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities Generate and validate the safety layer of clinical data rooms,...
Remote work
Full time
Contract work
Summer work
Mercor
Toronto, ON
13 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Evaluation Specialist - Fully Remote. Be the first to apply!