Incident Management Expert - Evaluator

$80 - $120 per hour

Mercor

Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Incident management / reliability / SRE Evaluator

Type: Contract

Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts against domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors.
Provide clear, structured written feedback.
Apply deep subject-matter expertise to grade outputs.
Collaborate asynchronously to ensure high-quality evaluations.
Work independently to meet deadlines and improve AI model performance.

Qualifications

Must-Have

5+ years of relevant professional experience in Incident management / reliability / SRE .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace, especially Slides .

Preferred

Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: Show email

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 22 days ago

Similar jobs that could be interesting for youBased on the Incident Management Expert - Evaluator in Toronto, ON vacancy

Incident Management Expert Evaluator
$80 - $120 per hour
...Larry Summers and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80$120... ...Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet deadlines and improve...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
16 days ago
Procurement Expert - Document Evaluator
$80 - $120 per hour
..., and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour... ...asynchronously to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have ~5+ years of...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
10 hours ago
Data Quality Expert - Evaluator
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
10 hours ago
Customer Success Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
10 hours ago
Business Operations Expert - Evaluator
$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...
Suggested
Hourly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Sales Engineering Expert - Evaluator
$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Legal Compliance Evaluator - Expert
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
10 hours ago
Legal Compliance Expert - Evaluator
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
10 hours ago
Data Science Expert - Evaluation Specialist
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Data Science Expert - AI Evaluation
$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Incident Response Specialist
...security alerts and events from SIEM, EDR/XDR, email security, cloud security, and other monitoring platforms. Validate security incidents and determine severity, scope, and business impact. Conduct end-to-end investigations of cybersecurity incidents including...
Full time
Integriti
Toronto, ON
10 hours ago
On-Site Critical Incident Counsellor
...lives. Homewood Health™ is looking for an experienced crisis management specialist to provide workplace trauma response and... ...professional manner; consistent with the unique needs of each critical incident and organizational culture · Deliver On-site Crisis Management...
Full time
Contract work
Work at office
Flexible hours
Weekend work
Homewood Health Inc.
Toronto, ON
10 hours ago
Program Management Evaluator Expert
$80 - $120 per hour
...Larry Summers and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80$120... ...model outputs . Collaborate with subject matter experts to ensure consistency and quality. Work...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
16 days ago
Productivity Expert - Task Management
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...
Full time
Contract work
Summer work
Mercor
Toronto, ON
10 hours ago
Administrative Services Manager - Expert
$60 - $140 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Administrative Services Manager Type: Independent Contractor Compensation: $60–$140/hour Location: US, UK, or Canada Commitment:...
Weekly pay
Full time
Temporary work
For contractors
Summer work
Mercor
Toronto, ON
10 hours ago
Insurance Operations Manager - Expert
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Policy Administration & Insurance Operations Manager Type: Contract Compensation: $800/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities...
Full time
Contract work
Summer work
Immediate start
Remote work
Mercor
Toronto, ON
10 hours ago
Project Management Expert - Fully Remote
$50 - $60 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Product Management Expert - Fully Remote
$80 - $90 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product Management Expert Type: Contract Compensation: $80–$90/hour Location: Remote Role Responsibilities...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Office Document Evaluation Specialist
$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and...
Full time
Contract work
Summer work
Work at office
Immediate start
Remote work
Mercor
Toronto, ON
10 hours ago
Hindi Music Specialist - Evaluator
$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...
Full time
Contract work
Summer work
Immediate start
Remote work
Mercor
Toronto, ON
10 hours ago
AI Evaluation Engineer (QA)
...Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...learning, to content and engagement management service enablement platforms. Inherent... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly...
Full time
Immediate start
Appnovation Technologies
Toronto, ON
10 hours ago
Research and Evaluation Specialist - Justice
$70k - $73.85k per year
...is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-... ...research activities; ~ Proficiency in data collection, management, and analysis for both qualitative and quantitative data;...
Full time
Internship
Ofifc
Toronto, ON
10 hours ago
Monitoring, Evaluation & Learning Officer
$50k - $60k per year
...SUMMARY The Monitoring, Evaluations & Learning Officer (MELO) provides technical expertise and support to strengthen the application of Catalyste+’s MEL system. Reporting to the MEL Manager, the individual will support the MEL team in ensuring the effective application...
Full time
Apprenticeship
Summer work
Work at office
Remote work
Catalyste
Toronto, ON
10 hours ago
Evaluation Specialist - Fully Remote
$80 - $160 per hour
...Provide structured feedback to enhance document relevance and impact. Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards and guidelines. Work independently and asynchronously to...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Financial Compliance AI Evaluator
$80 - $120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
10 hours ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...machine learning pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria... ...consistency. Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. Apply...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Sales Evaluator - GTM Specialist
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Flexible hours
Mercor
Toronto, ON
10 hours ago
Bilingual Evaluator - LLM Specialist
$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago
Process Improvement Expert Evaluator
$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
6 days ago
Excel Specialist - Document Evaluator
$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
10 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Incident Management Expert - Evaluator. Be the first to apply!