SRE Evaluator - Incident Management

$80 - $120 per hour

Mercor

Remote job

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .

Position: Incident management / reliability / SRE Evaluator

Type: Contract

Compensation: $80–$120/hour

Location: Remote

Role Responsibilities

Evaluate AI-generated artifacts against domain-specific quality rubrics.
Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
Provide clear, structured written feedback to improve AI-generated work products.
Apply deep subject-matter expertise in Incident management , reliability , and SRE to grade outputs.
Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.

Qualifications

Must-Have

5+ years of relevant professional experience in Incident management , reliability , or SRE .
Native or professional fluency in English .
Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).

Preferred

Advanced degree ( Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

Upload resume
AI interview based on your resume
Submit form

Resources & Support

For details about the interview process and platform information, please check:
For any help or support, reach out to: Show email

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management in Toronto, ON vacancy

Senior SRE, Managed Gateways
...and capabilities in others. Senior SRE, Managed Gateways About the Role: Kong's Managed... ...proactive monitoring and alerting to incident response and blameless post-mortems,... ...Konnect, enables organizations to secure, manage, accelerate, govern, and monetize the flow...
Suggested
Full time
Shift work
Kong Company
Toronto, ON
9 hours ago
Incident Management Expert Evaluator
$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role...
Suggested
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
16 days ago
Incident Management Expert - Evaluator
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...
Suggested
Remote job
Contract work
Summer work
Work at office
Mercor
Toronto, ON
22 days ago
Site Reliability Engineer III (SRE III)
...Site Reliability Engineer III (SRE III) plays a critical role in... ...Performance Proactively identify, evaluate, and implement preventative... ...-as-Code (IaC) principles to manage large-scale distributed... ...reliability, automation, and incident management. Lead root cause...
Suggested
Full time
Manual labor
Local area
Flexible hours
Emburse
Toronto, ON
9 hours ago
Site Reliability Engineer(SRE)
...technical support for the right fineness in management utilities at any time in a firm standing.... ...advantage. Job Description The SRE Role · SREs are engineers with the... ...performance and operability). · We constantly evaluate products and services before and after...
Suggested
Full time
Serigor Inc
Toronto, ON
9 hours ago
Incident Response Specialist
...security alerts and events from SIEM, EDR/XDR, email security, cloud security, and other monitoring platforms. Validate security incidents and determine severity, scope, and business impact. Conduct end-to-end investigations of cybersecurity incidents including...
Full time
Integriti
Toronto, ON
9 hours ago
On-Site Critical Incident Counsellor
...lives. Homewood Health™ is looking for an experienced crisis management specialist to provide workplace trauma response and... ...professional manner; consistent with the unique needs of each critical incident and organizational culture · Deliver On-site Crisis Management...
Full time
Contract work
Work at office
Flexible hours
Weekend work
Homewood Health Inc.
Toronto, ON
9 hours ago
DevOps Engineer - AI Model Evaluator
$85 per hour
..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Senior Site Reliability Engineer (SRE)
$130k - $180k per year
...growing and we are looking to hire a Senior Site Reliability Engineer (SRE) / Cloud Engineer Our main Cloud Platform is Azure (those... ...and optimize our infrastructure provisioning, configuration, and management processes using industry-standard tools and best practices....
Full time
Remote work
Visa sponsorship
Work visa
Flexible hours
Acquird.io
Toronto, ON
9 hours ago
AI Evaluation Engineer (QA)
...Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...learning, to content and engagement management service enablement platforms. Inherent... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly...
Full time
Immediate start
Appnovation Technologies
Toronto, ON
9 hours ago
Procurement Expert - Document Evaluator
$80 - $120 per hour
..., and Jack Dorsey . Position: Procurement / vendor management Evaluator Type: Contract Compensation: $80–$120/hour... ...asynchronously to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have ~5+ years of...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
9 hours ago
Research and Evaluation Specialist - Justice
$70k - $73.85k per year
...is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-... ...research activities; ~ Proficiency in data collection, management, and analysis for both qualitative and quantitative data;...
Full time
Internship
Ofifc
Toronto, ON
9 hours ago
Monitoring, Evaluation & Learning Officer
$50k - $60k per year
...SUMMARY The Monitoring, Evaluations & Learning Officer (MELO) provides technical expertise and support to strengthen the application of Catalyste+’s MEL system. Reporting to the MEL Manager, the individual will support the MEL team in ensuring the effective application...
Full time
Apprenticeship
Summer work
Work at office
Remote work
Catalyste
Toronto, ON
9 hours ago
Data Evaluator - Fully Remote
$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
9 hours ago
Evaluation Specialist - Fully Remote
$80 - $160 per hour
...Provide structured feedback to enhance document relevance and impact. Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards and guidelines. Work independently and asynchronously to...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Financial Compliance AI Evaluator
$80 - $120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
9 hours ago
Customer Success Evaluator - Expert
$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
9 hours ago
Data Scientist - AI Evaluation
$100 - $150 per hour
...machine learning pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria... ...consistency. Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. Apply...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Sales Engineering Expert - Evaluator
$100 - $150 per hour
...handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands-on experience with... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Sales Evaluator - GTM Specialist
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Flexible hours
Mercor
Toronto, ON
9 hours ago
Business Operations Expert - Evaluator
$60 - $80 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location: Remote...
Hourly pay
Full time
Contract work
For contractors
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Bilingual Evaluator - LLM Specialist
$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Excel Specialist - Document Evaluator
$80 - $150 per hour
..., and Jack Dorsey . Position: MS Excel / Google Sheets Evaluator Type: Contract Compensation: $80–$150/hour... ...relevance. Provide structured feedback to enhance document evaluation processes. Utilize MS Excel and Google Slides to perform...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Frontend Code Evaluation Specialist
$90 per hour
...impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic...
Full time
Contract work
Summer work
Local area
Remote work
Mercor
Toronto, ON
9 hours ago
Legal Compliance Expert - Evaluator
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...
Full time
Contract work
Summer work
Work at office
Remote work
Mercor
Toronto, ON
9 hours ago
Video Evaluation Specialist - Annotator
$15 - $20 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Office Document Evaluation Specialist
$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint formats. Perform side-by-side comparisons of two candidate...
Full time
Contract work
Summer work
Work at office
Immediate start
Remote work
Mercor
Toronto, ON
9 hours ago
Hindi Music Specialist - Evaluator
$14 - $42 per hour
...Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed quality standards. Compare AI-generated lyrics with published songs...
Full time
Contract work
Summer work
Immediate start
Remote work
Mercor
Toronto, ON
9 hours ago
Rubric Evaluation Specialist - Writing
$25 - $45 per hour
...25–$45/hour Location: Remote Role Responsibilities Evaluate AI-generated written conversations using predefined rubrics to enhance performance. Draft and refine evaluation rubrics for generalist writing tasks. Apply structured scoring...
Full time
Contract work
Summer work
Remote work
Mercor
Toronto, ON
9 hours ago
Sr Incident Manager
...Job Responsibility: What you'll do Management of Major / Critical incidents which has significant business and revenue impact and primarily involving large scale infrastructure issues or high-risk data or application issues. This role would be on call support 24/7 to support...
Full time
Work at office
Night shift
Canadian Tire Corporation
Toronto, ON
9 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to SRE Evaluator - Incident Management. Be the first to apply!