SRE Evaluator - Incident Management
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise in Incident management , reliability , and SRE to grade outputs.
- Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management , reliability , or SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management in Toronto, ON vacancy
$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$36 per hour
Our client, a top banking client in Canada is looking to hire a Incident Management Consultant for their team with a contract for 12 months with potential extension or conversion to Permanent. This role is Hybrid i.e. Mon and first Friday of every month in Toronto office....SuggestedPermanent employmentContract workWork at officeMonday to friday$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities...SuggestedFull timeContract workSummer workWork at officeRemote work- ...next generation of enterprise software and we’re starting with a suite of products that help talent leaders, recruiters, and hiring managers run their hiring process significantly better (we haven’t shared much publicly about what we’re building yet, but we’ll be more specific...Full time
$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager - EM&V with Resource Innovations, you will be responsible for technical support and project management services for the Advisory Services Group...Full timeWork at officeLocal area$141k - $191k per year
...Do you have experience in Service Management, working with cloud providers, software development... ...Reuters and develop your career. As an SRE Manager, you will lead a team of 10+... ...members, including conducting performance evaluations and providing constructive feedback to drive...Work at officeLocal areaFlexible hours2 days per week3 days per week$80k - $130k per year
DevOps SRE Consultant Position Description The DevOps Site... ...improve platform reliability and incident response. CGI is providing... ...être utilisés pour aider à l’évaluation des candidatures, sans jamais... ...technologie de l’information (TI) et en management au monde. DevOps SRE...- ...Offer technical expertise and support for the systems used Manage and resolving incidents and outages Manage requests for changes, system releases... ...technology infrastructure library), monitoring, DevOps, SRE (site reliability engineering), and disaster recovery. How...Permanent employmentRelocationFlexible hours
$120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at office$85 per hour
..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated...Remote jobContract workSummer work- ...big opportunity. We can’t wait to get to know you! The Work One of our goals is to fail small and learn fast. The Incident and Problem Manager will focus on minimizing the impacts of production incidents while ensuring the organization learns quickly to become more...Full time
$100 - $150 per hour
...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years... .... ~ Deep fluency in outbound prospecting, discovery, deal management, and structured sales methodologies. ~ Exceptionally strong...Remote jobContract workSummer work$70 - $100 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour Location: Remote...Remote jobContract workSummer workInternship$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$70 - $100 per hour
...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week Role Responsibilities Evaluate AI-generated office artifacts across Excel , Word , and PowerPoint formats. Perform pairwise comparisons of candidate responses...Remote jobContract workSummer workWork at officeImmediate start$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model... ...). # Complete a technical assessment, if required. # Hiring Manager review. Compensation Compensation is output-based...Remote jobFor contractors
$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Investor materials / fundraising / pitchbook Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$100 - $150 per hour
...handling technical objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands-on experience with... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$14 per hour
...Commitment: 10 hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation across various... ...training data to enhance model performance. Develop and refine evaluation standards for AI-generated music . Collaborate with AI...Full timeContract workSummer workImmediate startRemote work$80 - $120 per hour
...Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...Full timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...) Type: Contract Compensation: $50$70/hour Location: Remote Role Responsibilities Review and evaluate documents slides spreadsheets and similar materials for quality and correctness. Provide clear well-reasoned written feedback and...Full timeContract workSummer workRemote workFlexible hours- ...Technical Production Support Lead Web Applications & SRE Toronto ON - Hybrid (4 Days WFO) Production Support & Incident Management Own L1/L2 production support for web applications internal and external client facing Act as primary escalation point for...Permanent employmentFull time
$70 - $100 per hour
...PowerPoint (.pptx) formats. Perform side-by-side pairwise comparisons of two candidate responses and select the stronger one. Evaluate both the content and rendering of each document—layout, formatting, visual structure, formulas, and overall presentation against the...Remote jobContract workSummer workWork at officeImmediate start$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$70 per hour
...hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and rigor in... ...attention to detail and accurate application of structured evaluation guidelines. Work independently and asynchronously to meet...Remote jobContract workSummer work$100 - $150 per hour
...machine learning pipelines and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria... ...consistency. Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. Apply...Full timeContract workSummer workRemote work$90 per hour
...impact. ~ Professional written English for task justification. Preferred Prior RLHF , preference-labeling, model-evaluation, or structured code-review work. Pixel-perfect design-to-code experience. Accessibility expertise ( ARIA , semantic...Remote jobContract workSummer workLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SRE Evaluator - Incident Management. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- test evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur structure Toronto, ON
- estimateur en bâtiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur automobile Toronto, ON
- director revenue management Toronto, ON
- pain management physician Toronto, ON