SRE Evaluator - Incident Management
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise in Incident management , reliability , and SRE to grade outputs.
- Work independently and asynchronously to meet deadlines while ensuring high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management , reliability , or SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the SRE Evaluator - Incident Management in Toronto, ON vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office- # Join Pigment: The AI Platform Redefining Business Planning Pigment is the AI-powered business planning and performance management platform built for agility and scale. We connect people, data, and processes in one intuitive, feature-rich solution, empowering every team—from...SuggestedFull time
$141k - $191k per year
...Do you have experience in Service Management, working with cloud providers, software development... ...Reuters and develop your career. As an SRE Manager, you will lead a team of 10+... ...members, including conducting performance evaluations and providing constructive feedback to drive...SuggestedWork at officeLocal areaFlexible hours2 days per week3 days per week$36 per hour
Our client, a top banking client in Canada is looking to hire a Incident Management Consultant for their team with a contract for 12 months with potential extension or conversion to Permanent. This role is Hybrid i.e. Mon and first Friday of every month in Toronto office....SuggestedPermanent employmentContract workWork at officeMonday to friday- ...and latency Service availability Integration failures Manage and troubleshoot SSL/TLS certificates, certificate chains, keystores... ...and resolve issues. Manage and coordinate production incidents, ensuring timely investigation, appropriate escalation, stakeholder...Permanent employmentFull timeLocal area
- ...GCP Infrastructure & Cloud SRE Engineer Hybrid: 3 Days a week on-site Location... ...Role Description: • Build and manage enterprise-scale cloud platforms on Google... ...Automate platform provisioning, operations, and incident response. • Implement cloud security,...Permanent employment3 days per week
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at officeFlexible hours$100 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Management Consulting Expert Type: Contract Compensation:... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a consulting context....Remote jobContract workSummer workWork at office$65 - $75 per hour
...Dorsey . Position: Federal Certified Materials Specialist / Incident Analyst Type: Contract Compensation: $65–$75/... .... Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whether...Remote jobHourly payWeekly payContract workFor contractorsSummer work- ...Offer technical expertise and support for the systems used Manage and resolving incidents and outages Manage requests for changes, system releases... ...technology infrastructure library), monitoring, DevOps, SRE (site reliability engineering), and disaster recovery. How...Permanent employmentRelocationFlexible hours
$69.45k - $119.45k per year
...recover from the most consequential cyber incidents. Within CIFR this role, you will serve... ...component-level diagnostics, hardware lifecycle management, and secure disposal in accordance with... ...Support proof-of-concept builds, model evaluation, and integration of AI and LLM...Full timeWork at officeLocal areaRemote work$116k - $235.1k per year
...the Role: Site Reliability Engineering (SRE) at Tubi is not a traditional operations... ...cognitive load and increasing their velocity. Incident Response & Post-Mortem Analysis:... ...Tubi offers a Flexible Time Off Policy to manage all personal matters. For all full-time...RemplacementLong term contractFull timeTemporary workWork at officeLocal areaImmediate startFlexible hours2 days per week- ...leading tech companies, focused on testing, evaluating, and improving AI systems. This is a... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are... ...: differential diagnosis, next-step management, and application of evidence-based guidelines...Part timeFor contractorsRemote workFlexible hours
$39 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Healthcare...Full timeContract workSummer workRemote work$39 per hour
...answering questions, and correcting errors. Rate the experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional healthcare standards. Work independently and asynchronously to meet...Remote job$30 - $40 per hour
...daily search queries and rate the results to improve AI model outputs . Complete assigned queries each day to ensure timely evaluation. Provide short notes and annotations to enhance training data quality . Work independently and asynchronously to meet...Daily paidFull timeContract workSummer workRemote workFlexible hours$120k per year
...Site Reliability Engineer (SRE) – Java, Spring Boot, REST APIs & Automation Key Responsibilities: Automation and... ...50% of their time on software and engineering projects. Incident Response and Management: They act as first-line responders for critical emergencies...Permanent employment$150 per hour
...Compensation: $150/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging medical problems to improve model reasoning . Analyze input files and assess...Remote jobContract workSummer workImmediate start$30 per hour
...those a real user would type. Collaborate with the AI assistant on tasks guiding it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance. Qualifications Must-Have Frequent use of...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$57 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobHourly payContract workFor contractorsSummer work$30 per hour
...Linguistic Experts Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated Hindi text across various use cases, including translation and summarization. Edit,...Remote jobContract workSummer work$100 - $150 per hour
..., machine learning pipelines , and technical reports. Evaluate AI-generated or human-created work against established criteria... ...and accuracy. Provide detailed written justifications for evaluations and scores to maintain transparency. Apply consistent, evidence...Remote jobContract workSummer work$120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at office- ...discuss production support activity at a high level including ITIL (information technology infrastructure library), monitoring, DevOps, SRE (site reliability engineering), and disaster recovery. How to discuss common financial topics, including financial markets, equity...Permanent employmentRelocationFlexible hours
- ...diverse range of perspectives is a requirement for building great products. Join us on our mission and shape the future! Why this role?Evaluation is critical to making progress in scaling intelligence. As models continue to become superhuman in many real-world use cases, we...Full timeWork at officeRemote workFlexible hours
$45 - $55 per hour
...Role: Incident Response Manager Rates: Up to $55.00 p/h INC Location: Remote (GTA Located) Structure: 35 hours per week standard, ability... ...Models The final support model is currently being evaluated. Candidates may be considered for one or more of the following...Long term contractContract workRemote workFlexible hoursShift workNight shiftWeekend workAfternoon shift$140k - $175k per year
...production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family...Full timeInternshipWork at officeLocal areaFlexible hours$150 per hour
...Compensation: $150/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems. Analyze model reasoning to ensure clinical accuracy and...Remote jobContract workSummer workImmediate startFlexible hours$85 per hour
..., Larry Summers , and Jack Dorsey . Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience) Type: Contract... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to SRE Evaluator - Incident Management. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur - dessinateur Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur structure Toronto, ON
- estimateur automobile Toronto, ON