Incident Management Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management / reliability / SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Incident Management Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...SuggestedRemote jobContract workSummer workFlexible hours$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour... ...Work independently and asynchronously to ensure high-quality evaluations. Qualifications Must-Have ~5+ years of...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation... ...independently and asynchronously to evaluate and improve AI model performance .... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$68k - $72k per year
...tomorrow, we work together as a community—and you can be a part of that. Our team is looking to fill a new position of Manager, Planning and Evaluation. This is a full-time position working 35 hours per week anywhere in Canada. Please apply by August 18th, 2026....Full timeInternshipWork at officeFlexible hoursWeekend work$122k - $192k per year
...Resource Innovations is looking for an experienced DSM Evaluation Manager to join our expanding team. In this role, you will provide technical... ...experience with impact evaluation of energy efficiency programs. ~ Expert level understanding of building systems, energy end uses and...Full timeInternshipWork at officeLocal area$19 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11–$... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$142k - $192k per year
...comprehensive cloud infrastructure and managed service offerings to our customers... .... • You will handle major incidents, troubleshoot service failures, manage downtime scenarios, and also working... ...Technologies like HANA/ASE/MSSQL – with expert level knowledge in HANA • You...Long term contractPermanent employmentFull timeLocal areaWorldwideFlexible hours- ...Posting Period: 06-Aug-2026 to 20-Aug-2026 Reporting to the Manager, Evaluation and Quality Improvement, the Program Evaluator works... ...of program staff, management, senior management and technical experts. ~Credentialed Evaluator designation, is an asset....Hourly payFull timeTemporary workPart timeInternshipMonday to friday
- ...Job Description Role Title: Logistics & Supply Chain Management Expert Role Type: Contract Location: Remote Scope of Work... ...best practices in logistics and supply chain management. Evaluate and suggest improvements in current supply chain workflows based...Remote jobContract work
$14 - $42 per hour
...Larry Summers , and Jack Dorsey . Position: Music & Lyrics Expert - Hindi Type: Contract Compensation: $14–$42/... ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate against detailed...Remote jobContract workSummer workImmediate start$14 per hour
...Jack Dorsey . Position: Music Audio Expert - Punjabi Type: Contract... ...hours/week Role Responsibilities Evaluate AI model output for lyrics and voice generation... ...performance. Develop and refine evaluation standards for AI-generated music ....Remote jobContract workSummer workImmediate start$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 10–20+ hours/week Role Responsibilities Evaluate and compare AI-generated office artifacts in Excel , Word...Remote jobContract workSummer workWork at officeImmediate start$70 per hour
...Jack Dorsey . Position: Generalist Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...detail and accurate application of structured evaluation guidelines. Work independently and...Remote jobContract workSummer work$100k - $115k per year
...regulations. Our two main services – economic and management consulting – are delivered by practice groups that... ...include ongoing breach detection, threat analysis, incident response and malware analysis; Providing expert digital forensic support for counsel and clients in...Work at officeWork from home3 days per week$80k - $180k per year
...modernize product, pricing, offers, billing, loyalty, and relationship management; and Zafin IO , an integration platform that connects data,... ...responsibly and at scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable,...Full time$105k - $155k per year
Incident Response Lead Position Description This role can be located in any CGI office... ..., and decision making skills to manage high impact incidents in a fast paced global... ...’IA peuvent être utilisés pour aider à l’évaluation des candidatures, sans jamais remplacer le...Work at office$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: General Sales / GTM Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$100 - $150 per hour
...machine learning pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against established criteria... ...consistency. Provide detailed written justifications for evaluations and scores to maintain transparency and accountability. Apply...Remote jobContract workSummer work$80 - $120 per hour
...Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office- ...Platform | Production Support | Application Operations | Case Management Job Description Skills Required • 8–10 years of IT... ...Production Support environments • Hands-on experience with: • Incident management • Problem management • Change management...Permanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Incident Management Expert - Evaluator. Be the first to apply!
Related searches
- expert batiment Toronto, ON
- expert automobile Toronto, ON
- test evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- remote social media evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON