Incident Management Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Incident management / reliability / SRE Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Collaborate asynchronously to ensure high-quality evaluations.
- Work independently to meet deadlines and improve AI model performance.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Incident management / reliability / SRE .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Incident Management Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Larry Summers and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80$120... ...Collaborate asynchronously to ensure high-quality evaluations. Work independently to meet deadlines and improve...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$... ...asynchronously to meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have ~5+ years...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Larry Summers and Jack Dorsey . Position: Program management / implementation planning Evaluator Type: Contract Compensation: $80$120... ...model outputs . Collaborate with subject matter experts to ensure consistency and quality. Work...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedFull timeContract workSummer workWork at officeRemote work$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...Dorsey . Position: Sales Engineering Expert Type: Contract... ...objections, supporting proofs of concept, and evaluating product fit and technical risk. ~ Hands... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Full timeContract workSummer workRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Full timeContract workSummer workRemote work$120 - $170 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Full timeContract workSummer workRemote work$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Process improvement / SOPs Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...Full timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...to meet deadlines while improving evaluation processes. Qualifications Must-... ...in outbound prospecting, discovery, deal management, and structured sales methodologies....Remote jobContract workSummer work$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours- ...Job Responsibility: What you'll do Management of Major / Critical incidents which has significant business and revenue impact and primarily involving large scale infrastructure issues or high-risk data or application issues. This role would be on call support 24/7 to support...Full timeWork at officeNight shift
$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$70 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment:...Full timeContract workSummer workImmediate startRemote work$36 per hour
Our client, a top banking client in Canada is looking to hire a Incident Management Consultant for their team with a contract for 12 months with potential extension or conversion to Permanent. This role is Hybrid i.e. Mon and first Friday of every month in Toronto office....Permanent employmentContract workWork at officeMonday to friday$11 - $19 per hour
...Larry Summers and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11$19... ...on quality creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word choice slang and regional...Full timeContract workSummer workImmediate startRemote work$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation... ...independently and asynchronously to evaluate and improve AI model performance .... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$76.8k - $115.2k per year
...Fusion Centre covers the development and management of security strategies, standards, policies... ...to grow in all of it. : The Post-Incident Management Senior Analyst will be responsible... ...well as with leaders and subject matter experts in 2nd and 3rd lines of defense, legal,...Full timeWork from home- ...security alerts and events from SIEM, EDR/XDR, email security, cloud security, and other monitoring platforms. Validate security incidents and determine severity, scope, and business impact. Conduct end-to-end investigations of cybersecurity incidents including...Full time
- ...lives. Homewood Health™ is looking for an experienced crisis management specialist to provide workplace trauma response and... ...professional manner; consistent with the unique needs of each critical incident and organizational culture · Deliver On-site Crisis Management...Full timeContract workWork at officeFlexible hoursWeekend work
$20 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/...Remote jobContract workSummer work$60 - $140 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Administrative Services Manager Type: Independent Contractor Compensation: $60–$140/hour Location: US, UK, or Canada Commitment:...Weekly payFull timeTemporary workFor contractorsSummer work- About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Full timeContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Incident Management Expert - Evaluator. Be the first to apply!
Related searches
- expert batiment Toronto, ON
- expert automobile Toronto, ON
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur - dessinateur Toronto, ON
- estimateur industriel Toronto, ON