Operations Evaluator - Domain Expert
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Operations / inventory / capacity planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise in Operations , inventory , and capacity planning .
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Operations , inventory , and capacity planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Operations Evaluator - Domain Expert in Toronto, ON vacancy
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$15 - $20 per hour
...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and... ...Strong attention to detail . Background or experience in domains requiring structured analytical thinking . Preferred...SuggestedRemote jobContract workSummer work$90 - $110 per hour
...Commitment: 30–40 hours/week Role Responsibilities Create deliverables addressing common requests within the real estate domain. Review peer-developed deliverables to enhance AI research . Collaborate with AI research teams to diagnose and solve...SuggestedRemote jobContract workSummer workImmediate startFlexible hours$85k - $156k per year
...And as the largest 100% Canadian-owned and operated professional services firm in our country... .... Learn from deep subject matter experts through mentoring and on the job coaching... ...in the quality of our data as our Contact Domain Steward. What will your typical day look...Permanent employmentFlexible hours$142k - $192k per year
...Services (ECS) Delivery organization is to run and operate SAP’s private cloud offering. The Enhanced Operation Service is part of SAP Enterprise Cloud Services Delivery... ...Database Technologies like HANA/ASE/MSSQL – with expert level knowledge in HANA • You demonstrate the...Long term contractPermanent employmentFull timeLocal areaWorldwideFlexible hours$70 - $100 per hour
...Jack Dorsey . Position: Office-Suite Experts Type: Contract... ...hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel... ...Background in finance, consulting, operations, or executive support. Familiarity with...Remote jobContract workSummer workWork at officeImmediate start$80 - $120 per hour
...Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at office$60 per hour
...Jack Dorsey . Position: Generalist Expert Type: Contract... ...Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... ...and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI...Remote jobContract workSummer work- ...alongside iconic brand names. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- ...Job Title: Test Manager (with Credit cards DOMAIN) Location: Toronto, ON Work Style: Hybrid (2 days per week in-person at Toronto office preferred) Skills: Agile Way of Working~Test Management~Functional Testing Experience Required: 6-8 Must Haves:...Contract workWork at office2 days per week
- ...Job Description Workday Domain Lead, Talent Acquisition What is the opportunity?... ...attention to detail. As a subject matter expert, you will be responsible for staying up to... ...Nice-to-have: Experience with operating Phenom Experience in financial services...Full timeFlexible hours
$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager - EM... ...experience with impact evaluation of energy efficiency programs. ~ Expert level understanding of building systems, energy end uses and...Full timeWork at officeLocal area$142k - $192k per year
...Services (ECS) Delivery organization is to run and operate SAP’s private cloud offering. The Enhanced Operation Service is part of SAP Enterprise Cloud Services Delivery... ...Database Technologies like HANA/ASE/MSSQL – with expert level knowledge in HANA • You demonstrate the...Long term contractPermanent employmentFull timeLocal areaWorldwideFlexible hours- ...Position: Retail Banking Expert Type: Contract... ...Responsibilities Review and evaluate AI-generated outputs related... ...evaluation frameworks for banking-domain AI . Qualifications... ...or more areas such as branch operations and management, consumer or mortgage...Remote jobHourly payContract workSummer work
$70 - $100 per hour
...Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract... ...Responsibilities Design graduate-level computational problems using domain-specific scientific software libraries. Evaluate AI systems...Remote jobContract workSummer work- ...From enterprise architecture to operational technology, our teams use the... ...our railroad ensuring our operations run optimally and safely and... .... Join us! Job Summary The Expert, Data Engineering is responsible... ...~ Build data and domain event models, implement business...Full timeWork at officeRemote workMonday to friday
- ...days a week in-office Detailed Job Description: We are looking for an experienced Test Lead with strong expertise in Mortgage domain testing and hands-on experience in database validation and test automation. The candidate will be responsible for leading testing...Contract workWork at office2 days per week
- ...Ensure quality, risk mitigation, and governance Lead cross-functional teams Required Skills Project Program Management Stakeholder communication Delivery governance Preferred Skills BFSI domain Agile Scrum methodology Risk management...Contract workWork at office2 days per week
$72k - $125k per year
...largest 100% Canadian-owned and operated professional services firm in... ...from deep subject matter experts through mentoring and on the job... ...feedback loops ML Flow for model evaluation and drift detection... ...Flow into existing projects Domain‑specific GenAI solutions for DRO...Long term contractTemporary workFixed term contractFlexible hours- ...physical world? We're looking for Robotics ML Experts in Canada's vibrant AI research hub to... ...dynamics, and scene configurations Evaluate trained policies for stability, generalization... ...with sim-to-real transfer techniques (domain randomization, system identification)...Hourly payOngoing contractContract workFreelanceRemote workFlexible hours
$10k per year
...Informatics (MHI) Sessional Dates of Appointment: Fall 2026, September to December Existing Vacancy: Yes Course Title: MHI2009H: Evaluation Methods for Health Informatics Course Description: There is little debate that health information systems have...Long term contract- ...great products. Join us on our mission and shape the future! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs). Your...Full timeWork at officeRemote workFlexible hours
$54.8k - $74k per year
...existing, open vacancy As the next Store Operations Manager at Sephora, you will lead the... ...budget strategies. Be seen as the expert by demonstrating a strong understanding of... ...our recruitment process to assist in the initial screening and evaluation of applications....Full timePart timeInternshipWeekend workAfternoon shift$80 - $120 per hour
...Remote Duration: 3–4 weeks Role Responsibilities Create deliverables for common requests within your professional domain. Review peer-developed deliverables to improve AI research . Diagnose and solve real issues in your domain....Remote jobContract workSummer workWork at officeImmediate start$72k - $138k per year
...largest 100% Canadian-owned and operated professional services firm in... ...from deep subject matter experts through mentoring and on the... ...solutions across HR and payroll domains, enabling meaningful insights... ...supporting HR and payroll operations Leverage platform reporting...Temporary workFixed term contractFlexible hours- ...Project Manager / Scrum Master - Banking Domain Location : Toronto, ON (Hybrid – 4 days WFO) Role Summary The Project Manager / Scrum Master is responsible for leading the end-to-end delivery of projects, ensuring successful execution within scope, timeline, and...Contract work
- ...are seeking a highly experienced Global Security Expert to provide end-to-end security risk management and operational protection for multinational enterprises... ...practical experience in international security operations, risk prevention, crisis management, or overseas...Part timeRelocationOverseas
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Operations Evaluator - Domain Expert. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- web search evaluator Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- remote social media evaluator Toronto, ON
- expert batiment Toronto, ON