Operations Evaluator - Domain Expert
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Operations / inventory / capacity planning Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs .
- Apply deep subject-matter expertise in Operations , inventory , and capacity planning .
- Work independently and asynchronously to meet deadlines and ensure high-quality evaluations.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Operations , inventory , and capacity planning .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Operations Evaluator - Domain Expert in Toronto, ON vacancy
$80 - $120 per hour
...and Jack Dorsey . Position: General finance / accounting Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour... ...Responsibilities Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Position: Training / onboarding / L&D Evaluator Type: Contract Compensation... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... .... Collaborate with subject matter experts to ensure consistency and quality....SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Position: Product management / roadmap / PRD Evaluator Type: Contract... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual... ...to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$15 - $20 per hour
...sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and... ...Strong attention to detail . Background or experience in domains requiring structured analytical thinking . Preferred...Remote jobContract workSummer work$80 - $120 per hour
...Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at office$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager - EM... ...experience with impact evaluation of energy efficiency programs. ~ Expert level understanding of building systems, energy end uses and...Full timeWork at officeLocal area- ...administrative support to HR, Finance, and IT, including coverage during staff leaves. ~ Contribute to continuous process improvement in HR operations and systems. ~ Other duties assigned Required Work Capacities: ~ Physical demands: sitting at a desk for computer work (...Full timeImmediate startMonday to fridayShift work
$80 per hour
..., and Jack Dorsey . Position: STEM PhDs and Technical Domain Experts Type: Contract Compensation: $55–$80/hour... ...innovation by developing challenging problems in your domain. Evaluate and improve AI model training and outputs to ensure accuracy...Remote jobContract workSummer work$85k - $156k per year
...And as the largest 100% Canadian-owned and operated professional services firm in our country... .... Learn from deep subject matter experts through mentoring and on the job coaching... ...Role Overview We are seeking a Data Domain Modeler to define, standardize, and govern...Permanent employmentRemote workFlexible hours$80k - $180k per year
...responsibly and at scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate, reliable, safe... ...within the Reliability Testing phase of the AIOS (Zafin's AI Operating System) delivery lifecycle, the role designs, executes, and leads...Full time- ...Create deliverables for common requests within your professional domain. Review peer-developed deliverables to improve AI research... ...for around 3–4 weeks . Compensation & Legal ~ All experts receive a $100 onboarding payment for completing the onboarding...Remote jobHourly payContract workSummer workImmediate startTrial periodShift work
$50 per hour
...and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation: $50/... ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define expectations...Remote jobContract workSummer work10 hours per week$86.34k per year
...Professional Practice & Quality Assurance, Health & Wellness, the Program Evaluation and Quality Improvement Coordinator provides direct research... ...(Outlook, Word, Excel, PowerPoint, Access - intermediate to expert). Proficient with SPSS (ANOVA, MANOVA, regression, etc.)....Full timeCasual workWork at office$37.85 - $47.31 per hour
...multidisciplinary staff. Duties Plan and execute technology evaluation studies using validated frameworks such as the Technology... ...Create and maintain data dictionaries, codebooks, and standard operating procedures for data collection and management. Ensure data quality...Hourly payLong term contractRemplacementFull timeContract workTemporary workInternshipFlexible hours- ...présentement à la recherche d’un(e) Technicien(ne) en informatique expert afin de contribuer aux orientations techniques et à la stabilité... ...importants en gestion de projets multidisciplinaires, dans le domaine des transports, du génie civil, du TI et plus. Nos collaborateurs...Hourly payContract workApprenticeshipRemote workFlexible hours
- ...TEHORA est à la recherche d’ un(e) Expert(e) LEAN Construction afin d’agir à titre de référence stratégique dans la transformation des... ...besoins importants en gestion de projets multidisciplinaires, dans le domaine des transports, du génie civil, du TI et plus. Nos...Hourly payFull timeContract workApprenticeshipRemote workFlexible hours
- ...QA Lead - Insurance Domain Location: Toronto, ON Work Model: Hybrid – 3 days at client office Experience Required: 10+ years Skills ~ EIS: QA Inspection and Testing Skill Role Description Define and own end-to-end test strategy across...Contract workWork at office
- ...TEHORA est à la recherche d’un(e) Expert(e) en gestion des réclamations pour intervenir... ...stratégiques de gestion des réclamations Évaluer les risques contractuels majeurs Agir comme... ..., gestion de projet, ou tout autre domaine jugé équivalent) 16 ans et plus d’expérience...Hourly payContract workApprenticeshipRemote workFlexible hours
- ...TEHORA est présentement à la recherche d’un(e) Responsable BIM – Expert possédant une expertise approfondie en gestion stratégique BIM... ...pertinent en architecture, ingénierie, construction, bâtiment ou domaine pertinent 16 ans et plus d’expérience en gestion BIM , incluant...Hourly payFull timeContract workApprenticeshipRemote workFlexible hours
- ...construire. Nous pensons que les processus d’admission aux études supérieures ont un mandat d’aller au-delà des notes académiques, et d’évaluer le potentiel du candidat en considérant la personne dans son entièreté : son expérience personnelle, ses forces et ses qualités...Contract workApprenticeshipCasual workWork at officeFlexible hoursDay shift
$80 - $120 per hour
...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour... ...Evaluate AI-generated artifacts against domain-specific quality rubrics. Identify factual, aesthetic, and...Remote jobContract workSummer workWork at office- ...accomplished Principal Technology Services Expert who is well versed in delivering... ...join our SAP Sovereign Cloud Delivery and Operations team. You will contribute to SAP's global... ...Technical Administration (preferably in the domain of SAP Basis skills) Strong background in...Permanent employmentFull timeWork at officeWorldwideFlexible hours
$72k - $125k per year
...largest 100% Canadian-owned and operated professional services firm in... ...from deep subject matter experts through mentoring and on the job... ...feedback loops ML Flow for model evaluation and drift detection... ...Flow into existing projects Domain‑specific GenAI solutions for DRO...Long term contractTemporary workFixed term contractFlexible hours- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
$70 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning....Remote jobContract workSummer work- ...Role: AWS Solution Architect (Payment Domain) Total Experience: 6–8 Years Required Skill Set # CI/CD & Automation: Design,... ...Key Vault. # Scripting & Optimization: Write automation scripts using Ansible, PowerShell, Bash, or Python to reduce operational toil....Contract work
$54.8k - $68.5k per year
...for an existing, open vacancy As Operations Manager, Stores, you are responsible for... ...Develop budget strategies. Be seen as the expert by demonstrating a strong understanding... ...our recruitment process to assist in the initial screening and evaluation of applications....Full timePart timeInternshipNight shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Operations Evaluator - Domain Expert. Be the first to apply!
Related searches
- estimateur en bâtiment Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- chargé de projet estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- expert batiment Toronto, ON
- expert automobile Toronto, ON