Business Operations Expert - Evaluator
$70 - $100 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $70–$100/hour
Location: Remote
Role Responsibilities
- Solve one realistic, domain-specific task using the provided source files.
- Review five model-generated outputs for the task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
- Provide structured feedback on the task and study design.
- Work independently to meet deadlines within a short turnaround window.
- Use professional judgment as no rubric or golden answer is provided. LLMs or AI assistants are prohibited at every stage.
Qualifications
Must-Have
- 5+ years of hands-on professional experience in Admin , Marketing , Human Resources , or Accounting .
- Currently or recently practicing to judge work as a working professional would.
- Ability to write clear, specific, evidence-grounded rationales for judgments.
- Reliable within a short turnaround window.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Business Operations Expert - Evaluator in Toronto, ON vacancy
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120... ...model performance . Collaborate with subject matter experts to ensure consistency, relevance, and coverage across...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role...SuggestedFull timeContract workSummer workWork at officeRemote work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/... ...independently and asynchronously to ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...work to both technical and business stakeholders. ~ Detail-oriented... ...with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$120 - $170 per hour
...Dorsey . Position: Data Science Expert Type: Contract Compensation... ...in industry. ~ Background in business operations, product, or growth data science at top... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Customer success / support operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years...Remote jobContract workSummer work$80 - $120 per hour
...Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80$120/hour Location: Remote Role Responsibilities Evaluate AI...Full timeContract workSummer workWork at officeRemote work$50 - $70 per hour
...Larry Summers and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50$70... ...Location: Remote Role Responsibilities Review and evaluate documents slides spreadsheets and similar materials for quality...Full timeContract workSummer workRemote workFlexible hours$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...Dorsey . Position: Data Science Expert Type: Contract Compensation... ...in industry. ~ Background in business operations, product, or growth data science at top... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$80 - $150 per hour
...Dorsey . Position: UI / UX Design Expert Type: Contract Compensation... ...independently and asynchronously to evaluate and improve AI model performance .... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$11 - $19 per hour
...Larry Summers and Jack Dorsey . Position: Music & Lyrics Expert - Bengali Type: Contract Compensation: $11$19... ...on quality creativity prompt adherence and originality. Evaluate whether lyrics sound natural including word choice slang and regional...Full timeContract workSummer workImmediate startRemote work$77 - $98 per hour
..., Larry Summers , and Jack Dorsey . Position: Applied Business & Commerce Benchmark Specialist Type: Contract... ...included. Rate each question's difficulty as Medium, Hard, or Expert and provide 1 correct answer with 9 plausible alternatives....Remote jobContract workSummer work- ...Business Operations Lead Location: Toronto, ON Employment Type: Full-Time, Permanent Department: Programming & Partnerships Reports... ...connected funnel of three products: Scout — an AI-first, expert-validated market-intelligence tool that produces deep research...Permanent employmentFull timeLocal area
$60 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Marketing Expert — Marketing Operations (AI Agent Environments) Type: Contract... ...strong from plausible-but-wrong responses. Review and evaluate AI agent attempts against personal standards. Diagnose...Remote jobContract workSummer work- ...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Policy Administration & Insurance Operations Manager Type: Contract Compensation: $800/hour Location: Remote Commitment: 20–40 hours/week...Remote jobContract workSummer workImmediate start
$77 - $98 per hour
..., Larry Summers , and Jack Dorsey . Position: Applied Business & Commerce Benchmark Specialist Type: Contract... ...Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible...Remote jobContract workSummer work$77 - $98 per hour
...DAngelo Larry Summers and Jack Dorsey . Position: Applied Business & Commerce Benchmark Specialist Type: Contract... ...: Medium (intro undergraduate) Hard (advanced undergraduate) or Expert (post-graduate and above). Provide 1 correct answer and 9 plausible...Full timeContract workSummer workRemote work$75k per year
...member of our team – whether in teaching, operations, or technology – is dedicated to... ...Who we need We are looking for a Business Analyst, Technology and Operations to join... ...requirements gathering, process mapping, solution evaluation, and system implementation. You will...Full timeWork at officeRemote workFlexible hoursShift work$60k - $75k per year
...About GardaWorld Give your career a new vision with GardaWorld | Business Operations Analyst- Bilingual GardaWorld company, is transforming the way businesses protect their people and assets. We're seeking a driven and detail-oriented Business Operations Analyst to...Contract workRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Operations Expert - Evaluator. Be the first to apply!
Related searches
- junior business consultant Toronto, ON
- change management consultant Toronto, ON
- business systems consultant Toronto, ON
- project management consultant Toronto, ON
- document management consultant Toronto, ON
- risk management consultant Toronto, ON
- business sales specialist Toronto, ON
- business consultant Toronto, ON
- small business advisor Toronto, ON
- change management advisor Toronto, ON