Business Operations Expert - Evaluator
$60 - $80 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $60–$80/hour
Location: Remote
Role Responsibilities
- Sign an NDA before receiving any materials.
- Solve one realistic, domain-specific task using the source files provided.
- Review five model-generated outputs for that task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
- Provide structured feedback on the task itself and on the study design.
- Work independently to complete the task within a short turnaround window.
Qualifications
Must-Have
- 5+ years of hands-on professional experience in Admin , Marketing , Human Resources , or Accounting .
- Currently or recently practicing to judge work as a working professional would.
- Ability to write a clear, specific, evidence-grounded rationale for a judgment.
- Reliable within a short turnaround window.
Compensation & Legal
- Hourly contractor
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Business Operations Expert - Evaluator in Toronto, ON vacancy
$70 - $100 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $70–$100/hour...SuggestedRemote jobContract workSummer workInternship$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120... ...model performance . Collaborate with subject matter experts to ensure consistency, relevance, and coverage across...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/... ...independently and asynchronously to ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...Remote jobContract workSummer workWork at office$30 per hour
...Larry Summers , and Jack Dorsey . Position: Hindi Linguistic Experts Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated Hindi text across various...Remote jobContract workSummer work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts....Remote jobContract workSummer workWork at office$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Remote jobContract workSummer workWork at office$70k - $80k per year
...with the premier programme, project and cost management offering in markets around the world. Job Description The Business Operations Partner is a key support role within the team, providing a hybrid of executive support, operational coordination, marketing/proposal...Full timeFlexible hours$142k - $192k per year
...Delivery organization is to run and operate SAP’s private cloud offering. The Enhanced Operation Service is part of SAP Enterprise... ...like HANA/ASE/MSSQL – with expert level knowledge in HANA • You demonstrate... ...more efficiently and use business insight more effectively. Originally...Long term contractPermanent employmentFull timeLocal areaWorldwideFlexible hours$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data analysis / quantitative readouts Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$150k per year
...Job Responsibility: Join The Forever Group as the Director of Business Operations and Finance and unlock a world of opportunity! With 30 years of industry expertise, we are a Canadian powerhouse, known for our entrepreneurial drive and dedication to crafting top-notch consumer...Full timeInternshipWorldwideRelocationOverseasMonday to fridayFlexible hours$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...work to both technical and business stakeholders. ~ Detail-oriented... ...with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...Dorsey . Position: Data Science Expert Type: Contract Compensation... ...in industry. ~ Background in business operations, product, or growth data science at top... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$120 - $170 per hour
...Dorsey . Position: Data Science Expert Type: Contract Compensation... ...in industry. ~ Background in business operations, product, or growth data science at top... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Policy Administration & Insurance Operations Manager Type: Contract Compensation: $80/hour Location: Remote Commitment: 20–40 hours/week...Remote jobContract workSummer workImmediate start$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: BI dashboards / performance reporting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...independently and asynchronously to meet deadlines while improving evaluation processes. Qualifications Must-Have ~5+ years...Remote jobContract workSummer work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$85k - $156k per year
...opportunity. It builds consumer and business confidence, empowers... ...largest 100% Canadian-owned and operated professional services firm in... ...from deep subject matter experts through mentoring and on the... ...contracts management, finance and operations, capability build,...Permanent employmentRemote workFlexible hours$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start- ...by supporting and being there to help your team Be the store expert for all things service-related Account and billing inquiries... ...time to time, at its sole discretion to better reflect evolving business structure, goals and strategies. Qualifications: You are required...Hourly payPermanent employmentFull timePart timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Operations Expert - Evaluator. Be the first to apply!
Related searches
- business systems consultant Toronto, ON
- business sales specialist Toronto, ON
- emergency management consultant Toronto, ON
- project management consultant Toronto, ON
- small business associate Toronto, ON
- small business advisor Toronto, ON
- junior business consultant Toronto, ON
- change management consultant Toronto, ON
- change management advisor Toronto, ON
- business continuity specialist Toronto, ON