Business Operations Expert - Evaluator
$70 - $100 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting)
Type: Contract
Compensation: $70–$100/hour
Location: Remote
Role Responsibilities
- Solve one realistic, domain-specific task using the provided source files.
- Review five model-generated outputs for the task. Rank them 1–5 with no ties, score each 0–100, and write evidence-based rationales citing specific parts of the output.
- Provide structured feedback on the task and study design.
- Work independently to meet deadlines within a short turnaround window.
- Use professional judgment as no rubric or golden answer is provided. LLMs or AI assistants are prohibited at every stage.
Qualifications
Must-Have
- 5+ years of hands-on professional experience in Admin , Marketing , Human Resources , or Accounting .
- Currently or recently practicing to judge work as a working professional would.
- Ability to write clear, specific, evidence-grounded rationales for judgments.
- Reliable within a short turnaround window.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$80 - $120 per hour
...Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120... ...model performance . Collaborate with subject matter experts to ensure consistency, relevance, and coverage across...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare operations Evaluator Type: Contract Compensation: $80–$120/... ...independently and asynchronously to ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...SuggestedRemote jobContract workSummer workWork at office$39 per hour
...answering questions, and correcting errors. Rate the experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional healthcare standards. Work independently and asynchronously to meet...Remote job$39 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Healthcare...Full timeContract workSummer workRemote work$40 - $75 per hour
...include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Evaluation Rubric Reviewer Type: Contract Compensation: $40–$75/hour Location: Remote Role Responsibilities...Remote jobContract workSummer work$57 per hour
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobHourly payContract workFor contractorsSummer work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging medical problems...Remote jobContract workSummer workImmediate start$50 per hour
...Larry Summers , and Jack Dorsey . Position: French Linguistic Experts Type: Contract Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated French text across various...Remote jobContract workSummer work$150 per hour
...Larry Summers , and Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation: $150/hour... ...Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging medical problems...Remote jobContract workSummer workImmediate startFlexible hours$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts....Remote jobContract workSummer workWork at office$70k - $150k per year
...Customer Shared Services Manages day-to-day operations, solves issues for a designated digital... ...Acts as a trusted advisor to assigned business/group. Influences and negotiates to... ..., stakeholder management, execution, evaluation and sustainment of initiatives. Coordinates...Long term contractFull timeContract workTemporary workPart time$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...work to both technical and business stakeholders. ~ Detail-oriented... ...with AI training , evaluation, or human-data projects....Remote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...Join us on our mission and shape the future! The Strategy & Business Operations team’s mission is to support decision making on critical C-level... ...and profitable Build financial models and analyses to evaluate new and existing opportunities Contribute to corporate development...Full timeInternshipWork at officeRemote workFlexible hours
$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation: $100–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at officeFlexible hours$50 per hour
...Position: English Language and Literature Expert Type: Contract... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...writing, linguistic annotation, language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work$14 per hour
...Larry Summers , and Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation: $14/... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$80 - $150 per hour
..., Larry Summers , and Jack Dorsey . Position: Design Expert Type: Contract Compensation: $80–$150/hour... ...Preferred ~ Prior experience with AI training , evaluation, or human-data projects. Application Process (Takes 20–30...Remote jobContract workSummer work$120 - $170 per hour
...Dorsey . Position: Data Science Expert Type: Contract Compensation... ...in industry. ~ Background in business operations, product, or growth data science at top... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$50 - $70 per hour
...Larry Summers , and Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract Compensation: $50–$... ...Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar materials for...Remote jobContract workSummer workFlexible hours$120 - $170 per hour
...Dorsey . Position: Data Science Expert Type: Contract Compensation... ...in industry. ~ Background in business operations, product, or growth data science at top... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$142k - $192k per year
...Delivery organization is to run and operate SAP’s private cloud offering. The Enhanced Operation Service is part of SAP Enterprise... ...like HANA/ASE/MSSQL – with expert level knowledge in HANA • You demonstrate... ...more efficiently and use business insight more effectively. Originally...Long term contractPermanent employmentFull timeLocal areaWorldwideFlexible hours$70k - $80k per year
...The Business Operations Partner is a key support role within the team, providing a hybrid of executive support, operational coordination, marketing/proposal development, and administrative oversight across finance and HR processes. This role requires a highly organized, proactive...Full timeFlexible hours- ...Said plans and policies are subject to modification by the Company from time to time, at its sole discretion to better reflect evolving business structure, goals and strategies. Qualifications: You are required to provide 5 blocks with 5 continuous hours, with a minimum of...Hourly payPermanent employmentFull timePart timeFlexible hours
$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Business Operations Expert - Evaluator. Be the first to apply!
- business sales specialist Toronto, ON
- risk management consultant Toronto, ON
- small business associate Toronto, ON
- document management consultant Toronto, ON
- emergency management consultant Toronto, ON
- business continuity specialist Toronto, ON
- small business advisor Toronto, ON
- business systems consultant Toronto, ON
- change management advisor Toronto, ON
- senior business consultant Toronto, ON
