Recruiting Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: People ops / recruiting Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors.
- Provide clear, structured written feedback.
- Apply deep subject-matter expertise to grade outputs.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- 5+ years of relevant professional experience in People ops / recruiting.
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides (Google Slides / PowerPoint).
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$120 per hour
...Dorsey . Position: Education / school Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
...Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Pharmacist Type: Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm interaction,... ...~ Prior data annotation, labeling, or AI evaluation experience Application Process (Takes 20–30 mins...Remote jobContract workSummer work$42 per hour
...Type: Contract Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres for quality and creativity. Compare...Remote jobContract workSummer workImmediate start$120 per hour
...Larry Summers , and Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Expert Type: Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks Commitment:... ...public SEC filings to support AI model training . Evaluate the accuracy of AI-generated equity research to enhance...Remote jobHourly payContract workFor contractorsSummer work$120 per hour
...Accounting Domain Intake — Shape Upcoming Accounting Engagements Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Complete a ~30-minute written intake about your accounting practice. Describe your...Remote jobContract workFor contractorsSummer work$120 per hour
...Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for the point cited. Catch...Remote jobContract workSummer work$19 per hour
...Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$170 per hour
...Pharmacologist Type: Contract Compensation: $120–$170/hour Location: Remote Commitment: 20–25 hours/week Role... ...Design prompts, golden outputs, and rubrics for AI agent evaluation. Evaluate exposure-response relationships to...Remote jobContract workSummer workManual labor$170 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Biostatistician Type: Contract Compensation: $120–$170/hour Location: US or Canada Commitment: 20–25 hours/week Role Responsibilities Simulate raw patient...Remote jobHourly payContract workFor contractorsSummer work$100 per hour
...Compensation: $60–$100/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content to strengthen... ...quality and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI-generated...Remote jobContract workSummer work$19 per hour
...Type: Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music for musicality, creativity, prompt adherence, vocal quality...Remote jobContract workSummer workImmediate start$80 per hour
...Experience) Type: Contract Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving...Remote jobContract workSummer work$80 per hour
...and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location: Remote Role Responsibilities Sign an NDA before receiving any...Remote jobHourly payContract workFor contractorsSummer work$150 per hour
...Contract Compensation: $150–$250/hour Location: Remote Role Responsibilities Conduct structured, recorded remote sessions to capture expert design thinking. Evaluate design quality and critique to differentiate strong craft from weak....Remote jobContract workSummer work$70 per hour
...Compensation: $40–$70/hour Location: Remote Role Responsibilities Evaluate the accuracy and depth of AI-generated content to strengthen... ...quality and downstream performance. Develop evaluation rubrics and benchmarks for assessing AI-generated...Remote jobContract workSummer work$17 per hour
...Type: Contract Compensation: $17/hour Location: Remote Duration: Up to 6 months Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards in music ....Remote jobContract workSummer workImmediate start$85 per hour
...Experience) Type: Contract Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations...Remote jobContract workSummer work$60 per hour
...Jack Dorsey . Position: Expert Project Manager Type: Contract Compensation: $50–$60/hour Location: Remote Role Responsibilities Track project and annotator performance using Google Sheets . Review annotator quality to...Remote jobContract workSummer work$98 per hour
...Position: Applied Business & Commerce Benchmark Specialist Type: Contract Compensation: $77–$98/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original business questions that test deep conceptual...Remote jobContract workSummer work$190 per hour
...Jack Dorsey . Position: Medical Safety Expert Type: Contract Compensation: $140–$190/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities Generate and validate the safety layer of clinical data rooms,...Remote jobContract workSummer work$70 per hour
...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and... ...attention to detail and accurate application of structured evaluation guidelines. Work independently and asynchronously...Remote jobContract workSummer work$85 per hour
...Contract Compensation: $85/hour Location: Remote Role Responsibilities Author original, free-response... ...against three frontier language models until at least one fails. Evaluate the accuracy and depth of AI-generated content in...Remote jobContract workSummer work$63 per hour
...Position: Applied Philosophy Benchmark Specialist Type: Contract Compensation: $50–$63/hour Location: Remote Commitment: 10+ hours/week Role Responsibilities Author original philosophy questions that test deep conceptual understanding...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Recruiting Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
- chargé de projet estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur automobile Toronto, ON
- estimateur structure Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote disability management Toronto, ON
- remote security manager Toronto, ON
