Data Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve quality.
- Work independently and asynchronously to meet deadlines.
- Utilize expertise in Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...interactions and stale patient data driving incorrect doses; update based... ...Prior data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataContract workSummer work$120 per hour
...Restructuring (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~18 hours Role Responsibilities Evaluate AI-generated legal content in restructuring and insolvency to enhance accuracy...Remote jobHourly payContract workFor contractorsSummer work$120 per hour
...Survey Research & Consumer Insights Expert Type: Contract Compensation: $120/hour Location: Remote Role Responsibilities Review and evaluate surveys for methodological quality, clarity, and fitness for purpose. Assess survey questions...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...missed interactions, stale patient data, and monograph guidance superseded by... ...data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataContract workSummer work$120 per hour
...Capital Markets (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review and...Remote jobContract workSummer work$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Dorsey . Position: Legal Expert — Immigration (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~6 hours Role Responsibilities Read a synthetic legal matter and its underlying...Remote jobContract workSummer work$120 per hour
...Accounting Domain Intake — Shape Upcoming Accounting Engagements Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Complete a ~30-minute written intake about your accounting practice. Describe...Remote jobHourly payWeekly payContract workFor contractorsSummer work$120 per hour
...: Contract Compensation: $60–$120/hour Location: Remote Role Responsibilities Develop high-quality data sets to inform the future of AI innovation... ...of training data through rigorous evaluation. Qualifications Must-Have...Remote jobDataContract workSummer workFlexible hours$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards...Remote jobContract workSummer work$120 per hour
...Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to improve training data quality and model performance....Remote jobDataContract workSummer workWork at office$120 per hour
...Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...to support AI model training . Evaluate the accuracy of AI-generated equity... ...research teams to improve training data quality. Collaborate with subject...Remote jobDataHourly payContract workFor contractorsSummer work$42 per hour
...Type: Contract Compensation: $14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against detailed quality standards...Remote jobContract workSummer workImmediate startFlexible hours$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and Word for...Remote jobContract workSummer work$120 per hour
...Environmental (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~13 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review six...Remote jobContract workSummer work$120 per hour
...Real Estate (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~30 hours Role Responsibilities Evaluate AI-generated legal content in finance and real estate to ensure accuracy and relevance...Remote jobContract workSummer work$120 per hour
...Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for the point cited. Catch...Remote jobContract workSummer work$70 per hour
...Application Users - PowerPoint on Windows - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize PowerPoint on Windows for presentation design, slide masters, and animation....Remote jobContract workSummer work$80 per hour
...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience)... ...Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobDataContract workSummer work$150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain transparency...Remote jobDataContract workSummer work$20 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate paired...Remote jobContract workSummer work$19 per hour
...Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...Prior experience with AI training , evaluation, or human-data projects....Remote jobDataContract workSummer work$12 per hour
...Contract Compensation: $13/hour Location: Remote Role Responsibilities Source documents by... ...Preferred Experience with regional-language AI data annotation or bilingual evaluation. Skills in transcription, localization, and OCR...Remote jobDataContract workSummer work$50 per hour
...Compensation: $20–$50/hour Location: Remote Role Responsibilities Review... ...quality processes, checklists, and evaluation criteria. Collaborate asynchronously... .... Preferred Familiarity with data annotation, content review, or evaluation...Remote jobDataContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
- estimateur structure Toronto, ON
- admissions evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur - dessinateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur industriel Toronto, ON
