Data Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve quality.
- Work independently and asynchronously to meet deadlines.
- Utilize expertise in Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobDataContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Summers , and Jack Dorsey . Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...interactions and stale patient data driving incorrect doses; update based... ...Prior data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataContract workSummer work$120 per hour
...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
...and Jack Dorsey . Position: Engineering / manufacturing / technical operations Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Accounting Domain Intake — Shape Upcoming Accounting Engagements Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Complete a ~30-minute written intake about your accounting practice. Describe day...Remote jobHourly payContract workFor contractorsSummer work$42 per hour
...Type: Contract Compensation: $17–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres for quality and creativity. Compare...Remote jobContract workSummer workImmediate start$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards...Remote jobContract workSummer work$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and Word for...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...missed interactions, stale patient data, and monograph guidance superseded by... ...data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataContract workSummer work$120 per hour
...Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to improve training data quality and model performance....Remote jobDataContract workSummer workWork at office$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...to support AI model training . Evaluate the accuracy of AI-generated equity... ...research teams to improve training data quality. Collaborate with subject...Remote jobDataHourly payContract workFor contractorsSummer work$120 per hour
...Accounting Domain Intake — Shape Upcoming Accounting Engagements Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Complete a ~30-minute written intake about your accounting practice. Describe your...Remote jobContract workFor contractorsSummer work$170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...Prior experience with AI training , evaluation, or human-data projects....Remote jobDataContract workSummer work$80 per hour
...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience)... ...Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobDataContract workSummer work$120 per hour
...Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for the point cited. Catch...Remote jobContract workSummer work$19 per hour
...Contract Compensation: $11–$19/hour Location: Remote Duration: Up to 6 months Commitment: 20+... ...on quality, creativity, prompt adherence, and originality. Evaluate whether lyrics sound natural, including word choice, slang, and...Remote jobContract workSummer workImmediate start$150 per hour
...Jack Dorsey . Position: Data Scientist Talent Network... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain transparency...Remote jobDataContract workSummer work$170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...Prior experience with AI training , evaluation, or human-data projects....Remote jobDataContract workSummer work$150 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Clinical Data Manager / CDISC Type: Contract Compensation: $100–$150/hour Location: Remote Commitment: 20–25 hours/week Role Responsibilities Lead clinical...Remote jobDataContract workSummer work$150 per hour
...Position: MS Excel / Google Sheets Evaluator Type: Contract... ...$150/hour Location: Remote Role Responsibilities... ...feedback to improve document evaluation processes. Utilize MS Excel... ...Google Slides for comprehensive data analysis and presentation....Remote jobDataContract workSummer work$70 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Construct enterprise data science scenarios...Remote jobDataContract workSummer work$100 per hour
...Compensation: $60–$100/hour Location: Remote Role Responsibilities Design... ...judge them against your own standard. Evaluate AI-generated content in PR & Communications to improve model outputs and training data quality. Collaborate independently and...Remote jobDataContract workSummer work$35 per hour
...Contract Compensation: $35/hour Location: Remote Role Responsibilities Find images that may cause AI models... ...Preferred ~ Experience with photography, image editing, data labeling, or other detail-focused work. Application Process...Remote jobDataContract workSummer work$170 per hour
...Contract Compensation: $120–$170/hour Location: Remote Commitment: 20–25 hours/week... ...Simulate the pharmacology layer of each data room, including PK and PD... ...outputs, and rubrics for AI agent evaluation. Evaluate exposure-response relationships...Remote jobDataContract workSummer workManual labor$100 per hour
...Compensation: $60–$100/hour Location: Remote Role Responsibilities Design... ...from weak responses. Review and evaluate AI agent attempts against established standards. Diagnose issues from messy data, prioritize tasks, and orchestrate multi-step...Remote jobDataContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur structure Toronto, ON
- clinical data coordinator remote Toronto, ON
- data network cabling Toronto, ON
