Data Evaluator - Fully Remote | Upto $120/hr
$120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in outputs.
- Provide clear, structured written feedback to improve quality.
- Work independently and asynchronously to meet deadlines.
- Utilize expertise in Microsoft Office and Google Workspace , especially Slides .
Qualifications
Must-Have
- 5+ years of relevant professional experience in Software / AI / IT / data .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace , especially Slides .
Preferred
- Advanced degree ( Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobDataContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Real estate / hospitality / events Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Contract Compensation: $75–$120/hour Location: Remote Role Responsibilities Confirm... ...interactions and stale patient data driving incorrect doses; update based... ...Prior data annotation, labeling, or AI evaluation experience Application Process...Remote jobDataContract workSummer work$120 per hour
...Contract Compensation: $120/hour Location: Remote Role Responsibilities Apply... ...Contribute to AI model training, evaluation, and improvement . Collaborate... ...to enhance model outputs and training data quality. Work independently and...Remote jobDataContract workSummer work$120 per hour
...Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...meet deadlines while ensuring high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$120 per hour
...Larry Summers , and Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Capital Markets (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~24 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review and...Remote jobContract workSummer work$120 per hour
...Larry Summers , and Jack Dorsey . Position: Legal contracts / diligence / redlines Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-...Remote jobContract workSummer workWork at office$120 per hour
...Accounting Domain Intake — Shape Upcoming Accounting Engagements Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Complete a ~30-minute written intake about your accounting practice. Describe...Remote jobHourly payWeekly payContract workFor contractorsSummer work$120 per hour
...Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... ...AI research teams to improve training data quality and model performance....Remote jobDataContract workSummer workWork at office$120 per hour
...Contract Compensation: $120/hour Location: Remote Duration: Minimum four weeks... ...to support AI model training . Evaluate the accuracy of AI-generated equity... ...research teams to improve training data quality. Collaborate with subject...Remote jobDataHourly payContract workFor contractorsSummer work$120 per hour
...Experts Type: Contract Compensation: $120/hour Location: Remote Role Responsibilities Use an AI-powered product... ...generation, and marketing strategy recommendations. Evaluate outputs from an end-user perspective focusing on...Remote jobContract workSummer work$120 per hour
..., Larry Summers , and Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts against domain-specific...Remote jobContract workSummer workWork at office$120 per hour
...Real Estate (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~30 hours Role Responsibilities Evaluate AI-generated legal content in finance and real estate to ensure accuracy and relevance...Remote jobContract workSummer work$120 per hour
...Survey Research & Consumer Insights Expert Type: Contract Compensation: $120/hour Location: Remote Role Responsibilities Review and evaluate surveys for methodological quality, clarity, and fitness for purpose. Assess survey questions...Remote jobContract workSummer work$120 per hour
...Environmental (Project Donna) Type: Contract Compensation: $100–$120/hour Location: Remote Commitment: ~13 hours Role Responsibilities Evaluate AI-generated legal deliverables for accuracy and preference. Review six...Remote jobContract workSummer work$120 per hour
...Contract Compensation: $90–$120/hour Location: Remote Commitment: 40 hours/week... ...training infrastructure topics. Evaluate ML systems tasks and solutions. Provide... ...matter experts to keep training data consistent and accurate. Qualifications...Remote jobDataHourly payWeekly payContract workFor contractorsSummer workWeekday work$42 per hour
...Type: Contract Compensation: $14–$42/hour Location: Remote Duration: Up to 6 months Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres. Rate it against detailed quality standards...Remote jobContract workSummer workImmediate startFlexible hours$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Provide structured feedback to improve document standards and evaluation processes. Utilize Excel , PowerPoint , and Word for...Remote jobContract workSummer work$160 per hour
...Contract Compensation: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-... ...Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to improve document standards...Remote jobContract workSummer work$120 per hour
...Dorsey . Position: Domain Expert – Legal (Lexis+ Research) Type: Contract Compensation: $76–$120/hour Location: Remote Role Responsibilities Confirm every case, statute, and regulation is still good law for the point cited. Catch...Remote jobContract workSummer work$120 per hour
...: Contract Compensation: $60–$120/hour Location: Remote Role Responsibilities Develop high-quality data sets to inform the future of AI innovation... ...of training data through rigorous evaluation. Qualifications Must-Have...Remote jobDataContract workSummer workFlexible hours$40 per hour
...Compensation: $30–$40/hour Location: Remote Role Responsibilities Conduct daily... ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations to enhance training data quality . Work independently and asynchronously...Remote jobDataDaily paidContract workSummer workFlexible hours$70 per hour
...Word on macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Evaluate and utilize Word on macOS for long-form document authoring and review. Develop expertise in styles, referencing...Remote jobContract workSummer workFlexible hours$40 per hour
...Photoshop on Windows - Generalist Type: Contract Compensation: $30–$40/hour Location: Remote Role Responsibilities Evaluate the use of Photoshop for raster image editing, retouching, and compositing. Develop creative solutions...Remote jobContract workSummer work$80 per hour
...Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience)... ...Compensation: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobDataContract workSummer work$65 per hour
...Contract Compensation: $55–$65/hour Location: Remote Role Responsibilities Utilize PyCharm on macOS for... ...requirements. Collaborate with backend engineers and data practitioners to optimize workflows. Qualifications Must...Remote jobDataContract workSummer work$20 per hour
..., Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role Responsibilities Evaluate paired...Remote jobContract workSummer work$70 per hour
...Application Users - Excel on macOS - Professionals Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize Excel for spreadsheet modeling, formulas, pivot tables, and charting. Capture high-...Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Evaluator - Fully Remote | Upto $120/hr. Be the first to apply!
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
