Data Analysis Expert - Evaluator
$80 - $120 per hourMercor
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI-generated work products.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while ensuring domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data analysis / quantitative readouts .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree (Master's or higher) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
$100 - $150 per hour
...Position: Cybersecurity Labeling Expert Type: Contract... ...harm across domains like scaled data exfiltration , ransomware ,... ..., and exploits . Evaluate POC exploit development to determine... ...background: red team, malware analysis, pen testing, or exploit...SuggestedHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Expert Type: Contract Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software engineering...SuggestedContract workSummer workWork at officeRemote work- ...The Data Architect (Data & Analytics) will architect and deliver comprehensive data solutions using Microsoft Fabric . You will work... ...Consultation: Engage with clients to gather requirements, provide expert advice, and recommend best practices for leveraging Microsoft...SuggestedPermanent employmentFull time
$80 - $120 per hour
...Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs. Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet deadlines...SuggestedFull timeContract workSummer workWork at officeRemote workFlexible hours$100 - $150 per hour
...Position: Sales Engineering Expert Type: Contract... ...supporting proofs of concept, and evaluating product fit and technical risk... ...infrastructure, cybersecurity, data platforms, developer tools, or... ...experience with AI training , evaluation, or human-data projects....SuggestedFull timeContract workSummer workRemote work$80 - $120 per hour
..., General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote work$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Full timeContract workSummer workWork at officeRemote workFlexible hours$60 - $80 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type: Contract Compensation: $60–$80/hour Location:...Hourly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation: $100–$150/... ...Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science contexts...Remote jobContract workSummer workWork at office$100 - $150 per hour
...Summers , and Jack Dorsey . Position: Data Scientist Talent Network Type:... ..., and A/B test write-ups . Evaluate AI-generated or human-created work against... ...Provide detailed written justifications for evaluations and scores to maintain transparency and...Full timeContract workSummer workRemote work$80 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Full timeContract workSummer workRemote work- ...The Senior Director, Financial Planning and Analysis leads the Bank’s enterprise financial... ...that scales common standards, tools, models, data, and insight across the Bank. Financial... ..., and related scenario analysis. Evaluate adverse but plausible scenarios, key sensitivities...Hourly payPermanent employmentFull timeInternshipWork at office
$60 - $70 per hour
...Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Data Science and Analytics Experts Type: Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities...Full timeContract workSummer workRemote work$120 - $170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ..., metric definition, SQL/Python analysis, and communicating findings to executive... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$120 - $170 per hour
..., and Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ..., metric definition, SQL/Python analysis, and communicating findings to executive... ...Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$72 - $80 per hour
...Dorsey . Position: Physics Chart Analysis Expert Type: Contract Compensation... ...Author and review technical tasks to evaluate AI model performance on physics... ...original problem sets using experimental data plots, phase diagrams, spectra, and field...Hourly payFull timeContract workFor contractorsSummer workRemote workFlexible hours$67 - $75 per hour
...Dorsey . Position: Mathematics Chart Analysis Expert Type: Contract... ...review, and annotate technical tasks to evaluate AI model performance on mathematics problems... ...structured feedback to improve training data quality and downstream performance....Hourly payFull timeContract workFor contractorsSummer workRemote workFlexible hours$85k - $135k per year
...for a Financial Planning and Analysis Manager to join our team and... ...in building out their models, evaluating investment cases and leading... ...modeling, investment case evaluation, and variance analysis (budget... ...more information about how your data is processed, please contact...Full timeFlexible hours$50 per hour
...English Language and Literature Expert Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ...detailed linguistic feedback and analysis to guide ongoing model... ...language evaluation, or NLP data work in English. Strong...Remote jobContract workSummer work- ...Position: Data Scientist Location: Toronto, ON... ...candidate will leverage statistical analysis, machine learning methodologies... ...Symbiotic Digital provides the IT Experts you need that solve problems and... ...with proven Experts uniquely evaluated by our proven QMS- Quality Management...Full time
$50 per hour
...Commitment: 15–20 hours/week Role Responsibilities Evaluate AI models on visual document understanding and instruction-... ...to enhance model outputs. Collaborate with subject matter experts to ensure task consistency and relevance. Work independently...Full timeContract workSummer workRemote work$130k - $180k per year
...assets, enabling a new era of data-driven exploration and innovation... ...the Satellite Engineering and Analysis (SEA) team. As a Satellite... ...to onboarding, peer evaluations, regular 1:1s, and team development... ...Attributes: Problem-Solving: Expert in spacecraft-level...Long term contractFull timeInternshipWork at officeRelocation package$60 per hour
...Compensation: $60/hour Location: Remote Role Responsibilities Evaluate high-resolution images to test frontier AI models . Identify gaps in raw image analysis and build tasks around those gaps. Write realistic prompts requiring image work and...Remote jobContract workSummer work$80 - $160 per hour
...Position: Operations / Program Management Experts Type: Contract... ...feedback to improve document standards and evaluation processes. Collaborate with teams to... ..., PowerPoint , and Word for document analysis and reporting. Work independently and...Remote jobContract workSummer work$85k - $156k per year
...well-being and connectedness. Learn from deep subject matter experts through mentoring and on the job coaching Deloitte Global is... .... What will your typical day look like? The Manager, Data Analysis Discovery & Requirements role will lead the discovery, definition...Permanent employmentWork at officeFlexible hours$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...AI model performance . Collaborate with subject matter experts to ensure consistency and quality. Work independently and...Remote jobContract workSummer workWork at office$80 - $160 per hour
...Position: Operations / Program Management Experts Type: Contract... ...feedback to improve document standards and evaluation processes. Collaborate with teams to... ..., PowerPoint , and Word for document analysis and reporting. Work independently and...Remote jobContract workSummer work$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Public-sector procurement / RFI response Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$70 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+...Remote jobContract workSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur industriel Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur automobile Toronto, ON
- failure analysis engineer Toronto, ON

