Data Analysis Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while enhancing domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data analysis / quantitative readouts .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator in Toronto, ON vacancy
$50 per hour
...hours/week Role Responsibilities Evaluate the accuracy and depth of AI models in... ...to improve model outputs and training data quality. Work independently and asynchronously... ...AI model performance . Develop evaluation rubrics and benchmarks for assessing AI-...SuggestedRemote jobContract workSummer work$90 - $110 per hour
...Position: Finance & Banking Expert Type: Contract... ...produce accurate outputs. Evaluate AI models on professional document... .... Create objective evaluation rubrics for AI-generated content... ...experience in Investment & financial analysis . ~ Experience in...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: People ops / recruiting Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Market research / competitive intelligence Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at officeFlexible hours$50 per hour
...Role Responsibilities Evaluate the accuracy and depth of AI-generated... ...teams to improve training data quality and downstream performance. Develop evaluation rubrics and benchmarks for... ...Collaborate with subject matter experts to ensure consistency,...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs. Collaborate with AI research teams to enhance training data quality and performance. Work independently and asynchronously...Remote jobContract workSummer workWork at office- ...Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Data... ...discrepancies and support reconciliation processes through root cause analysis. Collaborate with business, data engineering, and technology...Full timeManual laborLocal area
$50 per hour
...Commitment: 15–20 hours/week Role Responsibilities Evaluate AI models on visual document understanding in the Pharma &... ...alignment with domain principles. Collaborate with subject matter experts to ensure consistency and relevance across datasets. Work...Remote jobContract workSummer work$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...Remote jobContract workSummer workWork at office$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone,...Remote jobContract workSummer work$80 - $120 per hour
...Jack Dorsey . Position: Product management / roadmap / PRD Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$122k - $192k per year
...is seeking an experienced DSM Evaluation Manager - EM&V to join our growing... ...and providing engineering and analysis support. Specific... ...staff activities: field work, data collection, energy analyses, project... ...energy efficiency programs. ~ Expert level understanding of...Full timeWork at officeLocal area$80k - $180k per year
..., an integration platform that connects data, systems, and workflows across complex enterprise... .... What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are... ...similar tools supporting evaluation and analysis. Nice to Have Experience...Full time- ..., and supporting HR administration in a unionized environment. You will also play a key role in supporting payroll processes, ensuring data accuracy, and providing general administrative support. Additionally, this position is responsible for coordinating employee access to...Full timeImmediate startMonday to fridayShift work
$10k per year
...SESSIONAL LECTURER for Fall 2026 Term, at .5 FCE – CUPE 3902 Unit 3 Course# & Course Title: CHL: 5150H Data collection methods for research and evaluation projects Course Description: This course aims to provide students with an understanding of the...Long term contract$86.34k per year
...Health & Wellness, the Program Evaluation and Quality Improvement... ...qualitative and quantitative data gathering activities, including... ...methods of data collection and analysis for research projects. Drafting... ...PowerPoint, Access - intermediate to expert). Proficient with SPSS (ANOVA,...Full timeCasual workWork at office$80 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Remote jobContract workSummer work$58.74 - $65.44 per hour
We are seeking a seasoned Senior Maximo Business Analyst / Data Analysis Lead to drive a critical multi-year asset management transformation... ...mapped, and migrated accurately. The ideal candidate is a Maximo expert who can command a room of frontline unionized workers and...Long term contractContract workImmediate startRemote work2 days per week3 days per week$110k - $120k per year
.... With critical thinking, advanced technical architecture and data engineering skills, and the opportunity to heavily impact a rapidly... ...you'll be doing: Become the organizational subject-matter expert and driving force behind our Core Lending System and all associated...Full timeInternshipWork at officeFlexible hours$37.85 - $47.31 per hour
...coordinating all aspects of the research study data collection, including conducting semi-... ...interview administration, data input and analysis and report production; providing... ...Duties Plan and execute technology evaluation studies using validated frameworks such as...Hourly payLong term contractRemplacementFull timeContract workTemporary workInternshipFlexible hours- ...lead financial planning forecasting and analysis for our core operational investments. Located... ...CapEx Planning & Governance: Oversee the evaluation tracking and prioritization of capital... ...leadership translating complex financial data into actionable insights that drive strategic...Full timeWork at officeLocal areaFlexible hours
$50 per hour
...and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation: $50/... ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define expectations...Remote jobContract workSummer work10 hours per week$85k - $156k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...reporting and strategic financial analysis projects. Key responsibilities for the Manager... ...6+ CoRe Service Areas to facilitate data requests, annual planning and forecasting...Permanent employmentRemote workFlexible hours- ...valuation, and reporting capabilities. The successful candidate will focus on quarterly valuations medium- and long-term investor return analysis and support financial planning and analysis, with a cash flow forecasting, KPI reporting, operating plan variance analysis, monthly...Long term contractFull time
$85k - $156k per year
...Learn from deep subject matter experts through mentoring and on the... ...typical day look like? The Data Quality Management Lead is... ...against industry best practices. Evaluate emerging technologies and... ...familiarity with data profiling, data analysis, DQ rule design, and DQ...Permanent employmentFlexible hours- ...analytical and strategic Senior Manager, Market Analysis & Strategic Planning to help shape the... ...financial and quantitative analyses to evaluate revenue opportunities, partnerships, product... ...to evaluate new advertising solutions, data products, and monetization potential. Support...Full timeWork at officeShift work3 days per week
- ...to help build the next generation of our financial planning and analysis capabilities. This is a role for someone energized by the opportunity... .... Leverage NetSuite and connected BI tools to strengthen data integrity, streamline workflows, and reduce manual effort. Partner...Permanent employmentLocal areaWorldwide
- ...world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the... ...availability query service to enable low-latency analysis and curation over large volumes of metric and tag data - Work with large datasets from various sources...Full timeInternship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!
Related searches
- estimateur en bâtiment Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- chargé de projet estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- manager financial planning & analysis Toronto, ON
- business analysis Toronto, ON