Data Analysis Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while enhancing domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data analysis / quantitative readouts .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator in Toronto, ON vacancy
- ...building great products. Join us on our mission and shape the future! Why this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality, reliability, and performance of our large language models (LLMs)....SuggestedFull timeWork at officeRemote workFlexible hours
$80 - $120 per hour
...Jack Dorsey . Position: Personal finance / consumer planning Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs. Collaborate with AI research teams to enhance training data quality and domain accuracy. Work independently and...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...SuggestedRemote jobContract workSummer workWork at office$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone,...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: IP / trademark / copyright law Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...SuggestedRemote jobContract workSummer workWork at office- ...culture working together as ONE TEAM. The careers we offer are meaningful because the work we do matters. Join us! Job Summary The Expert, Data Engineering is responsible to lead/mentor a team of specialists in the process of building, managing, and optimizing data pipelines...Full timeWork at officeRemote workMonday to friday
$14.38k per year
...Description: Course number and title : CSC265H1F - Enriched Data Structures and Analysis Please note, this position is equivalent to a 0.5 FCE appointment. Course description : This course covers the same topics as CSC263H1, but at a faster pace, in...Long term contractWork at office$58.74 - $65.44 per hour
We are seeking a seasoned Senior Maximo Business Analyst / Data Analysis Lead to drive a critical multi-year asset management transformation... ...mapped, and migrated accurately. The ideal candidate is a Maximo expert who can command a room of frontline unionized workers and...Long term contractContract workImmediate startRemote work2 days per week3 days per week$60 per hour
...Dorsey . Position: Generalist Expert Type: Contract... ...Role Responsibilities Evaluate AI-generated responses to strengthen... ...feedback to improve training data quality and downstream performance. Develop evaluation rubrics and benchmarks for assessing...Remote jobContract workSummer work$70 - $100 per hour
...Larry Summers , and Jack Dorsey . Position: Office-Suite Experts Type: Contract Compensation: $70–$100/hour... ...Commitment: 20–40 hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel , Word , and PowerPoint...Remote jobContract workSummer workWork at officeImmediate start$122k - $192k per year
...is seeking an experienced DSM Evaluation Manager - EM&V to join our growing... ...and providing engineering and analysis support. Specific... ...staff activities: field work, data collection, energy analyses, project... ...energy efficiency programs. ~ Expert level understanding of...Full timeWork at officeLocal area$80 - $120 per hour
..., Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Incident management / reliability / SRE Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...the roleWe’re seeking a Content Strategy & Analysis Associate to help shape and execute... ...supported services. This role transforms complex data into clear insights, dashboards, and... ...maintain models, trackers, and dashboards to evaluate content performance, value, and trade-offs...Work at officeLocal areaRemote workFlexible hoursShift work
- ...alongside iconic brand names. About the Role As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
$145k - $175k per year
...and sustainably as it grows. The Director, Financial Planning & Analysis (FP&A) is responsible for building and strengthening financial... ...-on leadership role for someone who enjoys working directly with data, developing financial models, producing meaningful analysis, and...Full time- ...We’re #Hiring a #TreasuryLiquidityDataAnalyst – SQL Expert Are you experienced in Capital Markets and Treasury and looking to leverage your expertise in SQL and financial data analysis? Join our Client's leading financial institution working on strategic initiatives in...Contract work
$82.8k - $154.8k per year
...Deadline: Address: 100 King Street West Job Family Group: Data Analytics & Reporting Applies statistical modeling and... ...~ Proficient in Python and SQL, with strong capabilities in data analysis, data engineering, and model development ~ Highly analytical, technically...Full timeContract workPart time$85k - $156k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...reporting and strategic financial analysis projects. Key responsibilities for the Manager... ...6+ CoRe Service Areas to facilitate data requests, annual planning and forecasting...Permanent employmentRemote workFlexible hours$100k - $130k per year
...Role: Revenue Planning & Analysis Manager Duration: Permanent Full Time Working Model: Hybrid Location: Toronto, ON Salary: $100,000... ...enhance reporting processes, governance, and automation to improve data quality and forecasting reliability. What You’ll Need to...Permanent employmentFull timeFlexible hours$95k - $113k per year
...preparation of consolidated budgets and forecasts, analysis to support the validity of budget/... ...to the input and review of budget data in the company’s financial systems. Prepare... ...be determined through a comprehensive evaluation of each candidate’s experience, capabilities...Long term contractCasual workImmediate startFlexible hours$84k - $175k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...will your typical day look like? As a Data Science Manager, you will play a key role... ...in various structured and ad-hoc analysis projects. You will be a principal link between...Permanent employmentFlexible hours$100 per hour
...Position: Corporate Finance Expert Type: Contract... ...Role Responsibilities Evaluate the accuracy of financial reporting... ...Analyze complex financial data to enhance the depth and rigor... ...assessing AI-generated financial analysis tasks and solutions....Remote jobHourly payWeekly payContract workFor contractorsSummer work- ...Digital Marketing Subject Matter Expert (SME) to review AI-generated... ...digital marketing content, evaluating reasoning quality, strategy fit... ...role is with a fast-growing AI Data Services company and delivering... ...linking, content briefs, SERP analysis. ~ Working knowledge of...Hourly payContract workPart timeFor contractorsImmediate startRemote work
$72k - $138k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...As a Computational Economist / Economic Data Scientist, you would take a hands-on role... ...in various structured and ad-hoc analysis projects. You will also perform data analysis...Permanent employmentFlexible hours$70 - $100 per hour
...Dorsey . Position: STEM Computational Scientific Software & Evaluation Design - Astrophysics & Cosmology Type: Contract... ...Develop experimental strategies to recover hidden information from data, emphasizing strategic reasoning. Calibrate tasks against state...Remote jobContract workSummer work$10k per year
...to December Existing Vacancy: Yes Course Title: MHI2009H: Evaluation Methods for Health Informatics Course Description:... ...digital landscape is rapidly changing with the emergence of big data and digital tools such as machine learning, process automation,...Long term contract- ...Position: Special Education Expert Type: Contract... ...Responsibilities Review and evaluate AI-generated outputs related... ...Annotate, label, and validate data across special education use cases... ..., or applied behavior analysis. ~ Strong analytical thinking...Remote jobHourly payContract workSummer work
$120k - $140k per year
...audiences in powerful ways through real-time data and easy-to-use visual tools. By... ...business performance. Your work will turn analysis into practical recommendations that improve... ...and generate meaningful insights. You will evaluate emerging technologies and contribute to initiatives...Long term contractFull timeInternshipWork at officeFlexible hoursShift work1 day per week$95k - $130k per year
...and Accounting Business Performance and Analysis located in our Etobicoke, ON Corporate... ..., empowering cross-functional teams with data-driven insights that facilitate informed... ...preparing presentations to support leadership in evaluating business initiatives and decisions....Long term contractFull timeContract workFor contractorsWork at officeLocal areaFlexible hours2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- web search evaluator Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- remote social media evaluator Toronto, ON
- manager financial planning & analysis Toronto, ON