Data Analysis Expert - Evaluator
$80 - $120 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Data analysis / quantitative readouts Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated artifacts against domain-specific quality rubrics.
- Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
- Provide clear, structured written feedback to improve AI model outputs.
- Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
- Work independently and asynchronously to meet deadlines while enhancing domain quality.
Qualifications
Must-Have
- 5+ years of relevant professional experience in Data analysis / quantitative readouts .
- Native or professional fluency in English .
- Highly proficient in Microsoft Office and Google Workspace, especially Slides .
Preferred
- Advanced degree ( Master's or higher ) from a reputable institution.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Data Analysis Expert - Evaluator in Toronto, ON vacancy
$50 per hour
...hours/week Role Responsibilities Evaluate the accuracy and depth of AI models in... ...to improve model outputs and training data quality. Work independently and asynchronously... ...AI model performance . Develop evaluation rubrics and benchmarks for assessing AI-...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...and Jack Dorsey . Position: General finance / accounting Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs. Collaborate with AI research teams to enhance training data quality. Work independently and asynchronously to meet deadlines...SuggestedRemote jobContract workSummer workWork at office$90 - $110 per hour
...Position: Finance & Banking Expert Type: Contract... ...produce accurate outputs. Evaluate AI models on professional document... .... Create objective evaluation rubrics for AI-generated content... ...experience in Investment & financial analysis . ~ Experience in...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...Dorsey . Position: General business strategy / management Evaluator Type: Contract Compensation: $80–$120/hour... ...independently and asynchronously to meet deadlines while enhancing evaluation processes. Qualifications Must-Have ~5+ years...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour... ...outputs. Collaborate with AI research teams to enhance training data quality and performance. Work independently and asynchronously...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...and Jack Dorsey . Position: Training / onboarding / L&D Evaluator Type: Contract Compensation: $80–$120/hour... ...structured written feedback. Collaborate with subject matter experts to ensure consistency and quality. Work independently and...Remote jobContract workSummer workWork at office$50 per hour
...Role Responsibilities Evaluate the accuracy and depth of AI-generated... ...teams to improve training data quality and downstream performance. Develop evaluation rubrics and benchmarks for... ...Collaborate with subject matter experts to ensure consistency,...Remote jobContract workSummer work$50 per hour
...Commitment: 15–20 hours/week Role Responsibilities Evaluate AI models on visual document understanding in the Pharma &... ...alignment with domain principles. Collaborate with subject matter experts to ensure consistency and relevance across datasets. Work...Remote jobContract workSummer work$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...and Jack Dorsey . Position: Humanities / arts / culture Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$80 - $120 per hour
...General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Healthcare / clinical Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
.... Position: Operations / inventory / capacity planning Evaluator Type: Contract Compensation: $80–$120/hour... ...and asynchronously to meet deadlines and ensure high-quality evaluations. Qualifications Must-Have ~5+ years of relevant...Remote jobContract workSummer workWork at office$15 - $20 per hour
...Responsibilities Conduct fact-checking using trusted public sources and external tools . Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies. Assess reasoning quality, clarity, tone,...Remote jobContract workSummer work- ...Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Data... ...discrepancies and support reconciliation processes through root cause analysis. Collaborate with business, data engineering, and technology...Manual laborLocal area
$80 per hour
...'Angelo , Larry Summers , and Jack Dorsey . Position: Data Engineer (Coding Agent Experience) Type: Contract... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Remote jobContract workSummer work- ...hands-on leader to build a new centralized Evaluation team. This team will be responsible for providing comprehensive and holistic analysis on all aspects of performance of the autonomy... ...functional team of software engineers, data analysts, and data scientists supporting automated...Full time
- ...Work Mode: Hybrid, 2 days onsite (9 AM – 5 PM) Role Description: · Senior BSA · Leads cross-LOB initiatives, drives data standardization and stakeholder alignment and having experience with Azure Data Engineering · Owns complex integrations and enterprise...Contract work
- ...world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the... ...availability query service to enable low-latency analysis and curation over large volumes of metric and tag data - Work with large datasets from various sources...Full timeInternship
$132.35k - $220.59k per year
...enrolment management, institutional research, and data governance. We provide strategic oversight... ...: The Director, Academic Planning and Analysis is a highly visible leadership role that... ...institutional priorities by providing expert analysis and advice on academic budgeting,...Long term contractFull timeWork at office$58.74 - $65.44 per hour
We are seeking a seasoned Senior Maximo Business Analyst / Data Analysis Lead to drive a critical multi-year asset management transformation... ...mapped, and migrated accurately. The ideal candidate is a Maximo expert who can command a room of frontline unionized workers and...Long term contractContract workImmediate startRemote work2 days per week3 days per week$50 per hour
...and Jack Dorsey . Position: Internet-Native Bilingual Evaluator Expert (French) Type: Contract Compensation: $50/... ...cultural references, sarcasm, and code-switching. Build evaluation rubrics for bilingual internet communication and define expectations...Remote jobContract workSummer work10 hours per week- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
- ...We’re #Hiring a #TreasuryLiquidityDataAnalyst – SQL Expert Are you experienced in Capital Markets and Treasury and looking to leverage your expertise in SQL and financial data analysis? Join our Client's leading financial institution working on strategic initiatives in...Contract work
- ...time. Your future duties and responsibilities Must Have: Analysis & Review of Budgeting, Forecasting & Estimates. Knowledge of... ...Looking for someone with financial modeling skills and expert in excel modeling. A BA with Financial modelling, planning, forecasting...Full timeManual laborWork at office
- ...com What You'll Be Doing As the Senior Manager, Business Analysis within CIBC's Client Data Technology team, you will play a pivotal role in driving... ...solution requirements effectively. Act as a Subject Matter Expert (SME) by providing guidance and direction to internal and...Full time
$85k - $156k per year
...connectedness. Learn from deep subject matter experts through mentoring and on the job coaching... ...reporting and strategic financial analysis projects. Key responsibilities for the Manager... ...6+ CoRe Service Areas to facilitate data requests, annual planning and forecasting...Permanent employmentRemote workFlexible hours- ...space-based assets, enabling a new era of data-driven exploration and innovation. With... ...Functional Lead for the Satellite Engineering and Analysis (SEA) team. As a Satellite Systems... ..., and contribute to onboarding, peer evaluations, regular 1:1s, and team development. This...Full timeWork at officeRelocation package
$70 per hour
...Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to ensure accuracy and depth in reasoning....Remote jobContract workSummer work$85 per hour
...Compensation: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms , Kubernetes ,...Remote jobContract workSummer work$85k - $156k per year
...Learn from deep subject matter experts through mentoring and on the... ...typical day look like? The Data Quality Management Lead is... ...against industry best practices. Evaluate emerging technologies and... ...familiarity with data profiling, data analysis, DQ rule design, and DQ...Permanent employmentFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Analysis Expert - Evaluator. Be the first to apply!
Related searches
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- failure analysis engineer Toronto, ON
- piping stress analysis engineer Toronto, ON