Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback. Apply deep subject-matter expertise...SuggestedRemote jobContract workSummer workWork at office$82.8k - $154.8k per year
...2026 Address: 100 King Street West Job Family Group: Data Analytics & Reporting Uses advanced analytical algorithms and... ...usable data from valuable data sources to assess feasibility of AI/ML solutions for improved processing and usage of organization data...SuggestedContract workPart timeWork at office$103k - $135k per year
...Will you collaborate with us? Our Team As a Manager in Data, Analytics and Automation, you will be a part of our Technology Consulting (... ...& Analytics! What you will do Creating and presenting AI and advanced analytics strategies, roadmaps and operating models...SuggestedFull timeInternship$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Public health communications Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...SuggestedRemote jobContract workSummer workWork at office$120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobContract workSummer workWork at office$125k - $150k per year
...Director of Data Management and Analytics, the Manager of Reporting,... ...technologies in analytics, BI, and AI-assisted reporting,... ...technical and business audiences. Evaluate and introduce modern modelling... ...performance goals, provide regular feedback, and create development...Long term contractTemporary workCasual workImmediate start$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Program management / implementation planning Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to enhance AI model outputs....Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Privacy / regulatory compliance Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to enhance the accuracy and rigor of AI...Remote jobContract workSummer workWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...inventory / capacity planning Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI model outputs... ...deadlines and ensure high-quality evaluations. Qualifications Must...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Review...Remote jobContract workSummer workWork at office$70 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...hours/week Role Responsibilities Evaluate AI-generated office artifacts in Excel... ...improve model behavior. Provide written feedback to the research team to enhance model performance...Remote jobContract workSummer workWork at officeImmediate start$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Special education / IEP Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI model outputs. Apply deep...Remote jobContract workSummer workWork at office$77k - $102k per year
...collaborate with us? Our Team As a Senior Consultant in Data, Analytics and Automation, you will be a part of our Technology Consulting (... ...Analytics! What you will do ~ Support the development of AI and advanced analytics strategies, roadmaps, and operating models...Full timeInternship$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...hours/week Role Responsibilities Evaluate AI model outputs for clinical accuracy,... ...against expert judgment. Write structured feedback on clarity, safety, and clinical rigor....Remote jobContract workSummer workImmediate start$15 - $20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...tools . Generate high-quality human evaluation data by identifying response strengths, areas... ...in domains requiring structured analytical thinking Preferred Prior experience...Remote jobContract workSummer work- ...names. About the Role As a luxury brand evaluator, you will step into the world of luxury... ...experiences, providing critical feedback that helps brands refine their services.... ...market. Compensation • Non-Purchase Evaluations: Earn a fee based on mission complexity....Contract workWorldwideFlexible hours
$147k - $192k per year
...difference. KPMG's Management Consulting practice helps organizations leverage change. The Data, Analytics and Automation team helps organizations unlock value from data and AI by enabling data-informed decision-making through strategy, governance, and operating model...Full timeInternship$99.48k - $233.38k per year
...organizations unlock the value of technology and build a more sustainable, more inclusive world. Go-To-Market Define and execute the Gen AI Go to Market Strategy, ensuring alignment with global corporate objectives and business goals. Partner with business development &...Permanent employmentFull timeLocal area$104k - $215k per year
...programs and services that unite our organization. The Data and AI/ML Products Senior Manager role will drive immediate and global... ...and deployment of innovative and value-generating data, analytics, and AI/ML products in the new Data Strategy & Governance Office...Permanent employmentWork at officeImmediate startFlexible hours$87.8k - $116.75k per year
...matters as they relate to Toronto workforce analytics initiatives such as staffing needs and... ...and/or maintain an employee performance evaluation and recognition program for customer... ...schedules. ~Communicates and provides feedback regarding performance metrics through written...Long term contractFull timeTemporary workInternshipSeasonal workMonday to fridayShift work- ...waiting for you. Come build a rewarding career at Rogers and be a driving force behind our success story! The Manager, Forecasts Analytics will be accountable for consolidation and forecasting of Rogers Communications wireless subscriber metrics, performance management,...Full timeContract workFlexible hoursShift work
$105.2k - $151.93k per year
...Digital Portfolio and Project Analytics Product Owner Department :... ...implement innovative ideas based on AI, ML concepts . This role will... ...expansion requests based on feedback heard from R&D business and/or... ...or managing Portfolio Evaluation and Management tools (for example...Long term contractPermanent employmentInternshipWork from home$112k - $162k per year
...debriefs with client to explain data insights and confirm report Analytics Coaching ~ Explains data to stakeholders and prepares them to... ...group and answers questions pertaining to the data Leverages AI to enhance inspection process for monthly revenue leakage reviews...Full timeWork at office$54.6k - $101.4k per year
...2026 Address: 100 King Street West Job Family Group: Data Analytics & Reporting Data & Analytics Data querying, extraction, and... ...of data sources to audit risks and business use cases AI & Automation Prompt engineering and prompt library development...Contract workTemporary workPart timeImmediate start- ...Manager BI & Analytics We are committed to connecting Canadians through unique partnerships, our world-class network and content Canadians... ...Finance BI & Analytics in cross-functional meetings • Evaluate, drive change, promote adoption, and governance of new processes...Full timeContract workShift work
$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager -... ...Verification experience. ~ Experience preparing reports detailing analytical findings. ~ Excellent writing, communication, and computer...Full timeWork at officeLocal area- ...waiting for you. Come build a rewarding career at Rogers and be a driving force behind our success story! Business intelligence and analytics are critical to understand trends and identify growth opportunities. Key indicators in our analytics and dashboards measure success...Full timeContract workShift work
$10k per year
...to December Existing Vacancy: Yes Course Title: MHI2009H: Evaluation Methods for Health Informatics Course Description:... ...as machine learning, process automation, predictive/preventive analytics and artificial intelligence. This course is designed to demystify...Long term contract- ...frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic... ...this role? As a Member of Technical Staff in Data Analysis and Evaluation, you will play a pivotal role in ensuring the quality,...Full timeWork at officeRemote workFlexible hours
$95k - $120k per year
...Manager, Constituent and Marketing Analytics plays a critical leadership... ...projects. ~ Develop evaluation frameworks for program strategies... ..., tools, methodologies, and AI-enabled capabilities embedded... ...ongoing basis; provide coaching and feedback as per the performance...Full timeHome officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- web search evaluator Toronto, ON
- estimateur structure Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- estimateur automobile Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur en bâtiment Toronto, ON
- remote social media evaluator Toronto, ON
- évaluateur-estimateur