Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$80k - $180k per year
...Zafin is an AI platform company helping regulated institutions modernize how critical... ...scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate... ...across releases, and providing actionable feedback that continuously improves AI agent...SuggestedFull time$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback. Apply deep subject-matter expertise...SuggestedRemote jobContract workSummer workWork at office$140k - $175k per year
...Summary: Product Analytics is building self-service tools and operating AI agents that influence product development; agents that monitor product health, surface... ...the shared repositories, standards, context, and evaluation tooling our analysts depend on, and you will define...SuggestedRemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...SuggestedRemote jobContract workSummer work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile...Remote jobContract workSummer work- ...secondary student for an Internship/Co-op position within the Data, Analytics & AI team. In this role, you will support business initiatives by... ...input, organizing work, meeting deadlines, and incorporating feedback. At Zurich Canada, we are committed to pay equity. We...InternshipWork at officeLocal areaWorldwide3 days per week
$125k - $150k per year
...Director of Data Management and Analytics, the Manager of Reporting,... ...technologies in analytics, BI, and AI-assisted reporting,... ...technical and business audiences. Evaluate and introduce modern modelling... ...performance goals, provide regular feedback, and create development...Long term contractTemporary workCasual workImmediate start$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Internet-Native Bilingual Evaluator Expert (French) Type:... ...prompts and provide detailed feedback to improve performance. Participate... .... Strong writing, analytical, and critical thinking skills....Remote jobContract workSummer work10 hours per week$122k - $192k per year
...Resource Innovations is seeking an experienced DSM Evaluation Manager - EM&V to join our growing team. As a DSM Evaluation Manager -... ...Verification experience. ~ Experience preparing reports detailing analytical findings. ~ Excellent writing, communication, and computer...Full timeWork at officeLocal area- Job Responsibility: Job title: HR Administrator Status: Full time, 35 hours per week Start Date: As soon as possible Reports to: Finance Manager Posting Date: April 25 Reference Number: CLNU-2025-06 Deadline to apply: Open till filled CultureLink Settlement...Full timeImmediate startMonday to fridayShift work
- ...through world-class networks, AI-powered solutions, and digital... ...will establish the commercial analytics, predictive modelling, KPI governance... ...pricing elasticity and evaluating commercial investment returns.... ...arrangements. If you have questions or feedback regarding accessibility at...Full timeWork at office3 days per week
$86.34k per year
...Assurance, Health & Wellness, the Program Evaluation and Quality Improvement Coordinator... ...analysis of service usage statistics and feedback to inform planning activities. Drafting... ...Strong attention to detail. Excellent analytical, interpretive and problem solving skills...Full timeCasual workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Market research / competitive intelligence Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI model outputs. Apply...Remote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: People ops / recruiting Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Remote jobContract workSummer workWork at office$69k - $114k per year
...dynamic individual to advance key People Analytics programs—leveraging data, insights, and technology... ..., equip leaders with tools to turn feedback into action, monitor project progress, resolve... ...utilize human screening combined with AI technology to help identify the skills and...Permanent employmentWork at officeFlexible hours$95k - $120k per year
...The Senior Manager, Marketing Analytics plays a critical leadership role... ...projects. ~ Develop evaluation frameworks for program strategies... ..., tools, methodologies, and AI-enabled capabilities embedded... ...ongoing basis; provide coaching and feedback as per the performance...Full timeHome officeFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Training / onboarding / L&D Evaluator Type: Contract Compensation... ...errors. Provide clear, structured written feedback. Collaborate with subject matter experts...Remote jobContract workSummer workWork at office- ...is accessible for you. As Head of Data, Analytics & Platforms, you’ll turn global digital... ...—owning the data backbone, platforms, and AI capabilities that power Commercial, Medical... ...high prioritization mindset Ability to evaluate and import new/untested/innovative models...Permanent employmentLocal areaRelocation package
$104k - $215k per year
...programs and services that unite our organization. The Data and AI/ML Products Senior Manager role will drive immediate and global... ...and deployment of innovative and value-generating data, analytics, and AI/ML products in the new Data Strategy & Governance Office...Permanent employmentWork at officeImmediate startFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Biology / environmental science Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI model outputs....Remote jobContract workSummer workWork at office- ...to come. QuadReal: Excellence lives here. At QuadReal, Analytics Engineers sit at the intersection of Business, Analytics, and Data... ..., and documentation practices. Provide best practices and feedback to contractual engineers to ensure standards are being followed...Full timeContract workWork at office
$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...management / roadmap / PRD Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI-generated work products... ...and ensure high-quality evaluations. Qualifications Must...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Review...Remote jobContract workSummer workWork at office$126k - $234k per year
...Senior Manager, you will play a leadership role in growing both our Analytics practice and our client relationships. You will help shape... ...analytics capabilities through thought leadership, reusable assets, AI-enabled delivery, and talent development initiatives. About the...Permanent employmentFlexible hours- ...following opportunity: Who we're looking for: The Digital Data Analytics Manager will play a key role in driving data-informed decision-... ...multiple projects and deadlines in a fast-paced environment. AI & Predictive Analytics: Familiarity with AI-driven tools and...Full timeContract workFlexible hoursShift work
$15 - $20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...tools . Generate high-quality human evaluation data by identifying response strengths, areas... ...in domains requiring structured analytical thinking . Preferred Prior...Remote jobContract workSummer work$37.85 - $47.31 per hour
...presentations and grant submissions; summarizing data and education of multidisciplinary staff. Duties Plan and execute technology evaluation studies using validated frameworks such as the Technology Acceptance Model (TAM) and related implementation science models....Hourly payLong term contractRemplacementFull timeContract workTemporary workInternshipFlexible hours$80k - $85k per year
...time? If you’re ready to take your strategic thinking, advanced analytic skills, and knack for digging into the details to the next level,... ...(e.g., IFRS) dashboards and reports ~ Leverage Generative AI tools (e.g., ChatGPT, Claude) to streamline workflows, enhance content...Full timeInternshipWork at officeFlexible hours- ...making, improved operational discipline, and practical adoption of AI across the business. This is a hybrid role with three (3)... ...About the Role We are creating a new Head of Data Science & Analytics role to build and lead the data function across Big Viking Games....Full timeWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- estimateur en bâtiment Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur structure Toronto, ON
- chargé de projet estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- ai evaluator
- estimateur en bâtiment