Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 27 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...SuggestedRemote jobContract workSummer workWork at office$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback. Apply deep subject-matter expertise...SuggestedRemote jobContract workSummer workWork at office$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile...SuggestedRemote jobContract workSummer work$140k - $175k per year
...Summary: Product Analytics is building self-service tools and operating AI agents that influence product development; agents that monitor product health, surface... ...the shared repositories, standards, context, and evaluation tooling our analysts depend on, and you will define...SuggestedRemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in... ...leader to build a new centralized Evaluation team. This team will be... ...offer guidance and constructive feedback to direct reports. Qualifications... ...teams - Experience with large scale databases and analytics...Full time
$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Internet-Native Bilingual Evaluator Expert (French) Type:... ...prompts and provide detailed feedback to improve performance. Participate... .... Strong writing, analytical, and critical thinking skills....Remote jobContract workSummer work10 hours per week$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Market research / competitive intelligence Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI model outputs. Apply...Remote jobContract workSummer workWork at officeFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: People ops / recruiting Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Training / onboarding / L&D Evaluator Type: Contract Compensation... ...errors. Provide clear, structured written feedback. Collaborate with subject matter experts...Remote jobContract workSummer workWork at office$120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Biology / environmental science Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI model outputs....Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Healthcare / clinical Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Remote jobContract workSummer workWork at office- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Review...Remote jobContract workSummer workWork at office$69k - $114k per year
...dynamic individual to advance key People Analytics programs—leveraging data, insights, and technology... ..., equip leaders with tools to turn feedback into action, monitor project progress, resolve... ...utilize human screening combined with AI technology to help identify the skills and...Permanent employmentWork at officeFlexible hours$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...inventory / capacity planning Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI model outputs... ...deadlines and ensure high-quality evaluations. Qualifications Must...Remote jobContract workSummer workWork at office- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of... ...impact the world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the algorithms & tooling...Full timeInternship
$15 - $20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...tools . Generate high-quality human evaluation data by identifying response strengths, areas... ...in domains requiring structured analytical thinking Preferred Prior experience...Remote jobContract workSummer work$104k - $215k per year
...programs and services that unite our organization. The Data and AI/ML Products Senior Manager role will drive immediate and global... ...and deployment of innovative and value-generating data, analytics, and AI/ML products in the new Data Strategy & Governance Office...Permanent employmentWork at officeImmediate startFlexible hours$5000 per month
...build relationships, and close new clients for high-value data and AI service projects. This is a commission-only role with recurring... ...for businesses globally, including: Data engineering Data analytics Business intelligence dashboards Power BI / Looker Studio reporting...- ...who we are by visiting Context We are looking for a CDE/Analytics Coordinator to join our project team. Missions/Main Duties... ...used for easy reading purposes and includes the feminine. We use AI-enabled tools in our recruitment platform (iCIMS) for tasks like...3 days per week
- ...Google, Microsoft, Salesforce, and Shopify, as well as innovators in AI, to deliver growth solutions tailored to the needs of our clients... ...through the jungle of cloud computing, insights, CRM, advanced analytics, and AI? Join our team as VP, Analytics - CRM/martech and lead...Local area
$99.48k - $233.38k per year
...organizations unlock the value of technology and build a more sustainable, more inclusive world. Go-To-Market Define and execute the Gen AI Go to Market Strategy, ensuring alignment with global corporate objectives and business goals. Partner with business development &...Permanent employmentFull timeLocal area$95k - $120k per year
...Manager, Constituent and Marketing Analytics plays a critical leadership... ...projects. ~ Develop evaluation frameworks for program strategies... ..., tools, methodologies, and AI-enabled capabilities embedded... ...ongoing basis; provide coaching and feedback as per the performance...Full timeHome officeFlexible hours$95k - $120k per year
...our next Senior Manager, Supply Finance & Analytics located in Etobicoke, ON. This is a... ...with Procurement and Supply leadership to evaluate sourcing strategies, vendor economics, pricing... ...the organization. Leverages automation, AI-enabled analytics, and visualization tools...Long term contractFull timeFor contractorsWork at officeLocal areaFlexible hours2 days per week- ...work. Here, you’ll find opportunities to learn, lead, and make an impact every day. POSITION OVERVIEW: Reporting to the VP, Analytics, the successful candidate will be responsible for creation and updating of Argus models and producing internal and external...Full timeContract work
$125k - $150k per year
...Director of Data Management and Analytics, the Manager of Reporting,... ...technologies in analytics, BI, and AI-assisted reporting,... ...technical and business audiences. Evaluate and introduce modern modelling... ...performance goals, provide regular feedback, and create development...Long term contractTemporary workCasual workImmediate start$80.49k - $100.62k per year
...play. Manager, Automation & AI DUCA is looking for a... ...and workflow optimization. Evaluate and recommend emerging AI automation... ...data, insights, and AI‑driven feedback loops. Test Automation (Web... ...an asset. Strong analytical and problem‑solving skills....Full timeCasual workWork at office$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: FP&A / corporate finance Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI-generated work products....Remote jobContract workSummer workWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- chargé de projet estimateur
- fragrance evaluator