Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to ensure accuracy and depth in reasoning.
- Provide structured written feedback to improve AI model outputs .
- Identify nuances, implicit meanings, and gaps in reasoning in AI-generated content .
- Write clear, precise, and well-evidenced rationales beyond surface-level observations.
- Work independently and asynchronously to meet deadlines and improve AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills.
- Native English fluency required.
Preferred
- None specified.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted 26 days ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...SuggestedRemote jobContract workSummer workWork at office$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...SuggestedRemote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback. Apply deep subject-matter expertise...SuggestedRemote jobContract workSummer workWork at office$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex engineering tasks. Review model-generated mobile...SuggestedRemote jobContract workSummer work$140k - $175k per year
...Summary: Product Analytics is building self-service tools and operating AI agents that influence product development; agents that monitor product health, surface... ...the shared repositories, standards, context, and evaluation tooling our analysts depend on, and you will define...SuggestedRemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in... ...leader to build a new centralized Evaluation team. This team will be... ...offer guidance and constructive feedback to direct reports. Qualifications... ...teams - Experience with large scale databases and analytics...Full time
$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Internet-Native Bilingual Evaluator Expert (French) Type:... ...prompts and provide detailed feedback to improve performance. Participate... .... Strong writing, analytical, and critical thinking skills....Remote jobContract workSummer work10 hours per week$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...strategy / management Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI-generated work products... ...meet deadlines while enhancing evaluation processes. Qualifications...Remote jobContract workSummer workWork at office$120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Finance operations / audit support Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to enhance the quality of AI outputs....Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Process improvement / SOPs Evaluator Type: Contract Compensation... ...errors. Provide clear, structured written feedback. Collaborate with subject matter experts...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Biology / environmental science Evaluator Type: Contract Compensation... ...decks. Provide clear, structured written feedback to improve AI model outputs....Remote jobContract workSummer workWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...inventory / capacity planning Evaluator Type: Contract... ...Provide clear, structured written feedback to improve AI model outputs... ...deadlines and ensure high-quality evaluations. Qualifications Must...Remote jobContract workSummer workWork at office$69k - $114k per year
...dynamic individual to advance key People Analytics programs—leveraging data, insights, and technology... ..., equip leaders with tools to turn feedback into action, monitor project progress, resolve... ...utilize human screening combined with AI technology to help identify the skills and...Permanent employmentWork at officeFlexible hours- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era of... ...impact the world in a positive way. To learn more visit: The Evaluation Algorithms team is responsible for building the algorithms & tooling...Full timeInternship
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Cybersecurity / IT GRC Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Review...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... .... Position: Healthcare / clinical Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Remote jobContract workSummer workWork at office- ...behind our success story! As the Manager of the Finance BI & Analytics team, you will be accountable for ensuring that all new products... ...Finance BI & Analytics in cross-functional meetings • Evaluate, drive change, promote adoption, and governance of new processes...Full timeContract workShift work
- ...We are seeking Audio Evaluators to participate in an exciting project focused on evaluating audio clips in English (Pakistani) . This... ...• Apply consistent and objective judgment based on provided evaluation guidelines. • Maintain high quality and timely completion of...Remote jobContract workFreelance
$15 - $20 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...tools . Generate high-quality human evaluation data by identifying response strengths, areas... ...in domains requiring structured analytical thinking Preferred Prior experience...Remote jobContract workSummer work$5000 per month
...build relationships, and close new clients for high-value data and AI service projects. This is a commission-only role with recurring... ...for businesses globally, including: Data engineering Data analytics Business intelligence dashboards Power BI / Looker Studio reporting...$104k - $215k per year
...programs and services that unite our organization. The Data and AI/ML Products Senior Manager role will drive immediate and global... ...and deployment of innovative and value-generating data, analytics, and AI/ML products in the new Data Strategy & Governance Office...Permanent employmentWork at officeImmediate startFlexible hours- ...Analytics Engineer Trolley is growing quickly and we are hiring for a full-time Analytics Engineer to join our team. Hybrid role... ...themselves with ever-expanding use-cases. Be fluent in modern AI tools and look for ways to apply them to real business problems....Full timeSummer workWork at officeRemote workWorldwide
- ...waiting for you. Come build a rewarding career at Rogers and be a driving force behind our success story! Business intelligence and analytics are critical to understand trends and identify growth opportunities. Key indicators in our analytics and dashboards measure success...Full timeContract workShift work
$99.48k - $233.38k per year
...organizations unlock the value of technology and build a more sustainable, more inclusive world. Go-To-Market Define and execute the Gen AI Go to Market Strategy, ensuring alignment with global corporate objectives and business goals. Partner with business development &...Permanent employmentFull timeLocal area- ...who we are by visiting Context We are looking for a CDE/Analytics Coordinator to join our project team. Missions/Main Duties... ...used for easy reading purposes and includes the feminine. We use AI-enabled tools in our recruitment platform (iCIMS) for tasks like...3 days per week
- ...waiting for you. Come build a rewarding career at Rogers and be a driving force behind our success story! The Manager, Forecasts Analytics will be accountable for consolidation and forecasting of Rogers Communications wireless subscriber metrics, performance management,...Full timeContract workFlexible hoursShift work
- ...Google, Microsoft, Salesforce, and Shopify, as well as innovators in AI, to deliver growth solutions tailored to the needs of our clients... ...through the jungle of cloud computing, insights, CRM, advanced analytics, and AI? Join our team as VP, Analytics - CRM/martech and lead...Local area
$102.4k - $134.4k per year
...successes. Here’s to crafting careers and creating new legacies. Crafted Highlights: In the role of Advanced Analytics Manager working in Toronto , you will be part of the Commercial Analytics and Reporting team within the broader Strategy and...Temporary workWork at officeFlexible hours$54.33 - $57.81 per hour
...to innovation. These time-sensitive roles support high-priority AI initiatives and offer a three month contract with the potential to... ...business requirements into technical specifications for custom digital analytics implementations, utilizing data layers, processing rules, and...Contract workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- chargé de projet estimateur
- fragrance evaluator