Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
- Ensure consistent and honest judgment, including critical assessments when warranted.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$70 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses to... ...Provide structured written feedback to improve training data quality... ...university preferred. Strong analytical and written communication...SuggestedRemote jobContract workSummer work- ...Zafin is an AI platform company helping regulated institutions modernize how critical... ...scale. What’s the Opportunity? The AI Evaluation Engineer ensures AI agent solutions are accurate... ...across releases, and providing actionable feedback that continuously improves AI agent...SuggestedFull time
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs. Apply deep...SuggestedFull timeContract workSummer workWork at officeRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... .... Incorporate structured feedback from senior reviewers and iterate...SuggestedFull timeContract workSummer workRemote work- ...consumer experiences, from mobile and web applications to advanced analytics and machine learning, to content and engagement management... ...digital experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team...SuggestedFull timeImmediate start
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback. Apply deep subject-matter expertise...Full timeContract workSummer workWork at officeRemote work$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation... ...Preferred Experience in annotation, human-feedback, evaluation, or content review....Remote jobContract workSummer work- ...What youll be doing Enterprise Analytics is a high-impact team that helps shape business... ...advanced analytics and artificial intelligence (AI). As a Director Data Science youll build... ...the design validation implementation and evaluation of statistical and machine learning...Full time3 days per week1 day per week
$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and defensible. Incorporate structured feedback from senior reviewers and iterate quickly... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Full timeContract workSummer workRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ..., and technical reports. Evaluate AI-generated or human-... ...detailed written justifications for evaluations and scores to maintain... .... Incorporate structured feedback from senior reviewers and iterate...Remote jobContract workSummer work$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... ...involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems...Full timeContract workSummer workRemote work$82.1k - $132.1k per year
...Job Description Product Analytics is building self-service tools and operating AI agents that influence product development... ...repositories, standards, and evaluation tooling the AI Engineering Lead... ...interfaces, semantic layers, and feedback loops that let those systems...RemplacementFull timeWork at officeLocal areaFlexible hours$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... ...outputs. Provide clear, structured written feedback to improve quality. Work independently...Remote jobContract workSummer workWork at office$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Full timeContract workSummer workRemote work- ...-winning culture. What we offer Reporting to the Chief Technology & Information Officer (CTIO), the Vice President, Data Analytics & AI is the executive leader responsible for setting the enterprise vision, strategy, and execution for Mattamy’s data, analytics, and...Long term contractFull timeInternshipWork at office
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs. Apply deep...Remote jobContract workSummer workWork at office$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote work$70 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer workImmediate start- ...experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering... ...solutions and provide clear technical feedback. Required Skills Strong proficiency...Remote jobFor contractors
$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Marketing Expert — Marketing Analytics (AI Agent Environments) Type: Contract... ...them against established standards. Evaluate AI-generated content in Marketing Analytics...Remote jobContract workSummer work$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start- ...Freelance Software Localization and AI Language Evaluator | English to Turkish Remote | US, Canada... ..., IT translation, machine translation evaluation, post-editing, or AI-generated content... ...objective, and actionable linguistic feedback to support improvements in machine...Long term contractContract workFor contractorsFreelanceRemote workWorldwideFlexible hours
$140k - $175k per year
...Summary: Product Analytics is building self-service tools and operating AI agents that influence product development; agents that monitor product health, surface... ...the shared repositories, standards, context, and evaluation tooling our analysts depend on, and you will define...RemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$231.2k - $299.2k per year
...take care of and improve your home — from personalized guidance to AI tools and a best-in-class hiring experience. Every day in every... ...you, join us. Imagine what we’ll build together. About the Pro Feedback and Targeting Team At Thumbtack, the Pro Feedback and...Full timeSeasonal workLocal areaFlexible hours$40 - $90 per hour
...90/hr Role Title: Research Evaluation Specialist (PhD / Researcher /... ...rigorous test material for advanced AI model evaluation as part of a... .... # Integrate reviewer feedback and consistently uphold all project... ...literature. # Exceptional analytical thinking close attention to...Full timeFor contractorsRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... ...errors. Provide clear, structured written feedback to improve AI model outputs . Collaborate...Contract workSummer workWork at officeRemote work$80 - $160 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...accuracy. Provide structured feedback to enhance document relevance and impact. Utilize strong analytical skills to contribute to high-impact evaluation projects. Collaborate with teams...Full timeContract workSummer workRemote work$80 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...: MS Excel / Google Sheets Evaluator Type: Contract... ...relevance. Provide structured feedback to enhance document evaluation... ...relevant domain. ~ Strong analytical and written communication skills...Full timeContract workSummer workRemote work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in... .... Provide clear, structured written feedback to improve AI model outputs . Apply...Contract workSummer workWork at officeRemote work- ...Company Overview Teragonia is the AI Operating System for Private Equity, helping sponsors... ...direction, timely and actionable feedback, and mentorship that builds independence and... ...Qualifications ~ Master's degree in Business Analytics, Business Administration, Accounting,...Long term contractFull timeTemporary workInternshipWork at officeRemote workVisa sponsorshipRelocation packageFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- estimateur structure Toronto, ON
- évaluateur-estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur automobile Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- chargé de projet estimateur Toronto, ON
- estimateur structure
- estimateur - dessinateur