Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
- Ensure consistent and honest judgment, including critical assessments when warranted.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$70 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses to... ...Provide structured written feedback to improve training data quality... ...university preferred. Strong analytical and written communication...SuggestedRemote jobContract workSummer work$30 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our... ...it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance. Qualifications Must-Have...SuggestedHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ..., and technical reports. Evaluate AI-generated or human-... ...detailed written justifications for evaluations and scores to maintain... .... Incorporate structured feedback from senior reviewers and iterate...SuggestedRemote jobContract workSummer work- ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...SuggestedPart timeFor contractorsRemote workFlexible hours
- ...Job Description Job Description Manager, Campaign Analytics - SQL, Pega/ TSYS CDH Location: Downtown, Toronto Hybrid: 3-4 days... ...audience definition through in-market monitoring and post-campaign evaluation. • Translate business and marketing priorities into...SuggestedContract workWork at office
FINTECH PROFESSIONALS CORP
Toronto, ON3 days ago $80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs. Apply deep...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... ...outputs. Provide clear, structured written feedback to improve quality. Work independently...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs. Apply deep...Remote jobContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... .... Incorporate structured feedback from senior reviewers and iterate...Remote jobContract workSummer work- ...Work Location: Montréal, Quebec, Canada Hours: 35 Line of Business: Analytics, Insights, & Artificial Intelligence Pay Details: 94 000 $/$94,000 - 132 700 $/$132,700 CAD TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth...Full timeWork from home
$140k - $175k per year
...is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare large language...Full timeInternshipWork at officeLocal areaFlexible hours$102.7k - $137k per year
...Position Title: Engineering Manager, Data AI & Analytics Position Type: Regular - Full-Time Requisition ID: 42289 In every role,... ...scalability, reliability, and deployment efficiency Continuously evaluate emerging technologies and implement improvements across data...Full timeWork from home$82.1k - $132.1k per year
...Job Description Product Analytics is building self-service tools and operating AI agents that influence product development... ...repositories, standards, and evaluation tooling the AI Engineering Lead... ...interfaces, semantic layers, and feedback loops that let those systems...RemplacementFull timeWork at officeLocal areaFlexible hours$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... ...involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems...Remote jobContract workSummer work- ...Data & Analytics Leader - BFSI, AI Transformation The Opportunity We are seeking an experienced Data & Analytics Leader to help shape and grow enterprise transformation programs across the financial services...Permanent employment
$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation... ...Preferred Experience in annotation, human-feedback, evaluation, or content review....Remote jobContract workSummer work$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Remote jobContract workSummer work$35 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: AI Assistant User – Weekly Feedback Study Type: Contract Compensation: $30–$35/hour...Remote jobContract workSummer work$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Marketing Expert — Marketing Analytics (AI Agent Environments) Type: Contract... ...them against established standards. Evaluate AI-generated content in Marketing Analytics...Remote jobContract workSummer work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and defensible. Incorporate structured feedback from senior reviewers and iterate quickly... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$140k - $175k per year
...Summary: Product Analytics is building self-service tools and operating AI agents that influence product development; agents that monitor product health, surface... ...the shared repositories, standards, context, and evaluation tooling our analysts depend on, and you will define...RemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$116.1k - $166.1k per year
...The Opportunity As a AML Analytics Manager , unlock your potential... ..., training, and ongoing feedback. ~ Contribute to the growth... ...Listening, Agile Methodology, AI Fluency, AI-Human Collaboration... ...helps ensure we combat bias by evaluating candidates equally and fairly,...Visa sponsorshipWork visa$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated... ...performance . Provide detailed linguistic feedback and analysis to guide ongoing model training...Remote jobContract workSummer work$70 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer workImmediate start- ...Data & Analytics Solutions Architect - AI platforms, AWS, Databricks The Opportunity We are hiring a senior Data & Analytics Solutions Architect to lead the design of enterprise data, analytics, and AI platforms using AWS and Databricks. This role combines hands-on...Permanent employment
- ...success story! Who we are looking for: The Manager, Product Analytics is a senior analytics professional within the Business... ...modeling, pricing analyses, and strategic planning activities. Evaluate the effectiveness of product launches, promotional programs, and...Full timeContract workFlexible hoursShift work
- ...developers and enterprises who are building AI systems to power magical experiences like... ...and shape the future! Why this role?Evaluation is critical to making progress in scaling... ...cross-functional teams to translate model feedback into trustworthy, repeatable evaluations....Full timeWork at officeRemote workFlexible hours
$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional...Remote job- ...our success story! Who we're looking for: The Digital Data Analytics Senior Analyst plays a key role in analyzing customer behaviour... ...experience trends. Explore new analytical techniques, including AI-assisted analysis and predictive methods, where they can improve...Full timeContract workFlexible hoursShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur - dessinateur Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur structure Toronto, ON
- estimateur automobile Toronto, ON