Analytical Evaluator - AI Feedback
$70 per hourMercor
Toronto, ON
- Remote job
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .
Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote
Role Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs .
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
- Ensure consistent and honest judgment, including critical assessments when warranted.
- Work independently and asynchronously to meet deadlines while improving AI model performance .
Qualifications
Must-Have
- Bachelor's degree from a top-500 globally ranked university preferred.
- Strong analytical and written communication skills.
- Ability to work independently and follow detailed task guidelines.
- Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
- Native English fluency required.
Application Process (Takes 20–30 mins to complete)
- Upload resume
- AI interview based on your resume
- Submit form
Resources & Support
- For details about the interview process and platform information, please check:
- For any help or support, reach out to: Show email
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the Analytical Evaluator - AI Feedback in Toronto, ON vacancy
$70 per hour
...technical talent with leading AI research labs. Headquartered in... ...Role Responsibilities Evaluate AI-generated responses to... ...Provide structured written feedback to improve training data quality... ...university preferred. Strong analytical and written communication...SuggestedRemote jobContract workSummer work$30 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our... ...it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance. Qualifications Must-Have...SuggestedHourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ..., and technical reports. Evaluate AI-generated or human-... ...detailed written justifications for evaluations and scores to maintain... .... Incorporate structured feedback from senior reviewers and iterate...SuggestedRemote jobContract workSummer work- ...Job Description Job Description Manager, Campaign Analytics - SQL, Pega/ TSYS CDH Location: Downtown, Toronto Hybrid: 3-4 days... ...audience definition through in-market monitoring and post-campaign evaluation. • Translate business and marketing priorities into...SuggestedContract workWork at office
FINTECH PROFESSIONALS CORP
Toronto, ON3 days ago - ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...SuggestedPart timeFor contractorsRemote workFlexible hours
- ...Work Location: Montréal, Quebec, Canada Hours: 35 Line of Business: Analytics, Insights, & Artificial Intelligence Pay Details: 94 000 $/$94,000 - 132 700 $/$132,700 CAD TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth...Full timeWork from home
$102.7k - $137k per year
...Position Title: Engineering Manager, Data AI & Analytics Position Type: Regular - Full-Time Requisition ID: 42289 In every role,... ...scalability, reliability, and deployment efficiency Continuously evaluate emerging technologies and implement improvements across data...Full timeWork from home$82.1k - $132.1k per year
...Job Description Product Analytics is building self-service tools and operating AI agents that influence product development... ...repositories, standards, and evaluation tooling the AI Engineering Lead... ...interfaces, semantic layers, and feedback loops that let those systems...RemplacementFull timeWork at officeLocal areaFlexible hours$140k - $175k per year
...is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare large language...Full timeInternshipWork at officeLocal areaFlexible hours- ...Data & Analytics Leader - BFSI, AI Transformation The Opportunity We are seeking an experienced Data & Analytics Leader to help shape and grow enterprise transformation programs across the financial services...Permanent employment
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs. Apply deep...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation... ...outputs. Provide clear, structured written feedback to improve quality. Work independently...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...regulatory response with financial-services AI Evaluator Type: Contract Compensation... .... Provide clear, structured written feedback to improve AI model outputs. Apply deep...Remote jobContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain... .... Incorporate structured feedback from senior reviewers and iterate...Remote jobContract workSummer work$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation... ...Preferred Experience in annotation, human-feedback, evaluation, or content review....Remote jobContract workSummer work$35 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: AI Assistant User – Weekly Feedback Study Type: Contract Compensation: $30–$35/hour...Remote jobContract workSummer work$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Marketing Expert — Marketing Analytics (AI Agent Environments) Type: Contract... ...them against established standards. Evaluate AI-generated content in Marketing Analytics...Remote jobContract workSummer work$140k - $175k per year
...Summary: Product Analytics is building self-service tools and operating AI agents that influence product development; agents that monitor product health, surface... ...the shared repositories, standards, context, and evaluation tooling our analysts depend on, and you will define...RemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$116.1k - $166.1k per year
...The Opportunity As a AML Analytics Manager , unlock your potential... ..., training, and ongoing feedback. ~ Contribute to the growth... ...Listening, Agile Methodology, AI Fluency, AI-Human Collaboration... ...helps ensure we combat bias by evaluating candidates equally and fairly,...Visa sponsorshipWork visa$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and defensible. Incorporate structured feedback from senior reviewers and iterate quickly... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... ...involving ETL pipelines , data warehouses , analytics platforms , and distributed data systems...Remote jobContract workSummer work$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards...Remote jobContract workSummer workImmediate start$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Remote jobContract workSummer work$70 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer workImmediate start- ...Data & Analytics Solutions Architect - AI platforms, AWS, Databricks The Opportunity We are hiring a senior Data & Analytics Solutions Architect to lead the design of enterprise data, analytics, and AI platforms using AWS and Databricks. This role combines hands-on...Permanent employment
- ...inspires extraordinary results. Our AI-powered platform helps... ...As Senior Engineering Manager, Analytics, you will lead two data and analytics... ..., data modeling, and BI to evaluate designs and assess risk and... ...grounded in trust, open feedback, and accountability Agile...Full time
$109k - $158k per year
...realize their greatest potential. Title and Summary Manager, Analytics & Metrics Overview At Mastercard, the People Insights Team... ...functional teams, working across multiple time zones Openness to feedback and strong self-awareness Ability to work within the confines...Full timeWorldwideFlexible hours$100k - $150k per year
...already runs on — executive KPIs, marketing attribution, funnel analytics, and internal ops tools are all powered by it today. Your job is... ...clustering, and bytes-scanned discipline. Document for humans and AI. Every model is documented, and the docs auto-sync to a...Full timeInternship$85 - $95 per hour
...more about what Aviso has to offer at . The Opportunity: We’re looking to fill an opening for a Business Analytics Specialist to join our Data Science and AI Enablement team for 12 months. Reporting to the Senior Director of Data Science and AI Enablement, you will...Hourly payTemporary workInternship$96k - $120k per year
...that “Lyft cares about me and made the experience easy.” As a Data Analytics Lead, you’ll partner directly with cross-functional stakeholders... ...metrics over time Design A/B tests and execute analyses to evaluate the impact of new product features and operational improvements...Hourly payLong term contractFull timeWork at officeFlexible hours3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Analytical Evaluator - AI Feedback. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur - dessinateur Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur structure Toronto, ON
- estimateur automobile Toronto, ON