Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Response Evaluator (Remote, Flexible)

Scale AI

Outlier is seeking English-speaking contributors to help train AI models via live conversations, image and video comparisons, and careful review of outputs. This freelance, remote role offers flexible hours and the ability to work from anywhere with a reliable internet connection.

You’ll assess naturalness, clarity, and usefulness, document evidence-based explanations in English, and rate AI outputs across adherence, quality, and realism.

#J-18808-Ljbffr
Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the AI Response Evaluator (Remote, Flexible) in Toronto, ON vacancy
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...$100–$150/hour Location: Remote Role Responsibilities Design precise, task-specific...  ...pipelines , and technical reports. Evaluate AI-generated or human-created work... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    5 days ago
  • usd16 per hour

     ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type: Freelance Location: Remote from Canada Work Schedule: Flexible Start Date: Immediately Duration: Approximately 10-15 total hours... 
    Remote work
    Flexible hours
    Hourly pay
    Daily paid
    Full time
    Freelance
    Immediate start

    Rws

    Toronto, ON
    21 days ago
  • $100 per hour

     ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is...  ...evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our... 
    Suggested
    Hourly pay
    Permanent employment
    Part time
    10 hours per week

    Mindrift

    Toronto, ON
    20 hours ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...— Health AI Conversation Quality Evaluation Type: Contract Compensation...  ...: $20–$160/hour Location: Remote Role Responsibilities Evaluate the relevance and... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week Role Responsibilities Source original material from... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    a month ago
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Software / AI / IT / data Evaluator Type: Contract...  ...: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...$100–$150/hour Location: Remote Role Responsibilities Design precise, task-specific...  ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Compliance / regulatory response with financial-services AI Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $39/hour Location: Remote Duration: Up to 6 months...  ...Commitment: 10+ hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...$120–$170/hour Location: Remote Role Responsibilities Design precise, task-specific...  ...Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $16.2 - $19.2 per hour

     ...this role, you’ll listen carefully and evaluate each caller’s situation to provide the right...  ...and enjoy the comfort of home. - Flexible Hours: Set your own schedule and work when...  ...assignment. Working Solutions will not be responsible for withholding taxes on your earnings while... 
    Remote work
    Flexible hours
    Contract work
    For contractors
    Work from home
    Night shift
    Weekend work

    Working Solutions

    Toronto, ON
    more than 2 months ago
  • $109.4k - $191.5k per year

     ...work. Today, ServiceNow is the AI control tower for business...  ...:  This is a Staff Incident Response Engineer role on ServiceNow’s...  ...offer health plans, including flexible spending accounts, ESPP, matching...  ...trust. Work personas (flexible, remote, or required in office) are... 
    Remote work
    Flexible hours
    Permanent employment
    Full time
    Work at office
    Immediate start
    Shift work

    ServiceNow

    Toronto, ON
    4 days ago
  • $150 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Compensation: $150/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses to... 
    Remote job
    Flexible hours
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    13 days ago
  • $30 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated Hindi text... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    14 hours ago
  • $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: FP&A / corporate finance Evaluator Type: Contract Compensation...  ...: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...$150–$200/hour Location: Remote Role Responsibilities Develop challenging machine learning...  ...8 attempts. Focus on inference, evaluation, and systems work rather than heavy... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    5 days ago
  • $42 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $14–$42/hour Location: Remote Duration: Up to 6 months...  ...Commitment: 20+ hours/week Role Responsibilities Evaluate AI-generated music across various genres... 
    Remote job
    Flexible hours
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Compensation: $100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in data science... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    15 days ago
  • $45 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $40–$45/hour Location: Remote Role Responsibilities Review short English-language conversations to evaluate AI responses . Apply appropriate labels... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  •  ...creative strategist, you will be responsible for the ideation, scripting,...  ..., and high-converting direct response ads - short and long form - that...  ...creative, runs a current AI stack in production, has experience...  .... Requirements Fully remote Fluent in English Direct... 
    Remote work
    Contract work
    Internship
    Immediate start
    Weekend work

    KittySpout

    Toronto, ON
    a month ago
  • $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  .../ philanthropy / community programs Evaluator Type: Contract Compensation...  ...: $80–$120/hour Location: Remote Role Responsibilities Evaluate AI-generated... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-...  ...analytical skills to contribute to high-impact evaluation projects. Collaborate with teams... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $65k - $75k per year

     ...organization, we are committed to leadership, innovation, partnership, responsibility, and community. Working with talented and energetic...  ...Responsible Investment Analyst will focus on supporting our proprietary Evaluations, Corporate Engagement, Proxy Voting, and Policy work to help... 
    Temporary work
    Internship

    Aviso Wealth

    Toronto, ON
    19 days ago
  • $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $80–$160/hour Location: Remote Role Responsibilities Review and assess domain-...  ...feedback to improve document standards and evaluation processes. Utilize Excel ,... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $22 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $16–$22/hour Location: Remote Role Responsibilities Red team conversational AI...  ...independently and asynchronously. Ensure flexible hours and meet deadlines.... 
    Remote job
    Flexible hours
    Contract work
    Summer work

    Mercor

    Toronto, ON
    13 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Response Evaluator (Remote, Flexible). Be the first to apply!