Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Rater & Evaluator (Flexible Hours, Freelance)

Scale AI

Outlier, an AI training platform, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score outputs for realism and adherence, and explain discrepancies in writing.

Work remotely on your own schedule, with payments weekly. Flexible hours and access to leading LLMs are provided; applicants from multiple countries are welcome to apply as contractors.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Rater & Evaluator (Flexible Hours, Freelance) in Toronto, ON vacancy
  •  ...also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC...  ...agree the rate in writing before each batch starts. No hourly tracking, no commission. Location: Remote - applicants... 
    Freelance
    Remote work
    Hourly pay
    Ongoing contract
    For contractors

    Sparked Agency

    Toronto, ON
    13 hours ago
  • $30 - $35 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30–$35/hour Location: Remote Role Responsibilities Use...  ...ongoing study with the same group of raters each week. Work independently and... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    23 days ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $30/hour Location: Remote Commitment: 10 hours/week...  ...questions, and correcting errors. Evaluate the experience and deliverables, providing... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  •  ...specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This...  ...Fully self-scheduled: no minimum hours and no set schedule; you choose...  ...tasks to take and when ~ Remote: open to US-licensed physicians... 
    Remote work
    Flexible hours
    Part time
    For contractors

    Mindrift

    Toronto, ON
    4 days ago
  •  ...Job Description We are seeking skilled Freelance photographers to join our team. This role...  ...commission-based only. Included Perks: 4 free hours of weekly studio time for personal use....  ...on-time results When needed, be flexible and agile, be business-minded, value long... 
    Freelance
    Flexible hours
    16 hours
    Long term contract
    Temporary work

    Oopsie Inc.

    Toronto, ON
    15 days ago
  • $30 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Type: Contract Compensation: $30/hour Location: Remote Role Responsibilities Evaluate pairs of AI-generated images against original prompts... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $100–$150/hour Location: Remote Role Responsibilities Design...  ...pipelines , and technical reports. Evaluate AI-generated or human-created work against... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $30 - $40 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct...  ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations... 
    Remote work
    Flexible hours
    Daily paid
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    1 day ago
  •  ...cliniques et une expertise dans les évaluations psychiatriques ?Chez IQVIA ,...  ...Indépendants Centraux (Central Independent Raters - CIRs) et recherchons des...  ...distance Horaires de travail flexibles Contrat de prestation de services (freelance) Profil recherché... 
    Freelance
    Remote work
    Flexible hours
    Full time
    Contract work
    Part time
    Immediate start
    Worldwide

    IQVIA

    Toronto, ON
    3 days ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  ...datasets with SMEs, coordinate evaluations, and design evaluation schemes, including...  ...Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office... 
    Flexible hours
    Remplacement
    Full time
    Work at office
    Local area

    Thomson Reuters

    Toronto, ON
    4 hours ago
  • $14 per unit

     ...make learning a language easy by combining AI-powered courses with feedback from our...  ...and a NYSE listed company. What does a Freelance Online Japanese Teacher do at Busuu? As...  ...freelance role? ~$14 paid per lesson taught ~ Remote position ~ Freedom to set your own... 
    Freelance
    Remote work
    For contractors
    Local area

    Busuu

    Toronto, ON
    12 hours ago
  •  ...Clinical Independent Rater - French Speaking Location: Remote/Virtual (Canada) Hours: Estimated 10–16 hours per month Role: Clinical Independent Rater (CIR)...  ...standardized assessment practices. Responsibilities include evaluating assessment quality, engaging in live discussions... 
    Remote work
    16 hours
    Full time
    Part time
    Work at office
    Immediate start
    Worldwide

    IQVIA

    Toronto, ON
    3 days ago
  • $140k - $175k per year

     ...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation...  ...What’s in it For You? Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office-based roles while delivering... 
    Flexible hours
    Full time
    Internship
    Work at office
    Local area

    Thomson Reuters

    Toronto, ON
    4 days ago
  • $70 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $100–$150/hour Location: Remote Role Responsibilities Design...  ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...Ensures Cosmetic Operating Standards are in place Identifies “peak hours” and schedules shifts accordingly QUALIFICATIONS: Planning...  ...the principal functions and duties as required for proper evaluation of the job and shall not be construed as a detailed description... 
    Flexible hours
    Hourly pay
    Full time
    Shift work

    Shoppers Drug Mart

    Toronto, ON
    1 day ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $39/hour Location: Remote Duration: Up to 6 months...  ...week Role Responsibilities Evaluate AI model output lyrics , voice generation... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...We are seeking an experienced  Freelance Growth Marketing Strategist to support a high-profile business executive and entrepreneur in expanding...  ...can combine strategy and execution across areas including SEO, AI search optimisation (AEO), website conversion, audience growth,... 
    Freelance
    Remote work

    Digital

    Toronto, ON
    a month ago
  •  ...Benefit from a purchase discount program, flexible and varied schedules, competitive pay and...  ...$18.55 - $20.95 / 18,55$ - 20,95$ (per hour / de l’heure) A candidate’s experience and...  ...intelligence artificielle dans le but de filtrer, d’évaluer et/ou de sélectionner les candidats à ce... 
    Flexible hours
    Hourly pay
    Full time
    Local area

    Shoppers Drug Mart

    Toronto, ON
    1 day ago
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $80/hour Location: Remote Role Responsibilities Use...  ...frontier AI coding agents to complete and evaluate complex data engineering tasks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $85/hour Location: Remote Role Responsibilities Use...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design...  ...Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $52.38 - $57.39 per hour

     ...Permanent Full Time Vacancy  Hourly Rate: $52.38 - $57.39 Shift...  ...Information: Monday to Friday, 35 hours per week  Affiliation: L79...  ..., Forestry & Recreation, the Evaluator, Programs will help design,...  ...orientation, dependability, and flexibility with initiative, capacity, and... 
    Hourly pay
    Permanent employment
    Full time
    Part time
    Internship
    Monday to friday
    Shift work

    City of Toronto

    Toronto, ON
    1 day ago
  •  ...IQVIA seeks bilingual mental health clinicians for freelance remote work as Central Independent Raters on a major depressive disorder clinical trial. The role...  ...Conduct independent, standardized psychiatric evaluations of trial participants Administer and score depression... 
    Freelance
    Remote work

    IQVIA

    Toronto, ON
    a month ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $39/hour Location: Remote Commitment: 10 hours/week...  ...providing concise notes on performance. Evaluate AI model interactions to ensure... 
    Remote job

    Mercor

    Toronto, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Rater & Evaluator (Flexible Hours, Freelance). Be the first to apply!