Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Media Evaluator — Remote, Flexible Hours

Scale AI

Outlier, a Scale AI company, is seeking detail-oriented English speakers to review AI-generated media from home on a flexible schedule. You will conduct live conversations with AI voice models, rank responses, and explain what looked or sounded off.

You’ll compare image and video outputs, annotate issues, and write concise justifications in English. This is freelance contract work with weekly pay and additional incentives.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Media Evaluator — Remote, Flexible Hours in Toronto, ON vacancy
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $30/hour Location: Remote Commitment: 10 hours/week...  ...questions, and correcting errors. Evaluate the experience and deliverables, providing... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  •  ...specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This...  ...Fully self-scheduled: no minimum hours and no set schedule; you choose...  ...tasks to take and when ~ Remote: open to US-licensed physicians... 
    Remote work
    Flexible hours
    Part time
    For contractors

    Mindrift

    Toronto, ON
    4 days ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  ...Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office...  ..., compliance, government, and media. Our products combine highly specialized... 
    Flexible hours
    Remplacement
    Full time
    Work at office
    Local area

    Thomson Reuters

    Toronto, ON
    4 hours ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $100–$150/hour Location: Remote Role Responsibilities Design...  ...pipelines , and technical reports. Evaluate AI-generated or human-created work against... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $30 - $40 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct...  ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations... 
    Remote work
    Flexible hours
    Daily paid
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    1 day ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $140k - $175k per year

     ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable...  ...Hybrid Work Model: We’ve adopted a flexible hybrid working environment for our office...  ...accounting, compliance, government, and media. Our products combine highly... 
    Flexible hours
    Full time
    Internship
    Work at office
    Local area

    Thomson Reuters

    Toronto, ON
    4 days ago
  • $70 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our...  ...Type: Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $100–$150/hour Location: Remote Role Responsibilities Design...  ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...Ensures Cosmetic Operating Standards are in place Identifies “peak hours” and schedules shifts accordingly QUALIFICATIONS: Planning...  ...the principal functions and duties as required for proper evaluation of the job and shall not be construed as a detailed description... 
    Flexible hours
    Hourly pay
    Full time
    Shift work

    Shoppers Drug Mart

    Toronto, ON
    1 day ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $39/hour Location: Remote Duration: Up to 6 months...  ...week Role Responsibilities Evaluate AI model output lyrics , voice generation... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...Benefit from a purchase discount program, flexible and varied schedules, competitive pay and...  ...$18.55 - $20.95 / 18,55$ - 20,95$ (per hour / de l’heure) A candidate’s experience and...  ...intelligence artificielle dans le but de filtrer, d’évaluer et/ou de sélectionner les candidats à ce... 
    Flexible hours
    Hourly pay
    Full time
    Local area

    Shoppers Drug Mart

    Toronto, ON
    1 day ago
  • $70 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Experts Type: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $80/hour Location: Remote Role Responsibilities Use...  ...frontier AI coding agents to complete and evaluate complex data engineering tasks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $85/hour Location: Remote Role Responsibilities Use...  ...frontier AI coding agents to complete and evaluate complex infrastructure engineering... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design...  ...Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on...  ...You can live anywhere. We are remote and we hire worldwide. The one...  ...calls during US Eastern business hours, because you are the client's...  ...removes the constraint. We are heavy AI users and we expect you to... 
    Remote work
    Worldwide
    Shift work

    Sweat Pants Agency

    Toronto, ON
    12 days ago
  • $60 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Position: Marketing Expert — Social Media (AI Agent Environments) Type:...  ...Contract Compensation: $60–$100/hour Location: Remote Role Responsibilities Design... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $52.38 - $57.39 per hour

     ...Permanent Full Time Vacancy  Hourly Rate: $52.38 - $57.39 Shift...  ...Information: Monday to Friday, 35 hours per week  Affiliation: L79...  ..., Forestry & Recreation, the Evaluator, Programs will help design,...  ...orientation, dependability, and flexibility with initiative, capacity, and... 
    Hourly pay
    Permanent employment
    Full time
    Part time
    Internship
    Monday to friday
    Shift work

    City of Toronto

    Toronto, ON
    1 day ago
  •  ...Hospitality industry. Tasks: Evaluate communication strategies and programs...  .... Keynote. Shopify. Social Media. Area of specialization:...  ...Excellent written communication. Flexibility. Initiative. Judgement. Organized...  ...options: Evening. Flexible hours. Experience: 5 years or more.... 
    Flexible hours
    Hourly pay
    Permanent employment
    Immediate start
    Weekend work
    Afternoon shift

    Demarco-Perpich Fine Flowers

    Toronto, ON
    1 day ago
  •  ...DoggySpout is looking for a Social Media Strategist to join our team! You will...  ...vertical and customer base. We're a 100% remote, lean, senior team that moves fast,...  ...day and answer the community within 24 hours. Work Smart – use AI and tools so your time goes to strategy... 
    Remote work
    Full time
    Weekend work

    KittySpout

    Toronto, ON
    18 days ago
  • $39 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors...  ...Professional Type: Contract Compensation: $39/hour Location: Remote Commitment: 10 hours/week Role... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    1 day ago
  •  ...and enterprises who are building AI systems to power magical...  ...shape the future! Why this role?Evaluation is critical to making progress...  ...capabilities. You have spent dozens of hours reviewing complex data and LLM...  ...and workspace improvement ~? Remote-flexible, offices in Toronto,... 
    Remote work
    Flexible hours
    Full time
    Work at office

    cohere

    Toronto, ON
    4 days ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Contract Compensation: $39/hour Location: Remote Commitment: 10 hours/week...  ...providing concise notes on performance. Evaluate AI model interactions to ensure... 
    Remote job

    Mercor

    Toronto, ON
    4 days ago
  • $57 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Professional Type: Contract Compensation: $57/hour Location: Remote Commitment: 10 hours/week Role Responsibilities... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    10 days ago
  •  ...Benefit from a purchase discount program, flexible and varied schedules, competitive pay and...  ...$19.20 - $22.20 / 19,20$ - 22,20$ (per hour / de l’heure) A candidate’s experience and...  ...intelligence artificielle dans le but de filtrer, d’évaluer et/ou de sélectionner les candidats à ce... 
    Flexible hours
    Hourly pay
    Part time
    Local area

    Shoppers Drug Mart

    Toronto, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Media Evaluator — Remote, Flexible Hours. Be the first to apply!