Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Media Evaluator

$15 per hour

Scale AI

Outlier, an AI training platform operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media and evaluate model performance. You’ll engage in live conversations with AI voice models, rate responses, and write concise explanations.

Work remotely with flexible hours across multiple countries. Earn up to $15 per hour with additional incentives and weekly payments via PayPal, AirTM, or ACH transfer.

#J-18808-Ljbffr
Vacancy posted 7 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Media Evaluator in Toronto, ON vacancy
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role...  ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  ...datasets with SMEs, coordinate evaluations, and design evaluation schemes, including...  ...accounting, compliance, government, and media. Our products combine highly... 
    Suggested
    Remplacement
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    8 hours ago
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...EHR vignettes for a medical AI evaluation project. General and internal... 
    Remote work
    Part time
    For contractors
    Flexible hours

    Mindrift

    Toronto, ON
    4 days ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$150/hour Location: Remote Role Responsibilities...  ..., and technical reports. Evaluate AI-generated or human-created...  ...detailed written justifications for evaluations and scores to maintain... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $30 - $40 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct...  ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations... 
    Remote work
    Daily paid
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    9 hours ago
  • $140k - $175k per year

     ...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation...  ...professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights... 
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 days ago
  • $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to...  ...accurate application of structured evaluation guidelines. Work... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$150/hour Location: Remote Role Responsibilities...  ...and A/B test write-ups . Evaluate AI-generated or human-created...  ...detailed written justifications for evaluations and scores to maintain... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $39/hour Location: Remote Duration: Up to 6 months...  ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1...  ...number. You can live anywhere. We are remote and we hire worldwide. The one hard requirement...  ...removes the constraint. We are heavy AI users and we expect you to build, not just... 
    Remote work
    Worldwide
    Shift work

    Sweat Pants Agency

    Toronto, ON
    12 days ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $60 - $100 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Marketing Expert — Social Media (AI Agent Environments)...  ...–$100/hour Location: Remote Role Responsibilities...  ...Review AI agent attempts and evaluate them against established standards... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...KittySpout / DoggySpout is looking for a Social Media Strategist to join our team! You will own...  ...vertical and customer base. We're a 100% remote, lean, senior team that moves fast, and...  ...community within 24 hours. Work Smart – use AI and tools so your time goes to strategy and... 
    Remote work
    Full time
    Weekend work

    KittySpout

    Toronto, ON
    18 days ago
  •  ...agency (Facebook and Google ads management for contractors) that also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC-style ads for our ecommerce products and need someone who... 
    Remote work
    Hourly pay
    Ongoing contract
    For contractors
    Freelance

    Sparked Agency

    Toronto, ON
    18 hours ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $39/hour Location: Remote Commitment: 10 hours/week Role...  ...providing concise notes on performance. Evaluate AI model interactions to ensure alignment... 
    Remote job

    Mercor

    Toronto, ON
    5 days ago
  • $60k - $75k per year

     ...ROLE: MEDIA SPECIALIST TEAM: MEDIA LOCATION: TORONTO - HYBRID ONSITE 2X/WEEK COMPANY...  ...people combine strategic thinking with AI-powered tools, automation and advanced...  ...accountability of the media plan, regularly evaluating and monitoring execution to implement meaningful... 
    Full time
    Seasonal work

    SALT XC

    Toronto, ON
    13 days ago
  • $39 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include...  ...: Contract Compensation: $39/hour Location: Remote Commitment: 10 hours/week Role Responsibilities... 
    Remote work
    Full time
    Contract work
    Summer work

    Mercor

    Toronto, ON
    9 hours ago
  • $100k - $120k per year

     ...This is a remote role Who We Are   Marketbridge partners with leading...  ...systems that connect strategy, AI, creativity, activation and...  ...of developing multi-faceted media strategies that support clients...  ...media plans  ~ Identify and evaluate media opportunities across programmatic... 
    Remote work
    Long term contract
    Summer work
    Manual labor
    Worldwide
    Flexible hours
    Shift work

    Marketbridge

    Toronto, ON
    6 days ago
  • $57 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...: Contract Compensation: $57/hour Location: Remote Commitment: 10 hours/week Role Responsibilities... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    11 days ago
  • $60k - $65k per year

     ...content more effectively to optimizing daily media channel performance and maximizing...  ...Effectiveness supports the measurement and evaluation of media performance, helping deliver actionable...  ...available to all permanent employees. AI Disclosure: [ dentsu ] utilizes artificial... 
    Permanent employment
    Full time
    Contract work
    Temporary work
    Internship

    dentsu

    Toronto, ON
    4 days ago
  • $52.38 - $57.39 per hour

     ...Analytics, in the Policy and Strategic Planning Branch of Parks, Forestry & Recreation, the Evaluator, Programs will help design, plan, and lead the implementation of small and large evaluations, performance measurement frameworks, needs assessments, and applied research projects.... 
    Hourly pay
    Permanent employment
    Full time
    Part time
    Internship
    Monday to friday
    Shift work

    City of Toronto

    Toronto, ON
    1 day ago
  • $150 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Compensation: $150/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Media Evaluator. Be the first to apply!