Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Media Quality Reviewer

Scale AI

Review AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based writing. Evaluate voices, images, and videos for quality.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI training projects. You will roleplay conversations with AI voice models, compare generated media, identify artifacts, and explain decisions clearly. This freelance opportunity supports evaluation and feedback for advanced AI systems.

Key Responsibilities:

  • Conduct live English conversations with AI voice models
  • Compare images and videos against text prompts
  • Inspect outputs for visual, motion, text, and audio problems
  • Rate adherence, quality, realism, naturalness, and clarity
  • Write specific explanations identifying observed issues

Requirements:

  • Fluent English and clear written communication skills
  • Strong attention to detail and patience during reviews
  • Comfort discussing realistic situations conversationally
  • Experience writing brief evidence-based explanations or reviews
  • Ability to choose clearly when both options have flaws

Apply your English communication, media evaluation, and close observation skills as an AI quality reviewer for Outlier.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Media Quality Reviewer in Toronto, ON vacancy
  •  ...model. See why our customers have reviewed us 5 stars on G2 ....  ...We conduct monthly financial reviews as a team so everyone has a pulse...  ...Role Rootly is building the AI-native future of incident management...  ...our customers do. As our AI Quality Engineer, you'll own the evaluation... 
    Quality
    Full time
    Internship
    Home office

    Rootly

    Toronto, ON
    1 day ago
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies,...  ...contact, no malpractice exposure: you review written clinical cases ~ All...  ...systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and... 
    Quality
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Toronto, ON
    3 days ago
  • $30 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...hour Location: Remote Role Responsibilities Review short English-language conversations to evaluate AI responses .... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $45 - $50 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ...Summers , and Jack Dorsey . Position: Editorial and Media Practice Reviewer Type: Contract Compensation: $45–$50/hour... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $30 - $50 per hour

     ...a competitive advantage. Cresta’s unified AI platform combines conversational AI agents...  ...students to join our  AI Delivery team as  AI Quality Assurance Interns . This is a hands-on...  ...misclassifications, or hallucinations Review and validate AI-generated suggestions,... 
    Quality
    Hourly pay
    Internship
    Work at office

    Cresta

    Toronto, ON
    1 day ago
  • $20 - $50 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Quality Analyst Type: Contract Compensation...  ...Remote Role Responsibilities Review work product against defined quality... 
    Quality
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $24 - $30 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Location: Remote Role Responsibilities Review recorded sessions where users interact with an AI assistant via voice... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $95k per year

     ...Join Our Team as a Claims Review Paralegal at Axiom We are currently seeking Claims Review Paralegals with claims review experience...  ...globally with our unique blend of world-class legal talent and advanced AI tools, delivering innovative solutions ranging from that combine... 
    Remote work
    Flexible hours

    Axiom Talent Platform

    Toronto, ON
    6 days ago
  •  ...Quality Engineer (QE) / SDET – AI Chatbot Validation Job Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality... 
    Quality
    Contract work

    Astra North Infoteck Inc.

    Toronto, ON
    8 days ago
  • $32.86 - $41.07 per hour

     ...37.5 hr per week Shifts: Days Status: Permanent Full Time Closing Date: November 4, 2026 Position Summary The Clinical Reviewer is responsible for the identification, collection, entering, validation, and reporting of clinical data for two surgical databases. The... 
    Hourly pay
    Remplacement
    Permanent employment
    Full time
    Internship
    Flexible hours
    Shift work

    University Health Network

    Toronto, ON
    1 day ago
  • $60 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Position: Marketing Expert — Social Media (AI Agent Environments) Type: Contract...  ...for realistic task execution. Write or review reference answers and criteria... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $45 - $65 per hour

     ...Quality Assurance Specialist - Accessibility Job Description Join our Enterprise Digital...  ...in remediation tasks. Engage in design reviews to ensure accessibility considerations are...  .... Use of Artificial Intelligence (AI): We may use Artificial Intelligence (AI)... 
    Quality
    Contract work
    Toronto, ON
    2 days ago
  • $86.1k - $136.1k per year

     ...efficient applications. We are looking for a Quality Engineer who is curious about emerging...  ...outcomes. Position Responsibilities: Review and translate requirements, specifications...  ...Selenium, Xray, Postman, and JMeter. Use AI-enabled tools and practices to support... 
    Quality
    Long term contract
    Temporary work
    Local area
    Flexible hours

    Manulife

    Toronto, ON
    1 day ago
  • $58k - $96k per year

     ...friends, families, and communities to enjoy the quality of life that comes with a sustainable...  ..., Métis).   When you apply, we will review your application using Deloitte's Global Talent...  ...utilize human screening combined with AI technology to help identify the skills and... 
    Quality
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    1 day ago
  • $144k - $198k per year

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential of AI. Okta secures AI by building the trusted...  ...safeguarding Okta’s products by conducting comprehensive security reviews, guiding engineering teams in secure development practices, and... 
    Local area
    Worldwide

    Okta

    Toronto, ON
    1 day ago
  • $85k - $100k per year

     ...ABOUT THE ROLE LEAP is hiring a Social Media Manager to bring our brand, products, and...  ...audience growth, traffic, lead volume and quality, and conversion signals  Partner with internal...  ..., production, publishing, and performance review  Continually remain engaged with... 
    Quality
    Full time
    Contract work
    Freelance
    Work at office
    Work from home
    3 days per week

    LEAP Legal Software

    Toronto, ON
    13 days ago
  •  ...KittySpout / DoggySpout is looking for a Social Media Strategist to join our team! You will own...  ...within 24 hours. Work Smart – use AI and tools so your time goes to strategy and...  ..., nothing late. Creator content – Review the creator and UGC content coming in from... 
    Full time
    Remote work
    Weekend work

    KittySpout

    Toronto, ON
    18 days ago
  •  ...that celebrates authenticity, quality, and community. Inspired by the...  ..., evaluating TOP samples, reviewing overseas inspection reports, and...  ...concerns to the Head of Dept for review and direction. This position...  ...including artificial intelligence (AI), to support parts of the... 
    Quality
    Permanent employment
    Full time
    Seasonal work
    Work at office
    Local area
    Overseas

    Roots

    Toronto, ON
    1 day ago
  •  ...through world-class networks, AI-powered solutions, and digital...  ...us? At Bell, you'll join the Media program and become part of a team...  ...news, and radio.  Leadership qualities demonstrated through extracurricular...  ...your #TeamBell potential.  Review our programs and apply for up... 
    Quality
    Internship
    Work at office
    3 days per week

    Bell

    Toronto, ON
    1 day ago
  •  ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They...  ...media buyer today is a sharp marketer who uses AI every day. We built an internal creative...  ...is the lever: You can pull insights from reviews, competitor ads, and comments to generate... 
    Full time

    Sweat Pants Agency

    Toronto, ON
    12 days ago
  •  ...Quality Agent: Sephora has been changing the face of prestige cosmetics since its debut in 1970s Paris. Sephora was acquired by luxury group Moët Hennessy Louis Vuitton (LVMH) in 1997 featuring nearly 300 brands. Sephora offers beauty products including cosmetics, skincare... 
    Quality
    Internship
    Worldwide
    Flexible hours
    Night shift
    Weekend work

    Sephora

    Toronto, ON
    1 day ago
  • $100k - $120k per year

     ...systems that connect strategy, AI, creativity, activation and measurement...  ...of developing multi-faceted media strategies that support clients...  ...when required  ~ Review campaign performance and use data...  ...recommendations to ensure strategic quality, accuracy, and alignment  ~... 
    Quality
    Long term contract
    Summer work
    Manual labor
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Marketbridge

    Toronto, ON
    6 days ago
  •  ...Move Your Career Forward with DAC as a Senior Quality Assurance Analyst Who We Are We are DAC—a global full-funnel performance media agency dedicated to delivering transformative...  ..., forward-thinking strategies. Powered by AI, data, and creative ingenuity, we deliver integrated... 
    Quality
    Full time
    Casual work
    Work at office
    Local area
    Remote work
    2 days per week

    DAC Group / Canada Ltd.

    Toronto, ON
    4 hours ago
  •  ...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional...  ...growth.  WPP Media is WPP's AI-driven media operating unit, bringing together...  ...IMPACT: Handle day-to-day client requests Review vendor contracts for accuracy Generate... 
    Work at office

    wppmedia

    Toronto, ON
    12 hours ago
  •  ...of an Ontario Line station. Improve the quality of life for commuters by reducing daily...  ...Management Lead and support the development, review, implementation, and continuous...  ...opportunities. OTG uses artificial intelligence (AI) tools as part of the applicant screening... 
    Quality
    Full time
    Contract work
    For subcontractor
    Work at office

    Ontario Transit Group

    Toronto, ON
    6 days ago
  • $47k - $78k per year

     ...and communities to enjoy the quality of life that comes with a sustainable...  ...include:   • Reviewing and validating client and engagement...  ...When you apply, we will review your application using Deloitte...  ...human screening combined with AI technology to help identify the... 
    Quality
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    1 day ago
  • $79k - $108.7k per year

     ...future for our planet and its people. The role will report to the Quality Lead. Your role Coordinate and collaborate with...  ...Integrated PMS Program, including design readiness validations and review processes at key project milestones. Plan and facilitate internal... 
    Quality
    Full time
    Internship
    Flexible hours

    AtkinsRéalis

    Toronto, ON
    2 days ago
  • $60k - $65k per year

     ...content more effectively to optimizing daily media channel performance and maximizing...  ...connections to media platforms. Monitor data quality by identifying discrepancies and supporting...  ...are available to all permanent employees. AI Disclosure: [ dentsu ] utilizes artificial... 
    Quality
    Permanent employment
    Full time
    Contract work
    Temporary work
    Internship

    dentsu

    Toronto, ON
    4 days ago
  • $69.7k - $98.4k per year

     ...execute, and maintain manual/automated tests across the SDLC, embedding quality into continuous delivery pipelines. Analyze requirements,...  ...rapid, data-driven quality feedback/reporting. Apply BDD/TDD and AI-assisted testing capabilities with governance (test generation,... 
    Quality
    Full time
    Work from home

    TD

    Toronto, ON
    5 days ago
  • $50k - $65k per year

     ...ROLE: SOCIAL MEDIA SPECIALIST TEAM: CREATOR LOCATION: TORONTO (HYBRID) COMPANY OVERVIEW...  ...Continuously look for ways to elevate the quality, creativity, and effectiveness of client...  ...Explore emerging technologies, including AI-powered creative and production tools, to improve... 
    Quality
    Full time
    Seasonal work
    Work at office
    Shift work
    2 days per week

    SALT XC

    Toronto, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Media Quality Reviewer. Be the first to apply!