Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Generative AI Media Quality Evaluator

Scale AI

Review generative AI images, videos, and voice outputs remotely as a freelance evaluator with flexible hours and fluent English. Identify quality issues precisely.

Outlier is seeking talented contributors to judge whether AI-generated media follows prompts and sounds or looks natural. This freelance work combines close inspection, comparative evaluation, live conversational testing, and written feedback. Candidates should communicate clearly, make decisions when outputs have flaws, and provide their own ratings without AI writing tools.

Key Responsibilities:

  • Compare pairs of AI-generated images and videos
  • Judge adherence to each provided prompt
  • Replay and zoom into outputs to identify defects
  • Rate adherence, quality, and realism across outputs
  • Explain observed evidence clearly in English

Requirements:

  • Fluent English speaker with strong written communication
  • Exceptional attention to visual and audio details
  • Ability to make clear decisions between flawed options
  • Bachelor’s degree pursuit or completion, or above
  • Independent work using a computer, headphones, and reliable internet

Apply analytical judgment and detailed media review skills to strengthen generative AI image, video, and voice evaluations.

#J-18808-Ljbffr
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Generative AI Media Quality Evaluator in Montréal, QC vacancy
  •  ...Description Job Description We are looking for an experienced Quality Assurance Specialist II to support supplier quality,...  ...Supplier Quality Management Lead supplier quality system evaluations, assessments, and audits. Manage supplier approval and qualification... 
    Quality

    Kronos Consulting

    Montréal, QC
    4 days ago
  • $80k - $155k per year

     ...que code (IaC) et des pipelines CI/CD. • Évaluer les environnements et applications...  ...contexte réglementé (résilience, sécurité, DORA, AI Act et souveraineté des données), avec le...  ...monde. Senior Cloud Architect – Cloud & Generative AI Position Description Help clients... 
    Quality
    Apprenticeship
    Local area
    Montréal, QC
    14 days ago
  • $90k - $175k per year

     ...sécurité, de fiabilité et de coûts. • Évaluer les cas d’usage et choisir les approches...  ...information (TI) et en management au monde. Generative AI and Agentic Solutions Architect...  ...approvals and traceability. • Define solution evaluation and acceptance criteria: response... 
    Quality
    Montréal, QC
    14 days ago
  •  ...AI SUPPORT ANALYST – GENERATIVE AI, M365 & TECHNICAL SUPPORT ROLE SUMMARY We are seeking a Level 2.5 AI Support Analyst to act as the front line for end-user AI, answering user questions across the firm's AI portfolio and capturing every query in a structured way... 
    Suggested
    Permanent employment
    Shift work

    Astra North Infoteck Inc.

    Montréal, QC
    6 days ago
  • $70k - $135k per year

     ...reproductibilité. • Participer à l’évaluation des infrastructures et...  ...(résilience, sécurité, DORA, AI Act, souveraineté), avec le soutien...  ...Cloud Architect – Powered by Generative AI Position Description...  ...and delivery while maintaining quality, security and human oversight.... 
    Quality
    Apprenticeship
    Montréal, QC
    14 days ago
  •  ...Botpress is the AI agent platform for customer support. We build AI agents that resolve tickets instead of just answering them, for support...  ...account list, from first touch to the hand-off into Sales Paid media, through our agency or in house, on a small budget that has to... 
    Full time
    Freelance
    Manual labor
    Work at office

    Botpress Technologies Inc.

    Montréal, QC
    11 days ago
  •  ...Evaluate AI-generated images and videos with close visual inspection, working remotely as a flexible freelance contributor for Outlier. Your judgments help measure output quality. Outlier is seeking detail-oriented English speakers to review generative AI media. You will... 
    Quality
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Montréal, QC
    17 hours ago
  •  ...healthcare organizations depend on. AI is now at the heart of that...  ...as the engine behind our next generation of mission-critical solutions...  ..., we believe the future of quality assurance lies in combining robust...  ...synthesis; Critically evaluate AI-generated outputs, exercise... 
    Quality
    Full time

    LGI Healthcare Solutions Santé Inc.

    Montréal, QC
    27 days ago
  • $100 per hour

     ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems.  Participation...  ...vignettes for a medical AI evaluation project. General and internal...  ...Score the clinical reasoning quality of benchmark items: vignette accuracy... 
    Quality
    Price work
    Part time
    10 hours per week
    Flexible hours

    Mindrift

    Montréal, QC
    3 days ago
  •  ...Evaluate generative AI images, videos, and voice models with fluent English, careful observation, and evidence-based written reviews. This remote...  ...human feedback for AI models. You will judge prompt adherence, quality, realism, natural conversation, and clarity while documenting... 
    Quality
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Montréal, QC
    17 hours ago
  •  ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They...  ...buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis...  ...reviews, competitor ads, and comments to generate new angles You've written UGC scripts... 
    Full time

    Sweat Pants Agency

    Montréal, QC
    4 days ago
  •  ...Review generative AI media for realism, prompt adherence, and quality while working remotely with flexible freelance hours. Outlier is seeking talented English speakers to provide human feedback for AI voice, image, and video models. This work centers on comparing outputs,... 
    Quality
    Freelance
    Work at office
    Remote work
    Flexible hours

    Scale AI

    Montréal, QC
    17 hours ago
  • $60k - $70k per year

     ...accounts and advertising strategies? Impact Media, a forward-thinking digital marketing...  ...initiatives succeed by creating engaging, high-quality content that aligns with their values and...  ...brand visibility, attract new users, and generate leads through Facebook and Instagram campaigns... 
    Quality
    Full time
    For contractors
    Fixed term contract
    Remote work
    Trial period
    Monday to friday
    Flexible hours

    Impact Media

    Montréal, QC
    11 days ago
  •  ...Media buying is now the easy part. In 2026, the buying itself is piping. The levers that...  ...media buyer today is a sharp marketer who uses AI every day. We built an internal creative...  ...our editors and designers and you hold the quality bar. Ship creative on a cadence. Roughly... 
    Quality
    Full time
    Remote work
    Worldwide

    Sweat Pants Agency

    Montréal, QC
    4 days ago
  •  ...Subject Matter Expert (SME) in Hydro Turbines-Generators Systems, supporting some of the largest...  ...of turbine-generator technology. Evaluation of refurbishment, power-increase (...  ...calculations. Manufacturing drawings. Quality plans and inspection & test plans (ITPs)... 
    Quality
    Remplacement
    Long term contract
    Full time
    Internship
    Flexible hours

    AtkinsRéalis

    Montréal, QC
    18 days ago
  •  ...collections of uncompromising style and quality for all.  We believe great people do their...  ...(18-month contract) The  Paid Media Specialist  plays a key role in developing...  ...optimization opportunities to achieve KPIs and evaluating overall results while providing insights... 
    Quality
    Full time
    Contract work
    Part time
    Internship
    Flexible hours

    Reitmans (Canada) Ltée/Ltd

    Montréal, QC
    13 days ago
  •  ...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional...  ...growth.  WPP Media is WPP's AI-driven media operating unit, bringing together...  ...account entrusted to you, promoting the highest quality media product and customer satisfaction.... 
    Quality
    Work at office

    wppmedia

    Montréal, QC
    27 days ago
  •  ...create collections of uncompromising style and quality for all.  We believe great people do...  ...your mark. We’re looking for a Social Media Manager who lives and breathes social, understands...  ...capture a brand's voice. Comfort using AI and emerging creative tools to work smarter... 
    Quality
    Full time
    Contract work
    Part time
    Flexible hours

    RW&CO

    Montréal, QC
    18 days ago
  •  ...create collections of uncompromising style and quality for all.  We believe great people do...  ...compromise. We're looking for a Social Media Manager who brings creativity, understands...  ...into meaningful content. Confidence using AI and emerging creative tools to work smarter... 
    Quality
    Full time
    Contract work
    Part time
    Flexible hours

    PENN.

    Montréal, QC
    18 days ago
  •  ...About WPP Media WPP is the trusted growth partner for the world’...  ...growth.  WPP Media is WPP's AI-driven media operating unit, bringing...  ...~ Ensure a high quality of execution cross-channel...  ...objectives; draws from experience to evaluate solutions from the business’s perspective... 
    Quality
    Work at office
    Shift work

    wppmedia

    Montréal, QC
    26 days ago
  •  ...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence...  ..., and deliver transformational growth.  WPP Media is WPP's AI-driven media operating unit, bringing together media, data, and partnerships... 
    Work at office
    Flexible hours

    wppmedia

    Montréal, QC
    7 days ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media from home with flexible hours. You will roleplay conversations with AI voice models, score each interaction, and explain what’s off, helping improve real-world AI performance. Ideal candidates... 
    Quality
    Weekly pay
    Remote work
    Flexible hours

    Outlier

    Montréal, QC
    17 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media on a fully remote, flexible schedule. You will roleplay live conversations with AI voice models, score outputs, and explain in writing what looked off. Work from home or while traveling, with... 
    Quality
    Weekly pay
    Remote work
    Work from home
    Flexible hours

    Outlier

    Montréal, QC
    17 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, score exchanges, and compare images and videos to judge prompt adherence. You will explain in writing what looked or sounded off, remotely... 
    Quality
    Hourly pay
    Remote work
    Flexible hours

    Outlier

    Montréal, QC
    17 hours ago
  •  ...AI Project Manager / Product Owner – Enterprise AI, Microsoft Copilot, ChatGPT & Generative AI We are seeking a seasoned Project Manager / Product Owner to lead cross-functional...  ...delivery roadmap while ensuring delivery quality, security, compliance and measurable... 
    Quality
    Permanent employment
    Shift work

    Astra North Infoteck Inc.

    Montréal, QC
    a month ago
  •  ...We are looking for an experienced, hands-on Freelance Paid Media Specialist to manage and optimise paid social campaigns for an established...  ...technology company. You will work closely with the Demand Generation team to improve campaign performance across the customer journey... 
    Freelance

    Digital

    Montréal, QC
    a month ago
  •  ...revenue-focused marketing leader who can build and own the demand-generation engine — generating and converting leads, managing the sales...  ...marketing/demand-generation function from the ground up • Skill using AI to accelerate productivity (campaign build, reporting, research)... 
    For contractors
    Freelance
    Internship
    Remote work

    EERS

    Montréal, QC
    9 days ago
  •  ...We are seeking a  Freelance Social Media Specialist to to lead end-to-end strategy, content creation, and profile management across TikTok...  ...educates audiences on life insurance, family protection, and generational wealth in an accessible, non-salesy way. Grow the accounts... 
    Part time
    Freelance
    Flexible hours

    Digital

    Montréal, QC
    more than 2 months ago
  •  ...Outlier in Canada is seeking detail-oriented English speakers to review AI-generated media, hold live conversations with AI voice models, and score outputs against prompts on a fully remote schedule. You will compare AI-generated images and videos, explain what looked off... 
    Quality
    Hourly pay
    Weekly pay
    Remote work
    Flexible hours

    Outlier

    Montréal, QC
    17 hours ago
  •  ...Outlier seeks detail-oriented English speakers to review AI-generated media and score live exchanges with AI voice models. You will compare image...  ...include rating outputs across dimensions like adherence, quality, and realism, plus writing precise explanations. Remote, flexible... 
    Quality
    Hourly pay
    Remote work
    Flexible hours

    Outlier

    Montréal, QC
    17 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Generative AI Media Quality Evaluator. Be the first to apply!