Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Media Evaluation Specialist

Scale AI

Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based judgment. Evaluate voices, images, and videos carefully.

As an Outlier Expert, you will assess AI outputs across varied projects for Scale AI’s training platform. You will roleplay conversations with AI voice models, compare generated media, and explain findings in writing. The work supports feedback that helps AI systems improve.

Key Responsibilities:

  • Conduct live English conversations with AI voice models
  • Rank speech for naturalness, usefulness, and clarity
  • Compare images and videos against text prompts
  • Inspect outputs for visual, motion, text, and audio problems
  • Write specific explanations supporting evaluation decisions

Requirements:

  • Fluent English and strong written communication skills
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing short evidence-based reviews
  • Comfort making clear decisions when options have flaws

Apply English communication, detailed observation, and media judgment to evaluate AI outputs as an Outlier Expert.

#J-18808-Ljbffr
Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the AI Media Evaluation Specialist in Ottawa, ON vacancy
  •  ...Review AI-generated media remotely on your own schedule, using English communication and careful visual and audio evaluation skills. Help assess voices, images, and videos. Outlier, operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects.... 
    Suggested
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated images, videos, and voices remotely while applying strong English communication...  ...English speakers to assess AI-generated media. You will roleplay conversations with AI...  ..., visual judgment, and audio evaluation skills to improve AI systems through Outlier... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and clear written reasoning. Review voice,...  ...communication and media-review judgment to help Outlier improve advanced AI systems through structured evaluations. #J-18808-Ljbffr
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Review AI-generated images, videos, and voices remotely while applying strong English communication and close attention to detail...  ...operated by Scale AI, seeks detail-oriented English speakers for AI media evaluation. You will assess model outputs, explain quality issues, and... 
    Suggested
    Freelance
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI voice, image, and video outputs remotely on your own schedule while applying fluent...  ...Expert, you will review AI-generated media and provide evidence-based feedback. You...  ...assess adherence, quality, and realism. Your evaluations support AI training and improvement... 
    Suggested
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Review AI-generated media for Outlier remotely, using fluent English, careful listening, and precise...  ...for AI training projects. You will evaluate voice conversations, images, videos, captions...  ...advanced AI systems through Outlier’s evaluation loop and supports better real-world... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos. Outlier, an AI training platform...  ...issues in writing, and support evaluation and feedback for advanced AI... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,...  ...platform, seeks detail-oriented English speakers for varied evaluation projects. You will assess model outputs, explain issues clearly... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Review AI-generated media remotely for Outlier using fluent English, careful observation, and evidence...  ...-oriented English speakers for AI evaluation projects. You will assess voice conversations...  ...feedback skills as an AI Media Evaluation Specialist with Outlier. #J-18808-Ljbffr
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media remotely for Outlier, using fluent English, careful observation, and clear written explanations on your own schedule....  ...LinkedIn profile Apply your English communication and media evaluation skills to help Outlier improve advanced AI systems through... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,...  ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess generated media, explain issues in... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based written feedback. Review voices...  ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess natural conversations, compare... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media for Outlier remotely, using fluent English, careful listening, and precise written feedback on model outputs. Set your own schedule. As an AI Media Evaluation Specialist, you will assess voice conversations, images, videos, captions, and generated... 
    Remote work

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...Evaluate AI-generated media in English with careful judgment, strong written communication, and flexible remote work on your own schedule. Review...  ...communication and media judgment skills to help Outlier improve advanced AI systems through structured evaluation. #J-18808-Ljbffr
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    11 hours ago
  •  ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task...  ...EHR vignettes for a medical AI evaluation project. General and internal medicine... 
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    4 days ago
  •  ...We are looking for an experienced, hands-on Freelance Paid Media Specialist to manage and optimise paid social campaigns for an established B2B technology company. You will work closely with the Demand Generation team to improve campaign performance across the customer... 
    Freelance

    Digital

    Ottawa, ON
    a month ago
  • $100 per hour

     ...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve...  ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    1 day ago
  •  ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,...  ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects... 
    Full time

    Sweat Pants Agency

    Ottawa, ON
    12 days ago
  • $77.95k - $96.29k per year

     ...As a  Marketing Communications Specialist for PCL's Defence...  ...materials. Develops social media content and applies an understanding...  ...and the ability to measure and evaluate marketing and communications performance...  ...of artificial intelligence (AI) to screen, assess, or select... 
    Long term contract
    Work at office
    Immediate start
    Flexible hours

    PCL Construction

    Ottawa, ON
    2 days ago
  • $68.54k - $97.22k per year

     ...11/2026 JOB SUMMARY You are responsible for serving as the media spokesperson for Transit Services, organizing media relations activities...  ..., audience analysis, public consultation and communications evaluation techniques Media relations strategies, media protocols,... 
    Full time
    Temporary work
    Local area
    Immediate start
    Shift work

    City of Ottawa

    Ottawa, ON
    1 day ago
  • $107.5k - $134.38k per year

     ...Family: Academic Program Management # of Open Positions: 1 Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A Date Posted (YYYY/MM/DD): 2026/10/08 Applications must be received... 
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    1 day ago
  • usd15 per hour

     ...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday...  ...data used by major search engines, social media sites, streaming platforms and more.... 
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Remote work
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    a month ago
  •  ...This role is Hybrid Ottawa AI Solutions Engineer Position...  ...options analysis, specifically evaluating the performance and reliability...  ...experience as a Software Specialist within an Integrated Product...  ...decisions, including candidate evaluation, selection, and disposition,... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $85k - $111.3k per year

     ...maintained through Generative AI and agentic software engineering...  ...developers, architects, AI specialists, and domain experts, you will...  ...use cases, prototype solutions, evaluate their impact on development efficiency...  ...repeatable benchmarks and evaluation methods to assess AI agent... 
    Long term contract
    Full time
    Temporary work
    Manual labor

    Ericsson

    Ottawa, ON
    5 days ago
  • $85k - $125k per year

     ...Thales has a vacancy for an Obsolescence Specialist who is dedicated to providing Integrated...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled...  ...All hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Work at office
    Local area

    Thales

    Ottawa, ON
    4 days ago
  • $110k - $130k per year

     ...has a vacancy for an AJISS Reliability Specialist will focus on in-service support for the...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools...  ...hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Work from home
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $76.1k - $96.14k per year

     ...promoting campus. The HPS (health promo specialist) must provide direct interventions with students...  ..., implementation, delivery and evaluation of interactive and evidence-informed wellness...  ...Lead in maintaining Health Promo’s social media and assist in web presence. Prepare... 
    Permanent employment
    Full time
    Temporary work
    For contractors
    Weekend work
    Afternoon shift

    University of Ottawa

    Ottawa, ON
    1 day ago
  •  ...with around 50 DTC and eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1 to $2M a month on Google...  ...scripts, reporting, whatever removes the constraint. We are heavy AI users and we expect you to build, not just prompt. You are a... 
    Remote work
    Worldwide
    Shift work

    Sweat Pants Agency

    Ottawa, ON
    12 days ago
  • $120k - $140k per year

     ...Thales has a vacancy for a Cyber Security Specialist (Detection Engineer) is responsible for...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools...  ...hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $20 per hour

     ...feeling like a pro. As an Athlete Highlight Specialist (AHS), you are responsible for capturing...  ...Brodie League's storytelling and social media presence. Your work extends the...  ...process, including to screen, assess, or evaluate applicants. POSITION STATUS This... 
    Hourly pay
    Long term contract
    Permanent employment
    Part time
    Shift work
    Night shift
    Weekend work
    Afternoon shift

    Brodie%20Rec%20League

    Ottawa, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Media Evaluation Specialist. Be the first to apply!