Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Media Evaluation Specialist

Scale AI

Review AI-generated media for Outlier remotely, using fluent English, careful listening, and precise written explanations on your own schedule.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI training projects. You will evaluate voice conversations, images, videos, captions, and audio. Your feedback helps improve advanced AI systems through Outlier’s evaluation loop and supports better real-world performance.

Key Responsibilities:

  • Roleplay conversations and rank voice model naturalness, usefulness, and clarity
  • Compare generated images and videos against prompts
  • Inspect outputs for anatomy, motion, text, and audio problems
  • Rate adherence, quality, and realism across outputs
  • Write specific evidence-based explanations in English

Requirements:

  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing short reviews or explanations
  • Ability to decide when both options have flaws

Apply your English communication, media judgment, and attention to detail to evaluate AI outputs for Outlier projects.

#J-18808-Ljbffr
Vacancy posted 20 hours ago
Similar jobs that could be interesting for youBased on the AI Media Evaluation Specialist in Ottawa, ON vacancy
  •  ...Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos. Outlier, an AI training platform...  ...issues in writing, and support evaluation and feedback for advanced AI... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,...  ...platform, seeks detail-oriented English speakers for varied evaluation projects. You will assess model outputs, explain issues clearly... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based judgment. Evaluate voices, images, and videos carefully. As an Outlier Expert...  ...specific explanations supporting evaluation decisions Requirements: Fluent... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Review AI-generated media remotely for Outlier using fluent English, careful observation, and evidence...  ...-oriented English speakers for AI evaluation projects. You will assess voice conversations...  ...feedback skills as an AI Media Evaluation Specialist with Outlier. #J-18808-Ljbffr
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and evidence-based written feedback. Review voices...  ...platform, seeks detail-oriented English speakers for AI evaluation projects. You will assess naturalness, prompt adherence, realism... 
    Suggested
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based written feedback. Review voices...  ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess natural conversations, compare... 
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media for Outlier remotely, using fluent English, careful listening, and precise written feedback on model outputs. Set your own schedule. As an AI Media Evaluation Specialist, you will assess voice conversations, images, videos, captions, and generated... 
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media in English with careful judgment, strong written communication, and flexible remote work on your own schedule. Review...  ...communication and media judgment skills to help Outlier improve advanced AI systems through structured evaluation. #J-18808-Ljbffr
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated images, videos, and voices remotely while applying strong English communication...  ...English speakers to assess AI-generated media. You will roleplay conversations with AI...  ..., visual judgment, and audio evaluation skills to improve AI systems through Outlier... 
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and clear written reasoning. Review voice,...  ...communication and media-review judgment to help Outlier improve advanced AI systems through structured evaluations. #J-18808-Ljbffr
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media remotely for Outlier, using fluent English, careful observation, and clear written explanations on your own schedule....  ...LinkedIn profile Apply your English communication and media evaluation skills to help Outlier improve advanced AI systems through... 
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,...  ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess generated media, explain issues in... 
    Remote work

    Scale AI

    Ottawa, ON
    20 hours ago
  •  ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task...  ...EHR vignettes for a medical AI evaluation project. General and internal medicine... 
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    4 days ago
  •  ...We are looking for an experienced, hands-on Freelance Paid Media Specialist to manage and optimise paid social campaigns for an established B2B technology company. You will work closely with the Demand Generation team to improve campaign performance across the customer... 
    Freelance

    Digital

    Ottawa, ON
    a month ago
  • $100 per hour

     ...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve...  ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    2 days ago
  • $77.95k - $96.29k per year

     ...As a  Marketing Communications Specialist for PCL's Defence...  ...materials. Develops social media content and applies an understanding...  ...and the ability to measure and evaluate marketing and communications performance...  ...of artificial intelligence (AI) to screen, assess, or select... 
    Long term contract
    Work at office
    Immediate start
    Flexible hours

    PCL Construction

    Ottawa, ON
    2 days ago
  •  ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,...  ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects... 
    Full time

    Sweat Pants Agency

    Ottawa, ON
    12 days ago
  • $68.54k - $97.22k per year

     ...11/2026 JOB SUMMARY You are responsible for serving as the media spokesperson for Transit Services, organizing media relations activities...  ..., audience analysis, public consultation and communications evaluation techniques Media relations strategies, media protocols,... 
    Full time
    Temporary work
    Local area
    Immediate start
    Shift work

    City of Ottawa

    Ottawa, ON
    1 day ago
  • usd15 per hour

     ...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday...  ...data used by major search engines, social media sites, streaming platforms and more.... 
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Remote work
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    a month ago
  • $107.5k - $134.38k per year

     ...Family: Academic Program Management # of Open Positions: 1 Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A Date Posted (YYYY/MM/DD): 2026/10/08 Applications must be received... 
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    1 day ago
  •  ...This role is Hybrid Ottawa AI Solutions Engineer Position...  ...options analysis, specifically evaluating the performance and reliability...  ...experience as a Software Specialist within an Integrated Product...  ...decisions, including candidate evaluation, selection, and disposition,... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $85k - $111.3k per year

     ...maintained through Generative AI and agentic software engineering...  ...developers, architects, AI specialists, and domain experts, you will...  ...use cases, prototype solutions, evaluate their impact on development efficiency...  ...repeatable benchmarks and evaluation methods to assess AI agent... 
    Long term contract
    Full time
    Temporary work
    Manual labor

    Ericsson

    Ottawa, ON
    5 days ago
  • $85k - $125k per year

     ...Thales has a vacancy for an Obsolescence Specialist who is dedicated to providing Integrated...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled...  ...All hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Work at office
    Local area

    Thales

    Ottawa, ON
    4 days ago
  • $110k - $130k per year

     ...has a vacancy for an AJISS Reliability Specialist will focus on in-service support for the...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools...  ...hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Work from home
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $76.1k - $96.14k per year

     ...promoting campus. The HPS (health promo specialist) must provide direct interventions with students...  ..., implementation, delivery and evaluation of interactive and evidence-informed wellness...  ...Lead in maintaining Health Promo’s social media and assist in web presence. Prepare... 
    Permanent employment
    Full time
    Temporary work
    For contractors
    Weekend work
    Afternoon shift

    University of Ottawa

    Ottawa, ON
    1 day ago
  •  ...with around 50 DTC and eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1 to $2M a month on Google...  ...scripts, reporting, whatever removes the constraint. We are heavy AI users and we expect you to build, not just prompt. You are a... 
    Remote work
    Worldwide
    Shift work

    Sweat Pants Agency

    Ottawa, ON
    12 days ago
  • $69k - $73k per year

     ...shift. In the role of Circuit Delayering Specialist you will be responsible for the careful...  ...nodes. WHAT YOU’LL DO   Prepare and evaluate samples for engineering analysis   Understand...  ...all aspects of the selection process. AI technology may be used to assist in the... 
    Permanent employment
    Full time
    Internship
    Work at office
    Flexible hours
    Shift work
    Afternoon shift
    Early shift

    TechInsights

    Ottawa, ON
    5 hours ago
  • $120k - $140k per year

     ...Thales has a vacancy for a Cyber Security Specialist (Detection Engineer) is responsible for...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools...  ...hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $95.59k - $120.75k per year

     ...world. Position Purpose The Senior Specialist, Executive Development plays an important...  ...prospective donors, including through social media. Networking: Actively networks at...  ...and international level. Performance Evaluation and Reporting: Prepares and submits monthly... 
    Remplacement
    Long term contract
    Permanent employment
    Temporary work
    For contractors
    Flexible hours
    Afternoon shift

    University of Ottawa

    Ottawa, ON
    1 day ago
  • $20 per hour

     ...feeling like a pro. As an Athlete Highlight Specialist (AHS), you are responsible for capturing...  ...Brodie League's storytelling and social media presence. Your work extends the...  ...process, including to screen, assess, or evaluate applicants. POSITION STATUS This... 
    Hourly pay
    Long term contract
    Permanent employment
    Part time
    Shift work
    Night shift
    Weekend work
    Afternoon shift

    Brodie%20Rec%20League

    Ottawa, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Media Evaluation Specialist. Be the first to apply!