AI Media Evaluation Analyst

Scale AI

Evaluate AI-generated media remotely on your own schedule using English communication, close observation, and evidence-based judgment. Review voice, image, and video outputs across varied projects.

As an Outlier Expert, you will help Scale AI improve advanced AI systems through structured evaluation and feedback. The work includes roleplaying live conversations with AI voice models, comparing generated media, and explaining specific issues in writing. You will assess adherence, quality, realism, naturalness, pronunciation, and clarity while making decisions when both options have flaws.

Key Responsibilities:

Conduct live English conversations with AI voice models
Rank exchanges for naturalness, usefulness, and clarity
Compare images and videos against their prompts
Inspect outputs for artifacts, errors, and unnatural motion
Write specific explanations supporting evaluation decisions

Requirements:

Fluent English with strong written communication
Strong attention to detail and patience
Comfort with natural conversational situations
Experience writing short evidence-based explanations
Valid identification, mobile phone, resume, and LinkedIn profile

Apply your English communication, media judgment, and detailed feedback skills while evaluating AI outputs for Outlier.

#J-18808-Ljbffr

Apply

Vacancy posted 2 hours ago

Similar jobs that could be interesting for youBased on the AI Media Evaluation Analyst in Ottawa, ON vacancy

AI Media Evaluation Analyst
...Review AI-generated media remotely on your own schedule, using English conversation skills and close attention to detail. Evaluate voices, images, and videos. Outlier Experts support Scale AI... ...improve advanced AI systems through evaluation and feedback. Key...
Suggested
Freelance
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Analyst
...Review AI-generated media remotely with Outlier, evaluating voice, image, and video outputs through careful English-language analysis. Set your own schedule... ...Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess naturalness, prompt...
Suggested
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Analyst
...Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and evidence-based writing skills. Review voices... ..., seeks detail-oriented English speakers for AI model evaluation. You will roleplay conversations, compare generated media,...
Suggested
Freelance
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Analyst
...Review AI-generated media remotely on your own schedule, using English communication and close attention to detail to evaluate model outputs carefully. Outlier, owned and operated by Scale... ...Write evidence-based explanations of evaluation decisions Requirements: Fluent...
Suggested
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Analyst
...Evaluate AI-generated media remotely on your own schedule using careful listening, visual inspection, and clear English explanations. Work with Outlier... ..., quality, realism, naturalness, and clarity across varied evaluation tasks. Your feedback helps improve advanced AI systems...
Suggested
Remote work
Flexible hours
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Analyst
...Evaluate AI-generated media for Outlier remotely on your own schedule, using English communication, careful listening, and visual attention to... ...findings in writing. Tasks include caption labeling and audio evaluations. Key Responsibilities: Roleplay live English...
Remote work
Scale AI
Ottawa, ON
2 hours ago
Remote AI Media Evaluation Analyst
...Evaluate AI-generated media remotely on your own schedule using careful observation and clear English communication. Review voice, image, and video... ...platform, seeks detail-oriented English speakers for AI evaluation projects. You will roleplay conversations with voice models...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Voice and Media Evaluator
...Evaluate AI voice models, images, and videos remotely on your own schedule as an English-speaking Outlier Expert. Your detailed feedback... ...AI, seeks detail-oriented English speakers for varied AI media evaluation projects. You will roleplay conversations, compare generated...
Remote work
Flexible hours
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Specialist
...Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos. Outlier, an AI training platform... ...issues in writing, and support evaluation and feedback for advanced AI...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Voice and Media Evaluator
...Evaluate AI voice models and generated media remotely on your own schedule using fluent English and careful listening. Explain findings clearly in writing... ...-oriented English speakers for flexible freelance evaluation work. You will roleplay conversations, compare images...
Freelance
Remote work
Flexible hours
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Reviewer
...Review AI-generated media remotely for Outlier, using English communication and close attention to detail on your own schedule. Evaluate voices, images, and videos against prompts. Outlier, operated... ...oriented English speakers for AI evaluation projects. You will roleplay...
Remote work
Scale AI
Ottawa, ON
2 hours ago
Freelance AI Media Evaluator
...Evaluate AI-generated media remotely on your own schedule with Outlier, using fluent English, careful listening, and sharp visual judgment. Review... ...AI, seeks detail-oriented English speakers for freelance AI evaluation projects. You will roleplay conversations with AI voice...
Freelance
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Specialist
...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,... ...platform, seeks detail-oriented English speakers for varied evaluation projects. You will assess model outputs, explain issues clearly...
Remote work
Scale AI
Ottawa, ON
2 hours ago
Remote AI Media Evaluator
$15 per hour
...Outlier, an AI training platform operated by Scale AI, is seeking detail-oriented English speakers to review AI-generated media and evaluate model performance. You’ll engage in live conversations with AI voice models, rate responses, and write concise explanations. Work...
Hourly pay
Weekly pay
Remote work
Flexible hours
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Specialist
...Review AI-generated media remotely for Outlier using fluent English, careful observation, and evidence-based written feedback on your own schedule... ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess voice conversations, images, videos...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Expert
...Review AI-generated media with Outlier using sharp visual judgment and clear English writing, remotely... ...Scale AI’s training projects by evaluating model outputs. You will roleplay conversations... ...Write evidence-based explanations of evaluation decisions Requirements: Fluent...
Remote work
Flexible hours
Scale AI
Ottawa, ON
2 hours ago
Remote AI Media Evaluator
...Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and clear written explanations. Evaluate voices, images, and videos for quality. Outlier, Scale... ...specific explanations supporting evaluation decisions Requirements: Fluent...
For contractors
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Voice and Media Evaluator
...Evaluate AI voice models and generated media remotely on your own schedule, using fluent English and close attention to detail. Review conversations, images... ...problems, and explain findings in writing. Your evaluations support feedback that helps AI systems improve in real...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Voice and Media Evaluator
...Review AI voice models and generated media remotely with Outlier, using fluent English, careful listening,... ...your own schedule. Outlier Experts evaluate model performance across voice, image... ..., and attention to detail support evaluations that help improve advanced AI systems...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Voice and Media Evaluator
...Evaluate AI voice, image, and video outputs remotely on your own schedule using fluent English... ...attention to detail. Review conversations and media while explaining decisions clearly in... ...-oriented English speakers for varied evaluation projects. You will roleplay live conversations...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Specialist
...Review AI-generated images, videos, and voices remotely while applying strong English communication and close attention to detail... ...operated by Scale AI, seeks detail-oriented English speakers for AI media evaluation. You will assess model outputs, explain quality issues, and...
Freelance
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Reviewer
...Review AI-generated media remotely for Outlier, using English communication and close attention to detail on your own schedule. Outlier,... ...operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess voice conversations, images, videos...
Remote work
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Specialist
...Evaluate AI voice, image, and video outputs remotely on your own schedule while applying fluent... ...Expert, you will review AI-generated media and provide evidence-based feedback. You... ...assess adherence, quality, and realism. Your evaluations support AI training and improvement...
Remote work
Flexible hours
Scale AI
Ottawa, ON
2 hours ago
AI Media Evaluation Specialist
...Review AI-generated media for Outlier remotely, using fluent English, careful listening, and precise... ...for AI training projects. You will evaluate voice conversations, images, videos, captions... ...advanced AI systems through Outlier’s evaluation loop and supports better real-world...
Remote work
Scale AI
Ottawa, ON
2 hours ago
Physician (MD/DO) - Medical AI Evaluation
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...
Part time
For contractors
Remote work
Flexible hours
Mindrift
Ottawa, ON
4 days ago
Copy of Software Developer - AI Coding Assistant Evaluation
$100 per hour
...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve... ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining...
Hourly pay
Contract work
Freelance
Remote work
Worldwide
10 hours per week
Lifted, an Upwork Company™
Ottawa, ON
1 day ago
Media Buyer / Creative Strategist
...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,... ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects...
Full time
Sweat Pants Agency
Ottawa, ON
12 days ago
MEDIA RELATIONS OFFICER / ATTACHE.E DE PRESSE
$68.54k - $97.22k per year
...11/2026 JOB SUMMARY You are responsible for serving as the media spokesperson for Transit Services, organizing media relations activities... ..., audience analysis, public consultation and communications evaluation techniques Media relations strategies, media protocols,...
Full time
Temporary work
Local area
Immediate start
Shift work
City of Ottawa
Ottawa, ON
1 day ago
Program Manager (Temporary)
$107.5k - $134.38k per year
...Family: Academic Program Management # of Open Positions: 1 Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A Date Posted (YYYY/MM/DD): 2026/10/08 Applications must be received...
Permanent employment
Temporary work
For contractors
Interim role
Work at office
University of Ottawa
Ottawa, ON
1 day ago
Search Engine Evaluator - French (Canada)
usd15 per hour
...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday... ...data used by major search engines, social media sites, streaming platforms and more....
Weekly pay
Full time
Part time
Freelance
Second job
Remote work
Work from home
Home office
Flexible hours
Rws
Ottawa, ON
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Media Evaluation Analyst. Be the first to apply!