AI Media Evaluation Specialist
Scale AI
Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based judgment. Evaluate voices, images, and videos carefully.
As an Outlier Expert, you will assess AI outputs across varied projects for Scale AI’s training platform. You will roleplay conversations with AI voice models, compare generated media, and explain findings in writing. The work supports feedback that helps AI systems improve.
Key Responsibilities:
- Conduct live English conversations with AI voice models
- Rank speech for naturalness, usefulness, and clarity
- Compare images and videos against text prompts
- Inspect outputs for visual, motion, text, and audio problems
- Write specific explanations supporting evaluation decisions
Requirements:
- Fluent English and strong written communication skills
- Strong attention to detail and patience
- Comfort with natural conversational situations
- Experience writing short evidence-based reviews
- Comfort making clear decisions when options have flaws
Apply English communication, detailed observation, and media judgment to evaluate AI outputs as an Outlier Expert.
#J-18808-Ljbffr- ...Review AI-generated media remotely on your own schedule, using English communication and careful visual and audio evaluation skills. Help assess voices, images, and videos. Outlier, operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects....SuggestedRemote workFlexible hours
- ...Evaluate AI-generated images, videos, and voices remotely while applying strong English communication... ...English speakers to assess AI-generated media. You will roleplay conversations with AI... ..., visual judgment, and audio evaluation skills to improve AI systems through Outlier...SuggestedRemote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and clear written reasoning. Review voice,... ...communication and media-review judgment to help Outlier improve advanced AI systems through structured evaluations. #J-18808-LjbffrSuggestedRemote work
- ...Review AI-generated images, videos, and voices remotely while applying strong English communication and close attention to detail... ...operated by Scale AI, seeks detail-oriented English speakers for AI media evaluation. You will assess model outputs, explain quality issues, and...SuggestedFreelanceRemote work
- ...Evaluate AI voice, image, and video outputs remotely on your own schedule while applying fluent... ...Expert, you will review AI-generated media and provide evidence-based feedback. You... ...assess adherence, quality, and realism. Your evaluations support AI training and improvement...SuggestedRemote workFlexible hours
- ...Review AI-generated media for Outlier remotely, using fluent English, careful listening, and precise... ...for AI training projects. You will evaluate voice conversations, images, videos, captions... ...advanced AI systems through Outlier’s evaluation loop and supports better real-world...Remote work
- ...Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos. Outlier, an AI training platform... ...issues in writing, and support evaluation and feedback for advanced AI...Remote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,... ...platform, seeks detail-oriented English speakers for varied evaluation projects. You will assess model outputs, explain issues clearly...Remote work
- ...Review AI-generated media remotely for Outlier using fluent English, careful observation, and evidence... ...-oriented English speakers for AI evaluation projects. You will assess voice conversations... ...feedback skills as an AI Media Evaluation Specialist with Outlier. #J-18808-LjbffrRemote work
- ...Evaluate AI-generated media remotely for Outlier, using fluent English, careful observation, and clear written explanations on your own schedule.... ...LinkedIn profile Apply your English communication and media evaluation skills to help Outlier improve advanced AI systems through...Remote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,... ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess generated media, explain issues in...Remote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based written feedback. Review voices... ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess natural conversations, compare...Remote work
- ...Evaluate AI-generated media for Outlier remotely, using fluent English, careful listening, and precise written feedback on model outputs. Set your own schedule. As an AI Media Evaluation Specialist, you will assess voice conversations, images, videos, captions, and generated...Remote work
- ...Evaluate AI-generated media in English with careful judgment, strong written communication, and flexible remote work on your own schedule. Review... ...communication and media judgment skills to help Outlier improve advanced AI systems through structured evaluation. #J-18808-LjbffrRemote workFlexible hours
- ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task... ...EHR vignettes for a medical AI evaluation project. General and internal medicine...Part timeFor contractorsRemote workFlexible hours
- ...We are looking for an experienced, hands-on Freelance Paid Media Specialist to manage and optimise paid social campaigns for an established B2B technology company. You will work closely with the Demand Generation team to improve campaign performance across the customer...Freelance
$100 per hour
...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve... ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining...Hourly payContract workFreelanceRemote workWorldwide10 hours per week- ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,... ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects...Full time
$77.95k - $96.29k per year
...As a Marketing Communications Specialist for PCL's Defence... ...materials. Develops social media content and applies an understanding... ...and the ability to measure and evaluate marketing and communications performance... ...of artificial intelligence (AI) to screen, assess, or select...Long term contractWork at officeImmediate startFlexible hours$68.54k - $97.22k per year
...11/2026 JOB SUMMARY You are responsible for serving as the media spokesperson for Transit Services, organizing media relations activities... ..., audience analysis, public consultation and communications evaluation techniques Media relations strategies, media protocols,...Full timeTemporary workLocal areaImmediate startShift work$107.5k - $134.38k per year
...Family: Academic Program Management # of Open Positions: 1 Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A Date Posted (YYYY/MM/DD): 2026/10/08 Applications must be received...Permanent employmentTemporary workFor contractorsInterim roleWork at officeusd15 per hour
...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday... ...data used by major search engines, social media sites, streaming platforms and more....Weekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours- ...This role is Hybrid Ottawa AI Solutions Engineer Position... ...options analysis, specifically evaluating the performance and reliability... ...experience as a Software Specialist within an Integrated Product... ...decisions, including candidate evaluation, selection, and disposition,...Long term contractFull timeTemporary workLocal areaWorldwide
$85k - $111.3k per year
...maintained through Generative AI and agentic software engineering... ...developers, architects, AI specialists, and domain experts, you will... ...use cases, prototype solutions, evaluate their impact on development efficiency... ...repeatable benchmarks and evaluation methods to assess AI agent...Long term contractFull timeTemporary workManual labor$85k - $125k per year
...Thales has a vacancy for an Obsolescence Specialist who is dedicated to providing Integrated... ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled... ...All hiring decisions, including candidate evaluation, selection, and disposition, are made by...Long term contractFull timeContract workTemporary workWork at officeLocal area$110k - $130k per year
...has a vacancy for an AJISS Reliability Specialist will focus on in-service support for the... ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools... ...hiring decisions, including candidate evaluation, selection, and disposition, are made by...Long term contractFull timeContract workTemporary workWork at officeLocal areaWork from homeWorldwide$76.1k - $96.14k per year
...promoting campus. The HPS (health promo specialist) must provide direct interventions with students... ..., implementation, delivery and evaluation of interactive and evidence-informed wellness... ...Lead in maintaining Health Promo’s social media and assist in web presence. Prepare...Permanent employmentFull timeTemporary workFor contractorsWeekend workAfternoon shift- ...with around 50 DTC and eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1 to $2M a month on Google... ...scripts, reporting, whatever removes the constraint. We are heavy AI users and we expect you to build, not just prompt. You are a...Remote workWorldwideShift work
$120k - $140k per year
...Thales has a vacancy for a Cyber Security Specialist (Detection Engineer) is responsible for... ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools... ...hiring decisions, including candidate evaluation, selection, and disposition, are made by...Long term contractFull timeTemporary workLocal areaWorldwide$20 per hour
...feeling like a pro. As an Athlete Highlight Specialist (AHS), you are responsible for capturing... ...Brodie League's storytelling and social media presence. Your work extends the... ...process, including to screen, assess, or evaluate applicants. POSITION STATUS This...Hourly payLong term contractPermanent employmentPart timeShift workNight shiftWeekend workAfternoon shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Media Evaluation Specialist. Be the first to apply!
- social media manager Ottawa, ON
- remote social media marketing manager Ottawa, ON
- work from home social media manager Ottawa, ON
- social media marketing manager Ottawa, ON
- social media manager no experience Ottawa, ON
- gestionnaire des médias sociaux Ottawa, ON
- social media community manager Ottawa, ON
- social media manager
- remote social media marketing manager
- work from home social media manager

