AI Media Evaluation Specialist
Scale AI
Review AI-generated media remotely on your own schedule using fluent English, careful judgment, and detailed written feedback. Evaluate voices, images, and videos against prompts.
As an Outlier Expert, you will help Scale AI’s platform improve advanced models through structured evaluation and feedback. Work includes conversational voice assessments, image and video comparisons, artifact detection, and evidence-based explanations. You will also label video actions and assess speech when assigned.
Key Responsibilities:
- Roleplay live conversations with English AI voice models
- Rank voice exchanges for naturalness, usefulness, and clarity
- Compare generated images and videos against prompts
- Inspect outputs for visual, motion, text, and audio problems
- Explain ratings with specific written evidence
Requirements:
- Fluent English and strong written communication
- Strong attention to detail and patience
- Comfort with natural conversational scenarios
- Experience writing short evidence-based reviews
- Valid identification, mobile phone, resume, and LinkedIn profile
Apply your English communication, media judgment, and detailed observation skills to evaluate AI outputs for Outlier remotely.
#J-18808-Ljbffr- ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task... ...EHR vignettes for a medical AI evaluation project. General and internal medicine...SuggestedPart timeFor contractorsRemote workFlexible hours
- ...Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos. Outlier, an AI training platform... ...issues in writing, and support evaluation and feedback for advanced AI...SuggestedRemote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,... ...platform, seeks detail-oriented English speakers for varied evaluation projects. You will assess model outputs, explain issues clearly...SuggestedRemote work
- ...Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based judgment. Evaluate voices, images, and videos carefully. As an Outlier Expert... ...specific explanations supporting evaluation decisions Requirements: Fluent...SuggestedRemote work
- ...Evaluate AI-generated media remotely on your own schedule using careful observation and clear English writing. Review voices, images, videos, and... ...explain specific issues in writing. Your feedback supports evaluation loops that improve advanced AI systems. Key Responsibilities...SuggestedRemote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and clear written reasoning. Review voice,... ...communication and media-review judgment to help Outlier improve advanced AI systems through structured evaluations. #J-18808-LjbffrRemote work
- ...Evaluate AI-generated images, videos, and voices remotely while applying strong English communication... ...English speakers to assess AI-generated media. You will roleplay conversations with AI... ..., visual judgment, and audio evaluation skills to improve AI systems through Outlier...Remote work
- ...Evaluate AI voice, image, and video outputs remotely on your own schedule while applying fluent... ...Expert, you will review AI-generated media and provide evidence-based feedback. You... ...assess adherence, quality, and realism. Your evaluations support AI training and improvement...Remote workFlexible hours
- ...Review AI-generated media for Outlier remotely, using fluent English, careful listening, and precise... ...for AI training projects. You will evaluate voice conversations, images, videos, captions... ...advanced AI systems through Outlier’s evaluation loop and supports better real-world...Remote work
- ...Review AI-generated images, videos, and voices remotely while applying strong English communication and close attention to detail... ...operated by Scale AI, seeks detail-oriented English speakers for AI media evaluation. You will assess model outputs, explain quality issues, and...FreelanceRemote work
- ...Evaluate AI-generated media remotely for Outlier, using fluent English, careful observation, and clear written explanations on your own schedule.... ...LinkedIn profile Apply your English communication and media evaluation skills to help Outlier improve advanced AI systems through...Remote work
- ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,... ...by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess generated media, explain issues in...Remote work
$100 per hour
...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve... ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining...Hourly payContract workFreelanceRemote workWorldwide10 hours per week- ...We are looking for an experienced, hands-on Freelance Paid Media Specialist to manage and optimise paid social campaigns for an established B2B technology company. You will work closely with the Demand Generation team to improve campaign performance across the customer...Freelance
- ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,... ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects...Full time
$77.95k - $96.29k per year
...As a Marketing Communications Specialist for PCL's Defence... ...materials. Develops social media content and applies an understanding... ...and the ability to measure and evaluate marketing and communications performance... ...of artificial intelligence (AI) to screen, assess, or select...Long term contractWork at officeImmediate startFlexible hours- ...Job Description Job Description NetSuite & Business Systems Specialist BPG Co-Op | Ottawa, Ontario | Part-Time Contract (10–20 hours per week, initially) Looking for a role where you can make an impact and keep things running seamlessly behind the scenes? BPG Co-...Long term contractContract workPart timeFor contractors10 hours per week
$68.54k - $97.22k per year
...11/2026 JOB SUMMARY You are responsible for serving as the media spokesperson for Transit Services, organizing media relations activities... ..., audience analysis, public consultation and communications evaluation techniques Media relations strategies, media protocols,...Full timeTemporary workLocal areaImmediate startShift work$107.5k - $134.38k per year
...Family: Academic Program Management # of Open Positions: 1 Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A Date Posted (YYYY/MM/DD): 2026/10/08 Applications must be received...Permanent employmentTemporary workFor contractorsInterim roleWork at officeusd15 per hour
...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday... ...data used by major search engines, social media sites, streaming platforms and more....Weekly payFull timePart timeFreelanceSecond jobRemote workWork from homeHome officeFlexible hours- ...This role is Hybrid Ottawa AI Solutions Engineer Position... ...options analysis, specifically evaluating the performance and reliability... ...experience as a Software Specialist within an Integrated Product... ...decisions, including candidate evaluation, selection, and disposition,...Long term contractFull timeTemporary workLocal areaWorldwide
$85k - $111.3k per year
...maintained through Generative AI and agentic software engineering... ...developers, architects, AI specialists, and domain experts, you will... ...use cases, prototype solutions, evaluate their impact on development efficiency... ...repeatable benchmarks and evaluation methods to assess AI agent...Long term contractFull timeTemporary workManual labor$85k - $125k per year
...Thales has a vacancy for an Obsolescence Specialist who is dedicated to providing Integrated... ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled... ...All hiring decisions, including candidate evaluation, selection, and disposition, are made by...Long term contractFull timeContract workTemporary workWork at officeLocal area$110k - $130k per year
...has a vacancy for an AJISS Reliability Specialist will focus on in-service support for the... ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools... ...hiring decisions, including candidate evaluation, selection, and disposition, are made by...Long term contractFull timeContract workTemporary workWork at officeLocal areaWork from homeWorldwide$76.1k - $96.14k per year
...promoting campus. The HPS (health promo specialist) must provide direct interventions with students... ..., implementation, delivery and evaluation of interactive and evidence-informed wellness... ...Lead in maintaining Health Promo’s social media and assist in web presence. Prepare...Permanent employmentFull timeTemporary workFor contractorsWeekend workAfternoon shift- ...with around 50 DTC and eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1 to $2M a month on Google... ...scripts, reporting, whatever removes the constraint. We are heavy AI users and we expect you to build, not just prompt. You are a...Remote workWorldwideShift work
$120k - $140k per year
...Thales has a vacancy for a Cyber Security Specialist (Detection Engineer) is responsible for... ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled tools... ...hiring decisions, including candidate evaluation, selection, and disposition, are made by...Long term contractFull timeTemporary workLocal areaWorldwide$75k - $125k per year
...Description: We are seeking Intermediate Agentic AI Developers / AI Engineers to support an AI... ...workflow orchestration capabilities. Evaluate, troubleshoot, and optimize AI agent... ...production AI applications, including testing, evaluation, monitoring, and responsible AI practices....Full time$20 per hour
...feeling like a pro. As an Athlete Highlight Specialist (AHS), you are responsible for capturing... ...Brodie League's storytelling and social media presence. Your work extends the... ...process, including to screen, assess, or evaluate applicants. POSITION STATUS This...Hourly payLong term contractPermanent employmentPart timeShift workNight shiftWeekend workAfternoon shift$95.59k - $120.75k per year
...world. Position Purpose The Senior Specialist, Executive Development plays an important... ...prospective donors, including through social media. Networking: Actively networks at... ...and international level. Performance Evaluation and Reporting: Prepares and submits monthly...RemplacementLong term contractPermanent employmentTemporary workFor contractorsFlexible hoursAfternoon shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Media Evaluation Specialist. Be the first to apply!
- social media manager Ottawa, ON
- remote social media marketing manager Ottawa, ON
- work from home social media manager Ottawa, ON
- social media marketing manager Ottawa, ON
- social media manager no experience Ottawa, ON
- gestionnaire des médias sociaux Ottawa, ON
- social media community manager Ottawa, ON
- social media manager
- remote social media marketing manager
- work from home social media manager


