Remote AI Media Evaluator
Outlier
Evaluate AI-generated images, videos, and voice conversations remotely while applying fluent English and careful visual and audio judgment. Choose flexible hours.
Outlier seeks detail-oriented English speakers to review generated media on their own schedule. You will compare image and video pairs, assess voice exchanges, and explain issues in clear written English. Evaluation dimensions include adherence, quality, realism, naturalness, and pronunciation.
Key Responsibilities:
- Hold scenario-based conversations with AI voice models
- Rank exchanges for naturalness, usefulness, and clarity
- Compare generated images and videos against prompts
- Inspect outputs for artifacts, motion, text, and audio issues
- Write evidence-based explanations of evaluation decisions
Requirements:
- Fluent English speaking and strong written communication
- Strong attention to detail and patience
- Comfort with natural, everyday conversational speech
- Experience writing short, evidence-based explanations or reviews
- Ability to decide when both options have flaws
Use English communication, close observation, and media evaluation skills to help Outlier improve AI-generated images, videos, and voice systems remotely.
#J-18808-LjbffrVacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Media Evaluator in Toronto, ON vacancy
$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...EHR vignettes for a medical AI evaluation project. General and internal...Remote workPart timeFor contractorsFlexible hours
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct... ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations...Remote workDaily paidFull timeContract workSummer workFlexible hours- ...eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1... ...number. You can live anywhere. We are remote and we hire worldwide. The one hard requirement... ...removes the constraint. We are heavy AI users and we expect you to build, not just...Remote workWorldwideShift work
$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights...Full timeInternshipWork at officeLocal areaFlexible hoursusd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in... ...collaboration. Job Type: Freelance Location: Remote from Canada Work Schedule: Flexible... .... - Providing structured evaluations and feedback following the project instructions...Remote workHourly payDaily paidFull timeFreelanceImmediate startFlexible hours$65k - $115k per year
...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence... ..., and deliver transformational growth. WPP Media is WPP's AI-driven media operating unit, bringing together media, data, and partnerships...Work at office$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Marketing Expert — Social Media (AI Agent Environments)... ...–$100/hour Location: Remote Role Responsibilities... ...Review AI agent attempts and evaluate them against established standards...Remote jobContract workSummer work- ...KittySpout / DoggySpout is looking for a Social Media Strategist to join our team! You will own... ...vertical and customer base. We're a 100% remote, lean, senior team that moves fast, and... ...community within 24 hours. Work Smart – use AI and tools so your time goes to strategy and...Remote workFull timeWeekend work
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...accurate application of structured evaluation guidelines. Work...Remote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $39/hour Location: Remote Duration: Up to 6 months... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobContract workSummer workImmediate start$60k - $75k per year
...ROLE: MEDIA SPECIALIST TEAM: MEDIA LOCATION: TORONTO - HYBRID ONSITE 2X/WEEK COMPANY... ...people combine strategic thinking with AI-powered tools, automation and advanced... ...accountability of the media plan, regularly evaluating and monitoring execution to implement meaningful...Full timeSeasonal work$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer work$70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and...Remote jobContract workSummer work$100k - $120k per year
...This is a remote role Who We Are Marketbridge partners with leading... ...systems that connect strategy, AI, creativity, activation and... ...of developing multi-faceted media strategies that support clients... ...media plans ~ Identify and evaluate media opportunities across programmatic...Remote workLong term contractSummer workManual laborWorldwideFlexible hoursShift work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$60k - $68k per year
...PharmaGenesis, Klick Katalyst, and btwelve), Klick Media, Klick Applied Sciences (including Klick... ...and award-winning data science and AI capabilities. Founded in 1997, we have offices... ...performance reports and insights that evaluate campaign effectiveness and inform recommendations...Full time$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$22 per hour
...Greater Toronto Area | Hybrid (in-office and remote) | 20–40 hours per week | Starting pay: CAD... ...ideas into consistent, professional social-media content. This combines practical personal-... ...posting is for a current vacancy. We use AI-assisted tools to support application review...Remote workHourly payFull timePart timeWork at officeLocal area$39.75k - $66.25k per year
...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence... ..., and deliver transformational growth. WPP Media is WPP's AI-driven media operating unit, bringing together media, data, and partnerships...Work at office$170k - $220k per year
...POSITION DESCRIPTION ROLE: VICE PRESIDENT, MEDIA ( Financial Institution Experience) TEAM... ...adoption, automation, and innovation. Evaluate and invest in technologies that improve... ...agency adoption of emerging technologies, AI applications, automation solutions, and...Long term contractFull timeWork at officeFlexible hoursShift work2 days per week- ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,... ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Media Evaluator. Be the first to apply!
Related searches
- évaluateur-estimateur Toronto, ON
- admissions evaluator Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur - dessinateur Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
- test evaluator Toronto, ON
- estimateur structure Toronto, ON
- estimateur automobile Toronto, ON