AI Media Evaluation Analyst
Scale AI
Review AI-generated media remotely on your own schedule, using English communication and close attention to detail to evaluate model outputs carefully.
Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI training projects. You will roleplay conversations with AI voice models, compare images and videos, inspect outputs closely, and explain findings in writing. Your feedback supports AI systems that learn and improve.
Key Responsibilities:
- Conduct scenario-based English conversations with AI voice models
- Rank speech for naturalness, usefulness, and clarity
- Compare generated images and videos against prompts
- Inspect outputs for artifacts, motion, text, and audio issues
- Write evidence-based explanations of evaluation decisions
Requirements:
- Fluent English and strong written communication
- Exceptional attention to detail and patience
- Comfort with natural conversational speech
- Experience writing concise evidence-based reviews
- Valid ID, mobile phone, resume, and LinkedIn profile
Apply your English communication and media evaluation skills as an Outlier contributor reviewing images, video, and voice outputs.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Media Evaluation Analyst in Montréal, QC vacancy
- ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...SuggestedPart timeFor contractorsRemote workFlexible hours
- ...Position Title: Senior AI Analyst (T & I) (Telework/Hybrid) Status of Employment: Contractee... ...the next-generation public service media organization. Technology &... ...cloud architectures. Help fine-tune, evaluate and integrate large language models (LLMs...SuggestedLong term contractFull timeInternshipWork at officeImmediate startRemote work
$110k - $120k per year
...N2P Systems is seeking an experienced AI Support Analyst to join our enterprise technology delivery team in Montreal, Quebec, Canada. At N2P Systems, you will put 3-5 years of hands-on experience with Technical Support, Enterprise Application Support and Microsoft 365 to work...SuggestedFull timeShift work- ...the strength of our geographic diversity, greater resilience, and seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our people, it brings an opportunity to shape truly boundaryless career paths in...SuggestedHourly payFull timeWork at officeLocal area3 days per week
- ...VALNET Investment & AI Operations Analyst Location: Onsite – Montreal Who We Are Valnet is a fast-growing digital media company where innovation, autonomy, and execution are... ...financial models and ad hoc analyses to evaluate new revenue initiatives (direct deals,partnerships...SuggestedFull time
- ...AI SUPPORT ANALYST – GENERATIVE AI, M365 & TECHNICAL SUPPORT ROLE SUMMARY We are seeking a Level 2.5 AI Support Analyst to act as the front line for end-user AI, answering user questions across the firm's AI portfolio and capturing every query in a structured way....Permanent employmentShift work
- ...TEHORA est présentement à la recherche d'un Analyste d’affaires senior CARE AI ayant d’excellentes aptitudes techniques, d’excellentes connaissances... ...fonctionnels, les exigences techniques et les critères d'évaluation pour un appel de soumissions; Proposer un séquencement...Hourly payFull timeContract workApprenticeshipInternshipRemote workFlexible hours
- ...sustainable, more inclusive world. Ideal Candidate A Data Analyst / Operations Analyst / IT Asset Management Analyst with strong Excel... ...updates. Identify automation opportunities using Python and AI to improve processes. Required Skills Python scripting (maintenance...Permanent employmentFull timeLocal area
- ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers...Work at officeFlexible hours
- ...développement de projets majeurs en énergie, infrastructures et ressources naturelles. Nous recherchons actuellement un(e) leader senior en évaluation environnementale souhaitant jouer un rôle clé dans la réalisation et le positionnement de projets structurants au Québec et à l’...Local areaFlexible hoursDay shift
- ...express yourself and make your mark. We’re looking for a Social Media Manager who lives and breathes social, understands fashion and... ...and a natural ability to capture a brand's voice. Comfort using AI and emerging creative tools to work smarter, move faster and push...Full timeContract workPart timeFlexible hours
- ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,... ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects...Full time
- (18-month contract) The Paid Media Specialist plays a key role in developing and executing integrated media plans across all available... ..., identifying optimization opportunities to achieve KPIs and evaluating overall results while providing insights to shape future strategies...Full timeContract workPart timeInternshipFlexible hours
- ...We are looking for an Application Support Analyst who brings a balanced mix of production support, business analysis, and technical development skills, enhanced by the use of AI tools and automation techniques. In this role, you will ensure the stability of business-critical...Full time
$140k - $160k per year
...is a next-generation data and AI consulting firm dedicated to accelerating... ...data engineers, AI engineers, analysts, and digital experts to solve... ...SMART objectives, run proper evaluations, and keep the team engaged.... ...in consulting, technology, media, or a related field. ~...Full time- ...leur conception ( safe-by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le départ pour être à la fois... ...les modèles de langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante chaque affirmation concernant...ApprenticeshipWork at officeFlexible hoursDay shift
- ...modèle. Renseignements sur l’équipe Les Services-conseils en évaluation d’entreprises et modélisation se spécialisent dans la résolution... ...and hiring teams will utilize human screening combined with AI technology to help identify the skills and qualities that matter...Permanent employmentApprenticeshipWork at officeLocal areaFlexible hoursDay shift
- ...connected future through world-class networks, AI-powered solutions, and digital experiences... ...Why join us? At Bell, you'll join the Media program and become part of a team... ...Assisting with end-to-end sales processes and evaluating performance to help us remain Canada’s #1...InternshipWork at office3 days per week
- ...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence... ..., and deliver transformational growth. WPP Media is WPP's AI-driven media operating unit, bringing together media, data, and partnerships...Work at officeFlexible hours
- ...re building a more connected future through world-class networks, AI-powered solutions, and digital experiences that elevate how people... ...one of the most exciting and ever-changing industries. On the Bell Media team you will be a part of creating and delivering the best...Full timeWork at office3 days per week
- ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation... ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between...Daily paidFull timeTemporary workWork at officeRemote work
- ...Media buying is now the easy part. In 2026, the buying itself is piping. The levers that actually move a DTC account are creative, offer... ...believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects...Full timeRemote workWorldwide
- Votre opportunité Axés sur la santé, la sécurité, la qualité et l’éthique, nos experts dirigent la réalisation de projets avec de la détermination, un esprit créatif et une vision de croissance. Présents partout dans le monde et comptant des professionnels dans plus de 20...Full timeContract workTemporary workPart timeWork at office
- ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes...Permanent employmentApprenticeshipWork at office
- ...tirant parti d’informations exactes. En tant que membre de l’équipe Évaluation, voilà ce que vous contribuerez à rendre possible. Vous serez... ...; un titre d’expert en évaluation d’entreprises (EEE) ou d’analyste financier agréé (CFA), ou être en voie d’obtenir l’un ou l’...Daily paidWeekend work
- ...Behavox Behavox is a cloud-native AI company providing an... ...About the Role The Senior FP&A Analyst owns Behavox's core financial... ...models behind every acquisition — evaluating targets, running diligence,... ...entity models behind acquisition evaluation and due diligence, and folds...Long term contractTemporary workWork at officeImmediate startWorldwide
- ...About the Role Recruiting Analysts are foundational members of the recruiting... ...technology, data, and AI-enabled tools alongside human... ...meet you. What You’ll Do Evaluate resumes against role requirements... ...effective prompting, critical evaluation of AI outputs, and appropriate...Hourly payFull timeContract workWork at officeLocal area
- ...value chains in Products, Communications, Media, High Tech, Aerospace & Defense, Chemicals,... ...of the Configuration Mangement/PLM Senior Analyst may include: Requirements & Specifications... ...technology and leadership in cloud, data and AI with unmatched industry experience,...Hourly payFull timeInternshipWork at officeLocal area
$43.7 - $62.83 per hour
École de technologie supérieure - ETS Analyste d’affaires NUMÉRO D'AFFICHAGE: 26-27/177 STATUT D'EMPLOI: Temporaire jusqu'au 22 décembre... ...d’affaires, vous agirez comme personne-ressource dans l’évaluation et l’orientation des solutions technologiques. Grâce à votre compréhension...Daily paidTemporary workApprenticeshipSummer workRemote workMonday to friday- ...About WPP Media WPP is the trusted growth partner for the world’s leading brands. With exceptional talent, trusted data and intelligence... ..., and deliver transformational growth. WPP Media is WPP's AI-driven media operating unit, bringing together media, data, and partnerships...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Media Evaluation Analyst. Be the first to apply!
