Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Content Evaluator

Scale AI

Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and evidence-based written feedback.

Outlier, Scale AI’s AI training platform, seeks detail-oriented English speakers to assess voice, image, video, and audio outputs. You will roleplay conversations, compare media against prompts, identify artifacts, and explain decisions clearly. Your evaluations support model improvement.

Key Responsibilities:

  • Conduct live scenario-based conversations with AI voice models
  • Compare generated images and videos against text prompts
  • Inspect outputs for visual, motion, text, and audio problems
  • Rate adherence, quality, realism, and conversational performance
  • Write specific English explanations supporting evaluation decisions

Requirements:

  • Fluent English with clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing short evidence-based explanations
  • Ability to decide when both options have flaws

Apply your English communication, media judgment, and careful analysis to evaluate AI outputs for Outlier projects.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Content Evaluator in Montréal, QC vacancy
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...medical AI evaluation, clinical content or exam-question review, or medical... 
    Remote work
    Content
    Part time
    For contractors
    Flexible hours

    Mindrift

    Montréal, QC
    4 days ago
  •  ...system spans everything from Paid Media and Content Marketing, to PR and Paid Social, to...  ...industry trends, including actively learning how AI and automation can enhance marketing and...  ...! Work Environment Requirements As a remote-first company, you’ll have the ability to... 
    Remote work
    Content
    Work at office
    Work from home
    Home office

    Directive

    Montréal, QC
    8 days ago
  • $23 per hour

     ...than 1 year Hybrid Work must be completed both in person and remotely. Internship This position is a paid internship that...  ...and information purposes Develop communication strategies Evaluate communication strategies and programs Design market research... 
    Remote work
    Content
    Full time
    Contract work
    Internship

    Diversité Artistique Montréal

    Montréal, QC
    5 days ago
  •  ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers... 
    Suggested
    Work at office
    Flexible hours

    Totem recruteur de talent

    Montréal, QC
    8 days ago
  • $23 per hour

     ...certificate Tasks Develop all kinds of events for publicity, fundraising and information purposes Develop communication strategies Evaluate communication strategies and programs Design market research questionnaires Develop feasibility studies Develop marketing... 
    Content
    Temporary work
    Internship

    Diversité Artistique Montréal

    Montréal, QC
    5 days ago
  •  ...développement de projets majeurs en énergie, infrastructures et ressources naturelles. Nous recherchons actuellement un(e) leader senior en évaluation environnementale souhaitant jouer un rôle clé dans la réalisation et le positionnement de projets structurants au Québec et à l’... 
    Local area
    Flexible hours
    Day shift

    Hatch

    Montréal, QC
    1 day ago
  •  ...leur conception ( safe-by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le départ pour être à la fois...  ...les modèles de langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante chaque affirmation concernant... 
    Apprenticeship
    Work at office
    Flexible hours
    Day shift

    LoiZéro

    Montréal, QC
    a month ago
  •  ...modèle. Renseignements sur l’équipe   Les Services-conseils en évaluation d’entreprises et modélisation se spécialisent dans la résolution...  ...and hiring teams will utilize human screening combined with AI technology to help identify the skills and qualities that matter... 
    Permanent employment
    Apprenticeship
    Work at office
    Local area
    Flexible hours
    Day shift

    Deloitte

    Montréal, QC
    1 day ago
  •  ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation...  ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between... 
    Remote work
    Daily paid
    Full time
    Temporary work
    Work at office

    JLL

    Montréal, QC
    4 days ago
  • Votre opportunité Axés sur la santé, la sécurité, la qualité et l’éthique, nos experts dirigent la réalisation de projets avec de la détermination, un esprit créatif et une vision de croissance. Présents partout dans le monde et comptant des professionnels dans plus de 20...
    Full time
    Contract work
    Temporary work
    Part time
    Work at office

    Stantec

    Montréal, QC
    1 day ago
  •  ...Job Description : As the Director, Content Strategy & Discoverability for Sun Life Canada, you will lead and activate compelling digital content to drive brand awareness, consideration, and conversion across our Health, Wealth, and Protection businesses. You will champion... 
    Content
    Internship
    Worldwide

    Sun Life

    Montréal, QC
    1 day ago
  •  ...gastroenterology, in addition to products and services across its Allergan Aesthetics portfolio. We have an opportunity for a Manager, Content Production & Operations to join AbbVie Canada's Internal Agency within Customer Excellence. Reporting to the Internal Agency Lead,... 
    Content
    Full time
    For contractors
    Freelance

    AbbVie

    Montréal, QC
    4 days ago
  •  ...AbbVie seeks a Manager, Content Production & Operations for its Montreal office to lead a multidisciplinary content team within the Internal Agency. The role oversees project delivery, team development, resource planning, and strategic guidance to translate business needs... 
    Content
    Freelance
    Work at office

    AbbVie

    Montréal, QC
    6 days ago
  •  ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes... 
    Permanent employment
    Apprenticeship
    Work at office

    Veriforce

    Montréal, QC
    12 days ago
  • $60 - $120 per hour

     ...AI & Software Engineers – Remote Opportunities Full-Time & Flexible Contract Options | Remote $60 - $120 per hour We are recruiting for multiple opportunities with a fast-growing AI technology business working on advanced AI systems and software engineering projects... 
    Remote job
    Hourly pay
    Full time
    Contract work
    Flexible hours

    Andrews Recruitment Group

    Montréal, QC
    a month ago
  •  ...campagnes. Établir des indicateurs de succès, évaluer la performance des campagnes et...  ...écrit qu'à l'oral. Manager, Brand & Content Altitude Sports is a Montreal-based...  ...campaigns. Establish success metrics, evaluate campaign performance, and monitor brand health... 
    Content
    Permanent employment
    Full time
    Contract work
    Local area

    Altitude Sports

    Montréal, QC
    5 days ago
  •  ...this range to apply as well. Salary range (but not limited to): 54,900 - 67,100  About the role Do you enjoy transforming content into effective, accessible, and consistent digital experiences? Join our Broker Marketing and Communications team at Canada’s largest... 
    Content
    Contract work

    Intact Financial Corporation

    Montréal, QC
    1 day ago
  •  ...Position Title: Senior AI Analyst (T & I) (Telework/Hybrid)...  ...At CBC/Radio-Canada, we create content that informs, entertains and connects...  ...with a mix of in-office and remote work. Work arrangements will be...  ...architectures. Help fine-tune, evaluate and integrate large language... 
    Remote work
    Content
    Long term contract
    Full time
    Internship
    Work at office
    Immediate start

    CBC/Radio-Canada

    Montréal, QC
    1 day ago
  •  ...Company Description NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute across our portfolio of film, television, and streaming, and bring to life through our global theme park destinations, consumer... 
    Content
    Daily paid
    Full time
    Local area

    NBCUniversal

    Montréal, QC
    4 days ago
  •  ...Job Description Job Description Job Title: AI/ML Architect Location: Montreal, QC Duration: 12 Months   Responsibilities...  ...software architecture of new analytical and AI tools; ·        Evaluate in a structured manner technological components or libraries... 

    Adient One LLC.

    Montréal, QC
    2 days ago
  •  ...Description École de technologie supérieure – ETS Conseillère ou Conseiller en gestion et en évaluation de programmes d’études NUMÉRO D'AFFICHAGE: 26-27/176 CATÉGORIE D'EMPLOI: Professionnel STATUT D'EMPLOI: Remplacement- 12 mois avec possibilité de prolongation... 
    Daily paid
    Remplacement
    Monday to friday

    École de technologie supérieure

    Montréal, QC
    8 days ago
  • $140k - $160k per year

     ...Artefact is a next-generation data and AI consulting firm dedicated to accelerating the...  ...behavior. Set SMART objectives, run proper evaluations, and keep the team engaged. Coach...  ...contribute to new business proposals and content development (research, articles, business... 
    Content
    Full time

    Artefact

    Montréal, QC
    4 days ago
  • $90.85k - $140.85k per year

     ...AI Transformation Associate Manager We Are: Accenture Song accelerates growth and value...  ...and marketing strategy; and campaign, content and channel orchestration. With strong client...  ...technology delivery alone. Develop and evaluate transformation approaches, weighing trade-... 
    Content
    Full time
    Work at office
    Local area

    Accenture Global

    Montréal, QC
    5 days ago
  • $108.8k - $220.4k per year

     ...As an experienced and senior AI/LLM Architect, you will play a...  ...across the practice. You will evaluate, select, and apply the right design...  ...sources, and domain-specific content — to ground AI systems in the...  ...identity, policies, and evaluation metrics. Design, implement,... 
    Content
    Full time
    Work at office
    Local area

    Accenture Global

    Montréal, QC
    5 days ago
  • $180k - $230k per year

     ...better enabling teams to deliver complex capital projects.  The AI buildout runs on physical things: data centers, power, and the...  ...timeline amelioration for major projects.  ~ Continuous improvement: Evaluate models repeatedly and prototype methods and new models to improve... 
    Full time
    For contractors
    Internship
    Work at office

    Foresight Works Ltd

    Montréal, QC
    4 days ago
  •  ...Localisation: Partout au Québec Nous recherchons un(e) spécialiste en milieux humides et végétation, possédant une expertise en évaluation environnementale. La personne retenue apportera un soutien technique pour les études environnementales, les évaluations d'impact et... 
    Full time
    Flexible hours

    AtkinsRéalis

    Montréal, QC
    12 days ago
  • $212.73k - $262.73k per year

     ...Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive...  ...executive North Star architecture. Add new content and reusable components back to the shared...  ...) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout... 
    Content
    Full time

    Salesforce

    Montréal, QC
    4 hours ago
  • usd16 - usd50 per hour

     ...We are looking for AI Data Specialists to support the improvement of AI-generated content in French from Canada. Job Type: Freelance Location: Remote anywhere Work Schedule: Part-time - 10+ hours...  ...tasks, including: - Data collection, evaluation, and annotation. - Pairwise... 
    Remote work
    Content
    Hourly pay
    Full time
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Rws

    Montréal, QC
    15 days ago
  •  ...the first Sony game development team in Canada. The Role We are seeking an incredibly organized, logistics-driven Character Content Manager to ensure our Character Art pipeline runs efficiently. You do not need to be a formal people manager. Instead, your... 
    Content
    Internship

    PlayStation Global

    Montréal, QC
    a month ago
  •  ...des cadres d’essais A/B afin d’évaluer l’efficacité de diverses...  ............. Position: AI Specialist/Developer Location...  ....g., collaborative filtering, content-based, deep learning) to deliver...  ...manage A/B testing frameworks to evaluate the effectiveness of various recommendation... 
    Content
    Permanent employment
    Apprenticeship
    Flexible hours

    Services de Gestion Quantum Ltée

    Montréal, QC
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Content Evaluator. Be the first to apply!