Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote English AI Evaluator

Scale AI

Use fluent English and sharp attention to detail as a remote evaluator reviewing AI-generated media on your own schedule. Work independently from anywhere.

Outlier Experts support Scale AI’s training platform by evaluating model performance across voice, images, video, and audio. You will roleplay conversations, compare outputs, identify artifacts, and explain findings in clear written English. This is a 1099 freelance contract opportunity.

Key Responsibilities:

  • Hold scenario-based conversations with AI voice models
  • Compare generated images and videos against prompts
  • Inspect outputs for visual, motion, text, and audio problems
  • Rate adherence, quality, realism, and naturalness
  • Write specific evidence-based explanations in English

Requirements:

  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational speech
  • Experience writing short reviews or explanations
  • Valid identification and mobile phone

Bring careful observation, conversational English, and evidence-based judgment to Outlier’s AI evaluation projects remotely.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote English AI Evaluator in Montréal, QC vacancy
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...QA (a plus); Strong written English (C1+). This project is not... 
    Remote work
    English language skills
    Part time
    For contractors
    Flexible hours

    Mindrift

    Montréal, QC
    4 days ago
  •  ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers... 
    English language skills
    Work at office
    Flexible hours

    Totem recruteur de talent

    Montréal, QC
    8 days ago
  •  ...développement de projets majeurs en énergie, infrastructures et ressources naturelles. Nous recherchons actuellement un(e) leader senior en évaluation environnementale souhaitant jouer un rôle clé dans la réalisation et le positionnement de projets structurants au Québec et à l’... 
    Suggested
    Local area
    Flexible hours
    Day shift

    Hatch

    Montréal, QC
    1 day ago
  •  ...brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi :...  ...read, and written), bilingual French and English is an asset Demonstrated proficiency in...  ...harness the power of artificial intelligence (AI) to efficiently accelerate meaningful... 
    Remote work
    English language skills
    Daily paid
    Full time
    Temporary work
    Work at office

    JLL

    Montréal, QC
    4 days ago
  •  ...therapists who can provide psychotherapy in both English and French. This is an independent...  ...tracking software (Workable) that may include AI-assisted features to help organize, parse,...  ...avec une aisance clinique, c’est-à-dire évaluer, créer un lien thérapeutique et intervenir... 
    English language skills
    Long term contract
    Contract work
    For contractors
    Flexible hours
    Shift work

    Shift Collab

    Montréal, QC
    8 days ago
  •  ...modèle. Renseignements sur l’équipe   Les Services-conseils en évaluation d’entreprises et modélisation se spécialisent dans la résolution...  ...and hiring teams will utilize human screening combined with AI technology to help identify the skills and qualities that matter... 
    Permanent employment
    Apprenticeship
    Work at office
    Local area
    Flexible hours
    Day shift

    Deloitte

    Montréal, QC
    1 day ago
  •  ...leur conception ( safe-by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le départ pour être à la fois...  ...les modèles de langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante chaque affirmation concernant... 
    Apprenticeship
    Work at office
    Flexible hours
    Day shift

    LoiZéro

    Montréal, QC
    a month ago
  • $88k - $132k per year

     ...design, development, and testing of innovative AI solutions that deliver meaningful business...  .... Advanced proficiency in both English and French is mandatory. Ideally, You'll...  ...model validation, bias detection, performance evaluation, robustness testing, and security... 
    English language skills
    Weekend work

    Ernst & Young

    Montréal, QC
    10 days ago
  • Votre opportunité Axés sur la santé, la sécurité, la qualité et l’éthique, nos experts dirigent la réalisation de projets avec de la détermination, un esprit créatif et une vision de croissance. Présents partout dans le monde et comptant des professionnels dans plus de 20...
    English language skills
    Full time
    Contract work
    Temporary work
    Part time
    Work at office

    Stantec

    Montréal, QC
    1 day ago
  •  ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes... 
    English language skills
    Permanent employment
    Apprenticeship
    Work at office

    Veriforce

    Montréal, QC
    12 days ago
  •  ...We are presently looking for a professional translator in the English-French language pair. This job posting relates to an existing...  ...planet, while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future... 
    English language skills
    Long term contract
    Worldwide
    Flexible hours
    Weekend work

    Ernst & Young

    Montréal, QC
    19 days ago
  • $60 - $120 per hour

     ...AI & Software Engineers – Remote Opportunities Full-Time & Flexible Contract Options | Remote $60 - $120 per hour We are recruiting for multiple opportunities with a fast-growing AI technology business working on advanced AI systems and software engineering projects... 
    Remote job
    Hourly pay
    Full time
    Contract work
    Flexible hours

    Andrews Recruitment Group

    Montréal, QC
    a month ago
  • $24 per hour

     ...Alphanumeric is hiring a Bilingual Customer Care Specialist (English/French) for Pharmaceuticals to work remotely supporting one of the biggest pharmaceutical...  ...: Full-time permanent Type of work : Fully remote in Canada, preferably based in Eastern Time Zone or close... 
    Remote job
    English language skills
    Permanent employment
    Full time
    Contract work
    Work at office
    Trial period
    Monday to friday
    Flexible hours
    Shift work

    Alphanumeric Systems

    Montréal, QC
    10 days ago
  •  ...and deploy autonomous and semi autonomous AI agents to automate complex tasks across the...  ...production (monitoring, tracing, output evaluation). Actively monitor technological developments...  ...stakeholders. Bilingual (French and English). Additional Assets: Experience with... 
    English language skills
    Full time

    CGI

    Montréal, QC
    4 days ago
  •  ...Job Description Job Description Job Title: AI/ML Architect Location: Montreal, QC Duration: 12 Months   Responsibilities...  ...software architecture of new analytical and AI tools; ·        Evaluate in a structured manner technological components or libraries... 

    Adient One LLC.

    Montréal, QC
    2 days ago
  •  ...efficient, collaborative professional who helps drive projects forward. Multilingual: Proficiency in both written and spoken French and English; knowledge of any additional language is considered an asset. Additional Information What's in it for YOU: A dynamic... 
    English language skills
    Full time

    Averna

    Montréal, QC
    9 days ago
  •  ...Description École de technologie supérieure – ETS Conseillère ou Conseiller en gestion et en évaluation de programmes d’études NUMÉRO D'AFFICHAGE: 26-27/176 CATÉGORIE D'EMPLOI: Professionnel STATUT D'EMPLOI: Remplacement- 12 mois avec possibilité de prolongation... 
    Daily paid
    Remplacement
    Monday to friday

    École de technologie supérieure

    Montréal, QC
    8 days ago
  • $180k - $230k per year

     ...better enabling teams to deliver complex capital projects.  The AI buildout runs on physical things: data centers, power, and the...  ...timeline amelioration for major projects.  ~ Continuous improvement: Evaluate models repeatedly and prototype methods and new models to improve... 
    Full time
    For contractors
    Internship
    Work at office

    Foresight Works Ltd

    Montréal, QC
    4 days ago
  •  ...Position Title: Senior AI Analyst (T & I) (Telework/Hybrid)...  ...Position Language Requirement: English, French Language Skills:...  ...position with a mix of in-office and remote work. Work arrangements will be...  .... Help fine-tune, evaluate and integrate large language models... 
    Remote work
    English language skills
    Long term contract
    Full time
    Internship
    Work at office
    Immediate start

    CBC/Radio-Canada

    Montréal, QC
    1 day ago
  •  ...practices for experimentation, reproducibility, evaluation, and deployment. · Define and execute...  ...· Passion for advancing structured-data AI and building platforms that deliver real-...  ...stakeholders in Canada, functional proficiency in English is required for positions based in the... 
    Long term contract
    Permanent employment
    Full time
    Local area
    Worldwide
    Flexible hours

    SAP

    Montréal, QC
    1 day ago
  •  ...Localisation: Partout au Québec Nous recherchons un(e) spécialiste en milieux humides et végétation, possédant une expertise en évaluation environnementale. La personne retenue apportera un soutien technique pour les études environnementales, les évaluations d'impact et... 
    Full time
    Flexible hours

    AtkinsRéalis

    Montréal, QC
    12 days ago
  •  ...inspiring the future of business with AI+ Data +CRM. Leading with our...  ...élargie L’expérience sera évaluée en fonction des compétences...  ...-based, office-flexible or remote depending on the team. You may...  ...extended team Experience will be evaluated based on the core competencies... 
    Remote work
    English language skills
    Long term contract
    Full time
    Work at office
    Flexible hours

    Salesforce

    Montréal, QC
    4 days ago
  • $131.7k - $278.1k per year

     ...deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around...  ..., policy-based routing, tool invocation, evaluation harnesses, and lifecycle observability....  ...Claude, Vertex AI, and open-source models. English is required for this position as this role... 
    English language skills
    Full time
    Work at office
    Local area
    3 days per week

    Accenture Global

    Montréal, QC
    5 days ago
  • $90.85k - $140.85k per year

     ...AI Transformation Associate Manager We Are: Accenture Song accelerates growth and value...  ...technology delivery alone. Develop and evaluate transformation approaches, weighing trade-...  ...design, and workforce change. ~ English is required for this position as this role... 
    English language skills
    Full time
    Work at office
    Local area

    Accenture Global

    Montréal, QC
    5 days ago
  • $212.73k - $262.73k per year

     ...About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer...  ...What you’ll bring ~ Bilingual French & English to support relevant Canada regions. ~10+...  ...) tools to help our recruiters assess and evaluate candidates’ resumes and qualifications throughout... 
    English language skills

    Salesforce

    Montréal, QC
    10 hours ago
  • $108.8k - $220.4k per year

     ...As an experienced and senior AI/LLM Architect, you will play a...  ...across the practice. You will evaluate, select, and apply the right design...  ...identity, policies, and evaluation metrics. Design, implement,...  ...Bachelor's Degree or equivalent English is required for this position,... 
    English language skills
    Full time
    Work at office
    Local area

    Accenture Global

    Montréal, QC
    5 days ago
  •  ...Artefact is a next-generation data and AI consulting firm dedicated to accelerating the...  ...it, the RAG pipeline feeding it, and the evaluations proving it works. This role combines breadth...  ...personal builds). ~ Professional English proficiency mandatory. You will work daily... 
    Full time

    Artefact

    Montréal, QC
    4 days ago
  • $69.45k - $119.45k per year

     ...reinvent their business with Data & Advanced AI — backed by a $3B investment and...  ...knowledge integration, workflow automation, evaluation, observability and AI Ops. You will integrate...  ...application deployment on cloud platforms. English is required for this position as this role... 
    English language skills
    Full time
    Manual labor
    Work at office
    Local area

    Accenture Global

    Montréal, QC
    5 days ago
  • usd16 - usd50 per hour

     ...We are looking for AI Data Specialists to support the improvement...  ...Job Type: Freelance Location: Remote anywhere Work Schedule: Part-...  ...including: - Data collection, evaluation, and annotation. - Pairwise...  ..., specifically from Canada. - English Proficiency: Fluent or advanced... 
    Remote work
    English language skills
    Hourly pay
    Full time
    Part time
    Freelance
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Rws

    Montréal, QC
    15 days ago
  • $115k - $140k per year

     ...countries, built on a single conviction: AI does not transform businesses. Architected...  ...observability, and operational requirements. • Evaluate architecture trade-offs, including model...  .... • Language courses (French and English). • Access to continuous learning through... 
    English language skills
    Permanent employment
    Full time
    Contract work
    Work at office
    2 days per week

    Keyrus Canada

    Montréal, QC
    21 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote English AI Evaluator. Be the first to apply!