Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

English AI Model Evaluator

Scale AI

Evaluate AI-generated conversations, images, videos, and audio remotely on your own schedule as a fluent English speaker. Apply careful judgment across varied projects.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for freelance evaluation work. You will assess model outputs, explain problems in writing, and help improve advanced AI systems. Projects include conversational, visual, video, captioning, audio, and voice evaluations.

Key Responsibilities:

  • Roleplay conversations with AI voice models in English
  • Rank exchanges for naturalness, usefulness, and clarity
  • Compare generated images and videos against prompts
  • Inspect outputs for artifacts, motion, text, and audio issues
  • Write evidence-based explanations supporting evaluation decisions

Requirements:

  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational speech
  • Experience writing short evidence-based reviews
  • Valid identification, mobile phone, resume, and LinkedIn profile

Use English communication, close observation, and evidence-based judgment to evaluate AI outputs for Outlier projects remotely.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the English AI Model Evaluator in Ottawa, ON vacancy
  •  ...Evaluate AI voice, image, and video outputs remotely while using fluent English and sharp attention to detail on your own schedule. Outlier, an AI training platform owned...  ...You will roleplay conversations with AI voice models, compare generated media, and explain findings... 
    English language skills
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Use fluent English and careful judgment to evaluate AI voice, image, and video models remotely with flexible freelance hours. Outlier needs clear communicators who can assess generated content with precision. As an English AI Model Evaluator, you will provide human feedback... 
    English language skills
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  •  ...Evaluate AI voice conversations in English remotely, using natural speech, careful listening, and clear written feedback on your own schedule. Outlier,...  ...flexible project work. You will assess conversational voice models, generated images, videos, captions, and audio. Your... 
    English language skills
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Evaluate AI voice models in fluent English as a remote freelance contributor with flexible hours and strong communication skills. Help assess naturalness, usefulness, and clarity. Outlier seeks detail-oriented English speakers to provide human feedback for generative AI voice... 
    English language skills
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  •  ...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work...  ..., from generating training data to evaluating the performance of models. About the opportunity We are seeking detail-oriented English speakers to review AI-generated media. Roleplay... 
    English language skills
    Hourly pay
    Contract work
    For contractors
    Freelance
    Internship
    Remote work
    Night shift

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models? About the opportunity: Outlier is looking for talented... 
    English language skills
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  •  ...Remote AI model evaluation suits fluent English speakers with sharp attention to detail and strong written communication. Set your own schedule while reviewing generated media. Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for varied AI... 
    English language skills
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Evaluate AI voice models remotely on your own schedule using fluent English, natural conversation, and careful listening skills. Review speech and media with precision. Outlier, operated by Scale AI, seeks detail-oriented English speakers for AI-generated media evaluation... 
    English language skills
    Freelance
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  • Evaluate AI models using consulting judgment, structured analysis, and clear written rationale from your own practice. Work remotely as an independent...  ...analytical and structured problem-solving skills Fluency in English at native or bilingual level Experience building and... 
    For contractors
    Remote work

    DataAnnotation

    Ottawa, ON
    5 hours ago
  • We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic...  ...for correctness and performance Qualifications: Fluency in English (native or bilingual level) Detail-oriented Proficient in... 
    Hourly pay
    For contractors

    Cim

    Ottawa, ON
    5 hours ago
  •  ...Evaluate AI-generated media remotely with fluent English, sharp observation, and clear written explanations on your own schedule. Outlier, operated by Scale...  ...Roleplay live English conversations with AI voice models Compare generated images and videos against prompts... 
    English language skills
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Evaluate AI models against real business problems using consulting judgment, analytical rigor, and structured written feedback from your own practice...  ...building and critiquing senior-stakeholder work Fluent English at native or bilingual level Detail-oriented approach;... 
    Remote work

    DataAnnotation

    Ottawa, ON
    5 hours ago
  •  ...Bring real-world quantitative experience to remote AI model evaluation, with flexible scheduling and projects selected around your availability...  ...methods and predictive modeling experience Strong English fluency at native or bilingual level Quantitative bachelor... 
    English language skills
    Remote work
    Flexible hours

    DataAnnotation

    Ottawa, ON
    5 hours ago
  •  ...Outlier, owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media and rate conversations with an AI voice model. You’ll compare images/videos to prompts, describe...  ...remotely on your own schedule. You’ll evaluate multiple modalities—images, video,... 
    English language skills
    Weekly pay
    Contract work
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  • Evaluate frontier AI models with electrical engineering judgment, circuit analysis expertise, and flexible remote work from your own computer. DataAnnotation...  ...to explain why technical answers are incorrect Fluent English and comfort using AI tools Use electrical engineering... 
    Contract work
    For contractors
    Internship
    Remote work
    Flexible hours

    DataAnnotation

    Ottawa, ON
    5 hours ago
  •  ...Evaluate AI-generated code at Turing using Python, TypeScript, or another production language. Work with coding agents...  ...compare solutions, identify failure modes, and create evaluation signals that improve coding models. The work includes collaboration with researchers and... 
    For contractors

    Turing Enterprises, Inc.

    Ottawa, ON
    5 hours ago
  •  ...Use fluent English and careful listening to review AI voice models remotely, with flexible freelance hours that fit your schedule. Your communication helps assess...  ...models. You will hold scenario-based conversations, evaluate naturalness and clarity, and explain your decisions... 
    English language skills
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  •  ...Outlier, operating under Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rate naturalness, and describe issues with supporting explanations. The role is remote and freelance, with... 
    English language skills
    Freelance
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier, an AI training platform operated by Scale AI, seeks detail-oriented English speakers to review AI-generated media remotely...  ...roleplay conversations with AI voice models, compare AI-created images and...  ...tasks such as image and video evaluations, video caption labeling, and... 
    English language skills
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier, an AI evaluation platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media, engage in live conversations with AI voice models, and rank outputs based on adherence and quality. You’ll provide written explanations and operate remotely... 
    English language skills
    For contractors
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Review AI-generated media in English for Outlier, using careful listening, visual inspection, and clear...  ...seeks fluent English speakers for AI evaluation projects. You will assess voice conversations...  ...-based conversations with AI voice models Compare generated images and... 
    English language skills
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  • $15 per hour

     ...Outlier, an AI evaluation platform, is seeking detail-oriented English speakers to review AI-generated media and roleplay live conversations with an AI voice model. You’ll score exchanges, compare prompts, and explain what looked or sounded off, all on your own schedule.... 
    English language skills
    Hourly pay
    Weekly pay
    Freelance
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Scale AI's Outlier platform invites detail‑oriented English speakers to review AI‑generated media, rate live conversations with AI voice models, and compare AI outputs for prompt adherence. You will...  ...include image, video, and audio evaluations with flexible hours; payments are... 
    English language skills
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier is seeking fluent English speakers to help train AI models from a remote location. You’ll participate in live conversations, rate output quality, and provide concise explanations in English. Projects cover voice, image, and video AI tasks. Flexible hours and freelance... 
    English language skills
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...EHR vignettes for a medical AI evaluation project. General and internal...  ...QA (a plus); Strong written English (C1+). This project is not... 
    English language skills
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    4 days ago
  •  ...seeking a Principal Engineer (Physical AI - System Modeling) to join the Pathfinding Studio within...  ...define and lead research in foundation model training and fine-tuning, vision-language...  ..., and reproducible training and evaluation. · Lead imitation-learning, reinforcement... 
    Long term contract
    Permanent employment
    Full time
    Work at office

    Renesas Electronics

    Ottawa, ON
    9 hours ago
  • $100 per hour

     ...software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The...  ...using AI assistance to write evaluation responses. Nice to Haves: Experience...  .... Projects involving AI model training or evaluation, machine learning... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    1 day ago
  • $107.5k - $134.38k per year

     ...Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A...  ...information to various audiences. Bilingualism – French and English (spoken and written) #LI-Hybrid Key Competencies at uOttawa:... 
    English language skills
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    1 day ago
  • $135.19k - $162.89k per year

     ...human resources, program development and evaluation, strategic planning, labour law and current...  ...reading comprehension): Advanced ~ Fluency in English, both oral and written Benefits...  ...Please note that artificial intelligence (AI) is not used to screen or evaluate resumes... 
    English language skills
    Permanent employment
    Full time
    Internship
    Afternoon shift

    Sandy Hill Community Health Centre

    Ottawa, ON
    20 days ago
  •  ...above what’s expected of us to meet the challenges of tomorrow and engineer a better world! We are looking for Senior Traffic Engineer/Modeller to support our expanding transportation sector in Ontario and work on traffic operational studies, roadway and railway safety reviews... 
    Permanent employment
    Full time
    Work at office
    Work from home
    Flexible hours

    CIMA+

    Ottawa, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to English AI Model Evaluator. Be the first to apply!