Remote AI Model Evaluator

Scale AI

Remote AI model evaluation suits fluent English speakers with sharp attention to detail and strong written communication. Set your own schedule while reviewing generated media.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for varied AI training projects. You will evaluate voice conversations, images, videos, and audio, identifying quality, realism, adherence, and other issues. The work supports Outlier’s evaluation and feedback loop for improving advanced AI systems.

Key Responsibilities:

Conduct scenario-based English conversations with AI voice models
Rank voice exchanges for naturalness, usefulness, and clarity
Compare generated images and videos against prompts
Inspect outputs for visual, motion, text, and audio errors
Write specific English explanations supporting evaluation decisions

Requirements:

Fluent English and clear written communication
Strong attention to detail and patience
Comfort with natural conversational speech
Experience writing evidence-based explanations or reviews
Ability to decide when both options have flaws

Apply your English communication, media evaluation, and evidence-based review skills to help Outlier improve AI systems remotely.

#J-18808-Ljbffr

Apply

Vacancy posted 3 hours ago

Similar jobs that could be interesting for youBased on the Remote AI Model Evaluator in Ottawa, ON vacancy

AI Audio Model Evaluator - Remote
...Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts... ..., from generating training data to evaluating the performance of models. About the opportunity: We are... ...what looked or sounded wrong, all remotely and on your own schedule. At Outlier...
Remote work
Hourly pay
Contract work
For contractors
Freelance
Internship
Night shift
Scale AI
Ottawa, ON
3 hours ago
Remote AI Model Performance Evaluator
...Outlier, owned by Scale AI, seeks detail-oriented English speakers to review... ...rate conversations with an AI voice model. You’ll compare images/videos to... ...describe issues in writing, and work remotely on your own schedule. You’ll evaluate multiple modalities—images, video, audio...
Remote work
Weekly pay
Contract work
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Remote AI Model Evaluator & Validation Specialist
...Scale AI's Outlier platform invites detail‑oriented English speakers... ...conversations with AI voice models, and compare AI outputs for... ...explanations in English and work remotely on your own schedule.... ...include image, video, and audio evaluations with flexible hours; payments...
Remote work
Freelance
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Remote AI Model Evaluator & Feedback Specialist
...Outlier is seeking fluent English speakers to help train AI models from a remote location. You’ll participate in live conversations, rate output quality, and provide concise explanations in English. Projects cover voice, image, and video AI tasks. Flexible hours and freelance...
Remote work
Freelance
Flexible hours
Scale AI
Ottawa, ON
5 hours ago
AI Voice Model Evaluator - English (Remote)
...Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with... ...voice, image, and video models This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you...
Remote work
Hourly pay
Freelance
Flexible hours
Scale AI
Ottawa, ON
5 hours ago
English AI Model Evaluator
...Evaluate AI voice, image, and video outputs remotely while using fluent English and sharp attention to detail on your own schedule. Outlier, an AI training... ...work. You will roleplay conversations with AI voice models, compare generated media, and explain findings in writing...
Remote work
Scale AI
Ottawa, ON
3 hours ago
AI Voice Model Evaluator
...Evaluate AI voice models remotely on your own schedule using fluent English, natural conversation, and careful listening skills. Review speech and media with precision. Outlier, operated by Scale AI, seeks detail-oriented English speakers for AI-generated media evaluation...
Remote work
Freelance
Scale AI
Ottawa, ON
3 hours ago
English AI Model Evaluator
...Evaluate AI-generated conversations, images, videos, and audio remotely on your own schedule as a fluent English speaker. Apply careful judgment across varied projects.... ...speakers for freelance evaluation work. You will assess model outputs, explain problems in writing, and help...
Remote work
Freelance
Scale AI
Ottawa, ON
3 hours ago
AI Model Evaluation Consultant
Evaluate AI models using consulting judgment, structured analysis, and clear written rationale from your own practice. Work remotely as an independent contractor. This consulting position helps train AI models on business problems. You will create client-style briefs, review...
Remote work
For contractors
DataAnnotation
Ottawa, ON
5 hours ago
English AI Model Evaluator
...Use fluent English and careful judgment to evaluate AI voice, image, and video models remotely with flexible freelance hours. Outlier needs clear communicators who can assess generated content with precision. As an English AI Model Evaluator, you will provide human feedback...
Remote work
Freelance
Flexible hours
Scale AI
Ottawa, ON
5 hours ago
Finance - AI Model Evaluator
We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of financial reasoning...
Hourly pay
For contractors
Cim
Ottawa, ON
5 hours ago
Remote AI Media Evaluator - Prompts & Model Feedback
usd15 per hour
...Outlier, owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media remotely and on a flexible schedule. You will roleplay live conversations with an AI voice model and evaluate image/video outputs against prompts, explaining what looked or sounded...
Remote work
Hourly pay
Weekly pay
Freelance
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Remote AI Model Quality Evaluator - Flexible Hours
...Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media remotely. You will roleplay conversations with an AI voice model, score exchanges, compare AI-generated media, and write concise explanations of observed...
Remote work
Freelance
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Remote Hardware Engineer: AI Model Evaluation & Design
...seeking an experienced Electrical Engineer to guide frontier AI models in evaluating real electrical engineering tasks. The role leverages your design... ...models, and critique model outputs with rigorous reasoning. Remote-first environment with global collaboration. #J-18808-...
Remote work
Internship
DataAnnotation
Ottawa, ON
5 hours ago
English AI Voice Model Evaluator
...Evaluate AI voice conversations in English remotely, using natural speech, careful listening, and clear written feedback on your own schedule. Outlier, an AI... ...flexible project work. You will assess conversational voice models, generated images, videos, captions, and audio. Your...
Remote work
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Senior AI Model Evaluation Consultant
...Evaluate AI models against real business problems using consulting judgment, analytical rigor, and structured written feedback from your own... ...client relevance. The work is independent contracting, completed remotely from your own computer and schedule. Key Responsibilities:...
Remote work
DataAnnotation
Ottawa, ON
5 hours ago
Quantitative Analyst AI Model Evaluator
...Bring real-world quantitative experience to remote AI model evaluation, with flexible scheduling and projects selected around your availability. As an Experimentation Analyst and AI Trainer with DataAnnotation, you will test whether AI outputs withstand practical scrutiny....
Remote work
Flexible hours
DataAnnotation
Ottawa, ON
5 hours ago
Electrical Engineer AI Model Evaluator
Evaluate frontier AI models with electrical engineering judgment, circuit analysis expertise, and flexible remote work from your own computer. DataAnnotation seeks an experienced electrical engineer for independent contract work evaluating real engineering tasks. Apply circuit...
Remote work
Contract work
For contractors
Internship
Flexible hours
DataAnnotation
Ottawa, ON
5 hours ago
Remote AI Physics Trainer — Train & Evaluate AI Models
An innovative company is seeking a physics expert to train AI models in a flexible remote role. You will engage with AI chatbots by providing complex physics problems and assessing their logic and performance. This position allows you to work on your own schedule and choose...
Remote work
Flexible hours
DataAnnotation
Ottawa, ON
5 hours ago
English AI Voice Model Evaluator
...Evaluate AI voice models in fluent English as a remote freelance contributor with flexible hours and strong communication skills. Help assess naturalness, usefulness, and clarity. Outlier seeks detail-oriented English speakers to provide human feedback for generative AI voice...
Remote work
Freelance
Flexible hours
Scale AI
Ottawa, ON
5 hours ago
AI Coding Model Evaluation Engineer
...Evaluate AI-generated code at Turing using Python, TypeScript, or another production language. Work with coding agents... ...compare solutions, identify failure modes, and create evaluation signals that improve coding models. The work includes collaboration with researchers and...
For contractors
Turing Enterprises, Inc.
Ottawa, ON
5 hours ago
AI Model Evaluator - Remote, Flexible Hours, Weekly Pay
$15 per hour
...Outlier, an AI training platform owned by Scale AI, seeks detail-oriented English speakers... ...live conversations with an AI voice model, score exchanges, and explain what looked... ...own hours, and help improve AI systems by evaluating images, videos, audio, and captions. Payment...
Remote work
Hourly pay
Weekly pay
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Remote AI Audio Evaluator: Detail QA for Voice Models
...Outlier, operated by Scale AI, seeks detail-oriented English speakers... ...conversations with an AI voice model, score exchanges, compare AI... ...write explanations of issues, all remotely and on your own schedule. As part of Outlier’s evaluation loop, you’ll help improve AI performance...
Remote work
Weekly pay
Contract work
Flexible hours
Scale AI
Ottawa, ON
3 hours ago
Physician (MD/DO) - Medical AI Evaluation
...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...EHR vignettes for a medical AI evaluation project. General and internal...
Remote work
Part time
For contractors
Flexible hours
Mindrift
Ottawa, ON
4 days ago
Principal Engineer Physical AI Systems Modeling
...seeking a Principal Engineer (Physical AI - System Modeling) to join the Pathfinding Studio within... ...versioning and reproducible training and evaluation. Lead imitation-learning... ...sole discretion of Renesas Canada. Remote Work : No Employment Type :...
Remote work
Long term contract
Permanent employment
Full time
Work at office
Renesas Electronics
Ottawa, ON
1 day ago
AI Model Evaluator - Portuguese Fluency Required
$30 per hour
Prolific is looking for Portuguese speakers to evaluate and train cutting-edge AI models, with earning potential of $30/hour. Enjoy flexible hours while... ...Prolific, you’ll play a pivotal role in AI model training and evaluation. Candidates will need advanced language skills and the...
Self employment
Work from home
Flexible hours
Prolific
Ottawa, ON
5 hours ago
Remote AI Media Evaluator
...Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and clear written explanations. Evaluate voices, images, and videos for quality. Outlier, Scale AI... ...independent contractors. You will evaluate model outputs, roleplay conversations,...
Remote work
For contractors
Scale AI
Ottawa, ON
3 hours ago
Remote AI Evaluation Specialist
...Scale AI, via Outlier, seeks detail-oriented English speakers to review AI-generated media... ...roleplay live conversations with AI voice models, rank outputs for naturalness and prompt... ...explanations of issues observed, all remotely and on your schedule. Ideal candidates...
Remote work
Scale AI
Ottawa, ON
3 hours ago
Remote AI Content Evaluator
...Evaluate AI-generated conversations, images, videos, and audio remotely while choosing your own schedule as an English-speaking Outlier Expert. Outlier, owned and operated... ...varied AI evaluation projects. You will score model outputs, compare media against prompts, inspect...
Scale AI
Ottawa, ON
3 hours ago
Remote AI Response Evaluator
...Evaluate large language model responses remotely with careful judgment, clear writing, and professional-level prompt development. Work flexible hours as an English... ...-speaking freelance contractor. Outlier is a Scale AI-operated platform seeking contributors to train and...
Remote work
Part time
For contractors
Freelance
Flexible hours
Outlier
Ottawa, ON
3 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Model Evaluator. Be the first to apply!