Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Specialist — Chat & Media QA

Scale AI

Scale AI’s Outlier program is seeking detail-oriented English speakers to review AI-generated media. You’ll roleplay conversations with AI voice models, rank outputs, and explain what looked off, all on your own schedule.

You’ll evaluate images, videos, and captions, rating adherence and realism, and provide concise explanations in English. This is a remote, flexible contract opportunity with competitive pay.)

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Evaluation Specialist — Chat & Media QA in Ottawa, ON vacancy
  • $80k - $85k per year

     ...enabled business intelligence solutions and is looking for a Junior QA Specialist to help us deliver with impeccable quality. We are looking for a...  ...us in their application.   Please note March Networks uses AI as part of the recruitment process. Hiring salary... 
    Suggested

    March Networks

    Ottawa, ON
    8 days ago
  •  ...Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain what looked or sounded off, all remotely and on your own schedule... 
    Suggested
    Weekly pay
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-...  ...exam-question review, or medical annotation/QA (a plus); Strong written English (C1+)... 
    Suggested
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    4 days ago
  • $15 per hour

     ...Outlier, an AI training platform, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank naturalness and usefulness, and explain errors in writing. You can work remotely on your own schedule, with... 
    Chat
    Hourly pay
    Weekly pay
    Freelance
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier is an AI evaluation platform operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media, role-play conversations with AI voice models, and provide written explanations on performance. You can work remotely with a flexible schedule, contributing... 
    Chat
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Scale AI is seeking detail-oriented English speakers to review AI-generated media and rate exchanges with AI voice models. You will compare images and videos, judge how...  ...You’ll work on tasks like image and video evaluations, caption labeling, and audio assessments, with... 
    Contract work
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos. Outlier, an AI training platform...  ...issues in writing, and support evaluation and feedback for advanced AI... 
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Evaluate AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Review voices,...  ...platform, seeks detail-oriented English speakers for varied evaluation projects. You will assess model outputs, explain issues clearly... 
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Review AI-generated media remotely on your own schedule using fluent English, sharp observation, and evidence-based judgment. Evaluate voices, images, and videos carefully. As an Outlier Expert...  ...specific explanations supporting evaluation decisions Requirements: Fluent... 
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Review AI-generated media remotely for Outlier using fluent English, careful observation, and evidence...  ...-oriented English speakers for AI evaluation projects. You will assess voice conversations...  ...feedback skills as an AI Media Evaluation Specialist with Outlier. #J-18808-Ljbffr
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  • $100 per hour

     ...experienced software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project aims to improve...  ...feedback without using AI assistance to write evaluation responses. Nice to Haves: Experience maintaining... 
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    1 day ago
  •  ...We are looking for an experienced, hands-on Freelance Paid Media Specialist to manage and optimise paid social campaigns for an established B2B technology company. You will work closely with the Demand Generation team to improve campaign performance across the customer... 
    Freelance

    Digital

    Ottawa, ON
    a month ago
  • $85k per year

     ...intelligence solutions in the cloud and is looking for a Junior Test Specialist (SDET) with cloud and analytics experience to help us deliver...  ...in automated testing on a cloud platform with video, analytics or AI. ~ Understanding of cloud computing platforms, web, mobile,... 
    Contract work

    March Networks

    Ottawa, ON
    8 days ago
  •  ...We are looking for a Senior QA Automation Engineer to drive quality engineering practices across a next-generation Workforce Management (WFM) and Customer Experience (CX) platform. You will own test automation across the full test pyramid (unit, component, integration, contract... 
    Contract work
    Internship
    Remote work
    Relocation
    Shift work

    Miratech

    Ottawa, ON
    1 day ago
  •  ...Media buying has changed. In 2026, a great media buyer is not just a button pusher. They understand the full system: creative, offer,...  ...We believe the best media buyer today is a sharp marketer who uses AI every day. We built an internal creative analysis tool that connects... 
    Full time

    Sweat Pants Agency

    Ottawa, ON
    12 days ago
  • $77.95k - $96.29k per year

     ...As a  Marketing Communications Specialist for PCL's Defence...  ...materials. Develops social media content and applies an understanding...  ...and the ability to measure and evaluate marketing and communications performance...  ...of artificial intelligence (AI) to screen, assess, or select... 
    Long term contract
    Work at office
    Immediate start
    Flexible hours

    PCL Construction

    Ottawa, ON
    1 day ago
  •  ...Job Description Job Description NetSuite & Business Systems Specialist BPG Co-Op | Ottawa, Ontario | Part-Time Contract (10–20 hours per week, initially) Looking for a role where you can make an impact and keep things running seamlessly behind the scenes? BPG Co-... 
    Long term contract
    Contract work
    Part time
    For contractors
    10 hours per week

    BPG Co-operative Inc.

    Ottawa, ON
    2 days ago
  • $19.75 per hour

     ...information, please see our Applicant Privacy Notice at  . #MTL_IND AI Disclosure: Keywords Studios uses AI-powered features within our...  ...Studios Location: Americas, Canada, Ottawa Area of Work: QA Testing Services Service: Globalize Employment Type: Full Time... 
    Hourly pay
    Permanent employment
    Full time
    Live In
    Work at office
    Remote work
    Work from home
    Trial period
    Work visa

    Keywords Studios

    Ottawa, ON
    more than 2 months ago
  • $120k - $140k per year

     ...vacancy for a Cyber Security Specialist (Detection Engineer) is responsible...  .../ Regular review / Update QA Log Parsing Preparation...  ..., and federal laws. AI We use artificial intelligence...  ...decisions, including candidate evaluation, selection, and disposition, are... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $68.54k - $97.22k per year

     ...11/2026 JOB SUMMARY You are responsible for serving as the media spokesperson for Transit Services, organizing media relations activities...  ..., audience analysis, public consultation and communications evaluation techniques Media relations strategies, media protocols,... 
    Full time
    Temporary work
    Local area
    Immediate start
    Shift work

    City of Ottawa

    Ottawa, ON
    1 day ago
  • $107.5k - $134.38k per year

     ...Family: Academic Program Management # of Open Positions: 1 Faculty/Service - Department: UGME Accreditation and Program Evaluation Campus: Roger Guindon Hall Union Affiliation: N/A Date Posted (YYYY/MM/DD): 2026/10/08 Applications must be received... 
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    1 day ago
  • usd15 per hour

     ...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to everyday...  ...data used by major search engines, social media sites, streaming platforms and more.... 
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Remote work
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    a month ago
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain...  ..., and optimize conversational AI and chat-based experiences. Implement agent planning...  ...observability, monitoring, telemetry, and evaluation platforms. Strong knowledge of software... 
    Chat
    Internship
    Remote work
    Relocation

    Miratech

    Ottawa, ON
    1 day ago
  •  ...This role is Hybrid Ottawa AI Solutions Engineer Position...  ...options analysis, specifically evaluating the performance and reliability...  ...experience as a Software Specialist within an Integrated Product...  ...decisions, including candidate evaluation, selection, and disposition,... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  • $28.5 - $44 per hour

     ...communicates. This posting is for an existing vacancy. Requisition ID: 78427    Description We are looking for a motivated QA / Software Development Co-op student to join our software development team based in Ottawa, Ontario, Canada. This position provides an... 
    Hourly pay
    Full time
    Internship
    Work at office

    Skyworks

    Ottawa, ON
    1 day ago
  • TEHORA est présentement à la recherche d’ un (e) analyste en assurance qualité afin de réaliser des activités d’essais et de validation dans le cadre de projets de développement et de correction d’applications mobiles Sans être exhaustifs, voici les services et livrables...
    Hourly pay
    Full time
    Contract work
    Apprenticeship
    Remote work
    Flexible hours

    TEHORA

    Ottawa, ON
    more than 2 months ago
  • $21 - $25 per hour

     ...is an on-site role at our Ottawa office. Our Quality Assurance (QA) team is eagerly seeking a QA Co-op Student who excels in problem-solving...  ...candidates taking part in all aspects of the selection process. AI technology may be used to assist in the screening and assessment of... 
    Permanent employment
    Internship
    Work at office

    TechInsights

    Ottawa, ON
    15 days ago
  •  ...parts and supplier intelligence, advanced AI and deep regulatory expertise to help organizations...  ...moving. We’re looking for a Deal Desk Specialist to join our Sales Operations team and act...  ...terms. Speed up approvals and quote QA with AI – Use AI to draft consistent deal summaries... 
    Full time
    Contract work
    Worldwide
    Flexible hours

    Assent

    Ottawa, ON
    6 days ago
  • $85k - $111.3k per year

     ...maintained through Generative AI and agentic software engineering...  ...developers, architects, AI specialists, and domain experts, you will...  ...use cases, prototype solutions, evaluate their impact on development efficiency...  ...repeatable benchmarks and evaluation methods to assess AI agent... 
    Long term contract
    Full time
    Temporary work
    Manual labor

    Ericsson

    Ottawa, ON
    5 days ago
  • $85k - $125k per year

     ...Thales has a vacancy for an Obsolescence Specialist who is dedicated to providing Integrated...  ...by local, provincial, and federal laws. AI We use artificial intelligence–enabled...  ...All hiring decisions, including candidate evaluation, selection, and disposition, are made by... 
    Long term contract
    Full time
    Contract work
    Temporary work
    Work at office
    Local area

    Thales

    Ottawa, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Specialist — Chat & Media QA. Be the first to apply!