Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Evaluator: Test Chats, Images & Videos

Scale AI

Outlier, an AI training platform owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. Role involves live conversations with AI voice models, ranking outputs, and writing concise explanations, all remotely on your own schedule.

Responsibilities include evaluating images, videos, captions, and audio quality, with emphasis on accuracy and adherence to prompts. Applicants should be fluent in English and have strong attention to detail.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluator: Test Chats, Images & Videos in Toronto, ON vacancy
  • $30 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: AI Chat Generalist Type:...  ...$30/hour Location: Remote Commitment: 10 hours/week...  ...questions, and correcting errors. Evaluate the experience and deliverables... 
    Remote job
    Chat
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  •  ...agency (Facebook and Google ads management for contractors) that also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC-style ads for our ecommerce products and need someone who... 
    Remote work
    Video
    Hourly pay
    Ongoing contract
    For contractors
    Freelance

    Sparked Agency

    Toronto, ON
    14 hours ago
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based,...  ...; you choose which tasks to take and when ~ Remote: open to US-licensed physicians based in eligible... 
    Remote work
    Part time
    For contractors
    Flexible hours

    Mindrift

    Toronto, ON
    4 days ago
  • $15 - $20 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract...  ...Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week... 
    Remote job
    Video
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $95k - $145k per year

     ...transportation landscape. Job Responsibilities: This role involves testing AI models and software for diverse use cases using various...  ...project team engineers and researchers by providing technical evaluation of technologies being considered by Magna. Your... 
    Suggested
    Permanent employment
    Local area
    Immediate start

    Magna International

    Toronto, ON
    1 day ago
  • $100 per hour

     ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.  Participation is...  ...evaluate clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the... 
    Remote work
    Price work
    10 hours per week
    Flexible hours

    Mindrift

    Toronto, ON
    6 days ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  .... Key Responsibilities Create, test, and refine prompts, skills, and agent...  ...standard datasets with SMEs, coordinate evaluations, and design evaluation schemes, including... 
    Remplacement
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 hours ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$150/hour Location: Remote Role Responsibilities...  ..., and technical reports. Evaluate AI-generated or human-created...  ...detailed written justifications for evaluations and scores to maintain... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $30 - $40 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct...  ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations... 
    Remote work
    Daily paid
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    1 day ago
  • $140k - $175k per year

     ...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation...  ...to build automated evaluation pipelines connecting model APIs, test datasets, and agreed scoring methods. Implement reliable workflows... 
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 days ago
  • $35 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Image Reasoning Generalist Type...  ...$35/hour Location: Remote Role Responsibilities...  ...similar-looking objects. Test images with AI models using the... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $60 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Position: 3D Artists & Video Editors (Must own MacBook)...  ...50–$60/hour Location: Remote Commitment: 10–20 hours...  ...brief paid assessment to further evaluate your fit for the role. Resources... 
    Remote job
    Video
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    14 days ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...$100–$150/hour Location: Remote Role Responsibilities Design...  ...learning pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work against... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to...  ...accurate application of structured evaluation guidelines. Work... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $39/hour Location: Remote Duration: Up to 6 months...  ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...experienced, creatively driven Senior Video Editor to lead the quality,...  .... Lead the development and testing of new editing styles, formats,...  .... ~ Familiarity with AI-powered editing tools and an interest...  ...Raven telehealth clinicians work remotely, providing the highest quality... 
    Remote work
    Video
    Full time
    Internship

    phoenix

    Toronto, ON
    1 day ago
  • $120 - $170 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$170/hour Location: Remote Role Responsibilities...  ...in experiment design and A/B testing, metric definition, SQL/Python...  ...experience with AI training , evaluation, or human-data projects.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $52.38 - $57.39 per hour

     ...Branch of Parks, Forestry & Recreation, the Evaluator, Programs will help design, plan, and lead the implementation of small and large evaluations, performance measurement frameworks,...  ...research and evaluations. Designs and tests evaluation and applied research strategies... 
    Hourly pay
    Permanent employment
    Full time
    Part time
    Internship
    Monday to friday
    Shift work

    City of Toronto

    Toronto, ON
    1 day ago
  • $60 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Compensation: $60/hour Location: Remote Role Responsibilities Evaluate AI models using high-resolution images to identify missed details and build tasks... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  .... Position: Multimodal Image Expert Type: Contract...  ...Compensation: $30/hour Location: Remote Role Responsibilities Evaluate pairs of AI-generated images... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $75k - $85k per year

     ...brand. We're looking for a Performance video editor to join our marketing team and...  ...asked and come back with ideas for the next test. When an ad flops, you want to know why. You...  ...to Hybrid: 2 days in-office, 3 days remote Please apply via this link: Only applications... 
    Remote work
    Video
    Full time
    Work at office

    Sidekick

    Toronto, ON
    a month ago
  •  ...Job Description: As a Manager, SEO & AI Discovery at Merkle, you will lead SEO strategy...  ..., SERP feature analysis, AI Overview evaluation, LLM visibility analysis, entity and brand...  ...international SEO, e-commerce SEO, local SEO, video/image SEO, link building, digital PR, or SEO... 
    Remote work
    Video
    Long term contract
    Permanent employment
    Full time
    Contract work
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work
    2 days per week
    3 days per week

    dentsu

    Toronto, ON
    4 days ago
  •  ...of a team that is redefining the future of media.   Part-Time Video Operator    Who we're looking for:    We’re looking for a...  ...correct, and monitor video levels on studio cameras, video monitors, remote cameras and elements in SDR and HDR colour spaces Work closely... 
    Remote work
    Video
    Contract work
    Part time
    Immediate start
    Shift work

    Rogers Communications

    Toronto, ON
    19 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Evaluator: Test Chats, Images & Videos. Be the first to apply!