Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Voice Evaluator & Media Quality Rater

Scale AI

Outlier, an AI evaluation platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and write precise explanations of issues found.

This is a remote, flexible, freelance opportunity with weekly payments and a performance-based incentive structure. You will evaluate images, videos, captions, and audio, providing evidence-based feedback.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Voice Evaluator & Media Quality Rater in Toronto, ON vacancy
  • $30 - $35 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $30–$35/hour Location: Remote Role Responsibilities Use Meta...  ...in an ongoing study with the same group of raters each week. Work independently and asynchronously... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    23 days ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role...  ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  ...legal expertise into practical, high-quality AI outputs. Key Responsibilities Create...  ..., compliance, government, and media. Our products combine highly specialized... 
    Quality
    Remplacement
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 hours ago
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...Score the clinical reasoning quality of benchmark items: vignette accuracy... 
    Remote work
    Quality
    Part time
    For contractors
    Flexible hours

    Mindrift

    Toronto, ON
    4 days ago
  •  ...changelog . About the Role Rootly is building the AI-native future of incident management, and we need someone...  ...our AI to its limits before our customers do. As our AI Quality Engineer, you'll own the evaluation and optimization of Rootly's agentic AI features -- designing... 
    Quality
    Full time
    Internship
    Home office

    Rootly

    Toronto, ON
    1 day ago
  • $30 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30/hour Location: Remote Role Responsibilities Evaluate pairs of AI-generated images...  ...based on prompt alignment, visual quality, anatomy, structure, rendered text,... 
    Remote job
    Quality
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...–$150/hour Location: Remote Role Responsibilities...  ..., and technical reports. Evaluate AI-generated or human-created...  ...established criteria to ensure quality and accuracy. Provide detailed... 
    Remote job
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $30 - $50 per hour

     ...competitive advantage. Cresta’s unified AI platform combines...  ...our  AI Delivery team as  AI Quality Assurance Interns . This is...  ...hands-on role where you will evaluate the behavior, accuracy, and reliability...  ...Intent recognition evaluation Conversation quality assessment... 
    Quality
    Hourly pay
    Internship
    Work at office

    Cresta

    Toronto, ON
    1 day ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ public administration Evaluator Type: Contract...  ...$120/hour Location: Remote Role Responsibilities...  ...artifacts against domain-specific quality rubrics. Identify factual... 
    Remote job
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $30 - $40 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$40/hour Location: Remote Role Responsibilities...  ...queries each day to ensure timely evaluation. Provide short notes and...  ...annotations to enhance training data quality . Work independently... 
    Remote work
    Quality
    Daily paid
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    1 day ago
  • $140k - $175k per year

     ...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build...  ...compare large language models (LLMs), measure quality, cost, and latency, and make informed...  ...accounting, compliance, government, and media. Our products combine highly specialized... 
    Quality
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 days ago
  •  ...Clinical Independent Rater - French Speaking Location: Remote/Virtual (Canada) Hours: Estimated 10–16 hours...  ...cutting-edge technology to deliver high-quality data and insights that shape the...  ...practices. Responsibilities include evaluating assessment quality, engaging in... 
    Remote work
    Quality
    16 hours
    Full time
    Part time
    Work at office
    Immediate start
    Worldwide

    IQVIA

    Toronto, ON
    3 days ago
  • $39 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $39/hour Location: Remote Duration: Up to 6 months...  ...week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards in music... 
    Remote job
    Quality
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $45 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...French-Canadian Professional Voice Actor Type: Contract...  ...–$300/hour Location: Remote Commitment: 2–10 hours...  ...audio recording setup for high-quality submissions. Submit audio... 
    Remote job
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $70 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to...  ...to improve training data quality and downstream performance. Develop... 
    Remote job
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: Software / AI / IT / data Evaluator Type: Contract...  ...$120/hour Location: Remote Role Responsibilities...  ...artifacts against domain-specific quality rubrics. Identify factual... 
    Remote job
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...–$150/hour Location: Remote Role Responsibilities...  ...and A/B test write-ups . Evaluate AI-generated or human-created...  ...established criteria to ensure quality and consistency. Provide detailed... 
    Remote job
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities... 
    Remote job
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...looking for a Senior Programmable Voice Engineer to develop...  ...capabilities, call control services, media processing, and API-driven communications...  ..., media, telephony, and call-quality issues across distributed...  .... Practical experience with AI-assisted software development or... 
    Remote work
    Quality
    Internship
    Relocation

    Miratech

    Toronto, ON
    1 day ago
  •  ...Quality Engineer (QE) / SDET – AI Chatbot Validation Job Description: We are looking for a seasoned AI first Senior Quality Engineer who is...  ...deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and... 
    Quality
    Contract work

    Astra North Infoteck Inc.

    Toronto, ON
    8 days ago
  • $80 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design...  ...~ Prior experience with AI training , evaluation, or human-data projects. Application... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1...  ...number. You can live anywhere. We are remote and we hire worldwide. The one hard requirement...  ...removes the constraint. We are heavy AI users and we expect you to build, not just... 
    Remote work
    Worldwide
    Shift work

    Sweat Pants Agency

    Toronto, ON
    12 days ago
  • $60 - $100 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: Marketing Expert — Social Media (AI Agent Environments)...  ...–$100/hour Location: Remote Role Responsibilities...  ...Review AI agent attempts and evaluate them against established standards... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Voice Actor: CX Agent Voice Cloning (...  ...–$150/hour Location: Remote Commitment: 5–10 hours...  ...Responsibilities Record high-quality voice samples across diverse... 
    Remote job
    Quality
    Contract work
    Summer work
    10 hours per week

    Mercor

    Toronto, ON
    more than 2 months ago
  • $50 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Voice Actor: CX Agent Voice Cloning (...  ...$50/hour Location: Remote Commitment: 5–10 hours...  ...Responsibilities Record high-quality voice samples across diverse... 
    Remote job
    Quality
    Contract work
    Summer work
    10 hours per week

    Mercor

    Toronto, ON
    more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Voice Evaluator & Media Quality Rater. Be the first to apply!