Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Voice Model Quality Rater

Scale AI

Review AI voice conversations remotely on your own schedule while applying English fluency and careful listening to each exchange. Evaluate naturalness, clarity, and usefulness across model responses.

Outlier, Scale AI’s AI training platform, seeks detail-oriented English speakers for remote project work. You will roleplay realistic conversations, compare generated media, and explain findings in writing. Your evaluations support feedback loops that help advanced AI systems improve performance in real-world applications.

Key Responsibilities:

  • Hold English conversations with AI voice models
  • Rank naturalness, usefulness, and clarity across exchanges
  • Inspect audio for pronunciation and target-voice matching
  • Write specific, evidence-based explanations in English
  • Record short voice explanations when required

Requirements:

  • Fluent English and clear written communication
  • Comfort with natural, everyday conversational speech
  • Strong attention to detail and patience
  • Experience writing concise reviews or explanations
  • Comfort making clear decisions when options have flaws

Use English communication, close listening, and evidence-based judgment to evaluate AI voice outputs for Outlier projects.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Voice Model Quality Rater in Toronto, ON vacancy
  • $30 - $35 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  .... Participate in an ongoing study with the same group of raters each week. Work independently and asynchronously to meet deadlines... 
    Suggested
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    23 days ago
  •  ...Palona’s AI agents operate in real restaurant environments: noisy phone...  ...requires more than selecting the newest model. It requires disciplined evaluation, high-quality data, modeling judgment,...  ...safety, latency, and cost of Palona’s voice and multimodal agents. You will own... 
    Quality
    Long term contract
    Full time
    Temporary work
    Internship
    Immediate start

    Palona AI

    Toronto, ON
    more than 2 months ago
  • $70k - $150k per year

     ...Managing change. Advanced level of proficiency: Data governance. IT standards and governance. Data integrity. Data quality. Metadata management. Intermediate level of proficiency: Privacy governance technology enablement. Data privacy. Enterprise... 
    Quality
    Full time
    Contract work
    Part time

    Bank of Montreal

    Toronto, ON
    1 day ago
  •  ...enterprise-ready platform and unique partnership model. See why our customers have reviewed us 5...  ...About the Role Rootly is building the AI-native future of incident management, and...  ...limits before our customers do. As our AI Quality Engineer, you'll own the evaluation and optimization... 
    Quality
    Full time
    Internship
    Home office

    Rootly

    Toronto, ON
    1 day ago
  • $30 - $50 per hour

     ...a competitive advantage. Cresta’s unified AI platform combines conversational AI agents,...  ...students to join our  AI Delivery team as  AI Quality Assurance Interns . This is a hands-on...  ...Conversation quality assessment Model output auditing Light prompt testing and... 
    Quality
    Hourly pay
    Internship
    Work at office

    Cresta

    Toronto, ON
    1 day ago
  • $45 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...French-Canadian Professional Voice Actor Type: Contract...  ...leading AI lab to improve their model's audio data handling and production...  ...recording setup for high-quality submissions. Submit audio... 
    Quality
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...Clinical Independent Rater - French Speaking Location: Remote/Virtual...  ...technology to deliver high-quality data and insights that shape the...  ...reviewing scales administered by raters to confirm standardized...  ...may use artificial intelligence (AI) in the processing of your application... 
    Quality
    16 hours
    Full time
    Part time
    Work at office
    Immediate start
    Remote work
    Worldwide

    IQVIA

    Toronto, ON
    3 days ago
  • $69k - $114k per year

     ...Job Type:  Permanent   Work Model:  Hybrid   Reference code: 135144...  ..., and communities to enjoy the quality of life that comes with a...  ...what clients tell us through our Voice of Client program, what the market...  ...scenario modelling, generative AI or automation to market... 
    Quality
    Permanent employment
    Work at office
    Flexible hours
    Shift work
    Early shift

    Deloitte

    Toronto, ON
    1 day ago
  •  ...use mathematical and statistical modeling skills and our qualitative...  ...operationalization of actuarial models and workflows, understanding actuarial...  ...skills, and an appetite for AI-enabled development. The role...  .../or reserving (model building, rater build, actuarial process improvement... 
    Minimum wage
    Full time
    Manual labor
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week
    1 day per week

    Marsh McLennan

    Toronto, ON
    5 days ago
  • $70k - $95k per year

     ...More Than a Job: A Mission We're looking for a talented BIM Modeller who is passionate about building the future of rail solutions. You...  .... Ensure compliance with industry regulations and internal quality standards for digital models. Contribute to the development of... 
    Quality
    Worldwide

    Alstom

    Toronto, ON
    19 hours ago
  •  ...Quality Engineer (QE) / SDET – AI Chatbot Validation Job Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered...  ...AI integrations, APIs, microservices, data pipelines, model interactions, and third-party services. • Establish... 
    Quality
    Contract work

    Astra North Infoteck Inc.

    Toronto, ON
    8 days ago
  • $113k - $163k per year

     ...Manulife is seeking an experienced Manager / Senior Manager, AI Model Risk Governance, Frameworks & Standards to lead the development and evolution of the enterprise AI Model Risk Management framework from an independent second-line perspective. This role offers a unique opportunity... 
    Long term contract
    Temporary work
    Local area
    Flexible hours

    Manulife

    Toronto, ON
    1 day ago
  • $85 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms , Kubernetes... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $56k - $84k per year

     ...Job Type:  Temporary Contract   Work Model:  Hybrid   Reference code: 134945 Primary...  ...friends, families, and communities to enjoy the quality of life that comes with a sustainable...  ...will utilize human screening combined with AI technology to help identify the skills and... 
    Quality
    Full time
    Temporary work
    Internship
    Flexible hours

    Deloitte

    Toronto, ON
    1 day ago
  • $80 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...and evaluate complex data engineering tasks. Review model-generated implementations involving ETL pipelines , data warehouses... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...looking for a Senior Programmable Voice Engineer to develop...  ...signaling, media, telephony, and call-quality issues across distributed environments...  ...relational databases, data modeling, integration data flows, and...  .... Practical experience with AI-assisted software development or... 
    Quality
    Internship
    Remote work
    Relocation

    Miratech

    Toronto, ON
    1 day ago
  • $30 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  .... Review and judge images based on prompt alignment, visual quality, anatomy, structure, rendered text, and artifacts. Provide a... 
    Quality
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $65k - $85k per year

     ...Lead Engineer Job Purpose The BIM Modeller – Electrical is responsible for developing...  ...BIM model where needed. Maintain model quality, parameter consistency, worksets, file references...  ...and includes the feminine. We use AI-enabled tools in our recruitment platform... 
    Quality
    Internship
    Toronto, ON
    6 days ago
  • $69.7k - $98.4k per year

     ...Description: Department Description: TD Model Validation (MV) group is responsible for the...  ...including assumptions. Assess the data quality and input control / governance process to ensure...  ...is an asset. Experience developing AI agent workflows to increase productivity is... 
    Quality
    Full time
    Work from home

    TD

    Toronto, ON
    3 days ago
  • $86.1k - $136.1k per year

     ...efficient applications. We are looking for a Quality Engineer who is curious about emerging...  ...digital solutions. You will have an active voice in a collaborative and supportive team where...  ...Selenium, Xray, Postman, and JMeter. Use AI-enabled tools and practices to support test... 
    Quality
    Long term contract
    Temporary work
    Local area
    Flexible hours

    Manulife

    Toronto, ON
    1 day ago
  • $69k - $114k per year

     ...Job Type:  Permanent   Work Model:  Hybride   Reference code: 135144 Primary Location...  ...friends, families, and communities to enjoy the quality of life that comes with a sustainable...  ...will utilize human screening combined with AI technology to help identify the skills and... 
    Quality
    Permanent employment
    Apprenticeship
    Work at office
    Flexible hours
    Day shift

    Deloitte

    Toronto, ON
    19 hours ago
  • $96.9k - $136.8k per year

     ...Strong expertise in quantitative financial models such as credit risk models (PD, LGD, EAD,...  ...measurement. ~ Expertise in evaluating AI-related risks and reviewing Machine Learning...  ...evaluating model assumptions, data quality, feature engineering, model limitations, performance... 
    Quality
    Full time
    Work from home

    TD

    Toronto, ON
    4 days ago
  • $58k - $96k per year

     ...Job Type:  Permanent   Work Model:  Hybrid   Reference code: 135584 Primary Location...  ...friends, families, and communities to enjoy the quality of life that comes with a sustainable...  ...will utilize human screening combined with AI technology to help identify the skills and... 
    Quality
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    1 day ago
  •  ...Understand better who we are by visiting Context MEP Modeller needed for an LRT Project in Ontario.  Missions/Main Duties...  ...used for easy reading purposes and includes the feminine. We use AI-enabled tools in our recruitment platform (iCIMS) for tasks like... 
    Remote work
    Toronto, ON
    6 days ago
  • $82k - $92k per year

     ...partnering with key stakeholders on configuration and underlying data models. Build the enablement layer for health scores across GTM, CX...  ...’s big enough for career growth, but lean enough to make your voice heard Career-defining opportunities   Plus benefits designed... 
    Full time
    Immediate start
    Remote work
    Flexible hours

    Lightspeed Commerce

    Toronto, ON
    1 day ago
  • $90k - $105k per year

     ...The Associate Manager, Voice of Customer Platform & Program is responsible for the day-to-day operation, governance, stakeholder support...  ...Monitor survey performance, platform health, user adoption and data quality, identifying opportunities for improvement. Drive continuous... 
    Quality

    Canadian Tire Corporation

    Toronto, ON
    1 day ago
  • usd160k per year

     ...we? Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real...  ...benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education... 
    Quality
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Toronto, ON
    1 day ago
  • $96.9k - $136.8k per year

     ...Description: 1. Role Overview The Manager, Compliance – Model and Data Governance is responsible for ensuring AI and data usage within TDS Compliance aligns with...  .... Ensure Compliance data accessibility and quality, and adherence to enterprise data and AI usage standards... 
    Quality
    Full time
    Work from home

    TD

    Toronto, ON
    4 days ago
  •  ...serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content...  ...reviewing complex data and LLM outputs to ensure high data quality. You are obsessive about rigorously measuring AI... 
    Quality
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    Toronto, ON
    4 days ago
  • $64k - $85k per year

     ...providing specialized design, project, and quality management expertise across the full...  ...for generations to come! The AutoCAD 3D Modeler (Dry Utility Modeler (3D), Utility Design)...  ...practices, Aecon may use artificial intelligence (AI) tools to assist in screening and... 
    Quality
    Permanent employment

    Aecon

    Toronto, ON
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Voice Model Quality Rater. Be the first to apply!