Inscrivez-vous pour accéder à toutes les fonctionnalités de notre service.
  • Recherche d'offres d'emploi
  • Favoris
  • Créer un CV
    Nouveau
  • Salaires
  • Souscriptions

AI Voice Evaluation Specialist

Temps plein

Jobgether

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Voice Evaluation Specialist based in Canada. Join an innovative AI-focused environment as an AI Voice Evaluation Specialist, where you will contribute to improving the quality, reliability, and performance of next-generation conversational AI systems. In this role, you will interact directly with two different AI models through real-time voice conversations, using identical scenarios to assess and compare their performance. You will evaluate conversational quality, identify potential errors, and analyze how effectively each model responds to different situations. Your observations and structured assessments will help determine which systems deliver the strongest and most natural user experiences. This opportunity is ideal for someone with excellent listening skills, strong analytical abilities, and a keen interest in artificial intelligence and voice-based technologies. You will work independently within a structured evaluation framework, ensuring consistency, objectivity, and accuracy throughout each assessment. Accountabilities: - Review assigned scenarios and conduct natural, voice-based roleplay conversations with two different AI models. - Interact with Model A and Model B using the same scenarios, maintaining consistent conversational approaches and conditions to ensure fair comparisons. - Keep approximately the same number of conversational turns with each model to support balanced and reliable evaluations. - Record voice interactions and carefully assess the quality, accuracy, relevance, and overall behavior of each model's responses. - Evaluate both AI models across five predefined quality dimensions, following established assessment criteria and evaluation guidelines. - Identify, document, and categorize relevant error patterns and clusters occurring during audio interactions or conversations. - Compare the performance of both models using structured evaluation frameworks and observations gathered throughout the interactions.

- Determine which model demonstrates stronger overall performance based on the defined quality standards and evaluation criteria. - Prepare detailed written rationales supporting final evaluations, referencing specific conversational examples and observations from both models. - Apply evaluation guidelines consistently across different scenarios and interactions to ensure objective, accurate, and dependable results. - Maintain high standards of documentation, attention to detail, and evaluation consistency throughout all assigned tasks. Requirements: - Bachelor's degree or equivalent relevant educational background. - Excellent attention to detail, with the ability to identify subtle differences in conversational quality, response accuracy, and AI model behavior. - Strong listening and comprehension skills, including the ability to understand spoken interactions and recognize inconsistencies or errors. - Excellent written communication skills, with the ability to document findings clearly, objectively, and accurately. - Ability to follow detailed instructions, structured evaluation frameworks, and predefined quality assessment guidelines. - Confidence in speaking naturally and participating in roleplay conversations across different scenarios. - Strong analytical and critical-thinking abilities, with the capacity to compare two interactions fairly and identify meaningful performance differences. - Objectivity and impartiality when evaluating AI-generated responses, without allowing personal preferences to influence final assessments. - High levels of reliability, consistency, and time management when completing repetitive and structured evaluation assignments. - Genuine interest in artificial intelligence, conversational AI assistants, voice technologies, or emerging AI applications.

L'offre d'emploi a été publiée il y a 1 jour
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre AI Voice Evaluation Specialist à à domicile
  • $30 - $35 par heure

     ...Description Overview We are looking for voice and audio experts with practical audio...  ...practical listening and recording skills, not specialist audio engineering. What You'll Do...  ...Task Execution: Complete recording, evaluation, and annotation tasks accurately. Check your... 
    Suggéré
    Temps plein
    Сontrat
    Pour les contractants
    Travail à distance

    Tundra Technical Solutions

    Remote
    il y a 1 jour
  •  ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager, Voice AI based in Canada. As an Engineering Manager, Voice AI, you will lead a high-performing engineering team building advanced... 
    Suggéré
    Embauche directe

    Jobgether

    Remote
    il y a 2 jours
  • $40 par heure

     ...your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible hours... 
    Suggéré
    Temps partiel
    Travail à distance
    Horaires flexibles

    Handshake

    Remote
    Il y a un mois
  •  ...a competitive advantage. Cresta’s unified AI platform combines conversational AI agents...  .... That’s you.   As our first AI Agent Evaluation Engineer, you define what quality means for...  ...engineers, product managers, and the voice/language engineering team to turn findings... 
    Suggéré
    Temps plein
    Travail au bureau
    Travail à distance
    Bureau à domicile
    Horaires flexibles

    Cresta

    Remote
    il y a 5 jours
  • © 2026 Smart Ecosystems. All rights reserved.
    Suggéré
    Сontrat

    Outlier AI

    Remote
    il y a 4 jours
  •  ...About the role AI assistants are becoming part of everyday life, helping people with...  ...and select your preferred experience. Evaluate conversational quality, helpfulness,...  ...simple testing guidelines and document your evaluations accurately. Who we're looking for Active... 
    Taux horaire
    Travail temporaire
    Temps partiel
    Travail à distance

    micro1

    Remote
    il y a 6 jours
  •  ...every conversation into a competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent...  ...it deserves a full-time owner. That’s you. As our first AI Agent Evaluation Engineer, you define what quality means for every agent we run,... 
    Temps plein

    Cresta

    Remote
    il y a 6 jours
  • $10 - $24 par heure

     ...Teach live online classes on grading one AI response against written criteria: accuracy, instruction following and safety, with a justification...  .... What the work is for YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut... 
    Сontrat
    Travail à distance

    YPAI

    Remote
    il y a 6 jours
  • usd16 par heure

     ...We are looking for AI Voice Recording Contributors to join a French (Canada) voice evaluation project and help support the development of the next generation of AI technologies. Job Type Freelance Location Work from home Work Schedule Flexible, task-based work (approximately... 
    Temps plein
    Freelance
    Recrutement immédiat
    Travail à distance
    Travail à domicile
    Horaires flexibles

    RWS

    Remote
    il y a 7 jours
  •  ...your own work and turn each one into a self-contained Task that an AI agent has to solve in a Linux terminal. For every Task, you'll...  ...programming languages - **Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography, reverse engineering,... 
    Travail posté

    Workada

    Remote
    il y a 13 jours
  • $30 par heure

     ...pays native Persian (also Farsi) speakers to act out short scripted scenes with a set emotion. The recordings are licensed to AI labs to train voice models. Pay: Up to $30/hr, earned as coins (1,000 coins = $1) and cashed out via PayPal, Venmo or gift cards; daily earning... 
    Temps partiel
    Travail à domicile

    Improv Arena

    Remote
    il y a 18 jours
  •  ...Job Application for Voice Actor - Freelance AI Trainer Project at Meridial Back to jobs Voice Actor...  ...cutting-edge AI tools, record and evaluate speech samples, and provide expert feedback...  ...with our team to refine prompts, evaluation methods, and voice design guidelines.... 
    Taux horaire
    Сontrat
    Temps partiel
    Pour les contractants
    Freelance
    Travail à distance

    Invisible Technologies

    Remote
    il y a 29 jours
  • $30 - $60 par heure

     ...Source verification Reasoning clarity Evaluation expertise About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and...  ...Role Title: Domain Contributor - Evaluation Specialist Role Type: Contractor (~15 hrs/week) Location... 
    Temps partiel
    Pour les contractants
    Travail à distance
    Horaires flexibles

    micro1

    Remote
    il y a 28 jours
  •  ...project requirements Help Shape the Future of AI in Healthcare What if the medical...  ...understands complex healthcare information, evaluates medical scenarios, and delivers more accurate...  ...with opportunities to contribute to the evaluation and improvement of advanced Artificial... 
    Сontrat
    Pour les contractants
    Stage de formation
    Travail à distance

    Volga Partners

    Remote
    il y a 13 jours
  •  ...Project Are you fluent in French (FR) and interested in working on AI-related projects? We're currently looking for detail-oriented individuals to join our talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance, remote opportunity... 
    Сontrat
    Freelance
    Travail à distance
    Horaires flexibles

    e2f

    Remote
    il y a 16 jours
  • $10 - $30 par heure

     ...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability collaboration...  ...train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... 
    Temps partiel
    Pour les contractants
    Travail à distance
    Travail posté

    micro1

    Remote
    il y a 23 jours
  • usd16 par heure

     ...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type...  ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality... 
    Taux horaire
    Tarif journalier
    Temps plein
    Freelance
    Recrutement immédiat
    Travail à distance
    Horaires flexibles

    RWS

    Remote
    Il y a un mois
  •  ...Curate and evaluate code in Rust to enhance AI training datasets. About Us Based in San Francisco, California, Turing is the world's leading research...  ...and written communication skills for clear, structured evaluation rationales. Engagement Details Commitment:... 
    Temps partiel
    Pour les contractants
    Horaires flexibles

    Turing

    Remote
    il y a 12 jours
  •  ...AI Fact-Checking & Response Evaluation Reviewer (German) Mission of the Role Apply independent judgment to identify AI blind spots, reasoning failures...  ...growth into advanced AI Quality, Fact-Checking, and QC Specialist roles ~ Help shape how AI systems evaluate information... 
    Contrat Longue Durée
    Сontrat
    Freelance
    Travail à distance
    Horaires flexibles

    e2f

    Remote
    il y a 7 jours
  •  ...remote, hourly contractor role supporting AI data and language projects on a project-based...  ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for...  ...model responses, or recording high-quality voice samples, to guide AI learning across diverse... 
    Taux horaire
    Сontrat
    Pour les contractants
    Travail à distance
    Horaires flexibles

    CNTXT AI

    Remote
    il y a 27 jours
  • $30 - $60 par heure

     ...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to...  .... Role Title: Research Evaluation Specialist (PhD or Masters / Researcher) Role Type:... 
    Pour les contractants
    Travail à distance
    Le monde entier

    micro1

    Remote
    il y a 20 jours
  • $100 par heure

     ...Checked Nov 7 → How Ethos hiring works Your application is a 10-minute call. Ethos's AI interviewer asks about your career, then matches you to projects like Voice AI Phone Agents: Paid User Interview. Keep your CV open and walk through the roles and skills that... 

    Ethos

    Remote
    il y a 11 jours
  • $40 - $65 par heure

     ...partner is looking for a British English Voice Expert based in Canada. As a British...  ...Expert, you will contribute to an AI training project focused on evaluating the quality and authenticity of...  ...guidelines and maintain high standards of evaluation. This freelance opportunity is ideal... 
    Taux horaire
    Temps plein
    Сontrat
    Temps partiel
    Freelance
    Recrutement immédiat
    Travail à distance
    Le monde entier
    Horaires flexibles

    Jobgether

    Remote
    il y a 8 jours
  •  ...steps. Our partner is looking for a Senior AI Content Specialist based in Canada . As a Senior AI...  ...defining their personalities, tone of voice, behavioral guidelines, and responses to...  ...reduce repetitive manual tasks. - Establish evaluation frameworks, quality standards, and... 
    Temps plein
    Travail manuel
    Travail à distance

    Jobgether

    Remote
    il y a 7 jours
  •  ...looking for a Solution Architect, Salesforce Voice based in Canada. As a Solution Architect,...  ...in designing and delivering innovative, AI-powered customer service and contact center...  ...with cross-functional teams, including AI specialists and technical experts, to deliver tailored... 

    Jobgether

    Remote
    il y a 5 jours
  •  ...Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve...  ..., specifically across desktop and mobile applications. Skills evaluation: You'll rate AI-generated outputs across multiple dimensions, provide... 
    Temps plein
    Сontrat

    Contra Labs

    Remote
    il y a 8 jours
  •  ...review - We'll assess your Contra profile and portfolio for strength in videography across a range of subjects and styles. # Skills evaluation - You’ll complete a structured videography submission designed to evaluate attention to detail, consistency, and execution.... 
    Temps plein
    Сontrat

    Contra Labs

    Remote
    il y a 27 jours
  •  ...Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve...  ...get paid when a job comes through. What You May Work On Evaluate AI-generated visual outputs across a wide range of styles, subjects... 
    Temps plein
    Сontrat

    Contra Labs

    Remote
    il y a 27 jours
  • $30 - $65 par heure

     ...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to...  ...quality and velocity. Job Title: Chinese Voice Coach Job Type: Contract Location:... 
    Сontrat
    Temps partiel
    Travail à distance
    Horaires flexibles

    micro1

    Remote
    il y a 19 jours
  •  ...About the Role mpathic provides independent, multidisciplinary evaluations of healthcare AI technologies seeking deployment in real-world clinical settings. As part of our work supporting Utah's Office of Artificial Intelligence Policy (OAIP) regulatory sandbox, we are recruiting... 
    Сontrat
    Travail au bureau
    Travail posté

    mpathic

    Remote
    Il y a un mois

Voulez-vous recevoir plus d'offres d'emploi ?

S'abonner et recevoir des offres d'emploi similaires à AI Voice Evaluation Specialist. Soyez parmi les premiers à postuler !