AI Voice Evaluation Specialist
Jobgether
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Voice Evaluation Specialist based in Canada. Join an innovative AI-focused environment as an AI Voice Evaluation Specialist, where you will contribute to improving the quality, reliability, and performance of next-generation conversational AI systems. In this role, you will interact directly with two different AI models through real-time voice conversations, using identical scenarios to assess and compare their performance. You will evaluate conversational quality, identify potential errors, and analyze how effectively each model responds to different situations. Your observations and structured assessments will help determine which systems deliver the strongest and most natural user experiences. This opportunity is ideal for someone with excellent listening skills, strong analytical abilities, and a keen interest in artificial intelligence and voice-based technologies. You will work independently within a structured evaluation framework, ensuring consistency, objectivity, and accuracy throughout each assessment. Accountabilities: - Review assigned scenarios and conduct natural, voice-based roleplay conversations with two different AI models. - Interact with Model A and Model B using the same scenarios, maintaining consistent conversational approaches and conditions to ensure fair comparisons. - Keep approximately the same number of conversational turns with each model to support balanced and reliable evaluations. - Record voice interactions and carefully assess the quality, accuracy, relevance, and overall behavior of each model's responses. - Evaluate both AI models across five predefined quality dimensions, following established assessment criteria and evaluation guidelines. - Identify, document, and categorize relevant error patterns and clusters occurring during audio interactions or conversations. - Compare the performance of both models using structured evaluation frameworks and observations gathered throughout the interactions.
- Determine which model demonstrates stronger overall performance based on the defined quality standards and evaluation criteria. - Prepare detailed written rationales supporting final evaluations, referencing specific conversational examples and observations from both models. - Apply evaluation guidelines consistently across different scenarios and interactions to ensure objective, accurate, and dependable results. - Maintain high standards of documentation, attention to detail, and evaluation consistency throughout all assigned tasks. Requirements: - Bachelor's degree or equivalent relevant educational background. - Excellent attention to detail, with the ability to identify subtle differences in conversational quality, response accuracy, and AI model behavior. - Strong listening and comprehension skills, including the ability to understand spoken interactions and recognize inconsistencies or errors. - Excellent written communication skills, with the ability to document findings clearly, objectively, and accurately. - Ability to follow detailed instructions, structured evaluation frameworks, and predefined quality assessment guidelines. - Confidence in speaking naturally and participating in roleplay conversations across different scenarios. - Strong analytical and critical-thinking abilities, with the capacity to compare two interactions fairly and identify meaningful performance differences. - Objectivity and impartiality when evaluating AI-generated responses, without allowing personal preferences to influence final assessments. - High levels of reliability, consistency, and time management when completing repetitive and structured evaluation assignments. - Genuine interest in artificial intelligence, conversational AI assistants, voice technologies, or emerging AI applications.
$30 - $35 par heure
...Description Overview We are looking for voice and audio experts with practical audio... ...practical listening and recording skills, not specialist audio engineering. What You'll Do... ...Task Execution: Complete recording, evaluation, and annotation tasks accurately. Check your...SuggéréTemps pleinСontratPour les contractantsTravail à distance- ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager, Voice AI based in Canada. As an Engineering Manager, Voice AI, you will lead a high-performing engineering team building advanced...SuggéréEmbauche directe
$40 par heure
...your choices. Accept All Customize Settings Reject All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the project Bachelor's Remote Part-time Flexible hours...SuggéréTemps partielTravail à distanceHoraires flexibles- ...a competitive advantage. Cresta’s unified AI platform combines conversational AI agents... .... That’s you. As our first AI Agent Evaluation Engineer, you define what quality means for... ...engineers, product managers, and the voice/language engineering team to turn findings...SuggéréTemps pleinTravail au bureauTravail à distanceBureau à domicileHoraires flexibles
- © 2026 Smart Ecosystems. All rights reserved.SuggéréСontrat
- ...About the role AI assistants are becoming part of everyday life, helping people with... ...and select your preferred experience. Evaluate conversational quality, helpfulness,... ...simple testing guidelines and document your evaluations accurately. Who we're looking for Active...Taux horaireTravail temporaireTemps partielTravail à distance
- ...every conversation into a competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent... ...it deserves a full-time owner. That’s you. As our first AI Agent Evaluation Engineer, you define what quality means for every agent we run,...Temps plein
$10 - $24 par heure
...Teach live online classes on grading one AI response against written criteria: accuracy, instruction following and safety, with a justification... .... What the work is for YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut...СontratTravail à distanceusd16 par heure
...We are looking for AI Voice Recording Contributors to join a French (Canada) voice evaluation project and help support the development of the next generation of AI technologies. Job Type Freelance Location Work from home Work Schedule Flexible, task-based work (approximately...Temps pleinFreelanceRecrutement immédiatTravail à distanceTravail à domicileHoraires flexibles- ...your own work and turn each one into a self-contained Task that an AI agent has to solve in a Linux terminal. For every Task, you'll... ...programming languages - **Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography, reverse engineering,...Travail posté
$30 par heure
...pays native Persian (also Farsi) speakers to act out short scripted scenes with a set emotion. The recordings are licensed to AI labs to train voice models. Pay: Up to $30/hr, earned as coins (1,000 coins = $1) and cashed out via PayPal, Venmo or gift cards; daily earning...Temps partielTravail à domicile- ...Job Application for Voice Actor - Freelance AI Trainer Project at Meridial Back to jobs Voice Actor... ...cutting-edge AI tools, record and evaluate speech samples, and provide expert feedback... ...with our team to refine prompts, evaluation methods, and voice design guidelines....Taux horaireСontratTemps partielPour les contractantsFreelanceTravail à distance
$30 - $60 par heure
...Source verification Reasoning clarity Evaluation expertise About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and... ...Role Title: Domain Contributor - Evaluation Specialist Role Type: Contractor (~15 hrs/week) Location...Temps partielPour les contractantsTravail à distanceHoraires flexibles- ...project requirements Help Shape the Future of AI in Healthcare What if the medical... ...understands complex healthcare information, evaluates medical scenarios, and delivers more accurate... ...with opportunities to contribute to the evaluation and improvement of advanced Artificial...СontratPour les contractantsStage de formationTravail à distance
- ...Project Are you fluent in French (FR) and interested in working on AI-related projects? We're currently looking for detail-oriented individuals to join our talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance, remote opportunity...СontratFreelanceTravail à distanceHoraires flexibles
$10 - $30 par heure
...detail constructive feedback digital delivery platforms ai-driven tools familiarity independent work adaptability collaboration... ...train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM...Temps partielPour les contractantsTravail à distanceTravail postéusd16 par heure
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type... ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality...Taux horaireTarif journalierTemps pleinFreelanceRecrutement immédiatTravail à distanceHoraires flexibles- ...Curate and evaluate code in Rust to enhance AI training datasets. About Us Based in San Francisco, California, Turing is the world's leading research... ...and written communication skills for clear, structured evaluation rationales. Engagement Details Commitment:...Temps partielPour les contractantsHoraires flexibles
- ...AI Fact-Checking & Response Evaluation Reviewer (German) Mission of the Role Apply independent judgment to identify AI blind spots, reasoning failures... ...growth into advanced AI Quality, Fact-Checking, and QC Specialist roles ~ Help shape how AI systems evaluate information...Contrat Longue DuréeСontratFreelanceTravail à distanceHoraires flexibles
- ...remote, hourly contractor role supporting AI data and language projects on a project-based... ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for... ...model responses, or recording high-quality voice samples, to guide AI learning across diverse...Taux horaireСontratPour les contractantsTravail à distanceHoraires flexibles
$30 - $60 par heure
...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to... .... Role Title: Research Evaluation Specialist (PhD or Masters / Researcher) Role Type:...Pour les contractantsTravail à distanceLe monde entier$100 par heure
...Checked Nov 7 â How Ethos hiring works Your application is a 10-minute call. Ethos's AI interviewer asks about your career, then matches you to projects like Voice AI Phone Agents: Paid User Interview. Keep your CV open and walk through the roles and skills that...$40 - $65 par heure
...partner is looking for a British English Voice Expert based in Canada. As a British... ...Expert, you will contribute to an AI training project focused on evaluating the quality and authenticity of... ...guidelines and maintain high standards of evaluation. This freelance opportunity is ideal...Taux horaireTemps pleinСontratTemps partielFreelanceRecrutement immédiatTravail à distanceLe monde entierHoraires flexibles- ...steps. Our partner is looking for a Senior AI Content Specialist based in Canada . As a Senior AI... ...defining their personalities, tone of voice, behavioral guidelines, and responses to... ...reduce repetitive manual tasks. - Establish evaluation frameworks, quality standards, and...Temps pleinTravail manuelTravail à distance
- ...looking for a Solution Architect, Salesforce Voice based in Canada. As a Solution Architect,... ...in designing and delivering innovative, AI-powered customer service and contact center... ...with cross-functional teams, including AI specialists and technical experts, to deliver tailored...
- ...Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve... ..., specifically across desktop and mobile applications. Skills evaluation: You'll rate AI-generated outputs across multiple dimensions, provide...Temps pleinСontrat
- ...review - We'll assess your Contra profile and portfolio for strength in videography across a range of subjects and styles. # Skills evaluation - You’ll complete a structured videography submission designed to evaluate attention to detail, consistency, and execution....Temps pleinСontrat
- ...Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve... ...get paid when a job comes through. What You May Work On Evaluate AI-generated visual outputs across a wide range of styles, subjects...Temps pleinСontrat
$30 - $65 par heure
...About micro1 micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to... ...quality and velocity. Job Title: Chinese Voice Coach Job Type: Contract Location:...СontratTemps partielTravail à distanceHoraires flexibles- ...About the Role mpathic provides independent, multidisciplinary evaluations of healthcare AI technologies seeking deployment in real-world clinical settings. As part of our work supporting Utah's Office of Artificial Intelligence Policy (OAIP) regulatory sandbox, we are recruiting...СontratTravail au bureauTravail posté
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à AI Voice Evaluation Specialist. Soyez parmi les premiers à postuler !

