Conversational Ai Qa Lead
CGS Immersive
Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting product quality through thoughtful manual and AI-assisted QA.As Quality Assurance Lead, you will assess whether conversational experiences meet agreed learning objectives and rubrics. You will maintain representative scenarios, repeat evaluations after model or content changes, and detect variation, unsupported claims, context loss, bias, inappropriate feedback, or instruction bypasses. Your work combines functional coverage with sound independent judgment.Key Responsibilities:
Evaluate simulation behaviour, AI coaching, scoring, critique, and guidanceMaintain approved AI scenarios and representative reference examplesReassess experiences after model, prompt, content, or configuration changesCover permissions, negative scenarios, interruptions, boundaries, and recovery pathsIdentify automation candidates while maintaining manual exploratory coverageRequirements:
Experience testing AI applications, conversational interfaces, or learning platformsAbility to translate complex functionality into comprehensive test scenariosStrong attention to detail, organization, and written communicationAbility to learn products deeply and assess intended outcomesFamiliarity with Xray, Zephyr, TestRail, or established testing practicesApply AI evaluation, exploratory testing, learning-outcome assessment, and QA process ownership to every CGS Immersive release.
#J-18808-Ljbffr
Evaluate simulation behaviour, AI coaching, scoring, critique, and guidanceMaintain approved AI scenarios and representative reference examplesReassess experiences after model, prompt, content, or configuration changesCover permissions, negative scenarios, interruptions, boundaries, and recovery pathsIdentify automation candidates while maintaining manual exploratory coverageRequirements:
Experience testing AI applications, conversational interfaces, or learning platformsAbility to translate complex functionality into comprehensive test scenariosStrong attention to detail, organization, and written communicationAbility to learn products deeply and assess intended outcomesFamiliarity with Xray, Zephyr, TestRail, or established testing practicesApply AI evaluation, exploratory testing, learning-outcome assessment, and QA process ownership to every CGS Immersive release.
#J-18808-Ljbffr
Vacancy posted 57 minutes ago
Similar jobs that could be interesting for youBased on the Conversational Ai Qa Lead in Winnipeg, MB vacancy
- A leading IT consulting firm in Toronto is seeking a talented UI/UX Manager - Conversation Design Consultant to create intuitive and customer-centric conversational experiences. The ideal candidate has over 5 years of experience in UX design and at least 2 years in conversation...SuggestedContract work
- ...Laotop recherche un Tech Lead spécialisé en Azure AI à Montréal pour piloter des solutions conversationnelles basées sur LLM et Azure OpenAI, afin de devenir la référence technique IA du projet. Le candidat idéal possède 10+ années en développement logiciel, 5+ ans d'expérience...Suggested
- ...or future sponsorship)Employment Type: Full-time ProfessionalRole Overview & Key Requirements:Focus: Architecture and design of Conversational AI solutions using Dialogflow CX, CCAI Insights, CCAI Agent Assist, and Vertex AI Agent Builder.Experience: 8+ years demonstrating...SuggestedFull timeTemporary workRemote work
- ...Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM...Suggested
- ...at your fingertips. With our AI-powered Global Work Platform™,... ...scale faster, compete harder, and lead the future of global work.... ...Manager to lead our high‑impact Conversational AI team. This is a critical... ...focus on metrics‑driven growth, conversion, and user experience. Communication...SuggestedContract workWork at officeLocal areaFlexible hours
- Shape Conversational AI strategy and customer experiences as Enercare’s Digital Product Owner in Markham, Ontario. Apply product ownership and analytics skills daily.This regular, full-time role owns Enercare’s current and future AI-powered customer interactions across outbound...Full time
$140k - $180k per year
# AI Experience Engineer (Conversational AI)UpgradeRemote Full Time Remote Posted 2 hours agoShare this job:WhatsApp LinkedIn X Facebook Email####... ...Studio (no-code journeys), Sierra simulations and conversation analytics, GraphQL and REST APIs (as journey tools), Genesys...Full timeInternshipSecond jobRemote workFlexible hours- Own Jobber’s lead nurture and conversion engine from Edmonton, Toronto, Vancouver, or Kitchener-Waterloo, connecting customer journeys to revenue.The... ..., size opportunities, and prioritize work. Using automation, AI-enriched profiles, and personalized communications, you will...
- ...The Conversion Rate Optimization (CRO) Lead is responsible for driving measurable improvements across Ritchie Bros. digital customer journeys, helping turn... ...platforms, experimentation tools, CMS platforms, and modern AI-assisted development tools. The CRO Lead will also act...
- Design conversational AI experiences in Toronto using conversation architecture, prompt writing, and human-centred service design. Shape virtual agents across digital channels.As a Senior Conversation Designer, you will create intelligent experiences for chatbots, voicebots...
- Lead AI/ML direction for Stripe’s Conversation Platform, building RAG systems and fine-tuned models for merchants worldwide. This engineering leadership role is end to end.As an Engineering Manager, you will guide teams developing machine learning models, streaming feature pipelines...Worldwide
- Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications. The role requires 10+...
$74.82k - $118.21k per year
...Role: Digital Product Owner, Conversational AIStatus: Regular, Full-TimeReports... ...Owner, Conversational AI is responsible for shaping and... ...underperformance. Analyze AI conversations, customer and agent feedback,... ...supporting capabilities. Lead product readiness for...Work from home- Lead AI/ML direction for Stripe’s Conversation Platform, shaping RAG systems and LLM-powered experiences for merchants worldwide. This position is not described with a work model.As an Engineering Manager, you will guide teams building machine learning systems from ideas through...Worldwide
- Build conversational AI with Botpress as a Senior Software Developer, using JavaScript, TypeScript, Node.Js, and React to create customer-impacting... ...quality, and performance improvements.Key Responsibilities: Lead feature design, development, testing, and deploymentMake...
- ...McKesson is seeking a Digital Agent Developer to design, build, test, and continuously improve AI-powered agents across voice, chat, and email channels within the Sierra Agent OS ecosystem. You will partner with platform engineers, solution architects, and business stakeholders...
- ...(a subsidiary of Delta Electronics) is a leading building controls manufacturer with over 300... ...SummaryThe Software Quality Assurance (QA) Lead is responsible for ensuring Delta IBT’ software... ...leader who drives innovation through AI technologies and modern automation practices...Long term contractWork at officeRemote workFlexible hours
- ...STAN AI, North York, Ontario, Canada, is seeking a Solutions Engineer to own the technical health of deployments end to end. You will troubleshoot AI behavior, refine prompts, analyze data, and work with engineering to fix issues, then clearly explain outcomes to customers....
- Job Description Engineering Manager, AI Conversation Platform Who we are About Stripe... ...and delight customers. You have experience leading teams that develop streaming feature pipelines... ...or equivalent Individual Contributor.Lead by example in high-growth, high-impact, ambiguous...
- ...Future of Customer ConversationsWe're looking for a Senior Conversation Designer to lead the design of intelligent, human-centred conversational experiences across virtual agents, chatbots, voicebots, and AI-powered service channels. In this role, you'll transform...
$95k - $130k per year
...Cosmo is on the rise.About the Role Reports To: QA Engineering ManagerDepartment: EngineeringRole... ...seeking a highly skilled and forward-thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI-based tools and intelligent automation across...- QA Lead (Automation)Department: Technology Employment Type: Permanent Location: Calgary, Canada Reporting To: Sr. Director... ...combine technical leadership with practical delivery: designing AI assisted test strategies, building and reviewing automation,...Permanent employment
- ...Preparedness today, safer tomorrow. Emergent is a leading public health company that delivers protective and life-saving solutions to... ...protecting and saving lives. Job Summary The Specialist I, QA Operations supports the Winnipeg site by providing quality oversight...Contract workFlexible hours
- About Glia Glia is the #1 Banking AI platform, empowering community and regional financial... .... People notice every pause in a conversation. We aim for the best voice AI experience available... .... Ideally, you bring prior tech lead, team lead, or mentorship experience.Glia...Internship
- ...Preparedness today, safer tomorrow. Emergent is a leading public health company that delivers protective and life-saving solutions to... ...collaboration, respectful challenge, and ability to strongly support QA decisions Continually monitor the effectiveness of the DI/CSV program...For contractorsLocal areaFlexible hours
- ...Aylo is seeking a Growth Marketing Specialist to drive user acquisition and conversions for a new telehealth product. You will own the customer journey from media buying to landing-page optimization, leveraging traffic across Aylo’s product ecosystem. Ideal candidates bring...
- ...Delta Intelligent Building Technologies (Canada) Inc., formerly Delta Controls, is seeking a Software QA Lead to drive testing strategy, automation, and AI-assisted QA across our building automation software. The role emphasizes hands-on leadership, mentoring, and collaboration...
- Senior Quality Assurance Specialist (AI Testing / QA Lead) Location: Toronto, ON | Hybrid, 3 days per week onsite, 2 days remote Language: English, excellent written and verbal communication required Duration: 6-month contract, 35 hours per week About the...Contract workRemote work3 days per weekWeekday work
- ...Lightspeed Commerce, Inc. recherche un gestionnaire de l’optimisation des conversions pour diriger les initiatives OTC des sites marketing et travailler en collaboration avec les équipes Growth et Product afin d’améliorer l’expérience utilisateur et les taux de conversion....Permanent employmentWork at office
- Join to apply for the Lead QA Engineer role at Infoya Infoya is a global IT consulting and services organization that collaborates with visionary leaders to deliver innovative solutions and guide transformative change. We work hand‑in‑hand with our clients to solve...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Conversational Ai Qa Lead. Be the first to apply!
Related searches
- qa lead Winnipeg, MB
- remote quality assurance Winnipeg, MB
- qa software testing Winnipeg, MB
- quality assurance Winnipeg, MB
- stage assurance qualité Winnipeg, MB
- responsable assurance qualité Winnipeg, MB
- entry level qa Winnipeg, MB
- specialiste assurance qualité Winnipeg, MB
- pharmaceutical quality assurance Winnipeg, MB
- quality assurance intern Winnipeg, MB

