Conversational Ai Qa Lead
CGS Immersive
Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting product quality through thoughtful manual and AI-assisted QA.As Quality Assurance Lead, you will assess whether conversational experiences meet agreed learning objectives and rubrics. You will maintain representative scenarios, repeat evaluations after model or content changes, and detect variation, unsupported claims, context loss, bias, inappropriate feedback, or instruction bypasses. Your work combines functional coverage with sound independent judgment.Key Responsibilities:
Evaluate simulation behaviour, AI coaching, scoring, critique, and guidanceMaintain approved AI scenarios and representative reference examplesReassess experiences after model, prompt, content, or configuration changesCover permissions, negative scenarios, interruptions, boundaries, and recovery pathsIdentify automation candidates while maintaining manual exploratory coverageRequirements:
Experience testing AI applications, conversational interfaces, or learning platformsAbility to translate complex functionality into comprehensive test scenariosStrong attention to detail, organization, and written communicationAbility to learn products deeply and assess intended outcomesFamiliarity with Xray, Zephyr, TestRail, or established testing practicesApply AI evaluation, exploratory testing, learning-outcome assessment, and QA process ownership to every CGS Immersive release.
#J-18808-Ljbffr
Evaluate simulation behaviour, AI coaching, scoring, critique, and guidanceMaintain approved AI scenarios and representative reference examplesReassess experiences after model, prompt, content, or configuration changesCover permissions, negative scenarios, interruptions, boundaries, and recovery pathsIdentify automation candidates while maintaining manual exploratory coverageRequirements:
Experience testing AI applications, conversational interfaces, or learning platformsAbility to translate complex functionality into comprehensive test scenariosStrong attention to detail, organization, and written communicationAbility to learn products deeply and assess intended outcomesFamiliarity with Xray, Zephyr, TestRail, or established testing practicesApply AI evaluation, exploratory testing, learning-outcome assessment, and QA process ownership to every CGS Immersive release.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Conversational Ai Qa Lead in Winnipeg, MB vacancy
- A leading IT consulting firm in Toronto is seeking a talented UI/UX Manager - Conversation Design Consultant to create intuitive and customer-centric conversational experiences. The ideal candidate has over 5 years of experience in UX design and at least 2 years in conversation...SuggestedContract work
- ...Laotop recherche un Tech Lead spécialisé en Azure AI à Montréal pour piloter des solutions conversationnelles basées sur LLM et Azure OpenAI, afin de devenir la référence technique IA du projet. Le candidat idéal possède 10+ années en développement logiciel, 5+ ans d'expérience...Suggested
- ...or future sponsorship)Employment Type: Full-time ProfessionalRole Overview & Key Requirements:Focus: Architecture and design of Conversational AI solutions using Dialogflow CX, CCAI Insights, CCAI Agent Assist, and Vertex AI Agent Builder.Experience: 8+ years demonstrating...SuggestedFull timeTemporary workRemote work
- ...verbal communication skills requiredDuration: 6-month contractAbout the Opportunity This is an exciting opportunity for a Conversational AI Engineer to help build AI-powered employee experiences within a large, complex enterprise environment. Working across digital workplace...Suggested
- ...at your fingertips. With our AI-powered Global Work Platform™,... ...scale faster, compete harder, and lead the future of global work.... ...Manager to lead our high‑impact Conversational AI team. This is a critical... ...focus on metrics‑driven growth, conversion, and user experience. Communication...SuggestedContract workWork at officeLocal areaFlexible hours
- Iris Software Inc. is seeking an experienced QA Automation Lead (Playwright) to drive quality across web and enterprise applications in Toronto.... ...background in UI/API/end-to-end testing, and a track record of applying AI-driven testing techniques to boost coverage and efficiency....
- RBC seeks a QA Lead to drive excellence in AI testing initiatives and lead a team of quality engineers. This role emphasizes hands-on testing, automation, and strategic mentorship. As the QA Lead, you will engineer robust testing frameworks while mentoring QA engineers in...
- ...The Conversion Rate Optimization (CRO) Lead is responsible for driving measurable improvements across Ritchie Bros. digital customer journeys, helping turn... ...platforms, experimentation tools, CMS platforms, and modern AI-assisted development tools. The CRO Lead will also act...
- ...Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM...
- Join Fortinet as a Lead QA Engineer, specializing in SaaS testing for our innovative FortiAIGate AI security solutions. This role encompasses testing for both on-premises and cloud deployments. As a senior contributor, you will spearhead the end-to-end testing process for...
- Shape Conversational AI strategy and customer experiences as Enercare’s Digital Product Owner in Markham, Ontario. Apply product ownership and analytics skills daily.This regular, full-time role owns Enercare’s current and future AI-powered customer interactions across outbound...Full time
$50 - $60 per hour
...pay rangeCA$50.00/hr - CA$60.00/hr Direct message the job poster from Creative Circle OverviewOur FI client is looking for a Conversation Designer to join their team. This will be a 12+ month, full‑time engagement with 4 days per week onsite downtown. Responsibilities...Full time$140k - $180k per year
An AI Experience Engineer owns the full lifecycle of the journeys our customers have with Upgrade's AI agent on chat, voice and email... ...transcripts, recordings and analytics every week, find where conversations fail or transfer, and ship fixes to journey logic, instructions...Internship- Build conversational AI with Botpress as a Senior Software Developer, using JavaScript, TypeScript, Node.Js, and React to create customer-impacting... ...quality, and performance improvements.Key Responsibilities: Lead feature design, development, testing, and deploymentMake...
- ...Litmus is seeking a QA Architect to own test automation and quality for Litmus Edge Manager (LEM). You will build a modern Playwright framework... ..., and collaborates with global teams to ensure scalable, reliable testing as Litmus scales its industrial AI platform. #J-18808-Ljbffr
$74.82k - $118.21k per year
...Role: Digital Product Owner, Conversational AIStatus: Regular, Full-TimeReports... ...Owner, Conversational AI is responsible for shaping and... ...underperformance. Analyze AI conversations, customer and agent feedback,... ...supporting capabilities. Lead product readiness for...Work from home- Lead AI/ML direction for Stripe’s Conversation Platform, shaping RAG systems and LLM-powered experiences for merchants worldwide. This position is not described with a work model.As an Engineering Manager, you will guide teams building machine learning systems from ideas through...Worldwide
- Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications. The role requires 10+...
- Drive conversion optimization from Canada in a fully remote CRO Lead role centered on Optimizely experimentation and measurable digital performance.This CRO Lead owns end-to-end conversion optimization across digital platforms. You will shape experimentation strategy, develop...Remote work
- ...applications and next steps. Our partner is looking for a Conversion Rate Optimization (CRO) Lead based in Canada. We are seeking a data-driven and creative... ..., global team. How Jobgether works: We use an AI-powered matching process to ensure your application is reviewed...Casual workRemote workFlexible hours
- Join us as a Creative Conversational Designer, focusing on crafting natural conversation flows for various brands. Your skills in human-computer interaction and conversation... ...Designer who has 2-4 years in conversational AI or chatbot ecosystems. This role involves analyzing...
- ...STAN AI, North York, Ontario, Canada, is seeking a Solutions Engineer to own the technical health of deployments end to end. You will troubleshoot AI behavior, refine prompts, analyze data, and work with engineering to fix issues, then clearly explain outcomes to customers....
$161k - $175k per year
...Experience Level: Proficient (8-12+ years of experience) Are you a seasoned QA professional who enjoys balancing hands‑on testing with strategic quality leadership? Trissential is hiring a QA Lead to join our client's team in Montreal. This is an exciting opportunity to...Hourly payWork at officeFlexible hours3 days per week- Role: QA LeadLocation: Toronto, CanadaDuration: 6+ MonthsBGV will be done for the selected candidates.Strong knowledge on Mortgage Securitization... ...ABS or TAO. Knowledge on TAO product is added advantageStrong QA Lead experience around 7-8 years and have done Planning, estimation...
- QA Team Lead Position Overview Centrilogic is seeking to strengthen its quality assurance (QA) practice, which places testing professionals on... ..., and bring innovation to the work, including practical use of AI. You will also write automation and review AI-produced test assets...
- QA Lead (Automation)Department: Technology Employment Type: Permanent Location: Calgary, Canada Reporting To: Sr. Director... ...combine technical leadership with practical delivery: designing AI assisted test strategies, building and reviewing automation,...Permanent employment
- ...(a subsidiary of Delta Electronics) is a leading building controls manufacturer with over 300... ...SummaryThe Software Quality Assurance (QA) Lead is responsible for ensuring Delta IBT’ software... ...leader who drives innovation through AI technologies and modern automation practices...Long term contractWork at officeRemote workFlexible hours
- ...Preparedness today, safer tomorrow. Emergent is a leading public health company that delivers protective and life-saving solutions to... ...collaboration, respectful challenge, and ability to strongly support QA decisions Continually monitor the effectiveness of the DI/CSV program...For contractorsLocal areaFlexible hours
$95k - $130k per year
...Cosmo is on the rise.About the Role Reports To: QA Engineering ManagerDepartment: EngineeringRole... ...seeking a highly skilled and forward-thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI-based tools and intelligent automation across...- Use Node.Js and LangGraph.Js to develop conversational AI for GoodTime’s Cori agent. This remote-first role is available to candidates located in Canada.GoodTime’s Senior Full Stack Engineer will help the Growth Team shape scalable AI features for autonomous hiring. You will...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Conversational Ai Qa Lead. Be the first to apply!
Related searches
- qa lead Winnipeg, MB
- entry level qa Winnipeg, MB
- remote qa Winnipeg, MB
- pharmaceutical quality assurance Winnipeg, MB
- software qa Winnipeg, MB
- assurance qualité Winnipeg, MB
- analyste assurance qualité Winnipeg, MB
- assurance qualite pharmaceutique Winnipeg, MB
- quality assurance intern Winnipeg, MB
- qa Winnipeg, MB

