Conversational AI QA Lead
CGS Immersive
Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting product quality through thoughtful manual and AI-assisted QA.
As Quality Assurance Lead, you will assess whether conversational experiences meet agreed learning objectives and rubrics. You will maintain representative scenarios, repeat evaluations after model or content changes, and detect variation, unsupported claims, context loss, bias, inappropriate feedback, or instruction bypasses. Your work combines functional coverage with sound independent judgment.
Key Responsibilities:
- Evaluate simulation behaviour, AI coaching, scoring, critique, and guidance
- Maintain approved AI scenarios and representative reference examples
- Reassess experiences after model, prompt, content, or configuration changes
- Cover permissions, negative scenarios, interruptions, boundaries, and recovery paths
- Identify automation candidates while maintaining manual exploratory coverage
Requirements:
- Experience testing AI applications, conversational interfaces, or learning platforms
- Ability to translate complex functionality into comprehensive test scenarios
- Strong attention to detail, organization, and written communication
- Ability to learn products deeply and assess intended outcomes
- Familiarity with Xray, Zephyr, TestRail, or established testing practices
Apply AI evaluation, exploratory testing, learning-outcome assessment, and QA process ownership to every CGS Immersive release.
#J-18808-Ljbffr- ...Le Lead QA sera responsable de structurer, implanter et améliorer en continu les pratiques d’assurance qualité au sein de l’organisation. PLUS PRÉCISÉMENT • Mettre en place et structurer les processus QA à partir d’un environnement peu défini : cadres de test...SuggestedFull time
- ...building brand-new integration platforms from the ground up, with AI at the center of how we work, and we’re looking for the person who... ...people who challenge what’s possible. What You’ll Do As a QA Analyst on our Integration team, you’ll test the APIs, transformation...SuggestedPermanent employmentRemote work
$131.7k - $278.1k per year
...seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our... ...client challenges. You Are A Senior Forward Deployed Technology lead, leading the modernization of customer data and application ecosystems...SuggestedFull timeWork at officeLocal area3 days per week- Job Responsibility: BrainBox AI utilizes self-adapted artificial intelligence technology to proactively optimize the energy consumption... ...Artificial Intelligence company for an AI Support Specialist Team Lead. In this critical role, you'll be the frontline champion for our...SuggestedFull time
$86.9k - $115.82k per year
...Issues, Audits, Inspections or during simillar QA activities Provide quality assurance... ...support in relation to the audit lifecycle Lead/collaborate/support in QA initiatives/projects... ...that we may use artificial intelligence (AI) in the processing of your application. However...SuggestedFull timeContract workPart timeImmediate startWorldwide- ...with clients to deliver breakthrough outcomes for their toughest AI challenges. We blend the power of AI technology with deep industry... ...unique and unprecedented products across industries. As a Senior Lead AI Engineer , you are primarily responsible for managing technical...Full timeWork at officeLocal areaRemote workFlexible hours3 days per week1 day per week
$100.3k - $216.7k per year
...seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our... ...most complex client challenges You are: An AI Native Development Lead with experience building cloud-native solutions, and deep expertise...Full timeWork at officeLocal area3 days per week- ...ferez-vous ? Vous rejoindrez l'équipe QA de la plateforme RSI, l'écosystème web de Star... ...------ Cloud Imperium Games is a leading game development company known for its innovative... ...have to do it by hand again. ~ Use AI agents to generate test cases from Jira tickets...Full timeApprenticeshipInternshipWorldwide
$85k - $105k per year
...by Are you actively looking for a new opportunity? Or just checking the market? Well… you might just be in the right place! As a Conversion Optimization Manager, Growth , you’ll own the conversion rate optimization strategy for Lightspeed’s marketing websites, treating...Permanent employmentFull timeFixed term contractWork at officeRemote workFlexible hours- ...Job Description: ~ A Quality Assurance (QA) and User Acceptance Testing (UAT) Analyst role tied to the Unitrax recordkeeping platform focuses on testing and verifying investor recordkeeping, transfer agency systems, and financial transactions for Canadian wealth and asset...Contract work
- ...coopérative. Nous voulons vous voir réussir dans votre entreprise et faire partie de notre famille. Nous recherchons un conseiller Spécialiste QA sénior ayant une solide expérience en transformation des pratiques de qualité logicielle afin daccompagner une équipe peu familière avec...Full time
$140k - $160k per year
...Canada/US and Europe. We currently have a role as an AI Application Modernization Architect/Lead with our large consulting client, working for a public... ...platforms for code analysis, documentation generation, conversion, and development acceleration. Supervise the...Remote jobLong term contractPermanent employmentContract workFreelance2 days per week3 days per week- ...coopérative. Nous voulons vous voir réussir dans votre entreprise et faire partie de notre famille. Nous recherchons un conseiller Spécialiste QA sénior ayant une solide expérience en transformation des pratiques de qualité logicielle afin d'accompagner une équipe peu familière...Permanent employment
$70 - $80 per hour
...Job Title: Bilingual Senior QA Analyst – Finance & Enterprise Performance Management (EPM) Location: Montreal, QC(Hybrid) Duration: Contract Rate: CAD$70-80/hr INC Position Summary We are seeking an experienced a Senior Bilingual Quality Assurance Analyst with a...Contract work$155k - $165k per year
...vacancy. Job Summary This is an opportunity to play a hands-on role in shaping how AI is adopted across a global organization. We're looking for an experienced Interim AI Adoption Lead to join our AI Center of Excellence during a maternity leave replacement. Rather than...RemplacementPermanent employmentFull timeContract workInterim roleManual laborLocal area$19.15 per hour
...own knowledge and experience. Candidates should refrain from using AI assistance or third-party tools or services that could influence, capture... ...Studios Location: Americas, Canada, Montreal Area of Work: QA Testing Services Service: Globalize Employment Type: Full...Hourly payPermanent employmentFull timeLive InWork at officeWork from homeTrial periodWork visa$60k - $115k per year
...accommodation, please inform your recruiter. That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the...Full time$55.81k - $95.64k per year
FUNCTION & DUTIES: Reporting to the Business Solutions and Development Coordinator, the incumbent is responsible for planning, developing, executing, and documenting quality assurance activities related to the School Board's business applications, integrations, and ServiceNow...Summer workWork at officeRelocation package- ...complets, concis et faciles à lire. Qu'attendons-nous de notre QA Technique Senior ? ~ Solide expérience en tant que développeur... ...genre ou le handicap . ------ Cloud Imperium Games is a leading game development company known for its innovative and immersive...Daily paidFull timeWorldwide
$85k - $105k per year
...ne fais que jeter un coup d’œil au marché? Eh bien… tu te trouves au bon endroit! En tant que gestionnaire de l’optimisation des conversions au sein de l’équipe Croissance , tu seras responsable de la stratégie d’optimisation du taux de conversion des sites Web...Permanent employmentFull timeContract workApprenticeshipWork at officeRemote workFlexible hours- ................................... Position: Quality Assurance (QA) Specialist | Public Safety Software Location: Montréal, QC (Hybrid... ...team, and hiring decisions are made by people. We may also use AI-enabled tools to support parts of the application review process.Permanent employmentFull timeWorldwideFlexible hours
- ...role; sourcing follows that reading. The required level is Senior, 8 years and more. Candidate sought: A test coordinator or test lead with 8+ years in testing who has already orchestrated integrated testing between a packaged solution and connected systems (APIs, interfaces...Contract work
$55.81k - $95.64k per year
FONCTION & TÂCHES : Relevant du Coordonnateur – Solutions d’entreprise et développement, le titulaire du poste est chargé d’analyser, de concevoir, d’élaborer et de gérer tous les aspects relevant du développement et de la programmation pour répondre aux besoins d’affaire...Work at office$55.81k - $95.64k per year
FONCTION & TÂCHES : Relevant du Coordonnateur - Solutions d'entreprise et développement, le titulaire du poste est chargé d'analyser, de concevoir, d'élaborer et de gérer tous les aspects relevant du développement et de la programmation pour répondre aux besoins d'affaire...Work at office- ...Position Title: AI Lead Architect, Software and Platforms Architecture (T & I) (Telework/Hybrid) Status of Employment: Contractee Long-Term (Durée déterminée) Position Language Requirement: English, French Language Skills: English (Reading - C - Advanced...Long term contractFull timeContract workWork at officeImmediate startRemote workWork from home
- ...Company Description NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute... ...notre monde. Job Description RESPONSIBILTIES The Development QA Tester partners directly with designers, engineers, and artists to...Daily paidFull timeWork at officeLocal area
- ...Job Description Job Description We are hiring LEAD AI SECURITY ARCHITECT - hybrid (3 days onsite) for a Contract position in Montreal, Canada LEAD AI SECURITY ARCHITECT 8+ years experience Our client, a global financial services firm, is seeking a Lead AI Security...Contract work
- ...features work as intended. Working closely with other members of the QA team, you will help deliver a polished gaming experience. This role... ...tools and platforms is also desirable. Ability to leverage AI tools and emerging technologies responsibly. Ability to interpret...Full timeFor contractors
- ...TEHORA est présentement à la recherche d’ un Analyste fonctionnel QA / Tests afin d’assurer la qualité des solutions. Sans être exhaustifs, voici les services et livrables que devra fournir la personne retenue : Élaborer et exécuter les plans de tests ; Réaliser les...Hourly payFull timeContract workApprenticeshipRemote workFlexible hours
$90k - $100k per year
...Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we... ...About the role The Client Solutions Lead (CSL) is an expander role responsible... ...revenus. ~ Atteinte du taux annuel cible de conversion des comptes sans services en clients de...Long term contractWork at officeLocal areaDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Conversational AI QA Lead. Be the first to apply!
- qa lead Montréal, QC
- remote quality assurance Montréal, QC
- qa software testing Montréal, QC
- quality assurance Montréal, QC
- stage assurance qualité Montréal, QC
- responsable assurance qualité Montréal, QC
- testeur qa Montréal, QC
- entry level qa Montréal, QC
- pharmacien assurance qualité Montréal, QC
- specialiste assurance qualité Montréal, QC


