Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Conversational AI QA Lead

CGS Immersive

Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting product quality through thoughtful manual and AI-assisted QA.

As Quality Assurance Lead, you will assess whether conversational experiences meet agreed learning objectives and rubrics. You will maintain representative scenarios, repeat evaluations after model or content changes, and detect variation, unsupported claims, context loss, bias, inappropriate feedback, or instruction bypasses. Your work combines functional coverage with sound independent judgment.

Key Responsibilities:

  • Evaluate simulation behaviour, AI coaching, scoring, critique, and guidance
  • Maintain approved AI scenarios and representative reference examples
  • Reassess experiences after model, prompt, content, or configuration changes
  • Cover permissions, negative scenarios, interruptions, boundaries, and recovery paths
  • Identify automation candidates while maintaining manual exploratory coverage

Requirements:

  • Experience testing AI applications, conversational interfaces, or learning platforms
  • Ability to translate complex functionality into comprehensive test scenarios
  • Strong attention to detail, organization, and written communication
  • Ability to learn products deeply and assess intended outcomes
  • Familiarity with Xray, Zephyr, TestRail, or established testing practices

Apply AI evaluation, exploratory testing, learning-outcome assessment, and QA process ownership to every CGS Immersive release.

#J-18808-Ljbffr
Vacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Conversational AI QA Lead in Montréal, QC vacancy
  •  ...Le Lead QA sera responsable de structurer, implanter et améliorer en continu les pratiques d’assurance qualité au sein de l’organisation.   PLUS PRÉCISÉMENT   • Mettre en place et structurer les processus QA à partir d’un environnement peu défini : cadres de test... 
    Suggested
    Full time

    DELAN

    Montréal, QC
    more than 2 months ago
  •  ...building brand-new integration platforms from the ground up, with AI at the center of how we work, and we’re looking for the person who...  ...people who challenge what’s possible. What You’ll Do As a QA Analyst on our Integration team, you’ll test the APIs, transformation... 
    Suggested
    Permanent employment
    Remote work

    Tecsys Inc.

    Montréal, QC
    8 days ago
  • $131.7k - $278.1k per year

     ...seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our...  ...client challenges. You Are A Senior Forward Deployed Technology lead, leading the modernization of customer data and application ecosystems... 
    Suggested
    Full time
    Work at office
    Local area
    3 days per week

    Accenture Global

    Montréal, QC
    11 days ago
  • Job Responsibility: BrainBox AI utilizes self-adapted artificial intelligence technology to proactively optimize the energy consumption...  ...Artificial Intelligence company for an AI Support Specialist Team Lead. In this critical role, you'll be the frontline champion for our... 
    Suggested
    Full time

    BrainBox AI Inc.

    Montréal, QC
    1 day ago
  • $86.9k - $115.82k per year

     ...Issues, Audits, Inspections or during simillar QA activities Provide quality assurance...  ...support in relation to the audit lifecycle Lead/collaborate/support in QA initiatives/projects...  ...that we may use artificial intelligence (AI) in the processing of your application. However... 
    Suggested
    Full time
    Contract work
    Part time
    Immediate start
    Worldwide

    IQVIA

    Montréal, QC
    9 days ago
  •  ...with clients to deliver breakthrough outcomes for their toughest AI challenges. We blend the power of AI technology with deep industry...  ...unique and unprecedented products across industries. As a Senior Lead AI Engineer , you are primarily responsible for managing technical... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours
    3 days per week
    1 day per week

    Marsh McLennan

    Montréal, QC
    11 days ago
  • $100.3k - $216.7k per year

     ...seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our...  ...most complex client challenges You are: An AI Native Development Lead with experience building cloud-native solutions, and deep expertise... 
    Full time
    Work at office
    Local area
    3 days per week

    Accenture Global

    Montréal, QC
    11 days ago
  •  ...ferez-vous ? Vous rejoindrez l'équipe QA de la plateforme RSI, l'écosystème web de Star...  ...------ Cloud Imperium Games is a leading game development company known for its innovative...  ...have to do it by hand again. ~ Use AI agents to generate test cases from Jira tickets... 
    Full time
    Apprenticeship
    Internship
    Worldwide

    Cloud Imperium Games Limited

    Montréal, QC
    10 days ago
  • $85k - $105k per year

     ...by Are you actively looking for a new opportunity? Or just checking the market? Well… you might just be in the right place! As a Conversion Optimization Manager, Growth , you’ll own the conversion rate optimization strategy for Lightspeed’s marketing websites, treating... 
    Permanent employment
    Full time
    Fixed term contract
    Work at office
    Remote work
    Flexible hours

    Lightspeed Commerce

    Montréal, QC
    7 days ago
  •  ...Job Description: ~ A Quality Assurance (QA) and User Acceptance Testing (UAT) Analyst role tied to the Unitrax recordkeeping platform focuses on testing and verifying investor recordkeeping, transfer agency systems, and financial transactions for Canadian wealth and asset... 
    Contract work

    Maarut

    Montréal, QC
    7 days ago
  •  ...coopérative. Nous voulons vous voir réussir dans votre entreprise et faire partie de notre famille. Nous recherchons un conseiller Spécialiste QA sénior ayant une solide expérience en transformation des pratiques de qualité logicielle afin daccompagner une équipe peu familière avec... 
    Full time

    IT UNLOCK CONSULTING INC.

    Montréal, QC
    6 days ago
  • $140k - $160k per year

     ...Canada/US and Europe. We currently have a role as an AI Application Modernization Architect/Lead with our large consulting client, working for a public...  ...platforms for code analysis, documentation generation, conversion, and development acceleration. Supervise the... 
    Remote job
    Long term contract
    Permanent employment
    Contract work
    Freelance
    2 days per week
    3 days per week

    Tech Talent International

    Montréal, QC
    a month ago
  •  ...coopérative. Nous voulons vous voir réussir dans votre entreprise et faire partie de notre famille. Nous recherchons un conseiller Spécialiste QA sénior ayant une solide expérience en transformation des pratiques de qualité logicielle afin d'accompagner une équipe peu familière... 
    Permanent employment

    IT UNLOCK CONSULTING INC.

    Montréal, QC
    11 days ago
  • $70 - $80 per hour

     ...Job Title: Bilingual Senior QA Analyst – Finance & Enterprise Performance Management (EPM) Location: Montreal, QC(Hybrid) Duration: Contract  Rate: CAD$70-80/hr INC Position Summary We are seeking an experienced a Senior Bilingual Quality Assurance Analyst with a... 
    Contract work

    Hays

    Montréal, QC
    21 days ago
  • $155k - $165k per year

     ...vacancy. Job Summary This is an opportunity to play a hands-on role in shaping how AI is adopted across a global organization. We're looking for an experienced Interim AI Adoption Lead to join our AI Center of Excellence during a maternity leave replacement. Rather than... 
    Remplacement
    Permanent employment
    Full time
    Contract work
    Interim role
    Manual labor
    Local area

    Giesecke+Devrient

    Montréal, QC
    5 days ago
  • $19.15 per hour

     ...own knowledge and experience. Candidates should refrain from using AI assistance or third-party tools or services that could influence, capture...  ...Studios Location: Americas, Canada, Montreal Area of Work: QA Testing Services Service: Globalize Employment Type: Full... 
    Hourly pay
    Permanent employment
    Full time
    Live In
    Work at office
    Work from home
    Trial period
    Work visa

    Keywords Studios

    Montréal, QC
    more than 2 months ago
  • $60k - $115k per year

     ...accommodation, please inform your recruiter. That same commitment to fairness extends to how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they never replace human judgement. All hiring decisions remain entirely in the... 
    Full time

    CGI

    Montréal, QC
    10 days ago
  • $55.81k - $95.64k per year

    FUNCTION & DUTIES: Reporting to the Business Solutions and Development Coordinator, the incumbent is responsible for planning, developing, executing, and documenting quality assurance activities related to the School Board's business applications, integrations, and ServiceNow...
    Summer work
    Work at office
    Relocation package

    Kativik Ilisarniliriniq

    Montréal, QC
    4 days ago
  •  ...complets, concis et faciles à lire. Qu'attendons-nous de notre QA Technique Senior ? ~ Solide expérience en tant que développeur...  ...genre ou le handicap . ------ Cloud Imperium Games is a leading game development company known for its innovative and immersive... 
    Daily paid
    Full time
    Worldwide

    Cloud Imperium Games Limited

    Montréal, QC
    7 days ago
  • $85k - $105k per year

     ...ne fais que jeter un coup d’œil au marché? Eh bien… tu te trouves au bon endroit! En tant que gestionnaire de l’optimisation des conversions au sein de l’équipe Croissance , tu seras responsable de la stratégie d’optimisation du taux de conversion des sites Web... 
    Permanent employment
    Full time
    Contract work
    Apprenticeship
    Work at office
    Remote work
    Flexible hours

    Lightspeed Commerce

    Montréal, QC
    7 days ago
  •  ................................... Position: Quality Assurance (QA) Specialist | Public Safety Software Location: Montréal, QC (Hybrid...  ...team, and hiring decisions are made by people. We may also use AI-enabled tools to support parts of the application review process.
    Permanent employment
    Full time
    Worldwide
    Flexible hours

    Services de Gestion Quantum Ltée

    Montréal, QC
    14 days ago
  •  ...role; sourcing follows that reading. The required level is Senior, 8 years and more. Candidate sought: A test coordinator or test lead with 8+ years in testing who has already orchestrated integrated testing between a packaged solution and connected systems (APIs, interfaces... 
    Contract work

    Maarut

    Montréal, QC
    9 hours ago
  • $55.81k - $95.64k per year

    FONCTION & TÂCHES  : Relevant du Coordonnateur – Solutions d’entreprise et développement, le titulaire du poste est chargé d’analyser, de concevoir, d’élaborer et de gérer tous les aspects relevant du développement et de la programmation pour répondre aux besoins d’affaire...
    Work at office

    Kativik Ilisarniliriniq (La commission scolaire du Nunavik)

    Montréal, QC
    3 days ago
  • $55.81k - $95.64k per year

    FONCTION & TÂCHES : Relevant du Coordonnateur - Solutions d'entreprise et développement, le titulaire du poste est chargé d'analyser, de concevoir, d'élaborer et de gérer tous les aspects relevant du développement et de la programmation pour répondre aux besoins d'affaire...
    Work at office

    Kativik Ilisarniliriniq

    Montréal, QC
    4 days ago
  •  ...Position Title: AI Lead Architect, Software and Platforms Architecture (T & I) (Telework/Hybrid) Status of Employment: Contractee Long-Term (Durée déterminée) Position Language Requirement: English, French Language Skills: English (Reading - C - Advanced... 
    Long term contract
    Full time
    Contract work
    Work at office
    Immediate start
    Remote work
    Work from home

    CBC/Radio-Canada

    Montréal, QC
    7 days ago
  •  ...Company Description NBCUniversal is one of the world's leading media and entertainment companies. We create world-class content, which we distribute...  ...notre monde. Job Description RESPONSIBILTIES The Development QA Tester partners directly with designers, engineers, and artists to... 
    Daily paid
    Full time
    Work at office
    Local area

    NBCUniversal

    Montréal, QC
    11 days ago
  •  ...Job Description Job Description We are hiring LEAD AI SECURITY ARCHITECT - hybrid (3 days onsite) for a Contract position in Montreal, Canada LEAD AI SECURITY ARCHITECT 8+ years experience Our client, a global financial services firm, is seeking a Lead AI Security... 
    Contract work

    Calance US

    Montréal, QC
    22 days ago
  •  ...features work as intended. Working closely with other members of the QA team, you will help deliver a polished gaming experience. This role...  ...tools and platforms is also desirable. Ability to leverage AI tools and emerging technologies responsibly. Ability to interpret... 
    Full time
    For contractors

    Keywords Studios

    Montréal, QC
    6 hours ago
  •  ...TEHORA est présentement à la recherche d’ un Analyste fonctionnel QA / Tests afin d’assurer la qualité des solutions. Sans être exhaustifs, voici les services et livrables que devra fournir la personne retenue : Élaborer et exécuter les plans de tests ; Réaliser les... 
    Hourly pay
    Full time
    Contract work
    Apprenticeship
    Remote work
    Flexible hours

    TEHORA

    Montréal, QC
    more than 2 months ago
  • $90k - $100k per year

     ...Integrator with deep expertise in cloud, data, AI, cybersecurity, and intelligent edge, we...  ...About the role The Client Solutions Lead (CSL) is an expander role responsible...  ...revenus. ~ Atteinte du taux annuel cible de conversion des comptes sans services en clients de... 
    Long term contract
    Work at office
    Local area
    Day shift

    Insight Enterprises, Inc.

    Montréal, QC
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Conversational AI QA Lead. Be the first to apply!