Senior Ai Chatbot Test Automation Engineer
Astra-North Infoteck Inc.
Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks.This Senior Quality Engineer / SDET role supports DevOps enablement by delivering exploratory, automated, and AI-focused testing. You will define test strategies, create evaluation datasets, and validate chatbot responses, APIs, microservices, and model interactions. The work covers functional, integration, system, regression, database, and acceptance testing.Key Responsibilities:
Design exploratory, automated, and AI-focused product quality testsBuild scalable frameworks using Java, Python, or GroovyValidate chatbot accuracy, safety, latency, and hallucination risksIntegrate testing and AI checks into CI/CD pipelinesCommunicate defects, risks, metrics, and release recommendationsRequirements:
Five-plus years in quality engineering, automation, or developmentFive-plus years programming with Java, Python, Groovy, or comparable languagesFive-plus years building and maintaining automation frameworksExperience testing AI applications, chatbots, LLMs, APIs, or conversational systemsHands-on Selenium, Playwright, RestAssured, or similar experienceApply senior automation expertise to AI chatbot validation, quality strategy, and reliable DevOps delivery across evolving products.
#J-18808-Ljbffr
Design exploratory, automated, and AI-focused product quality testsBuild scalable frameworks using Java, Python, or GroovyValidate chatbot accuracy, safety, latency, and hallucination risksIntegrate testing and AI checks into CI/CD pipelinesCommunicate defects, risks, metrics, and release recommendationsRequirements:
Five-plus years in quality engineering, automation, or developmentFive-plus years programming with Java, Python, Groovy, or comparable languagesFive-plus years building and maintaining automation frameworksExperience testing AI applications, chatbots, LLMs, APIs, or conversational systemsHands-on Selenium, Playwright, RestAssured, or similar experienceApply senior automation expertise to AI chatbot validation, quality strategy, and reliable DevOps delivery across evolving products.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Ai Chatbot Test Automation Engineer in Winnipeg, MB vacancy
- ...About the role We are seeking a highly skilled and self-motivated Senior AI Test Automation Engineer to join our Quality Engineering team. The ideal candidate will have extensive experience in test automation, database validation, AI-assisted testing, and modern quality...Senior
- Build AI test automation with Java or Python as a Senior Quality Engineer focused on prompt behavior, accuracy, and reliable releases.This senior position requires five-plus years in quality engineering, quality assurance, test automation, or software development. You will create...Senior
- Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance...SeniorRemote work
- Build smarter Playwright tests with GitHub Copilot, CodeGen, and MCP tools in Veriday Inc.'s remote Senior Automation Engineer contract.This six-month Canadian engagement, potentially extendable, requires hands-on engineering judgment beyond generated test output. You will...SeniorContract workRemote work
- Excel as a Senior Test Automation Engineer at PureFacts, specializing in AI-driven testing methodologies in Toronto. Transform software quality and efficiency with AI technologies. In this role, you will join the Quality Engineering team to innovate and optimize testing strategies...Senior
- Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will... ...Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable automation...Senior
- Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform functional testing to ensure a seamless banking... ...automation using Java, Selenium/Playwright, and AI-assisted workflows. You will also deploy...Senior
- Build automated testing expertise with LTM as a Test Automation Engineer in Mississauga, using Playwright, Selenium, and TypeScript. Work with complex multitier applications... ...frameworks from scratch. The work includes AI tools such as Copilot and Claude, prompt engineering...Senior
- Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions.This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain...SeniorFull timeRemote work
$81.2k - $122k per year
Senior Automation Test Engineer – VancityVancity is a member‑owned credit union committed to inclusion and social justice. We are looking for a Senior Automation Test Engineer to join our 2,700‑person team. About the workplaceThis is a permanent, full‑time role that offers...SeniorPermanent employmentFull timeTemporary workWork at officeFlexible hours- ...Senior Automation Engineer (Project Manager) Saguenay-Lac-Saint-Jean, QC, Canada Type of position: Regular To pursue project and client development in the Saguenay–Lac-Saint-Jean, BBA wants to bolster its local multidisciplinary team. Working closely with our offices...SeniorLong term contractTemporary workWork at officeLocal area
- Build software quality at StackAdapt as a remote Senior Test Automation Engineer, using Playwright, API testing, and CI/CD automation across North America.This senior position supports product releases in a cross-functional agile environment. You will develop reliable automated...SeniorRemote work
- ...&K Global Talent Solutions Inc. seeks a Chatbot Content Developer to modernize technical... ...migration from Confluence to Markdown, and automation for content conversion within CI/CD... ...docs in Git repositories, collaborate with engineering and DevOps, define metadata guidelines,...
- Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint, building... ...critical utility software workflows.As a Senior SDET, you will create automation... ...based prioritization. You will also evaluate AI-assisted tools for test generation, failure...Senior
- Build scalable test automation for Joist with Playwright, Appium, and BrowserStack while working remotely... ....EverPro seeks a Software Development Engineer in Test focused on Joist, an EverCommerce... ...and API layers using modern frameworks, AI tools, and detailed debugging. The work...SeniorFor contractorsRemote work
$90k - $117k per year
As an Automation Test Lead, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices...SeniorWork at office3 days per week- ...Canada’s largest Indigenous-owned software testing and technology services company. For... ...We’re looking for experienced Test Automation Specialists who are passionate about modern engineering practices and excited about how AI is changing the way software is tested...Internship
- ...Jonas Software in Canada is seeking an Automation Engineer to advance CORA Loyalty’s quality engineering and software delivery through scalable test automation, AI-enabled quality practices, and robust testing frameworks. You will collaborate with Software Engineering, Product...Remote work
- A national IT consulting company is seeking a QA Automation Engineer in Canada to ensure the quality and performance of enterprise applications. Responsibilities include analyzing requirements, defining test strategies, and maintaining automation frameworks. The ideal candidate...Senior
- Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes. With a minimum of 4 years in QA or test automation, you'll build and maintain...
- ...Infrastructure is seeking a QA Automation Specialist to own the... ...API, and hardware-in-the-loop testing. You will shape test coverage,... ...environments while exploring AI-assisted tooling to improve efficiency... ...end-to-end quality, mentoring engineers and driving best practices across...Senior
- Lead automation and performance testing in Toronto’s hybrid environment, applying API testing and CI/CD pipeline... ....This six-month contract suits a senior quality professional with seven-plus... ..., Test Automation, or Quality Engineering. Apply automation frameworks, performance...SeniorContract workWork at office
- Must Haves: 7+ years of experience in Quality Assurance, Test Automation, or Quality Engineering. 5+ years of experience developing and maintaining automation frameworks. 3+ years of hands‑on performance testing experience. 5+ years of experience working in Agile/Scrum environments...Senior
- Automate enterprise application testing with Python and performance engineering at Compugen, supporting cloud applications and Agile delivery environments.As a Senior Automation and Performance Test Engineer, you will build scalable frameworks and reusable automation components...Senior
- Lead automation testing with Selenium, Parasoft, and Robot Framework in a senior SDET role requiring six-plus years of experience.This SDET position focuses on automating tests across platforms and technologies throughout the full development lifecycle. Apply expertise in C#...Senior
- Build software quality through test automation, C#, and CI/CD pipelines as a Senior SDET in Calgary’s hybrid engineering environment. H&R Block supports technical quality leadership.Reporting to the Software Development Manager, this senior engineering role develops maintainable...SeniorContract work
- Engineer secure AI automation for National Bank’s Capital Markets and Treasury Risk Management teams. Apply AI evaluation, safeguards, and production software expertise.This Senior AI Engineering Developer role sits within a new multidisciplinary AI Solutions team. You will...Senior
- ...solutions concrètes.En tant que spécialiste senior en tests logiciels, vous collaborerez avec les... ...solution that centralizes and automates access control across physical security... ...reliable test environments, data, and automation toolsAnalyze logs, metrics, and pipeline...SeniorFlexible hours
- A leading tech firm in Toronto, Canada is seeking a Senior Automation Developer to enhance software automation processes. Key responsibilities include designing QA tests, executing test automation scripts, and collaborating with development teams. Ideal candidates will have...Senior
- ...Electronic Arts in Vancouver–Burnaby area seeks a Senior Software Developer to manage systems from... ..., write code, define metrics, and mentor engineers. Hybrid work requires at least 3 days... ...will lead multi-agent state machines, AI testing frameworks, and end-to-end test...SeniorWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ai Chatbot Test Automation Engineer. Be the first to apply!
Related searches
- test engineer Winnipeg, MB
- test automation developer Winnipeg, MB
- field test engineer Winnipeg, MB
- test automation engineer Winnipeg, MB
- drive test engineer Winnipeg, MB
- rf test engineer Winnipeg, MB
- automation engineer - process controls systems Winnipeg, MB
- control and automation engineer Winnipeg, MB
- automation specialist Winnipeg, MB
- electrical automation engineer Winnipeg, MB

