Quality Engineer (Qe) / Sdet - Ai Chatbot Validation
Astra-North Infoteck Inc.
Quality Engineer (QE) / SDET – AI Chatbot ValidationQuality Engineer (QE) / SDET – AI Chatbot Validation
Job Description:
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.
What You Will Do:
Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third‑party services.
Establish testing approaches for both deterministic and non‑deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
Identify, document, prioritize, and track defects through resolution.
Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
Collaborate with cross‑functional Agile teams to deliver reliable, secure, and user‑focused product features.
Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non‑technical stakeholders.
What You Will Need to Succeed:
5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
5+ years of experience building and maintaining test automation frameworks.
Experience testing AI or machine learning‑powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
Hands‑on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
Experience testing functional and non‑functional requirements, APIs, integrations, databases, microservices, and regression suites.
Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
Understanding of TDD, ATDD, BDD, continuous testing, and risk‑based testing practices.
Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
Ability to create effective test data and evaluation datasets for AI‑driven functionality.
Strong analytical, problem‑solving, communication, and technical documentation skills.
Ability to work effectively in a fast‑paced, cross‑functional Agile environment.
Nice to Have:
Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval‑augmented generation, embeddings, or model observability.
Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
Experience testing cloud‑native applications and distributed microservice architectures.
Experience with security, performance, accessibility, or reliability testing.
Experience developing automation scripts and reusable testing utilities.
Experience with Tableau or other analytics and visualization platforms.
CSTE certification or an equivalent quality engineering certification.
Experience working directly with DevOps teams to implement automated quality gates and release controls.
#J-18808-Ljbffr
Job Description:
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.
What You Will Do:
Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third‑party services.
Establish testing approaches for both deterministic and non‑deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
Identify, document, prioritize, and track defects through resolution.
Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
Collaborate with cross‑functional Agile teams to deliver reliable, secure, and user‑focused product features.
Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non‑technical stakeholders.
What You Will Need to Succeed:
5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
5+ years of experience building and maintaining test automation frameworks.
Experience testing AI or machine learning‑powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
Hands‑on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
Experience testing functional and non‑functional requirements, APIs, integrations, databases, microservices, and regression suites.
Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
Understanding of TDD, ATDD, BDD, continuous testing, and risk‑based testing practices.
Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
Ability to create effective test data and evaluation datasets for AI‑driven functionality.
Strong analytical, problem‑solving, communication, and technical documentation skills.
Ability to work effectively in a fast‑paced, cross‑functional Agile environment.
Nice to Have:
Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval‑augmented generation, embeddings, or model observability.
Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
Experience testing cloud‑native applications and distributed microservice architectures.
Experience with security, performance, accessibility, or reliability testing.
Experience developing automation scripts and reusable testing utilities.
Experience with Tableau or other analytics and visualization platforms.
CSTE certification or an equivalent quality engineering certification.
Experience working directly with DevOps teams to implement automated quality gates and release controls.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Quality Engineer (Qe) / Sdet - Ai Chatbot Validation in Winnipeg, MB vacancy
- ...is aiming to become the world's largest AI-led technology services company and is enabling... ..., and community empowerment. Validate chatbot responses for accuracy, relevance, completeness... ...conversation analysis and recommend quality improvements. Develop and maintain test...SuggestedLong term contract
- Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will partner with DevOps, Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable...Suggested
- ...protecting and saving lives. JOB SUMMARY Lead the Engineering, Facilities, and Validation (EFV) team at a site. Serve as a member of the Site Leadership... ...and integration with capital projects, operations, and quality systems Provide leadership oversight of validation-...SuggestedWork at officeFlexible hours
- ...QA Leader to take ownership of our overall Quality Assurance strategy, testing frameworks,... ...gap between internal product management, engineering teams, and external QA partners—ensuring that... ...Reporting: Power BI, Tableau, Jira Dashboards AI tooling: Claude, Codex......SuggestedShift work
- ...about SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing quality for... ...failures, rework, scrap, and recurring defects. Support validation of new or modified electrical test methods, fixtures, equipment...SuggestedPermanent employment
- ...role is responsible for supporting the validation effort and, where required leading projects... ...performance of the validation team and quality processes. Responsibilities Review... ...& Skills Requirements BS Engineering/Chemistry/Microbiology or related field....For contractorsLocal areaFlexible hours
- ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly aluminum castings. The role requires close collaboration with suppliers, frequent onsite visits, and active involvement in...
- ...doors to new opportunities and growth. THE POSITION The Quality Engineer leads the development, implementation, and continuous... ...quality management systems. Lead failure analysis, process validation, and continuous improvement projects to enhance manufacturing...Full timeRemote work
- ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service... ...free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and...
- ...Senior Technical Recruiter | IT Recruiter | (Canada Operations) Job Summary: We are seeking a highly skilled Quality Engineer (SDET BE) with a strong background in software testing, particularly in Java and API automation. The ideal candidate will have extensive experience...Full timeRemote work
- ...Summary Reporting to the Sr. Director, Quality, the Director, Quality Assurance leads QA Operations, Quality Systems, and QA Validation for the Winnipeg site. This role is... ...Bachelor’s degree in Science, Pharmacy, Engineering, or a related field. An advanced degree is...Flexible hours
- Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks.This Senior Quality Engineer / SDET role supports DevOps enablement by delivering exploratory, automated, and AI-focused testing. You...
- ...full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an...Full timeInternshipRemote workRelocation
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- Shape global quality engineering with Core Java and test automation architecture across high-throughput... ...quality gates, in-sprint automation, AI-assisted testing, performance engineering... ...quality engineeringThree-plus years as Lead SDET, Principal SDET, or QA ArchitectExpert Core...Contract work
- ...ensure flight and product efficiency. As a Quality Inspector , you will ensure that all aircraft components, engines, and systems are maintained, repaired, or overhauled... ...completion of the TCN instructions. Validate the certification on behalf of the company....Long term contractTemporary workTraineeshipInternshipImmediate startFlexible hoursShift workWeekend work
- ...The Quality Control Inspector will provide Quality Process Audit support to the Assembly Line. This position will assist in reducing process... .... Must be a Certified Inspection Mechanic. Must possess a valid Class 1 Driver's License. Minimum of 5 years of manufacturing...Full timeTemporary work
- Quality Engineer Job Summary Reporting directly to the Quality Assurance Manager, Quality Engineer performs execution of Quality Engineering systems including; handling of nonconforming materials, Corrective/Preventive Actions, failure reporting, analysis and corrective action...Full time
- ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have made... ...problem-solving skills. • The ability to read and interpret engineering drawings. • High proficiency in Microsoft office including,...Permanent employmentFull timeWork at office
- ...maintain automated tests for AI agent workflows, APIs, tools,... ...regression datasets, tool-call validation, and safety/approval checks.... ...and resource impact. Debug quality issues directly by reading logs... ...code/test changes without heavy engineering hand-holding. Partner with...Local area
- Build automated validation for streaming and broadband services using Selenium, Appium, and large-scale test ecosystems. Support release confidence across connected platforms.As an Automation Tester SDET, you will design, develop, and maintain automation for OTT, Streaming,...
- ...Director of Quality Assurance Winnipeg, MB Full-Time, Onsite POSITION SUMMARY: The Director of Quality Assurance - Transit... ...from recurring. Partner closely with Manufacturing, Engineering, Supply Chain, Service, and Operations teams to solve complex challenges...Full timeInternshipImmediate start
- ...bowl, or grabbing some groceries, our tech platform connects tens of millions of customers with hundreds of thousands of restaurant, grocery and convenience partners across the globe.About this role As a Senior Quality Engineer, you will work with an elite team of develop...Full timeNight shift
- ...requirement with our Direct Client as QE/SDET @ Toronto ON (Hybrid - 4Days/Week). if... ...plans, test cases, and automation scripts to validate APIs, backend systems, and integrations.... ..., tools, and practices to ensure high-quality releases. Mentor and guide junior QA team...Immediate start
- ...professionals where our culture is informed by our values and commitment to protecting and saving lives. Job Summary The Specialist I, Quality Compliance is responsible for supporting and representing Emergent during regulatory inspections, customer audits, and internal...Flexible hours
- ...Manager, Quality AssuranceApply: Remote, ON: Full time: Posted Yesterday: R2616835Our team members are at the heart of everything... ...product quality reviews, stability reports, qualification and validation protocols and reports, artwork and temperature studies.* Ensure...Full timeRemote work
- ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have made... ...shipping processes. • Work collaboratively with Production, Engineering, Shipping, Logistics, Supply Chain, Quality, and other cross-...
- ...redefined modern security with the world’s most advanced AI‑native platform. We work on large scale distributed... ...About the Role: CrowdStrike is seeking an experienced SDET Engineering Manager to lead our quality engineering efforts within the AI Detection and Response...Contract workInternshipWork at officeLocal areaWorldwide2 days per week3 days per week
- CrowdStrike Inc. is seeking an experienced SDET Engineering Manager to lead quality engineering within the AI Detection and Response team. You will manage a team responsible for end-to-end validation of AI-driven services, building test strategy, tooling, and automation across...
- A software solutions provider is seeking a QE/SDET in Toronto, ON for a hybrid position (4 days a week). The role requires 8-10+ years of... ...designing automation solutions, collaborating with teams to validate integrations, and mentoring junior QA members. The ideal candidate...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Quality Engineer (Qe) / Sdet - Ai Chatbot Validation. Be the first to apply!
Related searches
- quality engineer manufacturing Winnipeg, MB
- entry level quality engineer Winnipeg, MB
- quality engineer- qms Winnipeg, MB
- technicien qualité Winnipeg, MB
- ingénieur qualité Winnipeg, MB
- quality engineer Winnipeg, MB
- junior software tester Winnipeg, MB
- responsable amelioration continue et qualité Winnipeg, MB
- qualité santé Winnipeg, MB
- quality manufacturing Winnipeg, MB


