Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Quality Engineer (Qe) / Sdet - Ai Chatbot Validation

Astra-North Infoteck Inc.

Quality Engineer (QE) / SDET – AI Chatbot ValidationQuality Engineer (QE) / SDET – AI Chatbot Validation
Job Description:
We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality values and principles. The DevOps team is responsible for providing pipelines, metrics and tools for use by application development teams. The incumbent will actively participate in gathering quality criteria from the user community, developing a backlog of items, prioritizing them with the teams and delivering them continually.
What You Will Do:
Partner with DevOps, Development, Product, and QE teams to design and execute exploratory, automated, and AI-focused tests that ensure product quality.
Define quality strategies, test plans, test cases, and test data for functional, integration, system, regression, API, database, and acceptance testing.
Design, develop, and maintain scalable test automation frameworks using Java, Python, or Groovy.
Build automated tests for AI-enabled features, including, AI chatbot response validation, prompt behavior, response accuracy, hallucination risks, safety, reliability, latency, and regression coverage.
Validate AI integrations, APIs, microservices, data pipelines, model interactions, and third‑party services.
Establish testing approaches for both deterministic and non‑deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and repeatability.
Integrate automated testing and AI quality checks into CI/CD pipelines in partnership with DevOps teams.
Use tools and frameworks such as Selenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
Identify, document, prioritize, and track defects through resolution.
Analyze test coverage, quality trends, AI evaluation results, and production feedback to identify gaps and drive continuous improvement.
Collaborate with cross‑functional Agile teams to deliver reliable, secure, and user‑focused product features.
Communicate test results, risks, quality metrics, and release recommendations clearly to technical and non‑technical stakeholders.
What You Will Need to Succeed:
5+ years of relevant experience in Quality Engineering, Quality Assurance, test automation, or software development.
5+ years of programming experience with Java, Python, Groovy, or a comparable language.
5+ years of experience building and maintaining test automation frameworks.
Experience testing AI or machine learning‑powered applications, Chatbots, LLM validations, APIs, conversational systems, or generative AI features.
Hands‑on experience with Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similar automation technologies.
Experience testing functional and non‑functional requirements, APIs, integrations, databases, microservices, and regression suites.
Experience with testing frameworks and tools such as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
Understanding of TDD, ATDD, BDD, continuous testing, and risk‑based testing practices.
Understanding of AI quality concepts such as prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, and response consistency.
Ability to create effective test data and evaluation datasets for AI‑driven functionality.
Strong analytical, problem‑solving, communication, and technical documentation skills.
Ability to work effectively in a fast‑paced, cross‑functional Agile environment.
Nice to Have:
Experience with AI evaluation frameworks, LLM testing, prompt engineering, retrieval‑augmented generation, embeddings, or model observability.
Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, or Gradle.
Experience testing cloud‑native applications and distributed microservice architectures.
Experience with security, performance, accessibility, or reliability testing.
Experience developing automation scripts and reusable testing utilities.
Experience with Tableau or other analytics and visualization platforms.
CSTE certification or an equivalent quality engineering certification.
Experience working directly with DevOps teams to implement automated quality gates and release controls.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Quality Engineer (Qe) / Sdet - Ai Chatbot Validation in Winnipeg, MB vacancy
  •  ...is aiming to become the world's largest AI-led technology services company and is enabling...  ..., and community empowerment. Validate chatbot responses for accuracy, relevance, completeness...  ...conversation analysis and recommend quality improvements. Develop and maintain test... 
    Suggested
    Long term contract

    Tata Consultancy Services Limited

    Winnipeg, MB
    1 hour ago
  • Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will partner with DevOps, Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable... 
    Suggested

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...protecting and saving lives. JOB SUMMARY Lead the Engineering, Facilities, and Validation (EFV) team at a site. Serve as a member of the Site Leadership...  ...and integration with capital projects, operations, and quality systems Provide leadership oversight of validation-... 
    Suggested
    Work at office
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    11 days ago
  •  ...QA Leader to take ownership of our overall Quality Assurance strategy, testing frameworks,...  ...gap between internal product management, engineering teams, and external QA partners—ensuring that...  ...Reporting: Power BI, Tableau, Jira Dashboards AI tooling: Claude, Codex...... 
    Suggested
    Shift work

    Simpro Software Canada ULC

    Winnipeg, MB
    11 days ago
  •  ...about SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing quality for...  ...failures, rework, scrap, and recurring defects. Support validation of new or modified electrical test methods, fixtures, equipment... 
    Suggested
    Permanent employment

    SKF Group

    Winnipeg, MB
    11 days ago
  •  ...role is responsible for supporting the validation effort and, where required leading projects...  ...performance of the validation team and quality processes. Responsibilities Review...  ...& Skills Requirements BS Engineering/Chemistry/Microbiology or related field.... 
    For contractors
    Local area
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    10 days ago
  •  ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly aluminum castings. The role requires close collaboration with suppliers, frequent onsite visits, and active involvement in... 

    Global Connect Technologies

    Winnipeg, MB
    11 days ago
  •  ...doors to new opportunities and growth.  THE POSITION   The  Quality Engineer  leads the development, implementation, and continuous...  ...quality management systems.  Lead failure analysis, process validation, and continuous improvement projects to enhance manufacturing... 
    Full time
    Remote work

    Smartrend Manufacturing Group

    Winnipeg, MB
    20 days ago
  •  ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service...  ...free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and... 

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  •  ...Senior Technical Recruiter | IT Recruiter | (Canada Operations) Job Summary: We are seeking a highly skilled Quality Engineer (SDET BE) with a strong background in software testing, particularly in Java and API automation. The ideal candidate will have extensive experience... 
    Full time
    Remote work

    Quantum World Technologies Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Summary   Reporting to the Sr. Director, Quality, the Director, Quality Assurance leads QA Operations, Quality Systems, and QA Validation for the Winnipeg site. This role is...  ...Bachelor’s degree in Science, Pharmacy, Engineering, or a related field. An advanced degree is... 
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    10 days ago
  • Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks.This Senior Quality Engineer / SDET role supports DevOps enablement by delivering exploratory, automated, and AI-focused testing. You... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...full-time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an... 
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    10 days ago
  •  ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software... 

    Talentola

    Winnipeg, MB
    11 days ago
  • Shape global quality engineering with Core Java and test automation architecture across high-throughput...  ...quality gates, in-sprint automation, AI-assisted testing, performance engineering...  ...quality engineeringThree-plus years as Lead SDET, Principal SDET, or QA ArchitectExpert Core... 
    Contract work

    Dexian

    Winnipeg, MB
    1 hour ago
  •  ...ensure flight and product efficiency. As a Quality Inspector , you will ensure that all aircraft components, engines, and systems are maintained, repaired, or overhauled...  ...completion of the TCN instructions. Validate the certification on behalf of the company.... 
    Long term contract
    Temporary work
    Traineeship
    Internship
    Immediate start
    Flexible hours
    Shift work
    Weekend work

    StandardAero

    Winnipeg, MB
    16 days ago
  •  ...The Quality Control Inspector will provide Quality Process Audit support to the Assembly Line. This position will assist in reducing process...  .... Must be a Certified Inspection Mechanic. Must possess a valid Class 1 Driver's License. Minimum of 5 years of manufacturing... 
    Full time
    Temporary work

    Motor Coach Industries

    Winnipeg, MB
    15 days ago
  • Quality Engineer Job Summary Reporting directly to the Quality Assurance Manager, Quality Engineer performs execution of Quality Engineering systems including; handling of nonconforming materials, Corrective/Preventive Actions, failure reporting, analysis and corrective action... 
    Full time

    Linamar Corporation

    Winnipeg, MB
    19 days ago
  •  ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have made...  ...problem-solving skills. • The ability to read and interpret engineering drawings. • High proficiency in Microsoft office including,... 
    Permanent employment
    Full time
    Work at office

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  •  ...maintain automated tests for AI agent workflows, APIs, tools,...  ...regression datasets, tool-call validation, and safety/approval checks....  ...and resource impact. Debug quality issues directly by reading logs...  ...code/test changes without heavy engineering hand-holding. Partner with... 
    Local area

    Centraprise

    Winnipeg, MB
    1 hour ago
  • Build automated validation for streaming and broadband services using Selenium, Appium, and large-scale test ecosystems. Support release confidence across connected platforms.As an Automation Tester SDET, you will design, develop, and maintain automation for OTT, Streaming,... 

    Ampstek

    Winnipeg, MB
    1 hour ago
  •  ...Director of Quality Assurance Winnipeg, MB Full-Time, Onsite POSITION SUMMARY: The Director of Quality Assurance - Transit...  ...from recurring. Partner closely with Manufacturing, Engineering, Supply Chain, Service, and Operations teams to solve complex challenges... 
    Full time
    Internship
    Immediate start

    New Flyer

    Winnipeg, MB
    24 days ago
  •  ...bowl, or grabbing some groceries, our tech platform connects tens of millions of customers with hundreds of thousands of restaurant, grocery and convenience partners across the globe.About this role As a Senior Quality Engineer, you will work with an elite team of develop...
    Full time
    Night shift

    Just Eat Takeaway.com

    Winnipeg, MB
    19 days ago
  •  ...requirement with our Direct Client as QE/SDET @ Toronto ON (Hybrid - 4Days/Week). if...  ...plans, test cases, and automation scripts to validate APIs, backend systems, and integrations....  ..., tools, and practices to ensure high-quality releases. Mentor and guide junior QA team... 
    Immediate start

    Iris Software Inc.

    Winnipeg, MB
    1 hour ago
  •  ...professionals where our culture is informed by our values and commitment to protecting and saving lives. Job Summary  The Specialist I, Quality Compliance is responsible for supporting and representing Emergent during regulatory inspections, customer audits, and internal... 
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    10 days ago
  •  ...Manager, Quality AssuranceApply: Remote, ON: Full time: Posted Yesterday: R2616835Our team members are at the heart of everything...  ...product quality reviews, stability reports, qualification and validation protocols and reports, artwork and temperature studies.* Ensure... 
    Full time
    Remote work

    Micro Technologies

    Winnipeg, MB
    11 days ago
  •  ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have made...  ...shipping processes. • Work collaboratively with Production, Engineering, Shipping, Logistics, Supply Chain, Quality, and other cross-... 

    Price Industries Limited

    Winnipeg, MB
    11 days ago
  •  ...redefined modern security with the world’s most advanced AI‑native platform. We work on large scale distributed...  ...About the Role: CrowdStrike is seeking an experienced SDET Engineering Manager to lead our quality engineering efforts within the AI Detection and Response... 
    Contract work
    Internship
    Work at office
    Local area
    Worldwide
    2 days per week
    3 days per week

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  • CrowdStrike Inc. is seeking an experienced SDET Engineering Manager to lead quality engineering within the AI Detection and Response team. You will manage a team responsible for end-to-end validation of AI-driven services, building test strategy, tooling, and automation across... 

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  • A software solutions provider is seeking a QE/SDET in Toronto, ON for a hybrid position (4 days a week). The role requires 8-10+ years of...  ...designing automation solutions, collaborating with teams to validate integrations, and mentoring junior QA members. The ideal candidate... 

    Iris Software Inc.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Quality Engineer (Qe) / Sdet - Ai Chatbot Validation. Be the first to apply!