Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Quality Engineer - Test Automation, Ai Testing & Java/Python

Astra-North Infoteck Inc.

Senior Quality Engineer – Test Automation, AI Testing & Java/PythonQuality Engineer– Test Automation, Java/Python & GenAI
Roles and Responsibilities:
Partner with DevOps,Development, Product, andQE teams todesign and executeexploratory, automated,and AI-focusedtests that ensureproduct quality.
Define quality strategies, test plans, testcases, and testdata for functional, integration, system, regression, API, database, andacceptance testing.
Design, develop, andmaintain scalable testautomation frameworks usingJava, Python, orGroovy.
Build automated testsfor AI-enabledfeatures, including promptbehavior, response accuracy, hallucination risks, safety, reliability, latency,and regression coverage.
Validate AI integrations, APIs, microservices, datapipelines, model interactions, and third-partyservices.
Establish testing approachesfor both deterministicand non-deterministicAI behavior, includingevaluation datasets, expectedbehavior, quality thresholds, and repeatability.
Integrate automated testingand AI qualitychecks into CI/CD pipelines inpartnership with DevOpsteams.
Use tools andframeworks such asSelenium, Cucumber/Gherkin, Playwright, RestAssured, JUnit, TestNG, ReadyAPI, and JMeter.
Identify, document, prioritize, and track defectsthrough resolution.
Analyze test coverage, quality trends, AIevaluation results, andproduction feedback toidentify gaps anddrive continuous improvement.
Collaborate with cross-functional Agile teamsto deliver reliable, secure, and user-focused product features.
Communicate test results, risks, quality metrics, and release recommendationsclearly to technicaland non-technical stakeholders.
Required Skills:
5+ years ofrelevant experience inQuality Engineering, QualityAssurance, test automation, or software development.
5+ years ofprogramming experiencewith Java,Python, Groovy, ora comparable language.
5+ years ofexperience building andmaintaining test automationframeworks.
Hands-on experiencewith Selenium, Cucumber/Gherkin, Playwright, RestAssured, or similarautomation technologies.
Experience testing functionaland non-functionalrequirements, APIs, integrations, databases, microservices, and regression suites.
Experience with testingframeworks and toolssuch as JUnit, TestNG, qTest, ReadyAPI, and JMeter.
Understanding of TDD, ATDD, BDD, continuoustesting, and risk-based testing practices.
Experience testing AIor machine learning-powered applications, APIs, conversational systems, or generative AIfeatures.
Understanding of AIquality concepts suchas prompt evaluation, grounding, accuracy, relevance, toxicity, bias, hallucination detection, andresponse consistency.
Ability to createeffective test dataand evaluation datasetsfor AI-drivenfunctionality.
Strong analytical, problem-solving, communication,and technical documentationskills.
Abilityto work effectivelyin a fast-paced, cross-functionalAgile environment.
Nice to Have:
Experience with AIevaluation frameworks,LLM testing, promptengineering, retrieval-augmented generation, embeddings, or model observability.
Experience with Git, Bitbucket, Jenkins, CI/CD pipelines, Artifactory, SonarQube, Jira, Confluence, AWS, Kubernetes, Maven, orGradle.
Experience testing cloud-native applications anddistributed microservicearchitectures.
Experience with security, performance, accessibility, or reliability testing.
Experience developingautomation scripts andreusable testing utilities.
Experience with Tableau orother analytics andvisualization platforms.
Experience working directlywith DevOps teamsto implement automatedquality gates andrelease controls.
#J-18808-Ljbffr
Vacancy posted 11 minutes ago
Similar jobs that could be interesting for youBased on the Senior Quality Engineer - Test Automation, Ai Testing & Java/Python in Winnipeg, MB vacancy
  • Senior Quality Engineer – Test Automation, AI Testing & Java/PythonQuality Engineer– Test Automation, Java/Python & GenAI Roles and Responsibilities: Partner with DevOps,Development, Product, andQE teams todesign and executeexploratory, automated,and AI-focusedtests that... 
    Senior
    Python
    Java

    Astra-North Infoteck Inc.

    Winnipeg, MB
    3 hours ago
  •  ...time professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise... 
    Senior
    Python
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    7 days ago
  • A technology solutions company is seeking a highly skilled Automation Engineer with hands-on experience in Selenium automation frameworks and strong programming skills in Java or Python. The ideal candidate will design, develop, and maintain automated test suites to ensure product... 
    Python
    Java
    Full time

    Yochana

    Winnipeg, MB
    7 minutes ago
  • Build AI-augmented testing for Citi’s Front Office Trading platform using Java, Selenium, Playwright, and modern artificial intelligence techniques.This experienced Automation Engineer develops scalable UI and API automation frameworks within Technology Applications Development... 
    Java

    Citi Group

    Winnipeg, MB
    7 minutes ago
  •  ...largest Indigenous-owned software testing and technology services company...  ...who are passionate about quality, teamwork, and making an impact...  ...looking for experienced Test Automation Specialists who are passionate about modern engineering practices and excited about how... 
    Python
    Java
    Internship

    PLATO

    Winnipeg, MB
    6 minutes ago
  • Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes. With a minimum of 4 years in QA or test automation, you'll build and maintain... 
    Python

    Centraprise

    Winnipeg, MB
    4 minutes ago
  •  ...About the role We are seeking a highly skilled and self-motivated Senior AI Test Automation Engineer to join our Quality Engineering team. The ideal candidate will have extensive experience in test automation, database validation, AI-assisted testing, and modern quality... 
    Senior
    Python
    Java

    PureFacts Financial Solutions

    Winnipeg, MB
    3 hours ago
  • Engineer Python automation for EA-SPORTS FC quality verification at Electronic Arts, integrating CI/CD diagnostics and machine learning. This is hybrid work in Burnaby, BC.As a Software Engineer III, you will build tools that expand test coverage and detect defects earlier.... 
    Python

    Electronic Arts

    Winnipeg, MB
    3 hours ago
  • Build AI test automation with Java or Python as a Senior Quality Engineer focused on prompt behavior, accuracy, and reliable releases.This senior position requires five-plus years in quality engineering, quality assurance, test automation, or software development. You will create... 
    Senior
    Python
    Java

    Astra-North Infoteck Inc.

    Winnipeg, MB
    2 minutes ago
  • Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance... 
    Senior
    Python
    Java
    Remote work

    CrowdStrike Inc.

    Winnipeg, MB
    3 hours ago
  • Join Tata Consultancy Services as a Quality Engineer specializing in Python and automation. Focus on implementing valuable ETL testing solutions to ensure high-quality software outcomes. TCS is looking for a Quality Engineer with a solid automation engineering background. You... 
    Python

    Tata Consultancy Services Limited

    Winnipeg, MB
    3 hours ago
  • Build production AI features and automation systems in-studio in Kelowna, using Python services, LLM APIs, and connected business platforms. Own infrastructure that supports...  ...executive reporting.As an Automation and AI Engineer at Martell Group, you will operate mature customer... 
    Senior
    Python

    martellgrowthsolutions

    Winnipeg, MB
    10 minutes ago
  •  ...for a hybrid position (4 days a week). The role requires 8-10+ years of experience, strong programming skills in Java/Python, and expertise in test automation frameworks. Key responsibilities include designing automation solutions, collaborating with teams to validate integrations... 
    Senior
    Python
    Java

    Iris Software Inc.

    Winnipeg, MB
    1 minute ago
  • Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks.This Senior Quality Engineer / SDET role supports DevOps enablement by delivering exploratory, automated, and AI-focused testing. You... 
    Senior
    Python
    Java

    Astra-North Infoteck Inc.

    Winnipeg, MB
    3 hours ago
  • Excel as a Senior Test Automation Engineer at PureFacts, specializing in AI-driven testing methodologies in Toronto. Transform software quality and efficiency with AI technologies. In this role, you will join the Quality Engineering team to innovate and optimize testing strategies... 
    Senior
    Java

    PureFacts Financial Solutions

    Winnipeg, MB
    3 hours ago
  • Software quality and test automation define this remote-first Quality Engineer role at StackAdapt, open to candidates anywhere in Canada.StackAdapt seeks a Quality Engineer for a cross-functional agile environment supporting successful product releases. You will build reliable... 
    Python
    Remote work

    StackAdapt Inc.

    Winnipeg, MB
    10 minutes ago
  • AI test automation and software quality define this hands-on specialist role at PLATO, supporting modern engineering practices across Canada’s 100% Canada-based team.PLATO seeks experienced Test Automation Specialists with five or more years in testing, automation, development... 
    Senior
    Python
    Java

    Plato

    Winnipeg, MB
    3 hours ago
  • Capco is seeking a Backend Developer – Java/Python & AI to design, develop and integrate scalable backend services within complex financial...  ...services environments. This hands-on role combines core backend engineering with practical AI applications to automate workflows and... 
    Senior
    Python
    Java

    Capco

    Winnipeg, MB
    6 minutes ago
  • Join as a Senior Automation Engineer, focused on enhancing testing precision and efficiency. Drive quality in testing processes and collaborate with teams to implement cutting-edge automation strategies. This position is ideal for a highly skilled QA professional with a proven... 
    Senior
    Java

    Synechron

    Winnipeg, MB
    3 hours ago
  •  ...define qualityengineering and test strategy across Agile...  ...Developers, and Scrum teams to ensure quality delivery Ensure quality...  ...experience insoftware testing/quality engineering Proven experience leading...  ...hands-on experience withtest automation tools and frameworks... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    3 hours ago
  • Take on a pivotal role as an AI Quality Assurance and Testing Engineer, focusing on the assessment of machine learning and generative AI models. Ensure high standards of quality, bias assessment, and responsible AI practices across applications. In this short-term contract... 
    Python
    Temporary work

    Infotek Consulting Inc.

    Winnipeg, MB
    6 minutes ago
  • Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform functional testing to ensure a seamless banking experience for our customers. You will collaborate with product teams, define testing... 
    Senior
    Java

    Upgrade

    Winnipeg, MB
    3 hours ago
  • Build smarter Playwright tests with GitHub Copilot, CodeGen, and MCP tools in Veriday Inc.'s remote Senior Automation Engineer contract.This six-month Canadian engagement, potentially extendable, requires hands-on engineering judgment beyond generated test output. You will... 
    Senior
    Contract work
    Remote work

    Veriday

    Winnipeg, MB
    3 hours ago
  • $90k - $117k per year

    As an Automation Test Lead, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices... 
    Senior
    Python
    Java
    Work at office
    3 days per week

    Cognizant Technology Solutions Corporation

    Winnipeg, MB
    3 hours ago
  • Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint, building confidence across critical utility software workflows.As a Senior SDET, you will create automation foundations for a new team and influence testing standards across product squads... 
    Senior
    Python
    Java

    SpryPoint Services Inc.

    Winnipeg, MB
    3 hours ago
  • $80k - $105k per year

     ...candidate will have a strong background in automation engineering, focusing on designing and implementing...  ..., scalable automated solutions for ETL testing.Key Responsibilities As an...  ...create automation frameworks, ensuring high-quality software delivery and optimizing the QA... 
    Python

    Tata Consultancy Services Limited

    Winnipeg, MB
    5 minutes ago
  • Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated... 
    Python

    CrowdStrike Inc.

    Winnipeg, MB
    3 hours ago
  • Build automated testing with Selenium, Parasoft, and Robot Framework while delivering in-sprint quality within Agile development teams.This Test Automation Engineer develops, maintains, and executes automated tests across platforms and technologies. The work covers database... 
    Senior
    Python

    Envision Technology Solutions

    Winnipeg, MB
    8 minutes ago
  • Build software quality at StackAdapt as a remote Senior Test Automation Engineer, using Playwright, API testing, and CI/CD automation across North America.This senior position supports product releases in a cross-functional agile environment. You will develop reliable automated... 
    Senior
    Python
    Remote work

    Devconnectplatform

    Winnipeg, MB
    3 hours ago
  • AI-driven test automation defines this Test Automation Specialist role at PLATO, focused on scalable frameworks, modern engineering, and practical AI applications.PLATO seeks experienced Test Automation Specialists with five-plus years in testing, automation, development, or... 
    Python
    Java

    PLATO

    Winnipeg, MB
    5 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Quality Engineer - Test Automation, Ai Testing & Java/Python. Be the first to apply!