Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Quality Engineer - Ai

PeoplePilot

We are seeking a
Senior Software Quality Engineer – AI Focused
to drive quality, reliability, and automation for AI-enabled software products. The role will collaborate with Development, DevOps, Product, and QE teams to design robust testing strategies and scalable automation frameworks. The engineer will test AI/ML and Generative AI features, APIs, microservices, integrations, and data pipelines while ensuring reliable and secure product delivery. The position is
full-time and onsite in Toronto, ON .
Key Requirements
5+ years of experience in
Quality Engineering, QA, SDET, or Test Automation .
5+ years of programming experience with
Java, Python, Groovy, or similar languages .
Strong experience building and maintaining
test automation frameworks .
Hands-on experience with
Selenium, Playwright, Cucumber/Gherkin, or RestAssured .
Experience with
API, database, integration, regression, and microservices testing .
Experience with
JUnit, TestNG, ReadyAPI, qTest, and JMeter .
Hands-on experience testing
AI/ML, Generative AI, conversational AI, or LLM-based applications .
Knowledge of AI quality concepts such as
prompt evaluation, accuracy, relevance, grounding, hallucination detection, toxicity, bias, and response consistency .
Experience with
CI/CD, Agile, BDD, TDD, ATDD, and risk-based testing .
Strong analytical, problem-solving, communication, and documentation skills.
Key Responsibilities
Develop and execute comprehensive
quality strategies, test plans, test cases, and test data .
Design, develop, and maintain scalable
test automation frameworks .
Create automated tests for
AI/ML and Generative AI features .
Evaluate AI responses for
accuracy, relevance, safety, hallucination, reliability, and latency .
Test
APIs, microservices, databases, integrations, data pipelines, and third-party services .
Create AI evaluation datasets, expected behaviors, quality thresholds, and regression coverage.
Integrate automated testing and
AI quality checks into CI/CD pipelines .
Identify, document, prioritize, and track defects through resolution.
Analyze test coverage, quality metrics, AI evaluation results, and production feedback.
Collaborate with
Development, DevOps, Product, and QE teams
to improve product quality and release readiness.
#J-18808-Ljbffr
Vacancy posted 56 minutes ago
Similar jobs that could be interesting for youBased on the Senior Software Quality Engineer - Ai in Winnipeg, MB vacancy
  •  ...providers—creating a world where quality healthcare is more accessible,...  ...and computing, biometrics, AI, and clinical research to develop...  ...everyday life. Our innovation engine continuously expands the platform...  ...Role Overview: We are hiring a Senior Software Quality Engineer to shape... 
    Senior
    Long term contract
    Worldwide
    Shift work

    Myant Inc.

    Winnipeg, MB
    1 hour ago
  • $160k - $200k per year

     ...decision-driven care. Through our AI-native platform, MosaicOS™, we...  ...iteration, MosaicOS™ is engineered to solve the industry’s most pressing...  ...capacity, improves diagnostic quality by combining human expertise...  ...us.Position Summary: Own the software quality and test automation... 
    Senior
    Remplacement
    For contractors
    Remote work
    Shift work

    Radiology Partners, Inc.

    Winnipeg, MB
    58 minutes ago
  • Build trustworthy AI personalization quality at Autodesk in Toronto using TypeScript, Python, and automated...  ...Autodesk Assistant experiences.As a Senior AI Quality Developer, you will support...  ...evaluation. The role requires software engineering, quality engineering, or test... 
    Senior

    Skillhub Solutions Inc.

    Winnipeg, MB
    59 minutes ago
  • Klue Engineering is hiring! We're looking for a Senior Machine Learning Engineer to join our team in Toronto, focusing...  ...to measure and improve relevance, quality, and latency. Drive experimentation...  ...Acquisition (2025)Goldpan.Ai Acquisition (2025)Win-Loss Acquisition... 
    Senior
    Work at office
    Remote work
    2 days per week

    Klue

    Winnipeg, MB
    57 minutes ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer - AI based in Canada. The Senior Software Engineer will join a small AI Platform team responsible for building production-... 
    Senior
    Long term contract
    Remote work

    Jobgether

    Winnipeg, MB
    56 minutes ago
  • Build production AI features as a Senior AI Software Engineer at Safe Fleet, using LLMs, machine learning, and backend APIs. Help make fleet vehicles safer through scalable technology.This hands-on senior engineering role delivers AI-powered capabilities across Safe Fleet’s... 
    Senior

    Safe Fleet

    Winnipeg, MB
    58 minutes ago
  •  ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare...  ...telemetry, and evaluation platforms. ~ Strong knowledge of software engineering best practices, testing, debugging, and performance... 
    Senior
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    6 days ago
  • $150k - $200k per year

     ...Stikeman Elliott is building its own agentic AI platform, with production agents working...  ...and continues to expand. This is the senior engineering role responsible for advancing its...  ...role that spans application architecture, software development and production delivery. You... 
    Senior

    Stikeman Elliott LLP

    Winnipeg, MB
    57 minutes ago
  •  ...intersection of our people, our customers, and our brands. Senior Applied AI EngineerWho We Are.Newfold Digital is a leading web...  ...mark.We are looking for a hand on Senior Applied AI Engineer who combines strong software engineering with practical AI problem solving. You... 
    Senior

    Newfold Digital

    Winnipeg, MB
    52 minutes ago
  •  ...leadership. Fleetworthy is shaping the future of fleet readiness with AI-enabled, connected fleet technology that keeps drivers safe,...  ...Learn more at fleetworthy.Com .About the role:We're hiring a Senior Software Engineer for the AI Platform team. The team builds AI agents and... 
    Senior
    Long term contract

    Fleetworthy

    Winnipeg, MB
    56 minutes ago
  • $145k - $183k per year

    Job DescriptionToast is recruiting on behalf of this company for a Senior Software Engineer, AI to join their Engineering team in Toronto. They are looking for an experienced backend engineer who is excited to build and optimize LLM-powered systems that help users uncover meaningful... 
    Senior
    Full time
    Manual labor
    Work at office
    Flexible hours

    Toast

    Winnipeg, MB
    58 minutes ago
  •  ...a fast-growing, venture-backed B2B SaaS company building an AI-powered competitive intelligence platform that helps revenue...  ...office in downtown Toronto.About the role: We're hiring a Senior Software Engineer to build and optimize state-of-the- LLM-powered agents that can... 
    Senior
    Work at office

    GuruLink

    Winnipeg, MB
    54 minutes ago
  •  ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance...  ...an experienced Senior AI Engineer with over 8 years in software development. You will design and deploy AI and LLM applications... 
    Senior

    Talentola

    Winnipeg, MB
    6 days ago
  •  ...of talent at your fingertips. With our AI-powered Global Work Platform™,...  ...— we’re rethinking what it means for software to work with you, not just for you. Our...  ...AI assistant, and we’re looking for a Senior Full-Stack AI Engineer who wants to help define what AI-native... 
    Senior
    Contract work
    Local area
    Remote work
    Flexible hours

    Pebl

    Winnipeg, MB
    52 minutes ago
  • $176k - $200k per year

    We’re looking for a Senior Software Engineer to join our growing AI organization in Vancouver. Asana is pioneering a new category of technology as the human-agent operating system, doubling down on our AI Suite to move our customers toward expansive, end-to-end intelligent... 
    Senior
    Long term contract
    Work at office
    Local area
    Work from home
    Worldwide

    FDE Times

    Winnipeg, MB
    58 minutes ago
  •  ...Build AI Inference Networking software at Equinix using SDN, proxying, and open-source engineering expertise. Work within a globally distributed development team. As a Senior SDN Network Software Engineer, you will help develop open-source software for Equinix’s AI Inference... 
    Senior

    Equinix

    Winnipeg, MB
    6 days ago
  • $120k - $140k per year

     ...as we build smarter technologies that redefine fleet safety. When you help make fleets smarter, you make people safer. Senior Software Engineer, AI Product EngineeringAbout The PositionABOUT THE POSITION Meet the Smart Safety Company AtSafe Fleetour name says it all... 
    Senior
    Work at office
    Local area

    Safe Fleet

    Winnipeg, MB
    52 minutes ago
  • $90.49k - $132.71k per year

     ...empowering better decisions for individuals and those managing money for millions. The RoleWe are seeking a Senior Software Engineer to build the applied systems that bring AI capabilities into production: the data pipelines, LLM integrations, agentic workflows, tool interfaces,... 
    Senior
    Internship
    Work at office
    Worldwide

    Urban Ridge Supplies

    Winnipeg, MB
    52 minutes ago
  • We are hiring a Senior Software Engineer to build and run the search systems that connect Guidepoint clients with the right experts. You will join...  ...semantic search, the Python services in front of it all, and the AI features that turn a plain-language question into a ranked... 
    Senior
    Internship
    Work at office

    Guidepoint

    Winnipeg, MB
    53 minutes ago
  • $100k - $145k per year

     ...for proactive recruitment purposes and may be used to fill current openings or future vacancies within our organization.**Senior Software Engineer - AI (Materia AI)**We’re building the next generation of AI‑powered systems for tax and accounting professionals, and we need a... 
    Senior
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    55 minutes ago
  • $120k - $145k per year

     ...aVeraltocompany, is a mission-driven software company that organizes the world’s...  ...teamwork, a relentless pursuit of quality, a playful spirit, and a sense of humor...  .... Reporting to the Director of Engineering & Predictive Analytics, the Senior Software Engineer will contribute... 
    Senior
    Work at office
    Remote work
    Flexible hours
    Shift work

    Aquatic Informatics ULC

    Winnipeg, MB
    55 minutes ago
  • Transform the insurance industry with Owl.co as a Senior Software Engineer dedicated to applied AI systems. This full-time, onsite role is based in New York City, Toronto, or Vancouver. As a Senior Software Engineer, you will work closely with cross-functional teams to design... 
    Senior
    Full time

    Owl.co

    Winnipeg, MB
    59 minutes ago
  •  ...maintain automated tests for AI agent workflows, APIs, tools,...  ...and resource impact. Debug quality issues directly by reading logs...  ...code/test changes without heavy engineering hand-holding. Partner with...  ...engineering, SDET, test automation, software engineering, or similar hands‑... 
    Local area

    Centraprise

    Winnipeg, MB
    55 minutes ago
  •  ...Senior Back End Software Engineer Canada, United Kingdom, United States 1 gün 9 saat 9 dakika önce yayınlandı. Full Time Himalayas - Our software engineers at Epistemix show a clear passion for quality and love to bring software to life. You are energized by the idea of... 
    Senior
    Full time

    pofft Technology Inc.

    Winnipeg, MB
    6 days ago
  • Design AI agents and complex software systems at lululemon, using AWS Bedrock, Python, and enterprise automation expertise. This hybrid role requires onsite work four days weekly.As a Senior Software Engineer, you will lead AI agent implementation across multiple services and... 
    Senior

    Lululemon Athletica Inc.

    Winnipeg, MB
    59 minutes ago
  • Build reliable software with Python and AI at ZoomInfo, working remotely on applications, services, and data platforms for business teams.As a Senior Software Engineer, you will own complex technical projects from ambiguous requirements through production. You will use Python... 
    Senior
    Remote work

    ZoomInfo Technologies LLC

    Winnipeg, MB
    1 hour ago
  • $140k - $170k per year

     ...processes evidence, there's a good chance our software is working behind the scenes. That's been true for over four decades. AI is central to where we're going. Not as a...  ...something real. The RoleThe AI Native Senior Software Engineer is a change agent and a driver of value... 
    Senior
    Internship
    Remote work
    Work from home

    Aloft (formerly Kittyhawk)

    Winnipeg, MB
    55 minutes ago
  • Build Operational AI software at Samsara using backend services, APIs, and customer-facing experiences while working remotely or in offices where aligned.As a senior engineer, you will create agentic solutions for custom detections and workflows. You will own software from customer... 
    Senior
    Remote work

    Samsara

    Winnipeg, MB
    1 hour ago
  • $132.6k - $174k per year

     ...employee experience through automation, agentic automation, and AI. We partner with business and technology teams across...  ...responsibly, and at enterprise scale.Core responsibilitiesAs a Senior Software Engineer – AI Agents, you will lead the design and implementation of complex... 
    Senior
    Long term contract
    Permanent employment
    Part time
    Manual labor
    Local area
    Immediate start

    lululemon

    Winnipeg, MB
    1 hour ago
  • Build backend services and AI-powered workflows at Samsara, working flexibly from the United States or Canada on Connected Operations software.As a senior software engineer, you will create agentic solutions for custom detections and workflows. You will work across APIs, backend... 
    Senior

    Samsara

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Quality Engineer - Ai. Be the first to apply!