Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Software Test Engineering Manager

Knotch

Knotch needs an AI-focused QA Manager to validate changing outputs, cloud APIs, and product reliability. Work fully remotely from Canada, preferably Eastern Time.

You will lead hands-on software testing while managing automation across Knotch’s AI-native products. Your work will cover non-deterministic behavior, output quality, edge cases, performance, and regression risk. You will partner with agile product and engineering teams while mentoring distributed QA professionals.

Key Responsibilities:

  • Define evaluation strategies for AI-powered product features
  • Automate API validation across cloud services
  • Run regression, smoke, sanity, exploratory, and performance tests
  • Perform root-cause analysis and file JIRA tickets
  • Integrate automated testing into CI/CD pipelines

Requirements:

  • Eight-plus years of QA engineering experience
  • Two-plus years managing or leading automation teams
  • Experience testing AI tools, agents, and variable outputs
  • Strong Selenium, Playwright, Cypress, or comparable expertise
  • Knowledge of AWS, GCP, SQL, Git, and API testing

Help Knotch deliver dependable AI experiences through evaluation strategy, cloud API automation, and measurable software quality.

#J-18808-Ljbffr
Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the AI Software Test Engineering Manager in Ottawa, ON vacancy
  • $69k - $86k per year

     ...Location: Ottawa, ONT About this opportunity: Join our RP Test Management team and help shape software test for Ericsson’s embedded and cloud-native platforms,...  ...our RAN software test procedure through Agentic AI-driven approach, such as autonomous agents, intelligent... 
    Suggested
    Long term contract
    Full time
    Temporary work

    Ericsson

    Ottawa, ON
    6 days ago
  • $28.5 - $44 per hour

     ...global collaboration, minimal layers of management, and the freedom to make meaningful contributions...  ...seeking a motivated and detail-oriented Test Engineering Co-op student to support the development...  ...environment. Working knowledge of AI for Test Automation . Desired... 
    Suggested
    Hourly pay
    Full time
    Internship
    Work at office

    Skyworks

    Ottawa, ON
    4 days ago
  •  ...benefits, and flexible work arrangements. Job Description We are looking for a detail-oriented Embedded Software Test / Verification & Validation Engineer to support testing activities within an HSIT team in an automotive environment. You will play a key role in... 
    Suggested
    Permanent employment
    Full time
    Flexible hours

    CS Group

    Ottawa, ON
    10 days ago
  • Introduction At IBM Software, we transform client challenges into solutions...  .... Building the world's leading AI-powered, cloud-native products...  ...to invest. We're looking for an engineer to own that foundation. You'll run our incident management tooling day to day, owning PagerDuty... 
    Suggested
    Full time

    IBM

    Ottawa, ON
    3 days ago
  • $108.75k - $152.25k per year

     ...providing a trusted foundation for software-defined businesses to thrive....  ...for?The QNX Service PSP Test Team is seeking an experienced...  ...with hardware in a fast-paced engineering environment, we'd love to talk...  ...Have Experience working with AI technologies Knowledge of Hypervisor... 
    Suggested
    Full time
    Internship
    Immediate start

    BlackBerry

    Ottawa, ON
    6 days ago
  •  ...provide first level support under the direction of the manufacturing engineering group in Ottawa. The position therefore requires working some...  ...would assist with new product introduction, be responsible for test and test process maintenance, and provide a critical technical... 
    Full time
    Worldwide
    Afternoon shift

    Lumentum Operations

    Ottawa, ON
    6 days ago
  • $110k - $150k per year

     ...photonic solutions power everything from AI and cloud computing to data centers, telecom...  ...in. About the role We’re looking for an engineer to build the automation and software our photonics manufacturing runs on: process automation, test automation, machine vision, data... 
    Full time
    Internship
    Live In
    Flexible hours

    Lumentum Operations

    Ottawa, ON
    6 days ago
  • $100.3k - $216.7k per year

     ...delivery role. It is not a research position. A Forward Deployed AI Engineer-Associate Manager is a production engineer who works embedded inside a client...  ...architectures, including a minimum of 5 years of software engineering experience using Java, TypeScript/JavaScript, or... 
    Full time
    Internship
    Work at office
    Local area

    Accenture Global

    Ottawa, ON
    7 days ago
  • $90k - $140k per year

     ...individuals to join the Larus team as a Software Engineer. Our Software Engineering team is currently...  ...; Design, develop, integrate and test software modules and systems; Advocate...  ...specializing in Artificial Intelligence (AI), Machine Learning (ML), Big Data Analytics... 
    Permanent employment
    Full time
    Work at office
    Home office
    Monday to friday
    2 days per week
    3 days per week

    Larus Technologies

    Ottawa, ON
    17 days ago
  •  ...years. Backed by a legacy of engineering excellence, reliability and industry...  ...build, and maintain scalable test automation frameworks for...  ...You will work closely with software developers, DevOps engineers,...  ...and Kubernetes environments. Manage test execution, reporting, and... 
    Full time
    Worldwide

    Telesat

    Ottawa, ON
    10 hours ago
  •  ...Role: Senior Back End Engineer Location: Ottawa, ON  Working Structure...  ...with all major accounting software including QuickBooks, NetSuite...  ...want to build on your use of AI on the job? Bring it on! So do...  ...services. Work with management and your colleagues to drive towards... 
    Full time
    For contractors
    2 days per week

    Veem

    Ottawa, ON
    2 days ago
  • $75k - $110k per year

     ...what’s possible in orbit. As an Embedded Software Engineer, you will develop the core software that...  ...responsible for controlling hardware, managing data flows, and ensuring reliable operation...  ...role involves designing, implementing, testing, and deploying highly reliable software... 

    Spaceium

    Ottawa, ON
    7 hours ago
  • $93.4k - $133.4k per year

     ...Title: Senior Optical Characterization and Test Engineer Employment Type: Full-time, Existing...  ...photonic solutions power everything from AI and cloud computing to data centers, telecom...  ...problem-solving skills Proficiency in Software Development The ideal candidate will... 
    Full time
    Live In
    Flexible hours

    Lumentum Operations

    Ottawa, ON
    6 days ago
  • $85k - $111.3k per year

     ...About the Opportunity At Ericsson, we are transforming how large-scale software systems are understood, designed, developed, tested, and maintained through Generative AI and agentic software engineering. We are seeking an Applied AI Software Designer with 2–4 years of... 
    Long term contract
    Full time
    Temporary work
    Manual labor

    Ericsson

    Ottawa, ON
    7 days ago
  •  ...possible. This role is Hybrid Ottawa AI Solutions Engineer Position Summary The AI Solutions...  ...between traditional mission-critical software engineering and next-generation autonomous...  ...Integration & Lifecycle: Oversee the lifecycle management of AI-enabled C4ISR systems, including... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    6 days ago
  • $28.5 - $44 per hour

     ...global collaboration, minimal layers of management, and the freedom to make meaningful...  ...in wireless communications. Our Ottawa Test Engineering Team is offering an exciting Co-op opportunity...  ...enrolled in a BS or MS program in Software Engineering, Electrical Engineering, or... 
    Hourly pay
    Full time
    Internship

    Skyworks

    Ottawa, ON
    3 days ago
  • usd170k per year

     ...Financial Services is looking for a Software Development Manager in North America to grow and lead our...  ...Working closely with Staff/Principal Engineers, P&T Leadership and cross-functional stakeholders...  ...development Experience in test automation and/or DevOps engineering... 
    Long term contract
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Lightspeed Commerce

    Ottawa, ON
    1 day ago
  •  ...Reports to: Director of Software Type: Full-Time The Role...  ...links. Set up the automated testing, CI/CD, and observability (logs...  ...architectural calls, and support the engineers around you through code review...  ...based on impact* We use AI tools to support parts of the... 
    Full time

    dominion%20dynamics

    Ottawa, ON
    2 days ago
  •  ...scale human conversation into actionable insights. By leveraging AI and patented statistical models to analyze organic social media...  .... Role Description Weʼre looking for a Senior Software Engineer with 5 - 8 years of professional experience to help design, build... 
    Full time
    Internship
    Manual labor
    Work at office

    forum-ventures

    Ottawa, ON
    3 days ago
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to...  ...agents, planning, orchestration, memory management, and tool-calling frameworks. Experience...  ...platforms. Strong knowledge of software engineering best practices, testing, debugging... 
    Internship
    Remote work
    Relocation

    Miratech

    Ottawa, ON
    3 days ago
  •  ...your career with us! Role Summary We are seeking a senior engineering and AI/ML leader to build and lead a distributed team of AI/ML engineers...  ...brings 15+ years of experience across engineering management, software engineering, AI/ML systems, and data science, combined with... 
    Full time
    Local area

    Lumentum Operations

    Ottawa, ON
    6 days ago
  •  ...visitors worldwide. During the pandemic our engineering, product, and design teams went back to...  .... Collaborate with designers, product managers, and other engineers to iterate on new...  ..., implement unit and integration tests. Provide feedback on technical designs... 
    Full time
    Worldwide

    Tripadvisor

    Ottawa, ON
    2 days ago
  • $28.5 - $44 per hour

     ...global collaboration, minimal layers of management, and the freedom to make meaningful contributions...  ...candidate will report to a senior engineering mentor assigned. The ideal student will be...  ...assignments in the area of semiconductor test and electronic design. Must be available... 
    Hourly pay
    Internship

    Skyworks

    Ottawa, ON
    4 days ago
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task...  ...reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;... 
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    6 days ago
  • $125.8k - $133.2k per year

     ...collection of unmatched reverse engineering, teardown, and market analysis...  ...THE OPPORTUNITY:   As a Software Engineer on the Circuit Analysis...  ...about good design, automated testing and maintainability because...  ...leading by example. You’ll use AI-assisted development heavily,... 
    Permanent employment
    Full time
    Contract work
    Internship
    Flexible hours

    TechInsights

    Ottawa, ON
    9 days ago
  •  ...Senior Software Engineer (Full-Time, Remote) — Canada Work Schedule: 9:00 AM - 5:00 PM PST About...  ...technical decisions. ~ Familiarity with AI-assisted development tools (e.g., Copilot...  ...as it grows? How can AI help me build, test, and improve this more effectively?... 
    Long term contract
    Full time
    Immediate start
    Remote work

    AutoScale Ventures

    Ottawa, ON
    15 days ago
  • $75k - $110k per year

     ...push the boundaries of what's possible in orbit. As a Robotic AI Engineer, you will develop the intelligence that lets our spacecraft perceive...  ...hardware Integrate AI and robotics systems with flight software and ground segment tools Collaborate with software, systems,... 

    Spaceium

    Ottawa, ON
    7 hours ago
  •  ...Reports to: Director of Software Type: Full-Time Location:...  ...use it in the field. We value engineers who make good decisions quickly...  ...environments such as Gazebo or Unreal Engine. Background in security...  ...based on impact* We use AI tools to support parts of the... 
    Full time
    Shift work

    dominion%20dynamics

    Ottawa, ON
    2 days ago
  • $24 - $35 per hour

     ...consecutive year . Position Title: Embedded Software Engineer Co-op/Intern Employment Type: Student...  ...photonic solutions power everything from AI and cloud computing to data centers,...  ...software, code reuse, designing for test and support, distributed and multi-threaded... 
    Full time
    Internship

    Lumentum Operations

    Ottawa, ON
    6 days ago
  •  ...profile organizations improve the quality of the software they depend on. We are an independent quality engineering and software testing consultancy operating across Canada, the US,...  ...test automation, performance engineering, AI-First Quality Engineering and quality transformation... 
    Full time
    Contract work
    Internship
    Monday to friday

    TTC Global

    Ottawa, ON
    9 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Software Test Engineering Manager. Be the first to apply!