AI Software Test Engineering Manager
Knotch
Knotch needs an AI-focused QA Manager to validate changing outputs, cloud APIs, and product reliability. Work fully remotely from Canada, preferably Eastern Time.
You will lead hands-on software testing while managing automation across Knotch’s AI-native products. Your work will cover non-deterministic behavior, output quality, edge cases, performance, and regression risk. You will partner with agile product and engineering teams while mentoring distributed QA professionals.
Key Responsibilities:
- Define evaluation strategies for AI-powered product features
- Automate API validation across cloud services
- Run regression, smoke, sanity, exploratory, and performance tests
- Perform root-cause analysis and file JIRA tickets
- Integrate automated testing into CI/CD pipelines
Requirements:
- Eight-plus years of QA engineering experience
- Two-plus years managing or leading automation teams
- Experience testing AI tools, agents, and variable outputs
- Strong Selenium, Playwright, Cypress, or comparable expertise
- Knowledge of AWS, GCP, SQL, Git, and API testing
Help Knotch deliver dependable AI experiences through evaluation strategy, cloud API automation, and measurable software quality.
#J-18808-LjbffrVacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the AI Software Test Engineering Manager in Montréal, QC vacancy
$72k - $90k per year
...we operate these systems, building the software, hardware, and operations that make urban... ...team in Montreal is looking for a Software Engineer in Test to join its LUS team. Our goal is to... ...take off as much time as they need (with manager approval). Hourly team members get 15 days...SuggestedHourly payWork at officeWorldwideFlexible hours3 days per week- ...en développement logiciel de tests (SDET) Nous sommes à la recherche... ...vous sur ===== Senior Software Development Engineer in Test (... ...-related issues. Support AI initiatives and AI-related... ...QA, player support, community management, and datasets. Help us bring...SuggestedContract workRemote workWorldwideDay shift
$34 - $36 per hour
...belong and have the opportunity to thrive. As a Test Automation Intern at Lyft, you'll collaborate closely with industry-leading engineers while enjoying the freedom to innovate from... ...strong desire to learn and use cutting edge AI tooling Benefits: Mental health...SuggestedFull timeSummer workInternshipSummer internshipWork at officeImmediate startWork from home3 days per week$80k - $155k per year
...applications with the support of AI coding agents About our... ...development, refactoring and test creation, while ensuring that... ...qualifications At least 5 years of software development experience, with a... ...each candidate. Use of the term ‘engineering’ in this job posting refers to...SuggestedFull time$80k - $155k per year
...le développement, la refactorisation et la création de tests, tout en assurant la validation des résultats. • Réaliser... ...de conseil en technologie de l’information (TI) et en management au monde. Software Engineer – AI-Assisted Development Position Description Senior...Suggestedusd218k per year
...requirements Interacts with product management teams to understand product... ...define product roadmaps Software Architecture Participates... ...and third party packages Testing ~ Sets testing standards... ...Reliability & Support Engineering Manages internal/external...Full timeWork at office- ...Canada is looking for an experienced System Test Engineer for a consulting assignment based in... ..., and quality assurance for complex software or telecom related platforms. • Hands... ...Playwright, Selenium, Postman, and test management tools such as Jira and Xray. • Good knowledge...Apprenticeship
$180k - $230k per year
...complex capital projects. The AI buildout runs on physical... ...re looking for an Applied AI Engineer to help build the core ML engine... ...the bar on architecture, testing, observability and how the team... ...hands-on with AWS (S3, RDS, a managed queue or event service, containers...Full timeFor contractorsInternshipWork at office- ...contribute to the design, development, testing, and deployment of crucial features... ...include crafting and supporting software for trade booking, position management, settlement, and straight through... ...Oracle | GIT | Jenkins | Nugget| Unit Test | WHAT WILL BE YOUR DAY-TO-DAY?As "...Full time
$60 - $120 per hour
...AI & Software Engineers – Remote Opportunities Full-Time & Flexible Contract Options | Remote $60 - $120 per hour We are recruiting... ...Refactoring Performance optimisation Software testing Working with complex codebases Strong experience in...Remote jobHourly payFull timeContract workFlexible hours- ...flexible work arrangements. We are seeking a Software Safety Engineer with expertise in Artificial Intelligence (AI), Large Language Models (LLMs), and software safety... ...Integrate analysis outputs with requirements management and ALM tools, including Jira, Jama, and Polarion...Permanent employmentFull timeContract workFlexible hours
- ...tant que spécialiste senior en tests logiciels, vous collaborerez... ...physical identity and access management solution that centralizes and... ...solutions. As a Senior Software Test Specialist, you will collaborate... ...automation, or a similar engineering-focused role Strong...Full timeFlexible hours
- ...Defect Management & Root Cause Analysis The Manager, Link Layer Integration... ...reporting of system-level testing activities to ensure... ...Verification & Validation (V&V) engineers while collaborating closely with... ...Engineering, Operations, Software Development, and external suppliers...
$81.6k - $115.2k per year
...Insurance Digital Platform is looking for a Software Engineer to join the MyInsurance development team... ...and perform unit / component test for new application development initiatives... ...timelines and status updates to support management team / clients on prioritizing new and existing...Full timeWork from home- ...everyone has a voice, everyone can be themselves, everyone is welcome. Motive are seeking a Senior AI Software Developer to join our Iron Man project being developed using Unreal Engine 5. You will have the opportunity to work on a variety of AI features and systems in an...Full timeLocal area
- ...Description As a Machine Learning Operations Software Engineer at Ubisoft Montréal, you will help build... ...data processing pipelines Deploy and manage scalable cloud infrastructures... ...Contribute to exploratory projects testing new data and machine learning approaches...Full timeWork at office
- ...Financial Services is looking for a Software Development Manager in North America to grow and lead our... ...Working closely with Staff/Principal Engineers, P&T Leadership and cross-functional stakeholders... ...development Experience in test automation and/or DevOps engineering...Long term contractFull timeWork at officeLocal areaRemote workFlexible hours
- ...tâches, vous serez responsable de tester cette plateforme de façon... ...élaboration et à l’exécution de tests manuels et automatisés... ...infrastructure and users. As a software tester, you could play a key role... ...to a cloud-based solution that manages physical access more...Full timeFlexible hours
- ...arrangements. We are looking for a Senior V&V Test Engineer to support the validation of autonomous... ...vehicle networks, test environments and software interfaces. As the V&V activity grows... ...the CS Group Canada Technical Project Manager and technical leads across System...Permanent employmentFull timeFlexible hours
- ...MANNARINO Systems & Software Inc. is a leader in providing safety-... ..., hardware and certification engineering services to the aerospace, defense... ...implementation, integration, testing, optimization, and release.... ..., estimation, risk management, defect triage, lab bring-up,...Long term contractPermanent employmentWork at office
- ...MANNARINO Systems & Software Inc. is a leader in providing safety-... ..., hardware and certification engineering services to the aerospace, defense... ...implementation, integration, testing, troubleshooting, and release... ...programming Memory management and ownership Strong experience...Long term contractPermanent employmentWork at office
- ...MANNARINO Systems & Software Inc. is a leader in providing safety-... ..., hardware and certification engineering services to the aerospace, defense... ...through integration, testing, optimization, and release. Your... ...reviews, static analysis, release management, and technical documentation....Long term contractPermanent employmentWork at office
- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to... ...agents, planning, orchestration, memory management, and tool-calling frameworks. ~ Experience... ...platforms. ~ Strong knowledge of software engineering best practices, testing, debugging...Full timeInternshipRemote workRelocation
- ...is a next-generation data and AI consulting firm dedicated to accelerating... ..., AI technologies, data engineering, and digital transformation.... ...suites and regression tests for LLM-powered features, and... ...~3–5 years of experience in software engineering or data engineering...Full time
- ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task... ...reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;...Part timeFor contractorsRemote workFlexible hours
- .... This is a roughly 50/50 split between software engineering and operations: half your time you're writing... ...cascade. Design and implement proxy management, rotation strategies, and network-layer... ...— you know how to design and operate AI agents to discover new data sources, automate...Long term contractPermanent employmentFull timeInternshipWork at officeHome officeFlexible hours
$95k - $145k per year
...Time CGI is seeking an experienced Senior Software Engineering Specialist to join our growing Software... ...Engineering & Development Design, develop, test, and maintain high-quality, scalable... ...Evaluate emerging development frameworks, AI coding assistants, and engineering practices...Long term contractPermanent employmentFull timeWork at officeShift work- ...Responsibilities Propose and enhance project test plans with a focus on test automation.... ...methodologies, shift-left practices, and the software development lifecycle. Experience... ...GCP, Azure, and OpenShift. Knowledge of AI tooling applications within QA workflows....Long term contractTemporary workFlexible hoursShift work
$130k - $200k per year
...textile manufacturer as a hands-on engineer who embeds with operational teams to deliver production software. You will own projects end to... ...integrations, automation, and AI tools. What You'll Do... ...Work directly with factory managers and other stakeholders to move...Temporary workInternshipRelocation- ...de développement logiciel de tests automatisés pour la production... ...with R&D (Electronics, Firmware, Software, Mechanics), suppliers, and... ...the development team’s project management process (Kanban) Serve as a... ...architectures, and the ethical use of AI in software development...Full timeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Software Test Engineering Manager. Be the first to apply!
Related searches
- software quality assurance engineer Montréal, QC
- software test engineer Montréal, QC
- qa engineer Montréal, QC
- senior quality assurance engineer Montréal, QC
- senior test manager Montréal, QC
- test manager Montréal, QC
- junior software developer .net Montréal, QC
- remote software Montréal, QC
- entry level software Montréal, QC
- software sales Montréal, QC