Ingénieur D’assurance Qualité/Ingénieure D’assurance Qualité (Montreal)

Overview

Senior AI-First QA Engineer – Montreal, Hybrid, Full-time

Our client is a maritime software company building products that help customers make better decisions during live operations. They connect operational, reporting, compliance, optimization, and other business-critical data into one trusted foundation so teams can act while outcomes can be influenced. They believe AI is changing product development and are building teams that prototype faster, automate more, orchestrate agents, shorten feedback loops, and rethink how products are delivered from idea to release. They are hiring a Senior AI-First QA Engineer to help build quality into a new product from the start.

Responsibilities

• Design and build automated test suites across backend, frontend, and integration layers.
• Use AI tools to accelerate test generation, coverage analysis, and regression detection.
• Define quality standards for AI-powered features, including agent behavior, LLM outputs, and non-deterministic system responses.
• Integrate quality checks into CI/CD pipelines for fast, automated feedback.
• Collaborate with engineers and designers to catch issues early and enable rapid delivery without sacrificing quality.
• Define acceptance criteria and edge-case coverage with the product and engineering teams.
• Build and maintain test infrastructure that scales with a fast-moving product.
• Evaluate new AI-assisted testing tools and incorporate the best into the team’s workflow.
• Contribute to understanding failure modes of AI systems and build tests to surface them.
• Test AI-powered features, evaluate agent behavior, LLM outputs, and integration points with the product.

What we’re looking for

• Strong experience in QA engineering, test automation, or software quality roles.
• Hands-on experience building and maintaining automated test suites (unit, integration, end-to-end).
• Experience with Python testing frameworks (pytest and related tooling) and/or JavaScript/TypeScript testing (Jest, Playwright, Cypress).
• Understanding of how to test AI-powered features, including evaluation of LLM outputs and agent behavior.
• Comfortable working in fast-delivery environments with minimal documentation overhead.
• Strong debugging skills and ability to reason about complex system behavior.
• Collaborative and direct—able to push back on quality issues without slowing the team.
• A genuine curiosity about AI and a willingness to share your point of view on where things are headed.
• Self-awareness about strengths and gaps, with a habit of using AI to cover the latter.
• Proficiency in English and French is required.
• Experience using AI tools (Claude, Copilot, Cursor, or similar) to write or accelerate test creation is valuable.
• Experience testing LLM-based or agent-based systems.
• Experience with CI/CD integration (GitHub Actions, Argo CD, or similar).
• Experience with API and contract testing.
• Experience with React component testing and UI automation.
• Familiarity with evaluation frameworks for AI systems (LLM eval, RAG evaluation, etc.).
• Experience with Python with an interest in the broader stack (FastAPI, LangChain, and related tooling).

Why this role is different

You’ll join a Montreal-based team built around a new model of product development: senior people, high ownership, fast iteration, and deep use of AI across the full product lifecycle.

We value clarity of thinking, quality of analysis, precise questioning, and sound judgment in steering AI toward the right result. Reading and understanding deeply matters more here than producing quickly, and you will build test coverage that keeps pace with a product that is genuinely moving fast.

Working model & Benefits

Based in Montreal, with regular in-person collaborations as needed. Hybrid setup with collaboration across multiple regions. Strong local team and global product context. Attractive salary. 4 weeks vacation. Healthcare insurance.