Senior AI QA Engineer - AI Evaluation Lead

Novara

Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM-driven features.

You will work with the QA Manager and broader teams to extend automation coverage, improve observability, and ensure safe, reliable AI functionality across the product.

#J-18808-Ljbffr

Apply

Vacancy posted 5 hours ago

Similar jobs that could be interesting for youBased on the Senior AI QA Engineer - AI Evaluation Lead in Montréal, QC vacancy

AI Evaluation Engineer (QA)
...combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions... ...clients. En tant qu'ingénieur QA / Évaluation IA, vous rejoindrez une équipe... ...experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly...
Suggested
Full time
Apprenticeship
Immediate start
Appnovation Technologies
Montréal, QC
a month ago
Senior Software QA Engineer
...Relaxed Work Environment ~ Growth and Development Opportunities Position Summary The primary purpose of the Senior Software QA Engineer is to lead and deliver testing services using industry standards and best practices to meet customer requirements. This role will...
Senior
Full time
TTC Global
Montréal, QC
more than 2 months ago
QA Automation Engineer co-op
...Opportunity We're looking for a QA Developer Co-op to join our R&D... ...Using modern tooling, AI included, to work efficiently -... ...re currently studying Software Engineering, Computer Science, or a related... ...customers rely on Mentorship from senior developers who'll invest in how...
Senior
Full time
Internship
Remote work
Flexible hours
Flexspring
Montréal, QC
a month ago
QA Engineer
$69k - $86k per year
Opportunité À Valtech, vous trouverez un environnement propice à l’apprentissage continu, à l’impact concret et à la croissance professionnelle. Que vous développiez de nouvelles solutions digitales, remettiez en question les idées reçues ou construisiez la prochaine ...
Suggested
Full time
Apprenticeship
Work at office
Trial period
Flexible hours
Valtech Se
Montréal, QC
more than 2 months ago
Applied AI, Technical Lead, Forward Deployed AI Engineer
...Mistral provides full-stack AI solutions: from frontier models... ...Mistral AI is seeking a Technical Lead, Applied AI to drive the... ...a project teams of Applied AI Engineers, ensuring the successful deployment... ...emerging trends in AI , evaluating new tools and methodologies, and...
Suggested
Full time
Relocation package
Mistral
Montréal, QC
more than 2 months ago
AI Engineer
$150k - $160k per year
...Requisition Number: 106471 AI Engineer Location You will have the flexibility to work... ...prompt strategies, guardrails, and evaluation loops to improve reliability, safety, and... ...software development, including 2+ years leading technical delivery on client-facing or cross...
Full time
Local area
Remote work
Insight
Montréal, QC
13 days ago
Tech Lead DevX & AI
...YOU We are looking for a Tech Lead to drive delivery and cross-... ...for the Shop Builder DevX and AI team. You are the bridge between... ...direction set by the Principal Engineer and turn it into a running, shipping... ...your domain. You also have the seniority and judgment to coordinate...
Senior
Full time
Local area
Worldwide
Xsolla
Montréal, QC
more than 2 months ago
Applied AI Engineer
...solutions in Strategy, Analytics, Digital Engineering, Cloud, Data & AI, Experience Design, and Marketing.... ...Americas, APAC, and EMEA. By partnering with leading technology providers, we craft... ...research or prototyping. We are looking for senior, hands-on full-stack engineers who...
Senior
Full time
Internship
Local area
Worldwide
Work visa
Bounteous
Montréal, QC
more than 2 months ago
Senior SRE / Observability Engineer IA & AI Ops - Bilingual
$110k - $120k per year
...1000 companies to small and mid-sized organizations in Canada/US and Europe. We currently have a role as an Senior SRE / Observability Engineer – IA & AI Ops - Bilingual with our large consulting client, working for a public sector, crown corporation in the Montreal...
Senior
Long term contract
Permanent employment
Full time
Contract work
Freelance
2 days per week
3 days per week
Tech Talent International
Montréal, QC
4 days ago
AI-First Engineering Intern
$20 - $25 per hour
...is going all-in on becoming an AI-first company, and we're not... ...get there. We're offering AI Engineer Internships in regions across... ...developers – working closely with senior engineers and fellow interns... ...no formal problem sets. We're evaluating proof of work, not your ability...
Senior
Internship
Work at office
Shift work
Xsolla
Montréal, QC
more than 2 months ago
Principal Engineer DevX & AI
...We are looking for a Principal Engineer to take architectural ownership of... ...Builder platform. This is the most senior individual contributor role on the DevX and AI team, and the decisions you make here... ...of a public API. Design and lead delivery of the MCP server that allows...
Senior
Full time
Local area
Worldwide
Xsolla
Montréal, QC
more than 2 months ago
Senior AI Programmer
...Description Ubisoft is a global leader in gaming with teams across the... ..., developed in Unreal Engine. We’re looking for hands‑on developers... ...maintain real‑time gameplay AI systems in Unreal Engine Own... ...playable” gameplay. Act as a senior, hands‑on, pragmatic contributor...
Senior
Full time
Ubisoft
Montréal, QC
more than 2 months ago
Chef d'équipe Développement AQ / Development QA Test Lead
$24 - $30 per hour
...Studios seeks a Quality Assurance Lead (Development) who will operate... ...and accountability for overall QA delivery for assigned projects.... ...compétences. Réaliser les évaluations de performance des employés et... ...techniques de base avec Unreal Engine 4 et 5. Connaissance avancée...
Permanent employment
Full time
Work at office
Keywords Studios
Montréal, QC
more than 2 months ago
Senior Quality Assurance Engineer
$10k per year
...Description Senior Quality Assurance Engineer Location: Montreal, QC VIA is making an impact, and so... ...This is not a traditional 'downstream' QA role, you will be responsible for building... ...as a force multiplier by leveraging AI-driven automation to replace manual processes...
Senior
Full time
Summer work
Remote work
Work from home
Flexible hours
Via Science
Montréal, QC
more than 2 months ago
QA Service Manager
...Gestionnaire de services QA (Montréal, mode hybride) Lieu : résidence au Québec... ...ingénierie de la performance, notre approche AI-First Quality Engineering et la transformation de la qualité pour... ...governance, KPIs and reporting to senior stakeholders. Knowledge of Agile and...
Senior
Full time
Contract work
Internship
Monday to friday
Shift work
2 days per week
1 day per week
TTC Global
Montréal, QC
2 days ago
Software Engineer AI
...nous connectons les meilleurs talents tech avec des entreprises qui construisent l'avenir. Aujourd'hui, nous recrutons un·e Software Engineer AI pour l'un de nos clients : une scale-up montréalaise à la pointe de l'IA appliquée pour les opérations financières. Qui est...
Daily paid
Permanent employment
Full time
Part time
Remote work
Maplr
Montréal, QC
more than 2 months ago
Senior Presales Engineer
...ChapsVision ChapsVision est un leader mondial des solutions d’IA... ...Ingénieur(e) avant-vente (PreSales Engineer) afin de soutenir la croissance... ...is a global leader in Agentic AI and data solutions, helping... ...and strategic priorities ~ Lead technical discovery sessions with...
Senior
Permanent employment
Full time
Chapsvision Canada
Montréal, QC
19 days ago
Forward Deployed AI Engineer
$115k - $130k per year
...countries , built on a single conviction: AI does not transform businesses. Architected... ...pipeline for upcoming Forward Deployed AI Engineer opportunities in Canada. While we may not... ...clearly with both technical teams and senior business stakeholders. You navigate ambiguity...
Senior
Permanent employment
Full time
Contract work
Work at office
Immediate start
Work from home
Flexible hours
2 days per week
Keyrus Canada
Montréal, QC
more than 2 months ago
Lead Infrastructure Engineer
...autonomous vehicles at Cruise Automation, leading ops and growth for Uber, and building... ...the Apple app store. We have staff and senior engineers from Google, Uber, Meta, Shopify, Stripe... ...Infrastructure & Kubernetes Scope and lead large, often ambiguous technical projects...
Senior
Full time
Internship
Work at office
Atob
Montréal, QC
more than 2 months ago
AI Product Engineer - Canada
...family of operating groups—a global leader in acquiring and growing... ...The Mission We’re building AI startups inside an established... ...software companies—and we need engineers who can make ideas real, fast.... ...work alongside an AI Ventures Lead who owns customer discovery, product...
Long term contract
Full time
Internship
Work at office
Immediate start
Remote work
Valsoft
Montréal, QC
more than 2 months ago
Developpeur-euse AI senior
...Développeur(- euse ) logiciel IA senior Vision par ordinateur pour le tri robotisé en temps réel & MLOps Waste Robotics | Récupération... ...responsabilités ~ Déte ction en temps réel : entraîner, évaluer, comparer et livrer des modèles de détection et de segmentation (...
Senior
Full time
Apprenticeship
Remote work
Waste Robotics
Montréal, QC
a month ago
Retail Senior Client Lead
...dunnhumby dunnhumby est le leader mondial de la Data Science appliquée... ...quotidiennes de niveau senior avec les parties prenantes du distributeur... ...are dunnhumby's commercial engine - building the long-term,... ...assigned retailer stakeholders and lead the delivery of insight-led...
Senior
Daily paid
Long term contract
Full time
Contract work
Temporary work
Flexible hours
Dunnhumby
Montréal, QC
15 days ago
Senior Analytics Engineer
$5000 per month
...Lightspeed's Data Office is hiring a Senior Analytics Engineer to design and own the data models that drive... ...that power both human reviewers and AI/LLM-assisted workflows Diagnose root... ...health end-to-end: monitor proactively, lead incident response, and surface risks before...
Senior
Full time
Work at office
Immediate start
Remote work
Flexible hours
Lightspeed Commerce
Montréal, QC
more than 2 months ago
Senior Mobile Developer (AI-Enabled)
...most in their daily work. As a Senior Mobile Developer, you'll own the... ...managers, designers, and engineers across the organization. You... ...and architectural decisions , lead code reviews, and help your teammates... ..., not just what we build. The "AI Enabled" framing is intentional...
Senior
Full time
Remote work
Work from home
Solutions Petal Inc.
Montréal, QC
more than 2 months ago
Senior Data Engineer
...that are managed around the world. As the leading SaaS platform for physical security... ...seeking a highly skilled and motivated Senior Data Engineer to join our Data team. In this role, you... ...high bar for engineering quality. Use AI-assisted development tools in your own workflow...
Senior
Long term contract
Full time
Work at office
Local area
Remote work
Work from home
Flexible hours
Trackforce
Montréal, QC
more than 2 months ago
Lead Security Engineer (Fraud)
$150k - $220k per year
...and the age of 5G and IoT, with world class engineering, best-in-class user experience, and... ...exceptional to join our team. As the Lead Security Engineer , you’ll be both a hands... ...more! We may use artificial intelligence (AI) tools to support parts of the hiring process...
Full time
Work from home
Flexible hours
Us Mobile
Montréal, QC
more than 2 months ago
Lead Engine Programmer | Programmeur ou programmeuse moteur Lead
...Description NBCUniversal is one of the world's leading media and entertainment companies. We... ...vivons. Job Description As a Lead Engine Programmer , you are responsible for... ...en identifiant les risques techniques, en évaluant l’ampleur des travaux et en planifiant l’...
Long term contract
Full time
Local area
Nbcuniversal
Montréal, QC
2 days ago
Technical QA Specialist
...Spécialiste QA technique (Montréal, mode hybride ou télétravail) Lieu : Montréal en mode hybride; candidatures de l'extérieur... ...des tests, l'ingénierie de la performance, notre approche AI-First Quality Engineering et la transformation de la qualité pour des environnements d...
Full time
Contract work
Internship
Monday to friday
Shift work
2 days per week
1 day per week
TTC Global
Montréal, QC
2 days ago
Senior Software Engineer
...Description Role Overview We are seeking an experienced Senior Developer to support the implementation, optimisation, and transformation of Power Platform initiatives. The role requires deep understanding of the solution and relevant experience. the successful candidate...
Senior
Full time
Bbgc
Montréal, QC
10 days ago
Ingénieur Senior/Lead en Déploiement Avancé
...observabilité, de surveillance et d’évaluation afin d’assurer la qualité, la... ...des clients et agir comme leader technique actif et promoteur... ...Google Cloud Professional Data Engineer Google Cloud Professional Machine... ...Microsoft Certified: Azure AI Engineer Associate...
Senior
Daily paid
Full time
Work at office
Remote work
Trial period
Flexible hours
Valtech Se
Montréal, QC
a month ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI QA Engineer - AI Evaluation Lead. Be the first to apply!