Senior Ai Qa Engineer - Ai Evaluation Lead
Novara
Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM-driven features.You will work with the QA Manager and broader teams to extend automation coverage, improve observability, and ensure safe, reliable AI functionality across the product.
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Ai Qa Engineer - Ai Evaluation Lead in Winnipeg, MB vacancy
- Lead AI-augmented quality engineering at COSMO, combining automated testing and DevSecOps across connected products and digital services. Guide global QA efforts for family-focused technology.As Lead QA Engineer, you will own quality strategy for hardware, firmware, mobile...Suggested
COSMO Technologies
Winnipeg, MB1 hour ago - ...partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and... ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare...SeniorFull timeInternshipRemote workRelocation
$140k - $175k per year
Job Description Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research...SuggestedInternshipWork at officeLocal areaFlexible hoursThomson Reuters
Winnipeg, MB1 hour ago- Join to apply for the Lead QA Engineer role at Infoya Infoya is a global IT consulting and services organization that collaborates... ...drive tangible results. We are looking for an experienced Senior QA Engineer to lead end‑to‑end test automation and quality processes...Senior
Infoya
Winnipeg, MB1 hour ago $95k - $130k per year
...is on the rise. About the RoleReports To: QA Engineering Manager Department: Engineering Role... ...seeking a highly skilled and forward‑thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI‑based tools and intelligent automation...SuggestedCOSMO Technologies
Winnipeg, MB1 hour ago- Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting... ...thoughtful manual and AI-assisted QA.As Quality Assurance Lead, you will assess whether... ...maintain representative scenarios, repeat evaluations after model or content changes, and detect...
CGS Immersive
Winnipeg, MB1 hour ago - Nothing can limit yourdreams when you are atZoft SENIOR QA ENGINEER Work Location : Canada We are hiring a Senior QA Manager for an onsite... ...direct client communication are essential. This role is AI-first by design: you and your team will use modern AI-augmented...SeniorContract work
ZoftSolutions
Winnipeg, MB1 hour ago - Paralucent is seeking a Senior QA Automation Engineer to lead quality engineering for a complex enterprise workflow and case-management platform. You will build the automation strategy and ensure requirements are traced through functional, integration, end-to-end, performance...SeniorShift work
Paralucent
Winnipeg, MB1 hour ago $136k - $148k per year
...optimized hardware, software, and increasingly AI, coupled with the patient-centric experience... ...domestic and global clinics, have allowed us to lead the change against “we caught it too late again".We are looking for a Senior QA Engineer I to join our team! You will be...SeniorLocal areaImmediate startRemote workFlexible hoursPrenuvo
Winnipeg, MB1 hour ago$100k - $125k per year
Who We Are Konrad is an AI-driven digital consultancy and product-innovation firm providing... ...businesses and brands.We empower industry-leading brands to navigate change, strategize, and... ...500 million people.About the Role As a Senior QA Engineer, you will play a hands-on role in...SeniorContract workWork from homeKonrad
Winnipeg, MB1 hour ago- ...to November 4, 2026 OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning... ...and maintain prompt test libraries for LLM based features Evaluate responses for relevance, tone, factual accuracy, and alignment...Contract work
Infotek Consulting Inc.
Winnipeg, MB1 hour ago - Build reliable autonomous AI at Equifax through LLM evaluation, Python automation, and multi-agent workflow testing... ...As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities... .... Collaboration with AI Solution Leads and AI Agent Developers supports robust...
Equifax Inc.
Winnipeg, MB1 hour ago - Caylent is an AI-first cloud services company that helps organizations... ...release readiness to delivery leads and customer stakeholders... ...standard verification Partner with engineers during development to shift... ...suites, test data sets, QA checklists) back to the CXE practice...SeniorContract workWork at officeRemote workWorldwideFlexible hoursShift work
Caylent
Winnipeg, MB1 hour ago - The Role: Senior QA EngineerWhat you are looking for:A closely connected cultureA total rewards package meant to enhance your work... ...social causes through the Rexall Care NetworkThe Senior QA Engineer will lead the design and delivery of automated testing solutions that protect...SeniorShift work
Rexall
Winnipeg, MB1 hour ago - X360 AI Tech (X360 Technologies Limited) · Remote, Canada · Full-time or Contract... ...growing company and a leader in AI-based QA testing platforms. We help software... ...Marketplace. The roleWe're looking for a Senior Director, AI & QA to lead how our AI agents test software, and...SeniorFull timeContract workInternshipRemote work
X360 Technologies
Winnipeg, MB1 hour ago - Lead AI evaluation strategy from Canada, applying automated testing and model governance to improve agent reliability across enterprise automations... ...memory, learning, and self-improvement featuresPartner with engineering and design on intuitive configuration toolsRequirements:...
Jobgether
Winnipeg, MB1 hour ago - A technology solutions firm in Toronto is looking for a Senior Automation Developer with extensive experience in automation testing. The role requires identifying automation opportunities, executing QA tests, and collaborating with development teams to ensure high-quality software...Senior
Rubicon Path
Winnipeg, MB1 hour ago - Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will partner with DevOps, Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable...Senior
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Senior
- Our client is looking Senior QA Engineer for Long Term project in Toronto, ON / Ottawa, ON (Hybrid) Below is the detail requirement.... ...Optimization | Apache Kafka Event Validation | CI/CD Integration | AI-Assisted Testing KeyResponsibilities Translate complex...SeniorLong term contractContract work
Lorven Technologies Inc.
Winnipeg, MB1 hour ago - Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications. The role requires 10+...Senior
Altis Technology
Winnipeg, MB1 hour ago - ...The client is looking for a Senior QA Engineer to support application architecture, development, and innovation of new features for consumer solutions... .... The candidate will collaborate with cross-functional teams, lead testing initiatives, implement scalable test solutions, and...SeniorFlexible hours
Compunnel Inc.
Winnipeg, MB1 hour ago - ...G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations,...SeniorContract workRemote workFlexible hours
G2i Inc.
Winnipeg, MB1 hour ago $75k - $150k per year
...quality, we are looking for an experienced QA Engineer to deliver high-value features for Veeva... ...experience Nice to Have Experience utilizing AI testing tools for test-case generation and... ...A final conversation with our group's Senior Leader. Once all interviews are...SeniorInternshipWork at officeLocal areaWork from homeVeeva Systems
Winnipeg, MB1 hour ago- Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your design and debugging skills... ...realistic engineering problems from practical experience • Evaluate AI model outputs against professional benchmarks •...
DataAnnotation
Winnipeg, MB1 hour ago - ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the... ..., and the people who rely on them. Key Responsibilities: Lead the development and enhancement of evaluation and performance...SeniorLong term contract
- Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform... ..., and drive automation using Java, Selenium/Playwright, and AI-assisted workflows. You will also deploy disposable environments...Senior
Upgrade
Winnipeg, MB1 hour ago - ...Konrad, a Canada-based AI-driven digital consultancy, seeks a Senior QA Engineer to own automated testing across web, mobile, API, and backend systems. You will combine software engineering and AI-assisted practices to deliver reliable software. You will design and maintain...Senior
Konrad
Winnipeg, MB1 hour ago - Lead AI-powered quality strategy remotely across Canada for X360 AI Tech, shaping test automation, release readiness, and enterprise outcomes.As Senior Director, AI & QA, you will guide QA and AI engineering teams across X360 AI Galaxy. You will apply Playwright, Cypress, Selenium...SeniorRemote work
X360 Technologies
Winnipeg, MB1 hour ago - Lead automation and quality engineering for Veriforce’s SaaS platform in Calgary, using Playwright and AI-assisted testing within a hybrid workplace.This permanent QA Lead role provides technical leadership across Quality Engineering for platform and service integrations. You...SeniorPermanent employment
Cognibox
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ai Qa Engineer - Ai Evaluation Lead. Be the first to apply!
Related searches
- software quality assurance engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- senior quality assurance engineer Winnipeg, MB
- qa lead Winnipeg, MB
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB