Senior Ai Qa Engineer - Ai Evaluation Lead
Novara
Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM-driven features.You will work with the QA Manager and broader teams to extend automation coverage, improve observability, and ensure safe, reliable AI functionality across the product.
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Ai Qa Engineer - Ai Evaluation Lead in Winnipeg, MB vacancy
- Join Fortinet as a Lead QA Engineer, specializing in SaaS testing for our innovative FortiAIGate AI security solutions. This role encompasses testing for both on-premises and cloud deployments. As a senior contributor, you will spearhead the end-to-end testing process for...Senior
$140k - $175k per year
Job Description Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research...SuggestedInternshipWork at officeLocal areaFlexible hours- ...partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and... ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare...SeniorFull timeInternshipRemote workRelocation
$95k - $130k per year
...is on the rise.About the Role Reports To: QA Engineering ManagerDepartment: EngineeringRole Summary:... ...seeking a highly skilled and forward-thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI-based tools and intelligent automation...Suggested- Join to apply for the Lead QA Engineer role at Infoya Infoya is a global IT consulting and services organization that collaborates... ...drive tangible results. We are looking for an experienced Senior QA Engineer to lead end‑to‑end test automation and quality processes...Senior
- Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting... ...thoughtful manual and AI-assisted QA.As Quality Assurance Lead, you will assess whether... ...maintain representative scenarios, repeat evaluations after model or content changes, and detect...
- Join SoundHound AI as a Senior QA Automation Engineer and shape the future of Voice AI through quality testing. Work remotely to make a lasting impact. In this role, you will be pivotal in enhancing our software quality assurance practices at SoundHound AI. Your focus will...SeniorRemote work
- Nothing can limit yourdreams when you are atZoft SENIOR QA ENGINEER Work Location : Canada We are hiring a Senior QA Manager for an onsite... ...direct client communication are essential. This role is AI-first by design: you and your team will use modern AI-augmented...SeniorContract work
- Caylent is an AI-first cloud services company that helps organizations... ...release readiness to delivery leads and customer stakeholders... ...standard verification Partner with engineers during development to shift... ...suites, test data sets, QA checklists) back to the CXE practice...SeniorContract workWork at officeRemote workWorldwideFlexible hoursShift work
- The Role: Senior QA EngineerWhat you are looking for:A closely connected cultureA total rewards package meant to enhance your work... ...social causes through the Rexall Care NetworkThe Senior QA Engineer will lead the design and delivery of automated testing solutions that protect...SeniorShift work
- ...to November 4, 2026 OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning... ...and maintain prompt test libraries for LLM based features Evaluate responses for relevance, tone, factual accuracy, and alignment...Contract work
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Senior
- Paralucent is seeking a Senior QA Automation Engineer to lead quality engineering for a complex enterprise workflow and case-management platform. You will build the automation strategy and ensure requirements are traced through functional, integration, end-to-end, performance...SeniorShift work
- Define conversational AI quality remotely from Canada or the United States using Python, LLM APIs, and rigorous evaluation systems.As Cresta’s mid-level AI Agent Evaluation Engineer, you will own quality measurement for production LLM-based conversational agents. You will combine...Remote work
- Job DescriptionWe are seeking an experienced Senior QA Engineer (AI Native) to join Semios' Engineering team. This position will take ownership of quality throughout the software development lifecycle, from initial requirements and design through testing, deployment, and production...SeniorLong term contractContract workInternshipImmediate startRemote work
$65k - $80k per year
Senior/Intermediate QA EngineerOur client is a global leading provider of simple, secure and affordable network appliances comprised of an enterprise-class IP Address... ...is looking to hire a Senior/Intermediate QA Engineer. ResponsibilitiesThe ideal candidate will be responsible...SeniorContract workInternshipWorldwide- ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the... ..., and the people who rely on them. Key Responsibilities: Lead the development and enhancement of evaluation and performance...SeniorLong term contract
- A technology solutions firm in Toronto is looking for a Senior Automation Developer with extensive experience in automation testing. The role requires identifying automation opportunities, executing QA tests, and collaborating with development teams to ensure high-quality software...Senior
- ...G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations,...SeniorContract workRemote workFlexible hours
- Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications. The role requires 10+...Senior
- Zafin is seeking a QA Engineer III to lead functional quality assurance for complex banking applications. You will apply hands-on manual testing, automation, and thorough test documentation to ensure release quality across backend processes, APIs, and data workflows. This role...Senior
- ...The client is looking for a Senior QA Engineer to support application architecture, development, and innovation of new features for consumer solutions... .... The candidate will collaborate with cross-functional teams, lead testing initiatives, implement scalable test solutions, and...SeniorFlexible hours
- Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will partner with DevOps, Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable...Senior
- Our client is looking Senior QA Engineer for Long Term project in Toronto, ON / Ottawa, ON (Hybrid) Below is the detail requirement.... ...Optimization | Apache Kafka Event Validation | CI/CD Integration | AI-Assisted Testing KeyResponsibilities Translate complex...SeniorLong term contractContract work
$100k - $125k per year
Konrad is an AI-driven digital consultancy and product-innovation firm providing AI, strategy... ...businesses and brands.We empower industry-leading brands to navigate change, strategize, and... ...500 million people.About the Role As a Senior QA Engineer, you will play a hands-on role in...SeniorContract workWork from home- ...Konrad, a Canada-based AI-driven digital consultancy, seeks a Senior QA Engineer to own automated testing across web, mobile, API, and backend systems. You will combine software engineering and AI-assisted practices to deliver reliable software. You will design and maintain...Senior
$75k - $150k per year
...quality, we are looking for an experienced QA Engineer to deliver high-value features for Veeva... ...experience Nice to Have Experience utilizing AI testing tools for test-case generation and... ...A final conversation with our group's Senior Leader. Once all interviews are...SeniorInternshipWork at officeLocal areaWork from home- Lead automation and quality engineering for Veriforce’s SaaS platform in Calgary, using Playwright and AI-assisted testing within a hybrid workplace.This permanent QA Lead role provides technical leadership across Quality Engineering for platform and service integrations. You...SeniorPermanent employment
- Senior Quality Assurance Specialist (AI Testing / QA Lead) Location: Toronto, ON | Hybrid, 3 days per week onsite, 2 days remote Language: English, excellent written and verbal communication required Duration: 6-month contract, 35 hours per week About the...SeniorContract workRemote work3 days per weekWeekday work
- Evaluate AI-generated mechanical designs and calculations with strong engineering fundamentals and technical writing skills. Work fully remotely on flexible, project-based... ...or Python experienceBring careful engineering evaluation, failure analysis, and technical communication...For contractorsRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ai Qa Engineer - Ai Evaluation Lead. Be the first to apply!
Related searches
- software quality assurance engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- senior quality assurance engineer Winnipeg, MB
- qa lead Winnipeg, MB
- senior financial accountant Winnipeg, MB
- senior sales consultant Winnipeg, MB
- senior communications specialist Winnipeg, MB
- senior bookkeeper Winnipeg, MB
- senior system administrator Winnipeg, MB

