Senior Ai Qa Engineer - Ai Evaluation Lead
Novara
Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM-driven features.You will work with the QA Manager and broader teams to extend automation coverage, improve observability, and ensure safe, reliable AI functionality across the product.
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 57 minutes ago
Similar jobs that could be interesting for youBased on the Senior Ai Qa Engineer - Ai Evaluation Lead in Winnipeg, MB vacancy
- Lead AI-augmented quality engineering at COSMO, combining automated testing and DevSecOps across connected products and digital services. Guide global QA efforts for family-focused technology.As Lead QA Engineer, you will own quality strategy for hardware, firmware, mobile...Suggested
- Join Fortinet as a Lead QA Engineer, specializing in SaaS testing for our innovative FortiAIGate AI security solutions. This role encompasses testing for both on-premises and cloud deployments. As a senior contributor, you will spearhead the end-to-end testing process for...Senior
$140k - $175k per year
Job Description Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research...SuggestedInternshipWork at officeLocal areaFlexible hours$95k - $130k per year
...is on the rise.About the Role Reports To: QA Engineering ManagerDepartment: EngineeringRole Summary:... ...seeking a highly skilled and forward-thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI-based tools and intelligent automation...Suggested- ...partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and... ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare...SeniorFull timeInternshipRemote workRelocation
- Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting... ...thoughtful manual and AI-assisted QA.As Quality Assurance Lead, you will assess whether... ...maintain representative scenarios, repeat evaluations after model or content changes, and detect...
- Join SoundHound AI as a Senior QA Automation Engineer and shape the future of Voice AI through quality testing. Work remotely to make a lasting impact. In this role, you will be pivotal in enhancing our software quality assurance practices at SoundHound AI. Your focus will...SeniorRemote work
- Caylent is an AI-first cloud services company that helps organizations... ...release readiness to delivery leads and customer stakeholders... ...standard verification Partner with engineers during development to shift... ...suites, test data sets, QA checklists) back to the CXE practice...SeniorContract workWork at officeRemote workWorldwideFlexible hoursShift work
$136k - $148k per year
...optimized hardware, software, and increasingly AI, coupled with the patient-centric experience... ...domestic and global clinics, have allowed us to lead the change against “we caught it too late again".We are looking for a Senior QA Engineer I to join our team! You will be...SeniorLocal areaImmediate startRemote workFlexible hours- Build reliable autonomous AI at Equifax through LLM evaluation, Python automation, and multi-agent workflow testing... ...As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities... .... Collaboration with AI Solution Leads and AI Agent Developers supports robust...
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Senior
- X360 AI Tech (X360 Technologies Limited) · Remote, Canada · Full-time or Contract... ...growing company and a leader in AI-based QA testing platforms. We help software... ...Marketplace. The roleWe're looking for a Senior Director, AI & QA to lead how our AI agents test software, and...SeniorFull timeContract workInternshipRemote work
- Nothing can limit yourdreams when you are atZoft SENIOR QA ENGINEER Work Location : Canada We are hiring a Senior QA Manager for an onsite... ...direct client communication are essential. This role is AI-first by design: you and your team will use modern AI-augmented...SeniorContract work
- ...to November 4, 2026 OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning... ...and maintain prompt test libraries for LLM based features Evaluate responses for relevance, tone, factual accuracy, and alignment...Contract work
$65k - $80k per year
Senior/Intermediate QA EngineerOur client is a global leading provider of simple, secure and affordable network appliances comprised of an enterprise-class IP Address... ...is looking to hire a Senior/Intermediate QA Engineer. ResponsibilitiesThe ideal candidate will be responsible...SeniorContract workInternshipWorldwide- The Role: Senior QA EngineerWhat you are looking for:A closely connected cultureA total rewards package meant to enhance your work... ...social causes through the Rexall Care NetworkThe Senior QA Engineer will lead the design and delivery of automated testing solutions that protect...SeniorShift work
- Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications. The role requires 10+...Senior
- Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will partner with DevOps, Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable...Senior
- ...The client is looking for a Senior QA Engineer to support application architecture, development, and innovation of new features for consumer solutions... .... The candidate will collaborate with cross-functional teams, lead testing initiatives, implement scalable test solutions, and...SeniorFlexible hours
- Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your design and debugging skills... ...realistic engineering problems from practical experience • Evaluate AI model outputs against professional benchmarks •...
- ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the... ..., and the people who rely on them. Key Responsibilities: Lead the development and enhancement of evaluation and performance...SeniorLong term contract
- ...G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations,...SeniorContract workRemote workFlexible hours
- Zafin is seeking a QA Engineer III to lead functional quality assurance for complex banking applications. You will apply hands-on manual testing, automation, and thorough test documentation to ensure release quality across backend processes, APIs, and data workflows. This role...Senior
- Our client is looking Senior QA Engineer for Long Term project in Toronto, ON / Ottawa, ON (Hybrid) Below is the detail requirement.... ...Optimization | Apache Kafka Event Validation | CI/CD Integration | AI-Assisted Testing KeyResponsibilities Translate complex...SeniorLong term contractContract work
- Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform... ..., and drive automation using Java, Selenium/Playwright, and AI-assisted workflows. You will also deploy disposable environments...Senior
- Lead automation and quality engineering for Veriforce’s SaaS platform in Calgary, using Playwright and AI-assisted testing within a hybrid workplace.This permanent QA Lead role provides technical leadership across Quality Engineering for platform and service integrations. You...SeniorPermanent employment
- ## AI Applied Senior Engineering LeadApplyremote type: Hybridlocations: Mississauga Ontario Canadatime type: Full timeposted on: Posted Todayjob requisition... ...is seeking a highly hands-on AI Applied Senior Engineering Lead to design, build, and deploy cutting‐edge AI solutions for...Senior
- Senior Quality Assurance Specialist (AI Testing / QA Lead) Location: Toronto, ON | Hybrid, 3 days per week onsite, 2 days remote Language: English, excellent written and verbal communication required Duration: 6-month contract, 35 hours per week About the...SeniorContract workRemote work3 days per weekWeekday work
- Lead AI-powered quality strategy remotely across Canada for X360 AI Tech, shaping test automation, release readiness, and enterprise outcomes.As Senior Director, AI & QA, you will guide QA and AI engineering teams across X360 AI Galaxy. You will apply Playwright, Cypress, Selenium...SeniorRemote work
$80k - $130k per year
AI-Native Mobile QA EngineerSnaplii · Etobicoke (Toronto), ON · On-site · Full-time About SnapliiSnaplii is a profitable Toronto fintech... ...from the person who built it, with a full handover, and a senior engineer on the team is your go-to while you settle in. After that,...SeniorFull timeInternshipLmiaPnpMonday to friday
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ai Qa Engineer - Ai Evaluation Lead. Be the first to apply!
Related searches
- software quality assurance engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- senior quality assurance engineer Winnipeg, MB
- qa lead Winnipeg, MB
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB

