Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Ai Qa Engineer - Ai Evaluation Lead

Novara

Novara is seeking a QA Engineer to own the quality bar for AI-powered features, including non-deterministic systems and agent-based workflows. You will define what getting it right means, build tooling, and partner with product and engineering to bring rigor to testing LLM-driven features.You will work with the QA Manager and broader teams to extend automation coverage, improve observability, and ensure safe, reliable AI functionality across the product.
#J-18808-Ljbffr
Vacancy posted 57 minutes ago
Similar jobs that could be interesting for youBased on the Senior Ai Qa Engineer - Ai Evaluation Lead in Winnipeg, MB vacancy
  • Lead AI-augmented quality engineering at COSMO, combining automated testing and DevSecOps across connected products and digital services. Guide global QA efforts for family-focused technology.As Lead QA Engineer, you will own quality strategy for hardware, firmware, mobile... 
    Suggested

    COSMO Technologies

    Winnipeg, MB
    53 minutes ago
  • Join Fortinet as a Lead QA Engineer, specializing in SaaS testing for our innovative FortiAIGate AI security solutions. This role encompasses testing for both on-premises and cloud deployments. As a senior contributor, you will spearhead the end-to-end testing process for... 
    Senior

    Fortinet Inc.

    Winnipeg, MB
    57 minutes ago
  • $140k - $175k per year

    Job Description Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research... 
    Suggested
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    52 minutes ago
  • $95k - $130k per year

     ...is on the rise.About the Role Reports To: QA Engineering ManagerDepartment: EngineeringRole Summary:...  ...seeking a highly skilled and forward-thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI-based tools and intelligent automation... 
    Suggested

    Cosmo

    Winnipeg, MB
    48 minutes ago
  •  ...partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and...  ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... 
    Senior
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    5 days ago
  • Test AI coaches, simulations, and learner feedback at CGS Immersive while protecting...  ...thoughtful manual and AI-assisted QA.As Quality Assurance Lead, you will assess whether...  ...maintain representative scenarios, repeat evaluations after model or content changes, and detect... 

    CGS Immersive

    Winnipeg, MB
    49 minutes ago
  • Join SoundHound AI as a Senior QA Automation Engineer and shape the future of Voice AI through quality testing. Work remotely to make a lasting impact. In this role, you will be pivotal in enhancing our software quality assurance practices at SoundHound AI. Your focus will... 
    Senior
    Remote work

    SoundHound Inc.

    Winnipeg, MB
    56 minutes ago
  • Caylent is an AI-first cloud services company that helps organizations...  ...release readiness to delivery leads and customer stakeholders...  ...standard verification Partner with engineers during development to shift...  ...suites, test data sets, QA checklists) back to the CXE practice... 
    Senior
    Contract work
    Work at office
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Caylent

    Winnipeg, MB
    53 minutes ago
  • $136k - $148k per year

     ...optimized hardware, software, and increasingly AI, coupled with the patient-centric experience...  ...domestic and global clinics, have allowed us to lead the change against “we caught it too late again".We are looking for a Senior QA Engineer I to join our team! You will be... 
    Senior
    Local area
    Immediate start
    Remote work
    Flexible hours

    Prenuvo

    Winnipeg, MB
    53 minutes ago
  • Build reliable autonomous AI at Equifax through LLM evaluation, Python automation, and multi-agent workflow testing...  ...As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities...  .... Collaboration with AI Solution Leads and AI Agent Developers supports robust... 

    Equifax Inc.

    Winnipeg, MB
    52 minutes ago
  •  ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software... 
    Senior

    Talentola

    Winnipeg, MB
    5 days ago
  • X360 AI Tech (X360 Technologies Limited) · Remote, Canada · Full-time or Contract...  ...growing company and a leader in AI-based QA testing platforms. We help software...  ...Marketplace. The roleWe're looking for a Senior Director, AI & QA to lead how our AI agents test software, and... 
    Senior
    Full time
    Contract work
    Internship
    Remote work

    X360 Technologies

    Winnipeg, MB
    49 minutes ago
  • Nothing can limit yourdreams when you are atZoft SENIOR QA ENGINEER Work Location : Canada We are hiring a Senior QA Manager for an onsite...  ...direct client communication are essential. This role is AI-first by design: you and your team will use modern AI-augmented... 
    Senior
    Contract work

    ZoftSolutions

    Winnipeg, MB
    51 minutes ago
  •  ...to November 4, 2026 OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning...  ...and maintain prompt test libraries for LLM based features Evaluate responses for relevance, tone, factual accuracy, and alignment... 
    Contract work

    Infotek Consulting Inc.

    Winnipeg, MB
    59 minutes ago
  • $65k - $80k per year

    Senior/Intermediate QA EngineerOur client is a global leading provider of simple, secure and affordable network appliances comprised of an enterprise-class IP Address...  ...is looking to hire a Senior/Intermediate QA Engineer. ResponsibilitiesThe ideal candidate will be responsible... 
    Senior
    Contract work
    Internship
    Worldwide

    ROSS

    Winnipeg, MB
    57 minutes ago
  • The Role: Senior QA EngineerWhat you are looking for:A closely connected cultureA total rewards package meant to enhance your work...  ...social causes through the Rexall Care NetworkThe Senior QA Engineer will lead the design and delivery of automated testing solutions that protect... 
    Senior
    Shift work

    Rexall

    Winnipeg, MB
    48 minutes ago
  • Altis Technology in Toronto is seeking a Senior QA Specialist to lead AI testing and QA strategy across enterprise projects. You will develop AI-powered QA agents, perform diverse testing, and ensure security and reliability in AI-enabled applications. The role requires 10+... 
    Senior

    Altis Technology

    Winnipeg, MB
    56 minutes ago
  • Astra-North Infoteck Inc. is seeking a seasoned Quality Engineer (QE) / SDET to lead AI chatbot validation and ensure high-quality DevOps pipelines. You will partner with DevOps, Development, Product, and QE teams to design AI-focused tests, define strategies, and build scalable... 
    Senior

    Astra-North Infoteck Inc.

    Winnipeg, MB
    50 minutes ago
  •  ...The client is looking for a Senior QA Engineer to support application architecture, development, and innovation of new features for consumer solutions...  .... The candidate will collaborate with cross-functional teams, lead testing initiatives, implement scalable test solutions, and... 
    Senior
    Flexible hours

    Compunnel Inc.

    Winnipeg, MB
    51 minutes ago
  • Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your design and debugging skills...  ...realistic engineering problems from practical experience • Evaluate AI model outputs against professional benchmarks •... 

    DataAnnotation

    Winnipeg, MB
    48 minutes ago
  •  ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the...  ..., and the people who rely on them. Key Responsibilities: Lead the development and enhancement of evaluation and performance... 
    Senior
    Long term contract

    gov

    Winnipeg, MB
    5 days ago
  •  ...G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations,... 
    Senior
    Contract work
    Remote work
    Flexible hours

    G2i Inc.

    Winnipeg, MB
    56 minutes ago
  • Zafin is seeking a QA Engineer III to lead functional quality assurance for complex banking applications. You will apply hands-on manual testing, automation, and thorough test documentation to ensure release quality across backend processes, APIs, and data workflows. This role... 
    Senior

    Zafin

    Winnipeg, MB
    48 minutes ago
  • Our client is looking Senior QA Engineer for Long Term project in Toronto, ON / Ottawa, ON (Hybrid) Below is the detail requirement....  ...Optimization | Apache Kafka Event Validation | CI/CD Integration | AI-Assisted Testing KeyResponsibilities Translate complex... 
    Senior
    Long term contract
    Contract work

    Lorven Technologies Inc.

    Winnipeg, MB
    48 minutes ago
  • Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform...  ..., and drive automation using Java, Selenium/Playwright, and AI-assisted workflows. You will also deploy disposable environments... 
    Senior

    Upgrade

    Winnipeg, MB
    55 minutes ago
  • Lead automation and quality engineering for Veriforce’s SaaS platform in Calgary, using Playwright and AI-assisted testing within a hybrid workplace.This permanent QA Lead role provides technical leadership across Quality Engineering for platform and service integrations. You... 
    Senior
    Permanent employment

    Cognibox

    Winnipeg, MB
    58 minutes ago
  • ## AI Applied Senior Engineering LeadApplyremote type: Hybridlocations: Mississauga Ontario Canadatime type: Full timeposted on: Posted Todayjob requisition...  ...is seeking a highly hands-on AI Applied Senior Engineering Lead to design, build, and deploy cutting‐edge AI solutions for... 
    Senior

    Citigroup Inc.

    Winnipeg, MB
    48 minutes ago
  • Senior Quality Assurance Specialist (AI Testing / QA Lead) Location: Toronto, ON | Hybrid, 3 days per week onsite, 2 days remote Language: English, excellent written and verbal communication required Duration: 6-month contract, 35 hours per week About the... 
    Senior
    Contract work
    Remote work
    3 days per week
    Weekday work

    Altis Technology

    Winnipeg, MB
    52 minutes ago
  • Lead AI-powered quality strategy remotely across Canada for X360 AI Tech, shaping test automation, release readiness, and enterprise outcomes.As Senior Director, AI & QA, you will guide QA and AI engineering teams across X360 AI Galaxy. You will apply Playwright, Cypress, Selenium... 
    Senior
    Remote work

    X360 Technologies

    Winnipeg, MB
    53 minutes ago
  • $80k - $130k per year

    AI-Native Mobile QA EngineerSnaplii · Etobicoke (Toronto), ON · On-site · Full-time About SnapliiSnaplii is a profitable Toronto fintech...  ...from the person who built it, with a full handover, and a senior engineer on the team is your go-to while you settle in. After that,... 
    Senior
    Full time
    Internship
    Lmia
    Pnp
    Monday to friday

    Snaplii Inc.

    Winnipeg, MB
    49 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Ai Qa Engineer - Ai Evaluation Lead. Be the first to apply!