Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai / Ml Qa Engineer

Infotek Consulting Inc.

Contract Duration:
May 4, 2026 to November 4, 2026
OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning and generative AI systems. This role focuses on ensuring model quality, reliability, and responsible AI practices across a range of applications including NLP, classification, recommendation systems, and large language models.
Key ResponsibilitiesFunctional and Model Testing
Design and execute test cases for AI and ML models including NLP, classification, recommendation, and generative AI systems
Validate outputs for accuracy, consistency, and expected behavior across diverse datasets and inputs
Perform regression testing following model updates, retraining cycles, or data changes
Prompt and LLM Testing
Develop and maintain prompt test libraries for LLM based features
Evaluate responses for relevance, tone, factual accuracy, and alignment with business rules
Identify hallucinations, response drift, and edge case failures
AI Safety and Red Teaming
Conduct adversarial testing to uncover vulnerabilities such as prompt injection and jailbreak scenarios
Assess outputs for bias, fairness, and compliance with responsible AI standards
Document risks and collaborate with model teams on remediation strategies
Test Automation and Tooling
Build and maintain automated test suites using Python based frameworks
Track and report quality metrics, model performance benchmarks, and defect trends
Collaboration and Documentation
Work closely with data scientists, ML engineers, and product teams
Develop clear test plans, defect reports, and evaluation summaries
Contribute to QA standards and best practices for AI systems
Required Skills
Hands on experience testing AI and ML models including NLP, classification, and generative AI
Strong experience with LLM testing including prompt engineering and evaluation of hallucinations, bias, and response quality
Proficiency in Python and test automation frameworks
Experience working with CI CD pipelines
Solid understanding of regression testing
Nice to Have
Experience in banking or financial services
Exposure to AI safety and red teaming techniques such as prompt injection and jailbreak testing
Knowledge of responsible AI and model governance principles
Familiarity with LLM evaluation tools and frameworks
Experience testing recommendation or ranking systems
Exposure to ML pipelines and MLOps workflows
Understanding of bias and fairness metrics
Note: We use AI tools to: obtain basic information, detect plagiarism, false employment history or references, categorize your skills, and do an initial match with job posting.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Ai / Ml Qa Engineer in Winnipeg, MB vacancy
  • Position Summary The AI/ML Engineer will design, develop, integrate and deploy AI and machine learning solutions that improve business processes, operational efficiency and decision-making across the enterprise.Position Summary The AI/ML Engineer will design, develop,... 
    Suggested

    Java Holdings Ltd

    Winnipeg, MB
    2 hours ago
  •  ...Canada and the United States. We offer SaaS / API expertise, Data & AI Solutions, as well as Infrastructure / DevOps across leading public...  ...unstructured data processing Experience with data pipelines and ML workflows Hands-on experience with AI/ML model development,... 
    Suggested

    Lucrodyne

    Winnipeg, MB
    2 hours ago
  • $127.14k - $166.87k per year

     ...environment for our people. About this team The Enterprise Data & AI team is a strategic and operational driver of growth for...  ...drives enterprise efficiency. Core responsibilities As an AI/ML Engineer, you will contribute to the design and implementation of AI/ML systems... 
    Suggested
    Permanent employment
    Full time
    Part time
    Local area
    Immediate start

    lululemon

    Winnipeg, MB
    2 hours ago
  • AI/ML EngineerThe RoleWe are running an engagement to design and build an AI agent system that manages a complex, high-value transaction...  ...through close-out, across a multi-stage process. As an AI/ML Engineer, you will build agent capabilities in parallel during the build phases... 
    Suggested
    Contract work
    Internship

    Future Works

    Winnipeg, MB
    2 hours ago
  •  ...centers that create friction for customers and drag for teams. Even as AI has advanced, most insurance work is still manual, slow and...  ...agent systems with tool use, state and solid failure handling Engineer prompts and context deliberately, with guardrails and hallucination... 
    Suggested

    General Magic

    Winnipeg, MB
    2 hours ago
  • We are looking for an AI / ML Engineer who will design, build, and deploy AI-driven solutions for real-world business use cases. The role focuses on applying existing AI models and tools, integrating them into applications, and delivering scalable AI solutions for enterprise... 
    Flexible hours

    Testlify, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...PST hours). We are seeking a Senior Software Engineer, Localization Engineering to architect and...  .... This role combines deep expertise in AI-driven translation technologies with strong...  ...translation handoff, validation, and linguistic QA.Optimize model performance, inference... 

    Applicantz

    Winnipeg, MB
    2 hours ago
  • $141.5k - $283.5k per year

     ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Principal AI/ML Engineer based in British Columbia, Canada. The Principal AI/ML Engineer will provide senior technical leadership in the design and... 
    Remote work
    Work from home

    AItoolnavio

    Winnipeg, MB
    2 hours ago
  • About the Role We’re seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure and applications on Kubernetes. You’ll be responsible for...  ...manage AI/ML applications and related platforms across Dev/QA/Prod environments. Implement GitOps workflows using Flux... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    2 hours ago
  • Deploy AI/ML infrastructure on Kubernetes using GitOps, Helm, and secure secrets management across Dev, QA, and Prod environments.This Platform Engineer role focuses on reliable, scalable, and secure deployments for AI/ML applications. You will manage Kubernetes platforms,... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    2 hours ago
  • $200.08k - $262.61k per year

     ...environment for our people.About This Team The Enterprise Data & AI team is a strategic and operational driver of growthfor lululemon...  ...enterprise efficiency.Core responsibilities As a Staff AI/ML Engineer, you will define the Technology AI/ML engineeringapproach and solve... 
    Long term contract
    Permanent employment
    Part time

    Lululemon Athletica Inc.

    Winnipeg, MB
    2 hours ago
  • $173k - $192k per year

    Senior AI/ML Engineer, remote in Canada: own the AI that assesses patients for US healthcare providers and gets them to the right mental health care faster. About LimbicLimbic's vision is to ensure the highest quality therapy is accessible to everyone, everywhere. Limbic... 
    Remote work

    Software Directory

    Winnipeg, MB
    2 hours ago
  •  ...embrace transformation and leverage advanced technologies, including AI, to stay competitive. We deliver innovative solutions that meet...  ...’s rapidly changing digital economy. Why you:As a Lead AI / ML Engineer, you will define the technical vision, strategy, and overall architecture... 
    Work at office
    Immediate start
    Remote work
    Work from home

    Pythian

    Winnipeg, MB
    2 hours ago
  • Lead AI-augmented quality engineering at COSMO, combining automated testing and DevSecOps across connected products...  ...and digital services. Guide global QA efforts for family-focused technology.As...  ...hardware, mobile, cloud, and AI/ML solutionsAPI testing experience with REST... 

    COSMO Technologies

    Winnipeg, MB
    2 hours ago
  • $208.58k - $273.77k per year

     ...environment for our people.About This Team The Enterprise Data & AI organization is a strategic and operational driver of growth for...  ...enterprise efficiency.Core responsibilities As a Principal AI/ML Engineer, you will define and drive implementation approaches for... 
    Long term contract
    Permanent employment

    Lululemon Athletica Inc.

    Winnipeg, MB
    2 hours ago
  •  ...family-founded company on a mission to create the world’s first AI-powered Personal & Entrepreneurial Resource Planner (PRP), and we...  ...resource management—and change lives along the way.The Role As an AI/ML Engineer, you will play a crucial role in designing, developing, and... 
    Long term contract
    Work at office
    Remote work
    Worldwide
    Relocation

    Air Apps

    Winnipeg, MB
    2 hours ago
  • Job DescriptionWe are seeking an experienced Senior QA Engineer (AI Native) to join Semios' Engineering team. This position will take ownership of quality throughout the software development lifecycle, from initial requirements and design through testing, deployment, and production... 
    Long term contract
    Contract work
    Internship
    Immediate start
    Remote work

    Affinity

    Winnipeg, MB
    2 hours ago
  • $120k - $145k per year

     ...ambition and fuel your career growth.Reporting to the Director of Engineering & Predictive Analytics, the Senior Software Engineer will...  ...operate cutting-edge predictive analytics products that leverage AI and ML.This position is part of the Engineering Team in Vancouver, Canada... 
    Work at office
    Remote work
    Shift work

    Hach

    Winnipeg, MB
    2 hours ago
  • Drive AI innovation as a Senior AI/ML Engineer with a prominent enterprise client in downtown Toronto. Lead the development of transformative LLM solutions and build a top-tier engineering team. Your role will involve spearheading the design, development, and scaling of LLM... 

    Encore Technical Solutions Inc.

    Winnipeg, MB
    2 hours ago
  • $99.1k - $132.1k per year

     ...from you.About the Role At McKesson, we are advancing healthcare through trusted, scalable, and responsible AI solutions. We are seeking a Sr. AI/ML Engineer, RAIB to lead the development, evaluation, governance, and operationalization of machine learning and Generative... 
    Long term contract

    Mckesson Corporation

    Winnipeg, MB
    2 hours ago
  • Astra-North Infoteck Inc. seeks a Platform Engineer to deploy and manage AI/ML infrastructure on Kubernetes. You will build reliable, scalable deployment...  ...and manage LlamaIndex Cloud and KDB.AI workloads across Dev/QA/Prod environments. Responsibilities include implementing Flux... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    2 hours ago
  • $101k - $135k per year

     ...country’s largest enterprises and public sector organizations. Its AI team helps clients take machine learning and generative AI from...  ...to secure, scalable production. They are hiring a Manager, ML/AI Engineer to work directly with clients, architect AI solutions end to end... 
    Full time

    Toast

    Winnipeg, MB
    2 hours ago
  • $123.3k - $159.5k per year

    TThumbtackvia Jobicy# Software Engineer, AI/ML InfrastructureRemoteCanadaFull-timePosted2mo agoOpen to applicationsApply on jobicy.com ← Back to roles$job --description## About the roleThumbtack helps millions of people confidently care for their homes.Thumbtack is the one... 
    Seasonal work
    Local area

    DevOpsChat

    Winnipeg, MB
    2 hours ago
  • Develop AI/ML applications for Alberta’s power grid with AESO, using advanced analytics and Python to improve data-driven decisions.As a Senior Engineer or Senior Analyst, you will advance analytics methodologies, tools, and applications within Grid Analytics. The work includes... 

    Avenue.io Inc.

    Winnipeg, MB
    2 hours ago
  • $122.3k - $170.7k per year

     ...everyone makes play happen. DescriptionIn FC Quality Verification Engineering, our mission is to help our teams identify quality issues...  ...and developer tools that combine software development and applied AI/ML to improve how we test EA-SPORTS FC. Role SummaryYou will work... 
    Full time
    Work at office
    Local area
    3 days per week

    Electronic Arts

    Winnipeg, MB
    2 hours ago
  • $150k - $238k per year

     ...market in real-time analytics, data warehousing, observability, and AI workloads. The company’s sustained, accelerating momentum was...  ...use data. Come be a part of our journey! About The TeamThe AI/ML Engineering team builds and operates ClickHouse's AI and machine learning... 
    Local area
    Remote work
    Home office
    Flexible hours

    ClickHouse

    Winnipeg, MB
    2 hours ago
  • Concevez des solutions d’IA et de génie logiciel pour Retraite Canada chez Manulife, en mode hybride à Montréal. Mettez en pratique Java, C# ou Python.Comme ingénieur(e) logiciel senior, vous développerez des applications et services soutenant les produits, opérations et expériences...

    Manulife

    Winnipeg, MB
    2 hours ago
  • Lead AI/ML systems for digital forensics, spanning model training and deployment, in a full-time Canada and USA position.As a Principal AI/ML Engineer, you will build and operate systems powering digital forensics capabilities. Your work covers model training, evaluation, retrieval... 
    Full time

    Svitla

    Winnipeg, MB
    2 hours ago
  • Lead cloud-native engineering with Python, Java, Golang, or JavaScript expertise in a primarily remote position based in British Columbia, Canada.As Principal AI/ML Engineer, you will provide senior technical leadership for sophisticated products, platforms, and software systems... 
    Remote work

    AItoolnavio

    Winnipeg, MB
    2 hours ago
  • Join Mecka AI as an Embedded ML Engineer focused on integrating advanced computer vision into robotics. Enhance models and optimize performance while working with cutting-edge AI technologies in a collaborative environment. In this role, you will be pivotal in deploying... 

    Mecka AI

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai / Ml Qa Engineer. Be the first to apply!