Ai / Ml Qa Engineer
Infotek Consulting Inc.
Contract Duration:
May 4, 2026 to November 4, 2026
OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning and generative AI systems. This role focuses on ensuring model quality, reliability, and responsible AI practices across a range of applications including NLP, classification, recommendation systems, and large language models.
Key ResponsibilitiesFunctional and Model Testing
Design and execute test cases for AI and ML models including NLP, classification, recommendation, and generative AI systems
Validate outputs for accuracy, consistency, and expected behavior across diverse datasets and inputs
Perform regression testing following model updates, retraining cycles, or data changes
Prompt and LLM Testing
Develop and maintain prompt test libraries for LLM based features
Evaluate responses for relevance, tone, factual accuracy, and alignment with business rules
Identify hallucinations, response drift, and edge case failures
AI Safety and Red Teaming
Conduct adversarial testing to uncover vulnerabilities such as prompt injection and jailbreak scenarios
Assess outputs for bias, fairness, and compliance with responsible AI standards
Document risks and collaborate with model teams on remediation strategies
Test Automation and Tooling
Build and maintain automated test suites using Python based frameworks
Track and report quality metrics, model performance benchmarks, and defect trends
Collaboration and Documentation
Work closely with data scientists, ML engineers, and product teams
Develop clear test plans, defect reports, and evaluation summaries
Contribute to QA standards and best practices for AI systems
Required Skills
Hands on experience testing AI and ML models including NLP, classification, and generative AI
Strong experience with LLM testing including prompt engineering and evaluation of hallucinations, bias, and response quality
Proficiency in Python and test automation frameworks
Experience working with CI CD pipelines
Solid understanding of regression testing
Nice to Have
Experience in banking or financial services
Exposure to AI safety and red teaming techniques such as prompt injection and jailbreak testing
Knowledge of responsible AI and model governance principles
Familiarity with LLM evaluation tools and frameworks
Experience testing recommendation or ranking systems
Exposure to ML pipelines and MLOps workflows
Understanding of bias and fairness metrics
Note: We use AI tools to: obtain basic information, detect plagiarism, false employment history or references, categorize your skills, and do an initial match with job posting.
#J-18808-Ljbffr
May 4, 2026 to November 4, 2026
OverviewWe are seeking an experienced AI / ML QA Engineer to support testing and validation of advanced machine learning and generative AI systems. This role focuses on ensuring model quality, reliability, and responsible AI practices across a range of applications including NLP, classification, recommendation systems, and large language models.
Key ResponsibilitiesFunctional and Model Testing
Design and execute test cases for AI and ML models including NLP, classification, recommendation, and generative AI systems
Validate outputs for accuracy, consistency, and expected behavior across diverse datasets and inputs
Perform regression testing following model updates, retraining cycles, or data changes
Prompt and LLM Testing
Develop and maintain prompt test libraries for LLM based features
Evaluate responses for relevance, tone, factual accuracy, and alignment with business rules
Identify hallucinations, response drift, and edge case failures
AI Safety and Red Teaming
Conduct adversarial testing to uncover vulnerabilities such as prompt injection and jailbreak scenarios
Assess outputs for bias, fairness, and compliance with responsible AI standards
Document risks and collaborate with model teams on remediation strategies
Test Automation and Tooling
Build and maintain automated test suites using Python based frameworks
Track and report quality metrics, model performance benchmarks, and defect trends
Collaboration and Documentation
Work closely with data scientists, ML engineers, and product teams
Develop clear test plans, defect reports, and evaluation summaries
Contribute to QA standards and best practices for AI systems
Required Skills
Hands on experience testing AI and ML models including NLP, classification, and generative AI
Strong experience with LLM testing including prompt engineering and evaluation of hallucinations, bias, and response quality
Proficiency in Python and test automation frameworks
Experience working with CI CD pipelines
Solid understanding of regression testing
Nice to Have
Experience in banking or financial services
Exposure to AI safety and red teaming techniques such as prompt injection and jailbreak testing
Knowledge of responsible AI and model governance principles
Familiarity with LLM evaluation tools and frameworks
Experience testing recommendation or ranking systems
Exposure to ML pipelines and MLOps workflows
Understanding of bias and fairness metrics
Note: We use AI tools to: obtain basic information, detect plagiarism, false employment history or references, categorize your skills, and do an initial match with job posting.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Ai / Ml Qa Engineer in Winnipeg, MB vacancy
- ...software company in Toronto is seeking a Quality Assurance Automation Engineer to ensure the delivery of high-quality SaaS products. As part of... ...and Developers. The role requires over 3 years of experience in QA automation, problem-solving skills, and proficiency in testing...SuggestedFull time
- Responsibilities Design, develop, and deploy end-to-end AI/ML solutions, including data ingestion, feature engineering, model training, deployment, monitoring, and lifecycle management. Build scalable, cloud-native AI/ML applications and services using AWS technologies such...SuggestedLong term contract
- ...Valsoft Corporation and Aspire Software We are hiring for an AI-ML Engineer to join our growing team at Ampliphi in Toronto!As an AI... ...our pricing ecosystemDesign, build, and enhance the AI and rules engine that powers pricing recommendations, explainability, and automated...SuggestedWork at office
- ...Canada and the United States. We offer SaaS / API expertise, Data & AI Solutions, as well as Infrastructure / DevOps across leading public... ...unstructured data processing Experience with data pipelines and ML workflows Hands-on experience with AI/ML model development,...Suggested
- Lead the design, development, and deployment of AI and ML models and systems, focusing on scalability, reliability, and performance.... ...with cross‑functional teams, including data scientists, software engineers, and product managers, to deliver end‑to‑end AI/ML solutions....SuggestedInternship
- We are looking for an AI / ML Engineer who will design, build, and deploy AI-driven solutions for real-world business use cases. The role focuses on applying existing AI models and tools, integrating them into applications, and delivering scalable AI solutions for enterprise...Flexible hours
- AI/ML EngineerThe RoleWe are running an engagement to design and build an AI agent system that manages a complex, high-value transaction... ...through close-out, across a multi-stage process. As an AI/ML Engineer, you will build agent capabilities in parallel during the build phases...Contract workInternship
- ...centers that create friction for customers and drag for teams. Even as AI has advanced, most insurance work is still manual, slow and... ...agent systems with tool use, state and solid failure handling Engineer prompts and context deliberately, with guardrails and hallucination...
- Position SummaryThe AI/ML Engineer will design, develop, integrate and deploy AI and machine learning solutions that improve business processes, operational efficiency and decision-making across the enterprise. The role focuses on generative AI, large language models (LLMs...
$110k - $150k per year
..., we value expertise, curiosity, and continuous improvement - and we give you the space to grow.About the Role We are seeking ML/AI Engineers to contribute to major projects.Why Join Levio? Work on complex, high impact digital transformation projectsCollaborate with experienced...Full time- The AIOps Engineer is responsible for architecting, provisioning, and operationalizing multi-environment AI platforms on Google Cloud (Sandbox, Dev, Prod). The role includes cloud environment... ...for AI platform users (Owner, Support, ML Engineer, Viewer). Create IAM matrices,...Long term contract
- Join the dynamic and collaborative team at Katalyst Data Management (KDM)! KDM is seeking an AI/ML Engineer to support the operation, optimization, and reliability of the infrastructure powering our AI innovation platform. This hands‑on role will help maintain GPU environments...Full timeCasual workManual laborWork at officeLocal areaWorldwideMonday to friday
- Deploy AI/ML infrastructure on Kubernetes using GitOps, Helm, and secure secrets management across Dev, QA, and Prod environments.This Platform Engineer role focuses on reliable, scalable, and secure deployments for AI/ML applications. You will manage Kubernetes platforms,...
$200.08k - $262.61k per year
...environment for our people.About This Team The Enterprise Data & AI team is a strategic and operational driver of growthfor lululemon... ...enterprise efficiency.Core responsibilities As a Staff AI/ML Engineer, you will define the Technology AI/ML engineeringapproach and solve...Long term contractPermanent employmentPart time$141.5k - $283.5k per year
...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Principal AI/ML Engineer based in British Columbia, Canada. The Principal AI/ML Engineer will provide senior technical leadership in the design and...Remote workWork from home- About the Role We’re seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure and applications on Kubernetes. You’ll be responsible for... ...manage AI/ML applications and related platforms across Dev/QA/Prod environments. Implement GitOps workflows using Flux...
- # Senior AI/ML EngineerLimbic173k-192k CADFull-timeremote· seniorCanadallmpythontypescriptjavascriptsqlListed via Jobicy · posted 22 Oct... ...there, not on DevConnect.Apply on Jobicy## DescriptionSenior AI/ML Engineer, remote in Canada: own the AI that assesses patients for US...Remote work
- ...customers around the world, Blackpoint Cyber is in hyper‑growth mode, fueled by a recent 190m series C round.ROLE SUMMARY As AI/ML Ops Engineer, you will own the operational backbone of Blackpoint's AI/ML capability — taking models from training through production deployment...Local area
- ...family-founded company on a mission to create the world’s first AI-powered Personal & Entrepreneurial Resource Planner (PRP), and we... ...resource management—and change lives along the way.The Role As an AI/ML Engineer, you will play a crucial role in designing, developing, and...Long term contractWork at officeRemote workWorldwideRelocation
- ...PST hours). We are seeking a Senior Software Engineer, Localization Engineering to architect and... .... This role combines deep expertise in AI-driven translation technologies with strong... ...translation handoff, validation, and linguistic QA.Optimize model performance, inference...
- ...degreeRequired Qualifications 6+ years of software engineering experience, with significant backend or AI/ML focusStrong proficiency in Python and experience with... ...localization workflows (extraction, translation, review, QA, release)Experience with translation management...
- As a Principal AI Engineer, you will serve as a senior technical leader responsible for transforming state-of-the-art AI research into scalable... ...and lead the technical architecture for enterprise-scale AI and ML platforms. Design scalable, resilient, and reusable AI systems...Long term contract
- Join Cresta as a Machine Learning Engineer to innovate in AI-driven call center solutions. Work remotely with a world-class team to advance ML technologies and improve operational efficiency. Cresta, a rapidly growing startup founded by industry leaders, seeks talented engineers...Remote work
- ...embrace transformation and leverage advanced technologies, including AI, to stay competitive. We deliver innovative solutions that meet... ...’s rapidly changing digital economy. Why you:As a Lead AI / ML Engineer, you will define the technical vision, strategy, and overall architecture...Work at officeImmediate startRemote workWork from home
- ...Docker), orchestration (Kubernetes, etc.) Familiarity with GPU / AI compute clusters, high-performance data storage, and distributed... ..., Grafana, ELK / EFK, Datadog, etc.) Networking & systems engineering knowledge (TCP/IP, DNS, routing, load balancing, distributed storage...Full time
- Job DescriptionWe are seeking an experienced Senior QA Engineer (AI Native) to join Semios' Engineering team. This position will take ownership of quality throughout the software development lifecycle, from initial requirements and design through testing, deployment, and production...Long term contractContract workInternshipImmediate startRemote work
$208.58k - $273.77k per year
...environment for our people.About This Team The Enterprise Data & AI organization is a strategic and operational driver of growth for... ...enterprise efficiency.Core responsibilities As a Principal AI/ML Engineer, you will define and drive implementation approaches for...Long term contractPermanent employment- Architect AI/ML infrastructure remotely across Canada with Revvity Signals, applying Kubernetes and cloud expertise to support scientific... ...innovation. Work EST hours from Ontario.As Principal DevOps Engineer, you will lead scalable, secure, and resilient infrastructure for...Remote work
- Testlify is on the lookout for a skilled AI & ML Solutions Engineer to design, build, and deploy cutting-edge AI applications for business needs. This role emphasizes integrating advanced AI models into practical solutions. You will focus on creating scalable AI-driven solutions...
- Make an impact with Omnissa as a Staff Software Engineer based in Vancouver. This full-time hybrid role targets enterprise software architecture and AI/ML implementation for virtual desktop services. Bring your 5–18 years of engineering expertise to the Horizon Remote Experience...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai / Ml Qa Engineer. Be the first to apply!
Related searches
- machine learning engineer Winnipeg, MB
- junior machine learning developer Winnipeg, MB
- software quality assurance engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- senior quality assurance engineer Winnipeg, MB
- machine learning part time Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB
- machine learning researcher Winnipeg, MB
- machine learning Winnipeg, MB

