Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Agentic Qa Engineer

TribalScale

TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.
Our Digital Expertise
Transformation Experts:
We transform traditional business models into agile, AI-powered ecosystems.
Strategic Visionaries:
We navigate the uncharted waters of technological evolution.
Product Virtuosos:
We orchestrate the creation of world-class digital solutions.
Code Optimizers:
We leverage AI to refine and perfect digital systems.
Our Technological Toolkit
Voice-Activated Platforms:
(Amazon Alexa, Google Home)
Connected Ecosystems:
(Cars and Homes)
The TribalScale ProfessionalYou thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job;
you seek a calling—a chance to make a lasting impact on the digital landscape.
Agentic QA EngineerJob title: Agentic QA EngineerCompany: TribalScaleLocation: [To be confirmed]Employment type: [To be confirmed]
About TribalScaleTribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.
About the RoleTribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.
This role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.
The ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.
Key Responsibilities
Design and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.
Build automated test frameworks for functional, integration, regression, and end-to-end testing.
Develop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.
Test agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.
Identify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.
Establish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.
Integrate automated testing and quality checks into CI/CD pipelines.
Collaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.
Investigate production issues and use findings to improve agent behavior, test coverage, and application performance.
Evaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.
Required Qualifications
Professional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.
Experience building automated tests and testing frameworks.
Strong understanding of API, integration, regression, and end-to-end testing.
Experience debugging applications and investigating complex technical issues.
Familiarity with Git, CI/CD pipelines, and modern software development practices.
Strong analytical thinking and the ability to design test cases for complex, real-world scenarios.
Preferred Qualifications
Experience testing LLM-based applications, AI agents, or generative AI products.
Familiarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar technologies.
Experience with LLM evaluation, prompt testing, model benchmarking, or AI observability.
Familiarity with tools such as Pytest, Playwright, Cypress, or Selenium.
Understanding of hallucinations, nondeterministic outputs, prompt injection, and agent tool-use failures.
Experience with cloud platforms, APIs, distributed systems, and production deployments.
Previous experience in Agentic Engineering, Forward Deployed Engineering, Applied AI Engineering, or AI product development.
Ideal CandidateThe ideal candidate combines the engineering mindset of an FDE or Agentic Engineer with the quality-focused approach of an experienced QA Automation Engineer or SDET.
Candidates with strong programming and automation skills who have tested AI-powered applications are especially relevant. We are also open to Agentic Engineers or FDEs who have meaningful experience building testing frameworks, validating complex workflows, and improving software reliability.
Core focus: AI agent reliability, software testing, test automation, and production-ready AI systems.Why Choose TribalScaleAt TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients;
we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.
We empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated—it's fundamental to our strength. Our mission to "Right the Future" is a call to action to make a significant impact in the world of innovation.
Diversity: Our Collective StrengthTribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.
We not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.
Should you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Agentic Qa Engineer in Winnipeg, MB vacancy
  •  ...collaboration, respectful challenge, and ability to strongly support QA decisions Continually monitor the effectiveness of the DI/CSV...  .... Education, Experience & Skills Requirements BS Engineering/Chemistry/Microbiology or related field. Minimum 5-7 years related... 
    Suggested
    For contractors
    Local area
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    5 days ago
  • We are looking for an Automation Engineer - a developer-first, agentic thinker who will build the intelligent systems that keep Sophis, strategic front-to-back trading platform, running at the highest quality bar. You will operate as an AI agent coordinator, software developer... 
    Suggested
    Internship

    Compunnel Inc.

    Winnipeg, MB
    1 hour ago
  •  .... Our capabilities span generative and agentic AI, cloud migration and modernization, cloud...  ...standard verification Partner with engineers during development to shift testing left:...  ...assets (automated suites, test data sets, QA checklists) back to the CXE practice Mentor... 
    Suggested
    Contract work
    Work at office
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Caylent

    Winnipeg, MB
    1 hour ago
  •  ...day inspired to build a more efficient and enjoyable world. Role overviewAgentic engineering changes how software is built and how organizations operate. We're designing and building agentic engineering systems that can reason, use tools, interact with enterprise... 
    Suggested
    Flexible hours

    Osedea

    Winnipeg, MB
    1 hour ago
  •  ...and automation to deliver innovative solutions in a fast-paced environment.About This Opportunity: We’re seeking an experienced QA Engineer to join a dynamic team focused on test automation and AI-driven quality assurance. You’ll collaborate with product managers and development... 
    Suggested

    Akkodis

    Winnipeg, MB
    1 hour ago
  •  ...secretarial, governance, tax, and compliance. About The RoleWe are seeking a detail-oriented and technically skilled Quality Assurance (QA) Engineer to join our growing team. Reporting into the Director of Development, you will play a vital role in ensuring our software products... 
    Long term contract
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Athennian

    Winnipeg, MB
    1 hour ago
  •  ...efficient than ever before.Continuous protection. AI-powered Nonstop SecOps. That’s Ontinue.Role Overview We’re looking for a QA Automation Engineer to help us scale quality across a fast-moving engineering team. This role is about building the automation, processes, and... 

    Ontinue

    Winnipeg, MB
    1 hour ago
  •  ...from top-tier VCs, and are live with customers like Scale AI, Rippling, and Zendesk. Think of Maxima to accountants as Claude Code to engineers.Responsibilities Increasing end-to-end test coverage (Playwright + use AI to generate tests)Maintaining existing testsManual... 

    Maxima

    Winnipeg, MB
    1 hour ago
  • $80k - $100k per year

     ...Ventures, Intel Capital, and Y Combinator. What You'll Do Own the QA strategy across manual, automated, regression, and integration...  ...and maintain test frameworks that scale with our product and engineering growth. Triage and validate issues in collaboration with... 
    Work at office

    Suger, Inc.

    Winnipeg, MB
    1 hour ago
  • $175k - $200k per year

     ...RoleBig Viking Games is hiring a Principal Engineer, Agentic Products & Workflows to build the systems...  ..., product, design, art, live operations, QA, and leadership to find the highest-...  ..., queues, event-driven systems, workflow engines, or durable execution. Experience building... 
    Internship

    Big Viking Games

    Winnipeg, MB
    1 hour ago
  •  ...professionals where our culture is informed by our values and commitment to protecting and saving lives. Job Summary   The Specialist I, QA Operations supports the Winnipeg site by providing quality oversight for lot release, operational compliance, product distribution,... 
    Contract work
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    6 days ago
  • $175.6k - $283.1k per year

    Camunda is the enterprise platform for agentic orchestration, enabling organizations to coordinate AI agents, people, and systems across...  ...reading. About The RoleCamunda is hiring a Senior Manager, QA Engineering to lead the end-to-end QA strategy for Camunda 8 - elevating... 
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide
    Home office
    Flexible hours

    Camunda

    Winnipeg, MB
    1 hour ago
  • $98k - $138k per year

     ...teams deliver innovative technology solutions to help build a stronger financial future for the healthcare community. As a Lead Agentic AI Engineer, you will work directly with engineers, architects, security, governance, and business partners to find high - value... 
    Permanent employment
    Immediate start

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Engineer (Agentic Systems) based in Canada. Join a high-performing team of engineers and data scientists working at the forefront of artificial... 

    Jobgether

    Winnipeg, MB
    1 hour ago
  •  ...100 countries, with teams across North America, Europe, and Asia Pacific. The RoleLightspeed is seeking a Senior Director, Agentic Engineering to build and lead the platform, capabilities, and operating model that enable Product & Technology teams to work effectively... 
    Long term contract
    Temporary work
    Remote work
    Flexible hours

    FractionalFinders

    Winnipeg, MB
    1 hour ago
  •  ...intersection of consulting, data science, AI technologies, data engineering, and digital transformation. We do not just advise — we build,...  ...AI adoption. The RoleArtefact is looking for a Senior AI & Agentic Engineer: a full-stack engineer who takes AI features from idea... 

    Artefact

    Winnipeg, MB
    1 hour ago
  • Lead Agentic AI and Machine Learning engineering at Loblaw Companies Limited, guiding teams that build scalable retail technology. Apply Python and LLM expertise.As Engineering Manager, you will manage AI/ML engineers and shape production-grade systems for retail media, advertising... 

    Loblaw Digital

    Winnipeg, MB
    1 hour ago
  • We are seeking a Senior Agentic AI Engineer to design, develop, and deploy production-grade AI applications using Large Language Models (LLMs), Agentic AI frameworks, Retrieval-Augmented Generation (RAG), and Google Cloud Platform (GCP). The ideal candidate will have strong... 

    enableIT

    Winnipeg, MB
    1 hour ago
  • Build GenAI applications with Python, LLMs, and agentic frameworks at Infosys in Mississauga, Ontario. Design production-ready AI solutions through hands-on engineering.Infosys seeks a hands-on GenAI and Agentic AI Engineer for next-generation AI solutions. You will work with... 

    Infosys Limited

    Winnipeg, MB
    1 hour ago
  • Build agentic AI systems with Python or TypeScript at CareLink by Asepha in Toronto, working in a hybrid engineering environment.As a Senior Software Engineer, you will shape engineering efforts through architectural decisions and full-stack contributions. The work spans backend... 

    Asepha

    Winnipeg, MB
    1 hour ago
  •  ...Python automation, and multi-agent workflow testing. This newly created position focuses on production reliability.As an Agentic AI Evaluation & Tuning Engineer, you will connect LLM capabilities with dependable autonomous execution. You will curate Golden Sets, automate... 

    Equifax Inc.

    Winnipeg, MB
    1 hour ago
  • Company Description You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google. We are a...  ...production‑grade AI/ML systems. Experience architecting complex agentic systems, including orchestration, tool use, memory, and state management... 

    Ample Insight

    Winnipeg, MB
    1 hour ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Agentic AI Engineer based remotely in Canada. We are seeking an experienced Senior Agentic AI Engineer to lead the development of autonomous AI... 
    Full time
    Manual labor
    Remote work

    Jobgether

    Winnipeg, MB
    1 hour ago
  • $200k - $250k per year

    Join Snaplii as a founding member of a small, agile engineering team that is building the way AI agents pay. Location: Etobicoke (Toronto), onsite with hybrid 3 days max · Compensation: CAD $200k–250k + 20% performance bonus + equity About SnapliiSnaplii is a... 

    Snaplii

    Winnipeg, MB
    1 hour ago
  • $100k - $150k per year

    Position Title: AI Engineer (Agentic Workflows) Department: Research & Development Company: Protocase Inc. Location: Waterloo, Ontario, Canada Work Arrangement: In-Office Employment Type: Full-Time Shift: Dayshift Level: Mid–Senior (Expected Experience:... 
    Full time
    Seasonal work
    Work at office
    Worldwide
    Shift work
    Day shift

    Protocase Inc.

    Winnipeg, MB
    1 hour ago
  • Shape enterprise Agentic AI applications by deploying North securely across private cloud and on-premises infrastructure. Support customers...  ...through complex technical integrations.This Forward Deployed Engineer role connects North’s core product with client engineering teams... 

    Cohere

    Winnipeg, MB
    1 hour ago
  •  ...technology relationships as a Researcher at Huawei Canada, focusing on agentic interactions. Participate in groundbreaking research that...  ...for AI systems • Understanding of algorithms and prompt engineering • Ability to rapidly adapt to evolving AI tech • Enthusiasm for... 
    Contract work
    Work at office

    Huawei Canada

    Winnipeg, MB
    1 hour ago
  •  ...TribalScale is looking for a Forward Deployed Engineer to work at the intersection of software...  ...of automated delivery cycles Drive agentic engineering practices across our clients,...  ...Experience with agent frameworks, workflow engines, coding agents, or custom model‑... 
    Immediate start

    TribalScale

    Winnipeg, MB
    1 hour ago
  • Build agentic workflows and personalized AI features as an AI Engineer supporting Superhuman Mail from a remote-flexible Canada arrangement. Apply Python or TypeScript to production AI.This AI Engineer role focuses on backend infrastructure and applied AI for advanced email... 
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    1 hour ago
  • Job Title: Sr. QA Automation Engineer Location: Canada (Remote) Employment Type: Contract Job SummaryWe are looking for a skilled QA Automation Engineer to design, develop, and maintain automated test frameworks and scripts to ensure high-quality software... 
    Contract work
    Remote work

    RELQ TECHNOLOGIES

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Agentic Qa Engineer. Be the first to apply!