Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Agentic Qa Engineer

TribalScale

TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.
Our Digital Expertise
Transformation Experts:
We transform traditional business models into agile, AI-powered ecosystems.
Strategic Visionaries:
We navigate the uncharted waters of technological evolution.
Product Virtuosos:
We orchestrate the creation of world-class digital solutions.
Code Optimizers:
We leverage AI to refine and perfect digital systems.
Our Technological Toolkit
Voice-Activated Platforms:
(Amazon Alexa, Google Home)
Connected Ecosystems:
(Cars and Homes)
The TribalScale ProfessionalYou thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job;
you seek a calling—a chance to make a lasting impact on the digital landscape.
Agentic QA EngineerJob title: Agentic QA EngineerCompany: TribalScaleLocation: [To be confirmed]Employment type: [To be confirmed]
About TribalScaleTribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.
About the RoleTribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.
This role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.
The ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.
Key Responsibilities
Design and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.
Build automated test frameworks for functional, integration, regression, and end-to-end testing.
Develop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.
Test agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.
Identify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.
Establish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.
Integrate automated testing and quality checks into CI/CD pipelines.
Collaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.
Investigate production issues and use findings to improve agent behavior, test coverage, and application performance.
Evaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.
Required Qualifications
Professional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.
Experience building automated tests and testing frameworks.
Strong understanding of API, integration, regression, and end-to-end testing.
Experience debugging applications and investigating complex technical issues.
Familiarity with Git, CI/CD pipelines, and modern software development practices.
Strong analytical thinking and the ability to design test cases for complex, real-world scenarios.
Preferred Qualifications
Experience testing LLM-based applications, AI agents, or generative AI products.
Familiarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar technologies.
Experience with LLM evaluation, prompt testing, model benchmarking, or AI observability.
Familiarity with tools such as Pytest, Playwright, Cypress, or Selenium.
Understanding of hallucinations, nondeterministic outputs, prompt injection, and agent tool-use failures.
Experience with cloud platforms, APIs, distributed systems, and production deployments.
Previous experience in Agentic Engineering, Forward Deployed Engineering, Applied AI Engineering, or AI product development.
Ideal CandidateThe ideal candidate combines the engineering mindset of an FDE or Agentic Engineer with the quality-focused approach of an experienced QA Automation Engineer or SDET.
Candidates with strong programming and automation skills who have tested AI-powered applications are especially relevant. We are also open to Agentic Engineers or FDEs who have meaningful experience building testing frameworks, validating complex workflows, and improving software reliability.
Core focus: AI agent reliability, software testing, test automation, and production-ready AI systems.Why Choose TribalScaleAt TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients;
we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.
We empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated—it's fundamental to our strength. Our mission to "Right the Future" is a call to action to make a significant impact in the world of innovation.
Diversity: Our Collective StrengthTribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.
We not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.
Should you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Agentic Qa Engineer in Winnipeg, MB vacancy
  •  .... Our capabilities span generative and agentic AI, cloud migration and modernization, cloud...  ...standard verification Partner with engineers during development to shift testing left:...  ...assets (automated suites, test data sets, QA checklists) back to the CXE practice Mentor... 
    Suggested
    Contract work
    Work at office
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Caylent

    Winnipeg, MB
    2 hours ago
  • We are looking for an Automation Engineer - a developer-first, agentic thinker who will build the intelligent systems that keep Sophis, strategic front-to-back trading platform, running at the highest quality bar. You will operate as an AI agent coordinator, software developer... 
    Suggested
    Internship

    Compunnel Inc.

    Winnipeg, MB
    2 hours ago
  •  ...collaboration, respectful challenge, and ability to strongly support QA decisions Continually monitor the effectiveness of the DI/CSV...  .... Education, Experience & Skills Requirements BS Engineering/Chemistry/Microbiology or related field. Minimum 5-7 years related... 
    Suggested
    For contractors
    Local area
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    8 days ago
  •  ...day inspired to build a more efficient and enjoyable world. Role overviewAgentic engineering changes how software is built and how organizations operate. We're designing and building agentic engineering systems that can reason, use tools, interact with enterprise... 
    Suggested
    Flexible hours

    Osedea

    Winnipeg, MB
    2 hours ago
  •  ...and automation to deliver innovative solutions in a fast-paced environment.About This Opportunity: We’re seeking an experienced QA Engineer to join a dynamic team focused on test automation and AI-driven quality assurance. You’ll collaborate with product managers and development... 
    Suggested

    Akkodis

    Winnipeg, MB
    2 hours ago
  •  ...efficient than ever before.Continuous protection. AI-powered Nonstop SecOps. That’s Ontinue.Role Overview We’re looking for a QA Automation Engineer to help us scale quality across a fast-moving engineering team. This role is about building the automation, processes, and... 

    Ontinue

    Winnipeg, MB
    2 hours ago
  •  ...secretarial, governance, tax, and compliance. About The RoleWe are seeking a detail-oriented and technically skilled Quality Assurance (QA) Engineer to join our growing team. Reporting into the Director of Development, you will play a vital role in ensuring our software products... 
    Long term contract
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Athennian

    Winnipeg, MB
    2 hours ago
  • Job DescriptionWe are seeking an experienced Senior QA Engineer (AI Native) to join Semios' Engineering team. This position will take ownership...  ...data. Experience supporting teams adopting AI-native or agentic software development practices. About AffinityAffinity Group... 
    Long term contract
    Contract work
    Internship
    Immediate start
    Remote work

    Affinity

    Winnipeg, MB
    2 hours ago
  • $80k - $100k per year

     ...Ventures, Intel Capital, and Y Combinator. What You'll Do Own the QA strategy across manual, automated, regression, and integration...  ...and maintain test frameworks that scale with our product and engineering growth. Triage and validate issues in collaboration with... 
    Work at office

    Suger, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...from top-tier VCs, and are live with customers like Scale AI, Rippling, and Zendesk. Think of Maxima to accountants as Claude Code to engineers.Responsibilities Increasing end-to-end test coverage (Playwright + use AI to generate tests)Maintaining existing testsManual... 

    Maxima

    Winnipeg, MB
    2 hours ago
  • $175k - $200k per year

     ...RoleBig Viking Games is hiring a Principal Engineer, Agentic Products & Workflows to build the systems...  ..., product, design, art, live operations, QA, and leadership to find the highest-...  ..., queues, event-driven systems, workflow engines, or durable execution. Experience building... 
    Internship

    Big Viking Games

    Winnipeg, MB
    2 hours ago
  • $175.6k - $283.1k per year

    Camunda is the enterprise platform for agentic orchestration, enabling organizations to coordinate AI agents, people, and systems across...  ...reading. About The RoleCamunda is hiring a Senior Manager, QA Engineering to lead the end-to-end QA strategy for Camunda 8 - elevating... 

    Camunda

    Winnipeg, MB
    2 hours ago
  •  ...Cohere is seeking an Engineering Manager to lead our Deployment Engineering team in North America. This is a hands-on leadership role focused on technical excellence and delivering agentic AI integrations at scale for enterprise customers. You will mentor Forward Deployed... 

    Avenue.io Inc.

    Winnipeg, MB
    2 hours ago
  •  ...intersection of consulting, data science, AI technologies, data engineering, and digital transformation. We do not just advise — we build,...  ...AI adoption. The RoleArtefact is looking for a Senior AI & Agentic Engineer: a full-stack engineer who takes AI features from idea... 

    Artefact

    Winnipeg, MB
    2 hours ago
  • You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google. We are a fast growing consulting...  ...production-grade AI/ML systems. Experience architecting complex agentic systems, including orchestration, tool use, memory, and state... 

    Ample Insight Inc.

    Winnipeg, MB
    2 hours ago
  • $200k - $250k per year

    Join Snaplii as a founding member of a small, agile engineering team that is building the way AI agents pay. Location: Etobicoke (Toronto), onsite with hybrid 3 days max · Compensation: CAD $200k–250k + 20% performance bonus + equity About SnapliiSnaplii is a... 

    Snaplii

    Winnipeg, MB
    2 hours ago
  • Company Description You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google. We are a...  ...production‑grade AI/ML systems. Experience architecting complex agentic systems, including orchestration, tool use, memory, and state management... 

    Ample Insight

    Winnipeg, MB
    2 hours ago
  • $192.5k per year

    # Automation Engineer, Agentic OrchestrationStackAdapt128k-176k USDFull-timeremote· juniorCanada, USAopenaiawsllmpythonlangchaintensorflowpytorchgraphqlListed via Jobicy · posted 4 Nov 2026. The application happens there, not on DevConnect.Apply on Jobicy## DescriptionStackAdapt... 
    Local area
    Home office

    Devconnectplatform

    Winnipeg, MB
    2 hours ago
  • Build agentic AI systems with Python or TypeScript at CareLink by Asepha in Toronto, working in a hybrid engineering environment.As a Senior Software Engineer, you will shape engineering efforts through architectural decisions and full-stack contributions. The work spans backend... 

    Asepha

    Winnipeg, MB
    2 hours ago
  • $106k - $156k per year

     ...teamThe Huawei Human-Machine Interaction Lab unites global researchers, engineers, and designers to redefine human technology relationships through user centered, hands on research. We focus on agentic AI and multimodal interaction (voice, touch, vision, gesture) across smartphones... 
    Contract work
    Internship
    Immediate start

    Huawei Canada

    Winnipeg, MB
    2 hours ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Engineer (Agentic Systems) based in Canada. Join a high-performing team of engineers and data scientists working at the forefront of artificial... 

    Jobgether

    Winnipeg, MB
    2 hours ago
  • Build GenAI applications with Python, LLMs, and agentic frameworks at Infosys in Mississauga, Ontario. Design production-ready AI solutions through hands-on engineering.Infosys seeks a hands-on GenAI and Agentic AI Engineer for next-generation AI solutions. You will work with... 

    Infosys Limited

    Winnipeg, MB
    2 hours ago
  •  ...OpportunityTribalScale is looking for a Forward Deployed Engineer to work at the intersection of software...  ...of automated delivery cycles Drive agentic engineering practices across our clients,...  ...with agent frameworks, workflow engines, coding agents, or custom model-... 
    Immediate start

    TribalScale

    Winnipeg, MB
    2 hours ago
  • $200k per year

     ...finest business consultants, data analysts, data scientists, data engineers, and digital experts are all dedicated to bringing extra value...  ...systems - classical machine learning models, LLM applications,and agentic systems - ensuring scalability, reliability, and cost-efficient... 
    Manual labor

    Welcome to the Jungle

    Winnipeg, MB
    2 hours ago
  • $98k - $138k per year

     ...teams deliver innovative technology solutions to help build a stronger financial future for the healthcare community. As a Lead Agentic AI Engineer, you will work directly with engineers, architects, security, governance, and business partners to find high - value... 
    Permanent employment
    Immediate start

    Urban Ridge Supplies

    Winnipeg, MB
    2 hours ago
  •  ...can learn, grow, and thrive!Our Ratings and Awards Position: QA Automation EngineerLocation: Calgary - Remote, AlbertaJob Id:...  ...QA Automation Engineer360training is seeking a QA Automation Engineer to develop and maintain AI-assisted automated testing across our... 
    Work at office
    Local area
    Remote work
    Flexible hours

    360training.com

    Winnipeg, MB
    2 hours ago
  •  ...The client is looking for a Senior QA Engineer to support application architecture, development, and innovation of new features for consumer solutions. In this role, the candidate will provide guidance and standards to Quality Engineers to ensure the highest quality for each... 
    Flexible hours

    Compunnel Inc.

    Winnipeg, MB
    2 hours ago
  •  ...in bringing our vision to life. If this sounds like a fit, we’d love you to be a part of it. About The RoleWe are seeking a QA Automation Engineer for our Technology and IT Services Management Team. This role designs, develops, and executes automated test strategies to... 
    Full time

    CAAT Pension Plan

    Winnipeg, MB
    2 hours ago
  • Location: Remote / Hybrid [Insert City if applicable] Type: Full-time About the RoleGrant Advance is looking for a Senior QA Engineer to act as the primary "Gatekeeper" of our platform. We are looking for more than just a tester; we need a partner for our... 
    Long term contract
    Full time
    Immediate start
    Remote work
    Shift work

    Grant Advance Solutions Inc.

    Winnipeg, MB
    2 hours ago
  •  ...to turn analytics into impact and influence meaningful decisions, 360training is the place for you. QA Automation Engineer360training is seeking a QA Automation Engineer to develop and maintain AI-assisted automated testing across our software development and deployment... 

    360training

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Agentic Qa Engineer. Be the first to apply!