Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Agentic Qa Engineer

TribalScale

TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.
Our Digital Expertise
Transformation Experts:
We transform traditional business models into agile, AI-powered ecosystems.
Strategic Visionaries:
We navigate the uncharted waters of technological evolution.
Product Virtuosos:
We orchestrate the creation of world-class digital solutions.
Code Optimizers:
We leverage AI to refine and perfect digital systems.
Our Technological Toolkit
Voice-Activated Platforms:
(Amazon Alexa, Google Home)
Connected Ecosystems:
(Cars and Homes)
The TribalScale ProfessionalYou thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job;
you seek a calling—a chance to make a lasting impact on the digital landscape.
Agentic QA EngineerJob title: Agentic QA EngineerCompany: TribalScaleLocation: [To be confirmed]Employment type: [To be confirmed]
About TribalScaleTribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.
About the RoleTribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.
This role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.
The ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.
Key Responsibilities
Design and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.
Build automated test frameworks for functional, integration, regression, and end-to-end testing.
Develop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.
Test agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.
Identify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.
Establish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.
Integrate automated testing and quality checks into CI/CD pipelines.
Collaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.
Investigate production issues and use findings to improve agent behavior, test coverage, and application performance.
Evaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.
Required Qualifications
Professional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.
Experience building automated tests and testing frameworks.
Strong understanding of API, integration, regression, and end-to-end testing.
Experience debugging applications and investigating complex technical issues.
Familiarity with Git, CI/CD pipelines, and modern software development practices.
Strong analytical thinking and the ability to design test cases for complex, real-world scenarios.
Preferred Qualifications
Experience testing LLM-based applications, AI agents, or generative AI products.
Familiarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar technologies.
Experience with LLM evaluation, prompt testing, model benchmarking, or AI observability.
Familiarity with tools such as Pytest, Playwright, Cypress, or Selenium.
Understanding of hallucinations, nondeterministic outputs, prompt injection, and agent tool-use failures.
Experience with cloud platforms, APIs, distributed systems, and production deployments.
Previous experience in Agentic Engineering, Forward Deployed Engineering, Applied AI Engineering, or AI product development.
Ideal CandidateThe ideal candidate combines the engineering mindset of an FDE or Agentic Engineer with the quality-focused approach of an experienced QA Automation Engineer or SDET.
Candidates with strong programming and automation skills who have tested AI-powered applications are especially relevant. We are also open to Agentic Engineers or FDEs who have meaningful experience building testing frameworks, validating complex workflows, and improving software reliability.
Core focus: AI agent reliability, software testing, test automation, and production-ready AI systems.Why Choose TribalScaleAt TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients;
we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.
We empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated—it's fundamental to our strength. Our mission to "Right the Future" is a call to action to make a significant impact in the world of innovation.
Diversity: Our Collective StrengthTribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.
We not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.
Should you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Agentic Qa Engineer in Winnipeg, MB vacancy
  •  ...collaboration, respectful challenge, and ability to strongly support QA decisions Continually monitor the effectiveness of the DI/CSV...  .... Education, Experience & Skills Requirements BS Engineering/Chemistry/Microbiology or related field. Minimum 5-7 years related... 
    Suggested
    For contractors
    Local area
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    8 days ago
  • We are looking for an Automation Engineer - a developer-first, agentic thinker who will build the intelligent systems that keep Sophis, strategic front-to-back trading platform, running at the highest quality bar. You will operate as an AI agent coordinator, software developer... 
    Suggested
    Internship

    Compunnel Inc.

    Winnipeg, MB
    57 minutes ago
  •  .... Our capabilities span generative and agentic AI, cloud migration and modernization, cloud...  ...standard verification Partner with engineers during development to shift testing left:...  ...assets (automated suites, test data sets, QA checklists) back to the CXE practice Mentor... 
    Suggested
    Contract work
    Work at office
    Remote work
    Worldwide
    Flexible hours
    Shift work

    Caylent

    Winnipeg, MB
    1 hour ago
  •  ...day inspired to build a more efficient and enjoyable world. Role overviewAgentic engineering changes how software is built and how organizations operate. We're designing and building agentic engineering systems that can reason, use tools, interact with enterprise... 
    Suggested
    Flexible hours

    Osedea

    Winnipeg, MB
    1 hour ago
  •  ...secretarial, governance, tax, and compliance. About The RoleWe are seeking a detail-oriented and technically skilled Quality Assurance (QA) Engineer to join our growing team. Reporting into the Director of Development, you will play a vital role in ensuring our software products... 
    Suggested
    Long term contract
    Full time
    Work at office
    Remote work
    Work from home
    Flexible hours

    Athennian

    Winnipeg, MB
    1 hour ago
  •  ...from top-tier VCs, and are live with customers like Scale AI, Rippling, and Zendesk. Think of Maxima to accountants as Claude Code to engineers.Responsibilities Increasing end-to-end test coverage (Playwright + use AI to generate tests)Maintaining existing testsManual... 

    Maxima

    Winnipeg, MB
    1 hour ago
  • $90k - $120k per year

     ...Ventures, Intel Capital, and Y Combinator. What You'll Do Own the QA strategy across manual, automated, regression, and integration...  ...and maintain test frameworks that scale with our product and engineering growth. Triage and validate issues in collaboration with Engineering... 
    Work at office

    Suger

    Winnipeg, MB
    1 hour ago
  •  ...and automation to deliver innovative solutions in a fast-paced environment.About This Opportunity: We’re seeking an experienced QA Engineer to join a dynamic team focused on test automation and AI-driven quality assurance. You’ll collaborate with product managers and development... 

    Akkodis

    Winnipeg, MB
    59 minutes ago
  •  ...efficient than ever before.Continuous protection. AI-powered Nonstop SecOps. That’s Ontinue.Role Overview We’re looking for a QA Automation Engineer to help us scale quality across a fast-moving engineering team. This role is about building the automation, processes, and... 

    Ontinue

    Winnipeg, MB
    1 hour ago
  • $175k - $200k per year

     ...RoleBig Viking Games is hiring a Principal Engineer, Agentic Products & Workflows to build the systems...  ..., product, design, art, live operations, QA, and leadership to find the highest-...  ..., queues, event-driven systems, workflow engines, or durable execution. Experience building... 
    Internship

    Big Viking Games

    Winnipeg, MB
    1 hour ago
  • Job DescriptionWe are seeking an experienced Senior QA Engineer (AI Native) to join Semios' Engineering team. This position will take ownership...  ...data. Experience supporting teams adopting AI-native or agentic software development practices. About AffinityAffinity Group... 
    Long term contract
    Contract work
    Internship
    Immediate start
    Remote work

    Affinity

    Winnipeg, MB
    1 hour ago
  •  ...100 countries, with teams across North America, Europe, and Asia Pacific. The RoleLightspeed is seeking a Senior Director, Agentic Engineering to build and lead the platform, capabilities, and operating model that enable Product & Technology teams to work effectively... 
    Long term contract
    Temporary work
    Remote work
    Flexible hours

    FractionalFinders

    Winnipeg, MB
    59 minutes ago
  • We are seeking a Senior Agentic AI Engineer to design, develop, and deploy production-grade AI applications using Large Language Models (LLMs), Agentic AI frameworks, Retrieval-Augmented Generation (RAG), and Google Cloud Platform (GCP). The ideal candidate will have strong... 

    enableIT

    Winnipeg, MB
    1 hour ago
  •  ...intersection of consulting, data science, AI technologies, data engineering, and digital transformation. We do not just advise — we build,...  ...AI adoption. The RoleArtefact is looking for a Senior AI & Agentic Engineer: a full-stack engineer who takes AI features from idea... 

    Artefact North America

    Winnipeg, MB
    57 minutes ago
  • We're hiring a contract AI engineer who builds, deploys and operates AI agents in production, using leading-edge agentic development practice to ship quickly. The AI Platform team builds AI agents and products for the trucking and fleet compliance space, used by both our... 
    Contract work
    Internship

    Aplin

    Winnipeg, MB
    1 hour ago
  • $98k - $138k per year

     ...teams deliver innovative technology solutions to help build a stronger financial future for the healthcare community. As a Lead Agentic AI Engineer, you will work directly with engineers, architects, security, governance, and business partners to find high - value... 
    Permanent employment
    Immediate start

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  • Build GenAI applications with Python, LLMs, and agentic frameworks at Infosys in Mississauga, Ontario. Design production-ready AI solutions through hands-on engineering.Infosys seeks a hands-on GenAI and Agentic AI Engineer for next-generation AI solutions. You will work with... 

    Infosys Limited

    Winnipeg, MB
    1 hour ago
  • Develop intelligent collaboration and agentic automation at Asana’s Vancouver office with tested code, workflow orchestration, and AI curiosity. Hybrid work is office-centric.Asana seeks Software Engineers for teams building high-impact AI product surfaces and supporting systems... 
    Work at office

    ContentBuffer

    Winnipeg, MB
    1 hour ago
  •  ...TribalScale is looking for a Forward Deployed Engineer to work at the intersection of software...  ...of automated delivery cycles Drive agentic engineering practices across our clients,...  ...Experience with agent frameworks, workflow engines, coding agents, or custom model‑... 
    Immediate start

    TribalScale

    Winnipeg, MB
    1 hour ago
  • $175.6k - $283.1k per year

    Camunda is the enterprise platform for agentic orchestration, enabling organizations to coordinate AI agents, people, and systems across...  ...reading. About The RoleCamunda is hiring a Senior Manager, QA Engineering to lead the end-to-end QA strategy for Camunda 8 - elevating... 
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide
    Home office
    Flexible hours

    Camunda

    Winnipeg, MB
    1 hour ago
  • Lead agentic AI architecture at Robots & Pencils, using Python, AWS, and production-focused engineering judgment across end-to-end systems.As a Staff AI Builder, you will lead AI/ML system design, model development, optimization, and integration. You will guide architectural... 

    robotsandpencils

    Winnipeg, MB
    1 hour ago
  • Advance agentic reinforcement learning research from Canada with PyTorch and multimodal AI expertise in a fully remote setting. Build intelligent systems for complex challenges.This AI Research Engineer role focuses on next-generation intelligent systems and adaptive behavior... 
    Remote work

    Jobgether

    Winnipeg, MB
    1 hour ago
  • Nothing can limit yourdreams when you are atZoft SENIOR QA ENGINEER Work Location : Canada We are hiring a Senior QA Manager for an onsite assignment at our client's premises in Canada, owning QA leadership across multiple product streams. You will own end-to-end test... 
    Contract work

    ZoftSolutions

    Winnipeg, MB
    58 minutes ago
  • $110k - $150k per year

     ..., we're building the platforms that help regulated organizations adopt AI responsibly and at scale. What is the Opportunity?The QA Engineer III will be responsible for leading and executing functional quality assurance activities for complex banking and financial applications... 

    Zafin

    Winnipeg, MB
    1 hour ago
  • $95k - $130k per year

     ...alerts and manage contacts. Recognized as a top kids' wearable by PCMag and others, Cosmo is on the rise.About the Role Reports To: QA Engineering ManagerDepartment: EngineeringRole Summary: We are seeking a highly skilled and forward-thinking Lead QA Engineer to guide our... 

    Cosmo

    Winnipeg, MB
    1 hour ago
  • Job Title: Sr. QA Automation Engineer Location: Canada (Remote) Employment Type: Contract Job SummaryWe are looking for a skilled QA Automation Engineer to design, develop, and maintain automated test frameworks and scripts to ensure high-quality software... 
    Contract work
    Remote work

    RELQ TECHNOLOGIES

    Winnipeg, MB
    1 hour ago
  • Job Title QA Automation EngineerLocation PCS CA~TORONTOYears of Experience 7-10 YearsJob Summary We are seeking a highly skilled QA Automation Engineer with 7-10 years of experience to join our dynamic team in Toronto. The ideal candidate will play a crucial role in ensuring... 

    Virtusa Corporation

    Winnipeg, MB
    1 hour ago
  • Build agentic AI systems with Python or TypeScript at CareLink by Asepha in Toronto, working in a hybrid engineering environment.As a Senior Software Engineer, you will shape engineering efforts through architectural decisions and full-stack contributions. The work spans backend... 

    Asepha

    Winnipeg, MB
    58 minutes ago
  • Company Description You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google. We are a...  ...production‑grade AI/ML systems. Experience architecting complex agentic systems, including orchestration, tool use, memory, and state management... 

    Ample Insight

    Winnipeg, MB
    1 hour ago
  •  ...feelings knowing you have helped your community, your team, the business and social causes through the Rexall Care Network The Senior QA Engineer will lead the design and delivery of automated testing solutions that protect the quality, reliability, and performance of Rexall’s... 
    Shift work

    Rexall

    Winnipeg, MB
    58 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Agentic Qa Engineer. Be the first to apply!