Agentic QA Engineer
TribalScale
Shape the Future with TribalScale
TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.
Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.
Our Digital Expertise
- Transformation Experts: We transform traditional business models into agile, AI-powered ecosystems.
- Strategic Visionaries: We navigate the uncharted waters of technological evolution.
- Product Virtuosos: We orchestrate the creation of world-class digital solutions.
- Code Optimizers: We leverage AI to refine and perfect digital systems.
Our Technological Toolkit
- Mobile & Web Development: (iOS, Android, React Native, React, Node.js)
- Voice-Activated Platforms: (Amazon Alexa, Google Home)
- Connected Ecosystems: (Cars and Homes)
- Streaming Platforms: (Roku, Fire TV, Android TV, tvOS)
The TribalScale Professional
You thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job; you seek a calling—a chance to make a lasting impact on the digital landscape.
Agentic QA Engineer
About TribalScale
TribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.
About the Role
TribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.
This role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.
The ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.
Key Responsibilities
- Design and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.
- Build automated test frameworks for functional, integration, regression, and end-to-end testing.
- Develop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.
- Test agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.
- Identify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.
- Establish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.
- Integrate automated testing and quality checks into CI/CD pipelines.
- Collaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.
- Investigate production issues and use findings to improve agent behavior, test coverage, and application performance.
- Evaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.
Required Qualifications
- Professional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.
- Proficiency in Python, JavaScript, TypeScript, or another relevant programming language.
- Experience building automated tests and testing frameworks.
- Strong understanding of API, integration, regression, and end-to-end testing.
- Experience debugging applications and investigating complex technical issues.
- Familiarity with Git, CI/CD pipelines, and modern software development practices.
- Strong analytical thinking and the ability to design test cases for complex, real-world scenarios.
Preferred Qualifications
- Experience testing LLM-based applications, AI agents, or generative AI products.
- Familiarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar technologies.
- Experience with LLM evaluation, prompt testing, model benchmarking, or AI observability.
- Familiarity with tools such as Pytest, Playwright, Cypress, or Selenium.
- Understanding of hallucinations, nondeterministic outputs, prompt injection, and agent tool-use failures.
- Experience with cloud platforms, APIs, distributed systems, and production deployments.
- Previous experience in Agentic Engineering, Forward Deployed Engineering, Applied AI Engineering, or AI product development.
Ideal Candidate
The ideal candidate combines the engineering mindset of an FDE or Agentic Engineer with the quality-focused approach of an experienced QA Automation Engineer or SDET.
Candidates with strong programming and automation skills who have tested AI-powered applications are especially relevant. We are also open to Agentic Engineers or FDEs who have meaningful experience building testing frameworks, validating complex workflows, and improving software reliability.
Core focus: AI agent reliability, software testing, test automation, and production-ready AI systems.
Why Choose TribalScale
At TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients; we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.
We empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated—it's fundamental to our strength. Our mission to "Right the Future" is a call to action to make a significant impact in the world of innovation.
Diversity: Our Collective Strength
TribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.
We not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.
Should you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.
$95k - $130k per year
...and manage contacts. Recognized as a top kids' wearable by PCMag and others, Cosmo is on the rise. About the Role Reports To: QA Engineering Manager Department: Engineering Role Summary: We are seeking a highly skilled and forward-thinking Lead QA Engineer to guide...SuggestedFull time- ...signing off. We remove the grind, not the human. Maxima is the agentic AI platform for enterprise accounting. Our three co-founders... ...is below. The role You will be our first Founding QA Engineer in Toronto, and you will own quality for a product that prepares...SuggestedFull timeInternshipWork at office
- ...TribalScale is looking for a Forward Deployed Engineer to work at the intersection of software... ...of automated delivery cycles Drive agentic engineering practices across our clients,... ...Experience with agent frameworks, workflow engines, coding agents, or custom model-...SuggestedImmediate start
$110k - $150k per year
...building the platforms that help regulated organizations adopt AI responsibly and at scale. What is the Opportunity? The QA Engineer III will be responsible for leading and executing functional quality assurance activities for complex banking and financial applications...SuggestedFull time$100k - $125k per year
...implementation, our 750+ global experts deliver intelligent solutions trusted by 500 million people. About the Role As a Senior QA Engineer, you will play a hands-on role in engineering quality into complex digital products across web, mobile, API, and backend systems....SuggestedFull timeContract workWork from homeFlexible hours- ...You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google. We are a fast growing consulting... ...production-grade AI/ML systems. Experience architecting complex agentic systems, including orchestration, tool use, memory, and state...Contract work
$250k - $325k per year
...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.... ...and most curious people to help us do it. As the founding lead of Agentic Analytics, a new team in our Analytics and Data Insights organization...Full timeWork at officeLocal areaImmediate startRemote workHome office$99.8k - $142.6k per year
...About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences...RemplacementLong term contractFull timeTemporary workWork at officeLocal areaFlexible hoursShift work3 days per week- ...what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each... ...deeply care about customers and want to work at the cutting edge of Agentic AI. In this role, you will: Build and ship features for...Full timeWork at officeRemote workFlexible hours
- .... Hospitality is all about taking care of others, and it defines our culture. About the job As a Principal Engineer, you'll be a founding member of OpenTable's Agentic Engineering Platform team within Product Engineering, rethinking how software gets built. Our goal is to redesign...Full time
$175k - $200k per year
...Principal Engineer, Agentic Products & Workflows Toronto, ON Hybrid, 4 days per week in office... ..., product, design, art, live operations, QA, and leadership to find the highest-leverage... ..., queues, event-driven systems, workflow engines, or durable execution. Experience...Full timeInternshipWork at office- ...a new job, this is where you belong. Our teams are applying Agentic AI, Generative AI, and Machine Learning to solve complex problems... ...meaningful business impact at scale. We're looking for an Engineering Manager, Agentic AI & Machine Learning to lead a talented team...Long term contractPermanent employmentFull timeTemporary workInternship
$135k - $175k per year
...— keep reading. About the Role The Agentic AI Foundations team is building the core... ...to agent-native operations. As a Software Engineer II on the team, you will help design, build... ...systems — including guardrails, policy engines, content filters, or responsible AI frameworks...Full timeInternship- ...helping property owners, businesses, utilities, and drivers transition to a more sustainable future. We're looking for a QA Automation Engineer who is passionate about software quality and automation to help ensure our products are reliable, scalable, and deliver an exceptional...Full time
- ...QA Automation Engineer – Selenium & Playwright Work Arrangement: Hybrid – 3 Days per Week in Office Job Description We are looking for an experienced QA Automation Engineer with strong expertise in Selenium and Playwright to design, develop, and maintain robust...Permanent employmentWork at office3 days per week
$120k - $135k per year
...500 million people. About the Role As a QA Architect, you have a proven track record of defining quality engineering vision, strategy, and architecture for complex... ...assisted QA, intelligent test orchestration, and agentic workflows to improve test effectiveness, accelerate...Full timeWork from homeFlexible hoursShift work- ...Toronto # of roles: 2 Paralucent is seeking an experienced Agentic AI Platform Engineer to join our team and support a major client in the banking... ...Managers, architects, technical leads, business analysts, QA teams, and client stakeholders. Strong problem-solving, communication...Permanent employmentFull time2 days per week
$45 per hour
...Toronto. What You’ll Do: Lead the design and implementation of test strategies and plans Mentor and guide mid-level and junior QA engineers Develop and maintain automated test frameworks using Cypress, Jmeter, and Postman Conduct code reviews and provide feedback...Hourly payFixed term contractRemote workFlexible hours$85 per hour
...- Ability to work closely with software engineers, architects, and product teams. - Experience... ...experience. - Experience testing agentic AI, orchestration platforms, automation workflows... ...testing, automated testing, Agile, QA Lead, Playwright Top Skills Details...Contract work$115k - $165k per year
...-on experience in developing Generative AI solutions, including agentic AI projects. It combines practical technical work with architectural... ...advise clients on best practices in Agentic AI Helping data engineer and prompt engineer the LLM solutions end-to-end to enhance end...Full timeManual labor- ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.... ...programs that validate partner expertise across infrastructure and agentic domains. You will report functionally into Customer Education &...Permanent employmentFull timeWork at officeLocal areaRemote workHome office
- ...? We'd love to work with you if you have: ~ Bachelor's degree or diploma in a technical field such as computer science, computer engineering or related field ~8+ years of hands on UI and Integration (back-end) testing experience ~8+ Prior FI experience required ~8+...Full timeFlexible hours
- ...looking for experienced Forward Deployed Engineer with Gen AI experience to join our fast-... ...into production-grade GenAI and Agentic AI solutions — owning the journey from first... ...RAG using OpenSearch Serverless (Vector Engine), and configuring Bedrock Guardrails for...Full timeLocal areaWork from home
$95k - $145k per year
...Description: Are you passionate about building enterprise-scale Agentic AI solutions that move beyond experimentation into real-world business... ...alongside leading AI Architects, Data Scientists, and Cloud Engineers to deliver innovative AI solutions for global clients. This role...Full time$69.45k - $119.45k per year
...Ecosystem. You Are: As an Advanced AI, Large Language Model and Agentic AI Developer/Consultant, you will build production-grade AI... ...agentic AI stack, including model selection, prompt and context engineering, advanced RAG, tool/function calling, MCP/A2A-style integration...Full timeManual laborWork at officeLocal area$100k - $145k per year
...Senior AI Engineer, Agentic AI Thomson Reuters is seeking a Senior AI Engineer, Agentic AI to build and ship LLM-powered agents for our go-to-market organization. Our agent platform brings the tools sales teams use today into one AI-agent hub. You will build specialist...RemplacementFull timeWork at officeLocal areaFlexible hours- ...We are looking for a Senior QA Automation Engineer to drive quality engineering practices across a next-generation Workforce Management (WFM) and... ...systems. Experience testing WFM forecasting and scheduling engines or other complex rule-based business systems, e.g.,...Contract workInternshipRemote workRelocationShift work
- ...opportunity based in Toronto. In this role, you will take on a premier cloud integration architecture, API development, and middleware engineering capacity, specializing in designing, building, and deploying scalable integration solutions across Microsoft Azure platforms. As...Contract workImmediate start
$58k - $96k per year
...through mentoring and on the job coaching Deloitte Global is the engine of the Deloitte network. Our professionals reach across... ...and scripting initiatives, enabling gradual adoption of advanced (Agentic AI) security workflows. In this role you will: Support the...RemplacementPermanent employmentRemote workFlexible hours$90k - $175k per year
...typical day look like? Deloitte is seeking a Manager, SAP BTP & Agentic AI Solutions to help shape and deliver next-generation SAP AI... ...• Bachelor’s degree in Computer Science, Software Engineering, Engineering, Information Systems, Business Technology Management...Permanent employmentFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Agentic QA Engineer. Be the first to apply!
- software quality assurance engineer Toronto, ON
- software test engineer Toronto, ON
- qa engineer Toronto, ON
- senior quality assurance engineer Toronto, ON
- remote quality assurance Toronto, ON
- qa software testing Toronto, ON
- quality assurance Toronto, ON
- td qa Toronto, ON
- stage assurance qualité Toronto, ON
- responsable assurance qualité Toronto, ON
