Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Agentic QA Engineer

TribalScale

Shape the Future with TribalScale

TribalScale is a digital innovation firm that helps organizations adapt and thrive in a rapidly changing world. We partner with clients to build transformative digital products, modernize technology platforms, and apply emerging technologies—including artificial intelligence—to meaningful business challenges.
Our teams work closely with clients from strategy through execution. We value curiosity, ownership, practical innovation, and people who are comfortable turning ambiguity into action.

Our Digital Expertise

  • Transformation Experts: We transform traditional business models into agile, AI-powered ecosystems.
  • Strategic Visionaries: We navigate the uncharted waters of technological evolution.
  • Product Virtuosos: We orchestrate the creation of world-class digital solutions.
  • Code Optimizers: We leverage AI to refine and perfect digital systems.

Our Technological Toolkit

  • Mobile & Web Development: (iOS, Android, React Native, React, Node.js)
  • Voice-Activated Platforms: (Amazon Alexa, Google Home)
  • Connected Ecosystems: (Cars and Homes)
  • Streaming Platforms: (Roku, Fire TV, Android TV, tvOS)

The TribalScale Professional

You thrive in challenging environments where innovation is key. Your passion for technology is matched only by your drive to redefine its limits. You seek more than a job; you seek a calling—a chance to make a lasting impact on the digital landscape.

Agentic QA Engineer

About TribalScale

TribalScale is an innovation company focused on helping organizations build and scale digital products and AI-powered solutions. The team works at the intersection of emerging technologies, product development, and engineering to bring innovative solutions into production.

About the Role

TribalScale is looking for an Agentic QA Engineer who combines strong software testing and quality engineering expertise with hands-on experience in AI-powered applications and agentic systems.

This role is similar to a Forward Deployed Engineer (FDE) or Agentic Engineer, with a particular focus on software quality, test automation, and validating AI-driven workflows. You will help ensure that AI agents and LLM-powered applications perform reliably in real-world environments by designing testing strategies, building automated evaluation frameworks, and identifying edge cases and failure modes.

The ideal candidate is a hands-on engineer who can write code, debug complex systems, and apply software testing principles to applications where outputs may be dynamic, nondeterministic, and dependent on multi-step agent interactions.

Key Responsibilities

  • Design and implement testing strategies for AI agents, LLM-powered applications, and agentic workflows.
  • Build automated test frameworks for functional, integration, regression, and end-to-end testing.
  • Develop evaluation pipelines to measure agent accuracy, reliability, task completion, and consistency.
  • Test agent tool usage, API integrations, multi-step reasoning workflows, and interactions with external systems.
  • Identify, reproduce, and troubleshoot failures such as hallucinations, incorrect tool calls, unexpected outputs, and workflow breakdowns.
  • Establish quality metrics, evaluation datasets, test scenarios, and benchmarks for AI-driven applications.
  • Integrate automated testing and quality checks into CI/CD pipelines.
  • Collaborate with AI engineers, software developers, product teams, and client-facing engineering teams to improve system reliability.
  • Investigate production issues and use findings to improve agent behavior, test coverage, and application performance.
  • Evaluate edge cases, failure recovery, security considerations, and resilience in AI-powered systems.

Required Qualifications

  • Professional experience in Software QA, Quality Engineering, SDET, Test Automation, or Software Engineering with a strong testing focus.
  • Proficiency in Python, JavaScript, TypeScript, or another relevant programming language.
  • Experience building automated tests and testing frameworks.
  • Strong understanding of API, integration, regression, and end-to-end testing.
  • Experience debugging applications and investigating complex technical issues.
  • Familiarity with Git, CI/CD pipelines, and modern software development practices.
  • Strong analytical thinking and the ability to design test cases for complex, real-world scenarios.

Preferred Qualifications

  • Experience testing LLM-based applications, AI agents, or generative AI products.
  • Familiarity with agentic frameworks such as LangGraph, LangChain, CrewAI, or similar technologies.
  • Experience with LLM evaluation, prompt testing, model benchmarking, or AI observability.
  • Familiarity with tools such as Pytest, Playwright, Cypress, or Selenium.
  • Understanding of hallucinations, nondeterministic outputs, prompt injection, and agent tool-use failures.
  • Experience with cloud platforms, APIs, distributed systems, and production deployments.
  • Previous experience in Agentic Engineering, Forward Deployed Engineering, Applied AI Engineering, or AI product development.

Ideal Candidate

The ideal candidate combines the engineering mindset of an FDE or Agentic Engineer with the quality-focused approach of an experienced QA Automation Engineer or SDET.

Candidates with strong programming and automation skills who have tested AI-powered applications are especially relevant. We are also open to Agentic Engineers or FDEs who have meaningful experience building testing frameworks, validating complex workflows, and improving software reliability.

Core focus: AI agent reliability, software testing, test automation, and production-ready AI systems.

Why Choose TribalScale

At TribalScale, collaboration is at the heart of our innovative approach. We don't simply work for clients; we form partnerships, building transformative solutions that redefine what's possible. Our team, once at the forefront of the mobile revolution, now leads the charge in AI-driven innovation.

We empower each team member to be a catalyst for change, adhering to our principles of meritocracy, empowerment, and transparency. Diversity isn't just celebrated—it's fundamental to our strength. Our mission to "Right the Future" is a call to action to make a significant impact in the world of innovation.

 

Diversity: Our Collective Strength

TribalScale proudly stands as a beacon of equal opportunity in employment and workplace culture. We are steadfastly committed to equal employment opportunity, transcending the boundaries of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, able-bodiedness, or gender identity.

We not only welcome but actively encourage applications from individuals of all abilities, ages, citizenships, marital statuses, and gender identities. Your unique perspective is the key to our collective innovation.

Should you require any accommodations, we implore you to inform us. Our commitment to inclusivity knows no bounds, and we stand ready to adapt our processes to ensure your comfort and success.

 

Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Agentic QA Engineer in Toronto, ON vacancy
  • $95k - $130k per year

     ...and manage contacts. Recognized as a top kids' wearable by PCMag and others, Cosmo is on the rise. About the Role Reports To: QA Engineering Manager Department: Engineering Role Summary: We are seeking a highly skilled and forward-thinking Lead QA Engineer to guide... 
    Suggested
    Full time

    COSMO

    Toronto, ON
    11 days ago
  •  ...signing off. We remove the grind, not the human. Maxima is the agentic AI platform for enterprise accounting. Our three co-founders...  ...is below. The role You will be our first Founding QA Engineer in Toronto, and you will own quality for a product that prepares... 
    Suggested
    Full time
    Internship
    Work at office

    Maxima

    Toronto, ON
    6 days ago
  •  ...TribalScale is looking for a Forward Deployed Engineer to work at the intersection of software...  ...of automated delivery cycles Drive agentic engineering practices across our clients,...  ...Experience with agent frameworks, workflow engines, coding agents, or custom model-... 
    Suggested
    Immediate start

    TribalScale

    Toronto, ON
    2 hours ago
  • $110k - $150k per year

     ...building the platforms that help regulated organizations adopt AI responsibly and at scale. What is the Opportunity?    The QA Engineer III   will be responsible for leading and executing functional quality assurance activities for complex banking and financial applications... 
    Suggested
    Full time

    Zafin

    Toronto, ON
    2 hours ago
  • $100k - $125k per year

     ...implementation, our 750+ global experts deliver intelligent solutions trusted by 500 million people. About the Role As a Senior QA Engineer, you will play a hands-on role in engineering quality into complex digital products across web, mobile, API, and backend systems.... 
    Suggested
    Full time
    Contract work
    Work from home
    Flexible hours

    Konrad

    Toronto, ON
    2 hours ago
  •  ...You will join a world-class team of engineers and data scientists from Facebook, Uber, Amazon and Google. We are a fast growing consulting...  ...production-grade AI/ML systems. Experience architecting complex agentic systems, including orchestration, tool use, memory, and state... 
    Contract work

    Ample Insight Inc.

    Toronto, ON
    15 days ago
  • $250k - $325k per year

     ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft....  ...and most curious people to help us do it. As the founding lead of Agentic Analytics, a new team in our Analytics and Data Insights organization... 
    Full time
    Work at office
    Local area
    Immediate start
    Remote work
    Home office

    Cohere

    Toronto, ON
    5 days ago
  • $99.8k - $142.6k per year

     ...About the Role: Tubi is seeking a highly skilled and experienced Senior QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences... 
    Remplacement
    Long term contract
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    Shift work
    3 days per week

    Tubi - Canada

    Toronto, ON
    2 hours ago
  •  ...what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft. Each...  ...deeply care about customers and want to work at the cutting edge of Agentic AI. In this role, you will: Build and ship features for... 
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    Toronto, ON
    9 days ago
  •  .... Hospitality is all about taking care of others, and it defines our culture. About the job As a Principal Engineer, you'll be a founding member of OpenTable's Agentic Engineering Platform team within Product Engineering, rethinking how software gets built. Our goal is to redesign... 
    Full time

    Opentable

    Toronto, ON
    13 days ago
  • $175k - $200k per year

     ...Principal Engineer, Agentic Products & Workflows Toronto, ON Hybrid, 4 days per week in office...  ..., product, design, art, live operations, QA, and leadership to find the highest-leverage...  ..., queues, event-driven systems, workflow engines, or durable execution. Experience... 
    Full time
    Internship
    Work at office

    Big Viking Games

    Toronto, ON
    more than 2 months ago
  •  ...a new job, this is where you belong.  Our teams are applying Agentic AI, Generative AI, and Machine Learning to solve complex problems...  ...meaningful business impact at scale. We're looking for an Engineering Manager, Agentic AI & Machine Learning to lead a talented team... 
    Long term contract
    Permanent employment
    Full time
    Temporary work
    Internship

    Loblaw Companies Limited

    Toronto, ON
    2 days ago
  • $135k - $175k per year

     ...— keep reading. About the Role The Agentic AI Foundations team is building the core...  ...to agent-native operations. As a Software Engineer II on the team, you will help design, build...  ...systems — including guardrails, policy engines, content filters, or responsible AI frameworks... 
    Full time
    Internship

    Socure

    Toronto, ON
    6 days ago
  •  ...helping property owners, businesses, utilities, and drivers transition to a more sustainable future. We're looking for a QA Automation Engineer who is passionate about software quality and automation to help ensure our products are reliable, scalable, and deliver an exceptional... 
    Full time

    SWTCH Energy Inc.

    Toronto, ON
    a month ago
  •  ...QA Automation Engineer – Selenium & Playwright Work Arrangement: Hybrid – 3 Days per Week in Office Job Description We are looking for an experienced QA Automation Engineer with strong expertise in Selenium and Playwright to design, develop, and maintain robust... 
    Permanent employment
    Work at office
    3 days per week

    Astra North Infoteck Inc.

    Toronto, ON
    12 days ago
  • $120k - $135k per year

     ...500 million people. About the Role As a QA Architect, you have a proven track record of defining quality engineering vision, strategy, and architecture for complex...  ...assisted QA, intelligent test orchestration, and agentic workflows to improve test effectiveness, accelerate... 
    Full time
    Work from home
    Flexible hours
    Shift work

    Konrad

    Toronto, ON
    2 hours ago
  •  ...Toronto # of roles: 2 Paralucent is seeking an experienced Agentic AI Platform Engineer to join our team and support a major client in the banking...  ...Managers, architects, technical leads, business analysts, QA teams, and client stakeholders. Strong problem-solving, communication... 
    Permanent employment
    Full time
    2 days per week

    Paralucent

    Toronto, ON
    4 days ago
  • $45 per hour

     ...Toronto. What You’ll Do: Lead the design and implementation of test strategies and plans  Mentor and guide mid-level and junior QA engineers Develop and maintain automated test frameworks using Cypress, Jmeter, and Postman Conduct code reviews and provide feedback... 
    Hourly pay
    Fixed term contract
    Remote work
    Flexible hours

    DEPT

    Toronto, ON
    6 days ago
  • $85 per hour

     ...- Ability to work closely with software engineers, architects, and product teams. - Experience...  ...experience. - Experience testing agentic AI, orchestration platforms, automation workflows...  ...testing, automated testing, Agile, QA Lead, Playwright Top Skills Details... 
    Contract work
    Toronto, ON
    6 days ago
  • $115k - $165k per year

     ...-on experience in developing Generative AI solutions, including agentic AI projects. It combines practical technical work with architectural...  ...advise clients on best practices in Agentic AI Helping data engineer and prompt engineer the LLM solutions end-to-end to enhance end... 
    Full time
    Manual labor

    CGI

    Toronto, ON
    9 days ago
  •  ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft....  ...programs that validate partner expertise across infrastructure and agentic domains. You will report functionally into Customer Education &... 
    Permanent employment
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Toronto, ON
    5 days ago
  •  ...? We'd love to work with you if you have: ~ Bachelor's degree or diploma in a technical field such as computer science, computer engineering or related field ~8+ years of hands on UI and Integration (back-end) testing experience ~8+ Prior FI experience required ~8+... 
    Full time
    Flexible hours

    Scotiabank

    Toronto, ON
    3 days ago
  •  ...looking for experienced Forward Deployed Engineer with Gen AI experience to join our fast-...  ...into production-grade GenAI and Agentic AI solutions — owning the journey from first...  ...RAG using OpenSearch Serverless (Vector Engine), and configuring Bedrock Guardrails for... 
    Full time
    Local area
    Work from home

    Tiger Analytics Inc.

    Toronto, ON
    a month ago
  • $95k - $145k per year

     ...Description: Are you passionate about building enterprise-scale Agentic AI solutions that move beyond experimentation into real-world business...  ...alongside leading AI Architects, Data Scientists, and Cloud Engineers to deliver innovative AI solutions for global clients. This role... 
    Full time

    CGI

    Toronto, ON
    9 days ago
  • $69.45k - $119.45k per year

     ...Ecosystem. You Are: As an Advanced AI, Large Language Model and Agentic AI Developer/Consultant, you will build production-grade AI...  ...agentic AI stack, including model selection, prompt and context engineering, advanced RAG, tool/function calling, MCP/A2A-style integration... 
    Full time
    Manual labor
    Work at office
    Local area

    Accenture Global

    Toronto, ON
    10 days ago
  • $100k - $145k per year

     ...Senior AI Engineer, Agentic AI Thomson Reuters is seeking a Senior AI Engineer, Agentic AI to build and ship LLM-powered agents for our go-to-market organization. Our agent platform brings the tools sales teams use today into one AI-agent hub. You will build specialist... 
    Remplacement
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    1 day ago
  •  ...We are looking for a Senior QA Automation Engineer to drive quality engineering practices across a next-generation Workforce Management (WFM) and...  ...systems.  Experience testing WFM forecasting and scheduling engines or other complex rule-based business systems, e.g.,... 
    Contract work
    Internship
    Remote work
    Relocation
    Shift work

    Miratech

    Toronto, ON
    6 days ago
  •  ...opportunity based in Toronto. In this role, you will take on a premier cloud integration architecture, API development, and middleware engineering capacity, specializing in designing, building, and deploying scalable integration solutions across Microsoft Azure platforms. As... 
    Contract work
    Immediate start

    Randstad Canada

    Toronto, ON
    6 days ago
  • $58k - $96k per year

     ...through mentoring and on the job coaching Deloitte Global is the engine of the Deloitte network. Our professionals reach across...  ...and scripting initiatives, enabling gradual adoption of advanced (Agentic AI) security workflows.  In this role you will:   Support the... 
    Remplacement
    Permanent employment
    Remote work
    Flexible hours

    Deloitte

    Toronto, ON
    5 days ago
  • $90k - $175k per year

     ...typical day look like? Deloitte is seeking a Manager, SAP BTP & Agentic AI Solutions to help shape and deliver next-generation SAP AI...  ...• Bachelor’s degree in Computer Science, Software Engineering, Engineering, Information Systems, Business Technology Management... 
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Agentic QA Engineer. Be the first to apply!