Agentic AI QA Engineer
Rootly
Rootly is seeking an AI Quality Engineer to own the evaluation and optimization of our agentic AI features—designing test scenarios, running adversarial prompts, interpreting outputs, and working directly with engineering and product to close the loop on performance.
This role involves thinking like an attacker, a curious user, and a power user across complex incident workflows to probe how our AI agents reason, decide, and handle edge cases.
#J-18808-LjbffrVacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Agentic AI QA Engineer in Toronto, ON vacancy
- ...looking for experienced Forward Deployed Engineer with Gen AI experience to join our fast-growing... ...challenges into production-grade GenAI and Agentic AI solutions — owning the journey from... ...using OpenSearch Serverless (Vector Engine), and configuring Bedrock Guardrails for...SuggestedFull timeLocal areaWork from home
- ...Toronto # of roles: 2 Paralucent is seeking an experienced Agentic AI Platform Engineer to join our team and support a major client in the banking... ...Managers, architects, technical leads, business analysts, QA teams, and client stakeholders. Strong problem-solving, communication...SuggestedPermanent employmentFull time2 days per week
- ...Role: AI Engineer Role Descriptions: AI Engineer Essential Skills: • Purely hands-on experience with: • Agentic AI on Azure • GenAI and RAG • Integration and API standardization Desirable Skills: Keyword:...SuggestedFull time
$120k - $170k per year
...of hospitals and clinics across North America. Conductor is our agentic AI automation platform — purpose-built to take the administrative... ...hospitals and clinics. This role sits at the intersection of clients, engineering, sales, and customer success, ensuring deployments move quickly...SuggestedFull timeWork at office2 days per week- ...Security Research Engineer - AI Security, Agentic AI & Emerging Cybersecurity Must Have Technical Skills Technical Security Research Engineer to research, prototype, evaluate, and operationalize emerging cybersecurity capabilities. This is a hands-on role for...SuggestedPermanent employmentInternship
$75.7k - $108k per year
...About the Role: Tubi is seeking a highly skilled and experienced QA Automation Engineer to lead quality assurance initiatives for our cutting-edge streaming and AI-driven product features. This pivotal role involves ensuring exceptional end-to-end user experiences, robust...Long term contractRemplacementFull timeTemporary workWork at officeLocal areaFlexible hours2 days per week$175k - $200k per year
...Principal Engineer, Agentic Products & Workflows Toronto, ON Hybrid, 4 days per week in office... ...We are now rebuilding the company as an AI-first studio. That is not a slogan here.... ..., product, design, art, live operations, QA, and leadership to find the highest-leverage...Full timeInternshipWork at office- ...Responsibility: SGGG Fund Services Inc. (SGGG-FSI) is currently seeking to fill a full-time permanent position for the role of Software QA Engineer. The successful candidate joining our existing software development team will be energetic, enthusiastic, reliable, and will have...Permanent employmentFull timeManual laborWork at officeRemote work
- ...seeking a Staff-level, hands-on software and ML engineering professional for an embedded, client-... ...and build production integrations between AI agents, enterprise APIs, agent... ...experience building LLM-based applications and agentic systems, including agent orchestration and...Full time
$120k per year
...Principal Consultant – AWS Data Platforms & Agentic AI About the Role We are looking for a Principal Consultant – AWS Data Platforms... ...combination of AWS Data architecture, Agentic AI expertise, engineering depth and executive presence. You should be equally...Permanent employment- ...helping property owners, businesses, utilities, and drivers transition to a more sustainable future. We're looking for a QA Automation Engineer who is passionate about software quality and automation to help ensure our products are reliable, scalable, and deliver an exceptional...Full time
- ...traditional business models into agile, AI-powered ecosystems.... ...looking for a Forward Deployed Engineer to work at the intersection of... ...automated delivery cycles Drive agentic engineering practices across... ...agent frameworks, workflow engines, coding agents, or custom model...Immediate start
$65k - $115k per year
QA Automation Engineering Position Description We are looking for an experienced QA Automation Engineer to support the design, development, and... ...to scalable automation frameworks, CI/CD integration, and AI-augmented testing practices while supporting quality across complex...Work at office3 days per week$100k - $120k per year
...stability, empowering economies and enabling customers to create sustainable growth. We are seeking a hands-on Full Stack QA Automation Engineer to ensure quality, reliability, and performance of trading platforms across backend and web applications. Through our modular...Work at office- ...Director, Engineering, AI Job Description Are you passionate about transforming how legal professionals find trusted answers with AI? Join... ...organization around products, services, or customer outcomes. Agentic systems and responsible AI. Experience shipping agentic...Long term contractFull timeContract workWork at officeLocal areaFlexible hoursShift work
- ...designing developing and deploying scalable UiPath automation solutions across enterprise processes. Proficient in integrating Agentic AI capabilities for intelligent decision-making document understanding and dynamic workflow orchestration. Skilled in end-to-end bot...Full time
$110k - $150k per year
...Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our... ...responsibly and at scale. What is the Opportunity? The QA Engineer III will be responsible for leading and executing functional quality...Full time$140.6k - $190.6k per year
...Job Description: Engineering Manager, Are you passionate about transforming the future of legal research with AI? Join our Global Westlaw Engineering organization and help shape... ...generation of experiences. Your team will build agentic legal research experiences and the...Full timeInternshipWork at officeLocal areaWorldwideFlexible hoursShift work- ...Senior AI Engineer Toronto Downtown, ON - Hybrid (4 Days WFO) In Person Interview Required Key Responsibilities • AI Product... ...architect scalable Generative AI solutions, including LLM pipelines, Agentic workflows, Model Context Protocol (MCP), Graph/RAG...Long term contractPermanent employment
- ...Position Role Overview We are seeking a Technical Lead, Agentic AI Platforms to help shape and scale the next generation of AI-enabled... ...-in-the-loop controls. Define architecture patterns and engineering standards for AI-enabled applications built on AWS and/or Azure...Permanent employmentFull time2 days per week
$92k - $118k per year
...As an AI Security Engineer , you will work at the intersection of software engineering, cybersecurity, and artificial intelligence. You will... ...security risks across technologies such as Generative AI, RAG, and agentic systems. What You'll Do Design, build, and implement...InternshipImmediate start$132.69k - $182.69k per year
...primarily focuses on the design, review of AI Security architecture and as well as the... ...governance frameworks to monitor and control agentic behaviors. Participates in the security... ...-aware security culture across internal engineering and product teams. Knowledge/Skills/Competencies...Temporary workInternshipWork at officeLocal areaRemote workNight shift- ...Reference Number : R2868511 Position title : AI Engineer Department: Commercial Data Science Location: Toronto,ON ( Flexible... ...Design, develop, deploy, and support scalable Generative AI and Agentic AI solutions aligned with strategic priorities across Sanofi's...Work at officeWork from homeHome officeFlexible hours
- ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... ...functions. This is an exciting opportunity to work with cutting-edge agentic AI architectures, build scalable AI solutions, and collaborate...Full timeInternshipRemote workRelocation
$145k - $195k per year
Director AI Engineering Position Description CGI is Canada's largest independent information technology services firm, and after 50 years... ...to this role, including Forward Deployed Engineer / AI Co-op, Agentic AI Engineers, Founding AI Engineers, and the Distinguished AI...Work at office2 days per week$140k - $160k per year
...measurable employee engagement worldwide. And we'd love for you to join us! About the job - Applied AI Engineer Join the Engineering Team, where you'll help build our agentic future. You'll work alongside senior engineers, Product, and our Chief Product & Technology...Manual laborWork at officeWorldwide1 day per week$100k - $145k per year
...Job Description: What if the AI agents you help build empower legal professionals to act with sharper judgment and greater... ...Our agent platform team builds and ships using AI-native engineering practices: agentic coding tools that let a small, senior group move at a pace well...Full timeInternshipWork at officeLocal areaFlexible hours- ..., guiding the team to apply automation themselves vs handing to "QA/QE" to automate Participate in product... .... Apply advanced understanding of engineering best practices and drive continuous improvement across the team...Long term contractInternshipShift work
$140k - $175k per year
...What if the AI agents you architect empower legal professionals to act with sharper judgment and greater leverage, using tools... ...Our agent platform team builds and ships using AI-native engineering practices: agentic coding tools that let a small, senior group move at a pace well...Full timeInternshipWork at officeLocal areaFlexible hoursShift work$175k - $210k per year
...Overview: Guidepoint is investing in applied AI across its research platform. We're... ...proprietary datasets. You'll be an early engineer on a new initiative: taking working... ...media infrastructure. LLM orchestration: agentic systems that pursue goals over multi-turn...Full timeInternshipWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Agentic AI QA Engineer. Be the first to apply!
Related searches
- software quality assurance engineer Toronto, ON
- senior quality assurance engineer Toronto, ON
- qa engineer Toronto, ON
- software test engineer Toronto, ON
- td qa Toronto, ON
- remote qa Toronto, ON
- assurance qualite pharmaceutique Toronto, ON
- remote quality assurance Toronto, ON
- coordonnateur assurance qualité Toronto, ON
- quality assurance auditor Toronto, ON