Ai Test Automation Lead
$90k - $117k per yearCognizant Technology Solutions Corporation
As an Automation Test Lead, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices across complex insurance and retirement systems.
In this role, you will
Create and maintain test cases for prompt-driven applications, AI agents, RAG systems, and workflow orchestration platforms
Design, build, and maintain automated test frameworks for AI applications and services
Develop automated evaluation pipelines to assess AI responses, workflows, and model behavior
Drive automation-first quality strategy and lead automation solutions across programs.
Design scalable automation architectures spanning UI, API, Mobile, and Database layers.
Develop and implement GenAI-powered solutions for automated test design, code generation, execution, and defect analysis.
Test AI agents, copilots, APIs, workflow engines, MCP integrations, and tool-calling capabilities
Leverage AI and ML tools to enhance test coverage, improve efficiency, and reduce regression cycles.
Leverage GitHub Copilot and Claude to enable AI-assisted automation and enforce CI/CD quality gates.
Integrate automated AI and regression test suites into CI/CD pipelines to support continuous integration and rapid model updates.
Collaborate with cross-functional teams and mentor engineers on GenAI, Agentic AI, automation, model deployment, and AI safety best practices.
Work model
We believe hybrid work is the way forward as we strive to provide flexibility wherever possible.
Based on this role’s business requirements, this is a hybrid position requiring 3 days a week in a client or Cognizant office in Toronto or Kitchener location.
Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.
Note:
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured;
we will always be clearabout role expectations.
Key Skills:
Test Automation Architecture | GenAI & LLMs | GitHub Copilot | CI/CD & DevOps | Quality Analytics | Strong communication, presentation skills | Stakeholder Management
What you need to have to be considered
10+ years of Quality Engineering experience covering functional, API, integration, and automation testing with a dedicated focus on AI testing and validation.
3+ years in AI/ML systems testing;
expert proficiency in AI/ML testing frameworks, MLOps, CI/CD integration, and programming (Python, Java);
Hands-on GitHub Copilot and Claude experience to enable AI-assisted automation and enforce CI/CD quality gates.
Hands-on experience with AI platforms and prompt engineering.
Ability to work independently, have the capability to lead a team and engage with senior business and technology stakeholders.
These will help you stand out
Exposure to Life Insurance, Retirement domain
Total compensation
We regularly assess market data to ensure we offer a competitive compensation package for our associates. The base salary for this position ranges between CAD 90,000-117,000 per year. Where the successful candidate may fall within the range depends on relevant education, work and/or management experience and other business-related and job-necessary qualifications. This position is also eligible for Cognizant’s discretionary annual performance-based bonus, as well as benefits that support your physical, mental and financial wellbeing.
#J-18808-Ljbffr
In this role, you will
Create and maintain test cases for prompt-driven applications, AI agents, RAG systems, and workflow orchestration platforms
Design, build, and maintain automated test frameworks for AI applications and services
Develop automated evaluation pipelines to assess AI responses, workflows, and model behavior
Drive automation-first quality strategy and lead automation solutions across programs.
Design scalable automation architectures spanning UI, API, Mobile, and Database layers.
Develop and implement GenAI-powered solutions for automated test design, code generation, execution, and defect analysis.
Test AI agents, copilots, APIs, workflow engines, MCP integrations, and tool-calling capabilities
Leverage AI and ML tools to enhance test coverage, improve efficiency, and reduce regression cycles.
Leverage GitHub Copilot and Claude to enable AI-assisted automation and enforce CI/CD quality gates.
Integrate automated AI and regression test suites into CI/CD pipelines to support continuous integration and rapid model updates.
Collaborate with cross-functional teams and mentor engineers on GenAI, Agentic AI, automation, model deployment, and AI safety best practices.
Work model
We believe hybrid work is the way forward as we strive to provide flexibility wherever possible.
Based on this role’s business requirements, this is a hybrid position requiring 3 days a week in a client or Cognizant office in Toronto or Kitchener location.
Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.
Note:
The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured;
we will always be clearabout role expectations.
Key Skills:
Test Automation Architecture | GenAI & LLMs | GitHub Copilot | CI/CD & DevOps | Quality Analytics | Strong communication, presentation skills | Stakeholder Management
What you need to have to be considered
10+ years of Quality Engineering experience covering functional, API, integration, and automation testing with a dedicated focus on AI testing and validation.
3+ years in AI/ML systems testing;
expert proficiency in AI/ML testing frameworks, MLOps, CI/CD integration, and programming (Python, Java);
Hands-on GitHub Copilot and Claude experience to enable AI-assisted automation and enforce CI/CD quality gates.
Hands-on experience with AI platforms and prompt engineering.
Ability to work independently, have the capability to lead a team and engage with senior business and technology stakeholders.
These will help you stand out
Exposure to Life Insurance, Retirement domain
Total compensation
We regularly assess market data to ensure we offer a competitive compensation package for our associates. The base salary for this position ranges between CAD 90,000-117,000 per year. Where the successful candidate may fall within the range depends on relevant education, work and/or management experience and other business-related and job-necessary qualifications. This position is also eligible for Cognizant’s discretionary annual performance-based bonus, as well as benefits that support your physical, mental and financial wellbeing.
#J-18808-Ljbffr
Vacancy posted 39 minutes ago
Similar jobs that could be interesting for youBased on the Ai Test Automation Lead in Winnipeg, MB vacancy
- ...Price Industries Limited, North America’s leading manufacturer and distributor of air... ...follow-up service have made Price a market leader in supplying air distribution, critical... ...Price Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP •...Suggested
- Join Cognizant as an AI Testing Automation Lead and play a crucial role in developing quality engineering solutions for AI-powered applications in a hybrid setting. This position focuses on CI/CD integrations and robust testing strategies. You'll be responsible for leading test...Suggested
- Iris Software Inc. is seeking an experienced QA Automation Lead (Playwright) to drive quality across web and enterprise applications... ...Playwright, strong background in UI/API/end-to-end testing, and a track record of applying AI-driven testing techniques to boost coverage and...Suggested
- ...Description Reporting to the Director, BSS Release Testing & Ops, the Job Title is responsible for leading quality automation initiatives by defining automation strategy,... ...integrating quality into CI/CD pipelines, and leveraging AI-assisted capabilities to improve software quality...SuggestedInternship
- Iris's Direct client, a highly diversified financial services provider based in Canada is looking to hire a Test Automation Lead f or a Long Term Contract / Full Time opportunity. Location: Hybrid Toronto – 3 days onsiteJOB DESCRIPTION Seeking a hands-on...SuggestedLong term contractFull timeWork at office
- Skills: Automation Testing, Selenium WebDriver, CI/CD IntegrationLooking for a Senior Automation Test Lead with 10 years of expertise to architect and manage comprehensive, end to end automation solutions for complex web and mobile applications across diverse domains, including...Flexible hours
- ...Litmus is seeking a QA Architect to own test automation and quality for Litmus Edge Manager (LEM). You will build a modern Playwright framework... ...collaborates with global teams to ensure scalable, reliable testing as Litmus scales its industrial AI platform. #J-18808-Ljbffr
- Centrilogic is seeking a QA Team Lead to oversee the QA workstream on client engagements, defining the test approach and leading a team of QA practitioners. You will... ...functional, regression, and UAT testing, and drive automation and AI-enabled QA initiatives. You will work with...
$90k - $113k per year
We are seeking an experienced Playwright Automation Test Lead with strong expertise in designing, developing scalable, cross-browser test frameworks... ...; strong facilitation andmentoring skills.Experience with AI-assisted/agentic testing tooling.NuGet or equivalent package...Remote work- AI-driven test automation defines this Test Automation Specialist role at PLATO, focused on scalable frameworks, modern engineering, and practical AI applications.PLATO seeks experienced Test Automation Specialists with five-plus years in testing, automation, development, or...
- ...We are seeking a highly skilled and self-motivated Senior AI Test Automation Engineer to join our Quality Engineering team. The ideal candidate... ...datasets and high-volume transactional systems. Experience leading or supporting AI transformation initiatives within Quality Engineering...
- O2E Brands in Vancouver is seeking a Test Automation Architect to design, scale, and maintain automated testing frameworks, incorporating AI to optimize test generation and self-healing... ...quality products across environments. You will lead cross-functional QA standards, mentor...
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated...
- ...safety record, having flown an industry leading 130,000+ hours of operational training without... ...!Join our team!Position Summary The AI and Automation Leader establishes and leads Top Aces'... ...Lead the design, development, testing, deployment, monitoring, support, and continuous...Long term contractContract workLocal areaWorldwideFlexible hours
- ## AI Automation LeadDSEL##### OverviewDSEL is looking for a dynamic and driven professional to lead the deployment of artificial intelligence across our organization.As our AI Automation... ...and business processes* Rapidly prototype, test, and deploy AI-powered tools that solve...Permanent employmentFull timeRemote work
- Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions.This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain...Full timeRemote work
- AI test automation and software quality define this hands-on specialist role at PLATO, supporting modern engineering practices across Canada’s 100% Canada-based team.PLATO seeks experienced Test Automation Specialists with five or more years in testing, automation, development...
- Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance...Remote work
- PLATO is Canada’s largest Indigenous-owned software testing and technology services company seeking experienced Test Automation Specialists. You will design and build scalable... ...Python, Java, JavaScript, and PySpark, and apply AI tools to improve testing and productivity. Join a...
- Build AI test automation with Java or Python as a Senior Quality Engineer focused on prompt behavior, accuracy, and reliable releases.This senior position requires five-plus years in quality engineering, quality assurance, test automation, or software development. You will create...
- Lead automated testing across applications with Worksoft Automation and JavaScript in Edmonton, with a hybrid option in Calgary. Support a contract expected to last approximately one year.This Automated QA Analyst assignment suits an experienced testing professional with seven...Contract work
- Lead test automation for Tata Consultancy Services with expertise in Selenium, Cypress, Playwright, and API testing. Support AWS cloud environments.This QA Lead role directs quality assurance across complex enterprise applications. You will define test strategies, build scalable...
- Test Automation LeadEnterprise Systems - IFS ERP - Multi-site ManufacturingROLE PURPOSE Build and lead a pragmatic test automation and performance assurance program that improves the reliability of enterprise systems while reducing the cost and effort of repetitive...
- What is the opportunity. We’re seeking an experienced QA Lead who can balance hands‑on technical excellence with team leadership. This role combines active testing on AI and alternate data, automation, and mentoring a team of QA engineers. You’ll drive quality initiatives,...Worldwide
- Talent Acquisition Associate @Integriti | Connecting leading experts with Fortune 500 clientsContract-to-Hire | Initial Duration... ...6 Months About the RoleWe are seeking an experienced Lead QA Engineer (Test Automation) to join our Fortune 500 client’s Team in North York,...Long term contractFull timeContract workRemote work2 days per week3 days per week
- ...specifically wires and ACH payments along with automation experience.Qualifications 8 to 10 years of functional and automation testing experienceHands on Knowledge of using Postman... ..., Wires- Fedwire ISO knowledge)Ability to Lead the testing team across geographyAbility to estimate...Work at office
- Lead and define qualityengineering and test strategy across Agile delivery teams Design, implement, and maintainautomated testing frameworks Coach and... ...teams Strong hands-on experience withtest automation tools and frameworks Experience working in Agile/Scrumdelivery...
- Lead intelligent automation and AI development at OpenText, using advanced Python to improve IT operations, reliability, and operational efficiency.This... ...includes technical leadership, engineering standards, testing, and mentoring developers.Key Responsibilities: Develop...
- Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks.This Senior Quality Engineer... ...exploratory, automated, and AI-focused testing. You will define test strategies, create evaluation...
- CrowdStrike Canada ULC is seeking an experienced SDET to define how AI agents are tested, evaluated and trusted in production. You will build and maintain automated test suites for a cloud-based cybersecurity platform, extend agentic tooling, and ensure robust test coverage...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Test Automation Lead. Be the first to apply!
Related searches

