Quality Engineer / Sdet - Ai Chatbot Validation

Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.
TCS has been serving the Canadian marketplace for more than 35 years and today is the technology partner of choice for many of the country's leading organizations. As one of the largest IT services providers in Canada and globally, TCS is aiming to become the world's largest AI-led technology services company and is enabling its clients to transform themselves across the full AI stack, from infrastructure to intelligence.
Rooted in the heritage and values of the Tata Group, TCS is focused on creating long‑term value for its clients, investors, employees, and the communities it serves. With a highly skilled workforce supporting customers from coast to coast, TCS has consistently been recognized as a Top Employer by the Top Employers Institute, including a recent top ranking at the country level.
TCS also sponsors 14 of the world's most prestigious marathons and endurance events, including the TCS Toronto Waterfront Marathon, reflecting its commitment to health, sustainability, and community empowerment.
Validate chatbot responses for accuracy, relevance, completeness, and consistency.
Create and execute test scenarios, test cases, and regression test suites.
Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
Perform chatbot conversation analysis and recommend quality improvements.
Develop and maintain test automation for chatbot validation where possible.
Work closely with developers, AI engineers, and content teams to resolve defects.
Track, document, and report defects, test results, and quality metrics.
Support UAT, release validation, and production quality monitoring.
Key Skillsets
Strong demonstrated experience in QA, SDET, or test automation.
Experience testing AI, LLM, GenAI, chatbots, virtual assistants, or conversational platforms.
Knowledge of prompt engineering concepts.
Experience with Jira, Confluence, GitHub, and Agile delivery.
Experience with API testing and automation frameworks.
Strong analytical and troubleshooting skills.
Experience with Python, Selenium, Playwright, PyTest, or similar tools.
Strong communication and documentation skills.
Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodation during the recruitment and selection process, please inform Human Resources.
Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.
#J-18808-Ljbffr