Bilingual QA Automation Engineer - AI/IVR

About the Job: The QA
Engineer is responsible for end-to-end test coverage across manual and
AI-driven automated testing. This role requires the ability to design and
execute traditional manual test cases as well as build and prompt AI agents to
autonomously generate and execute test cases, making AI-based test automation a
mandatory, hands-on skill rather than a nice-to-have.

Office Location: Toronto

Employment Type: Permanent

Role Type: New position – current requirement

Work Arrangement: Hybrid (2 days in office)

Position Responsibilities:

• Analyze requirements/user stories and design
comprehensive manual test cases (functional, regression, integration, UAT, edge
cases).

• Execute manual test cases, log results, and
track defects through resolution.

• Design and configure AI agents (e.g., via prompt
engineering / agentic AI test tools) to autonomously generate test cases from
requirements or application context.

• Prompt and direct AI agents to execute generated
test cases, validate outcomes, and interpret AI-produced results.

• Continuously refine prompts/agent configurations
to improve accuracy, coverage, and reliability of AI-generated tests.

• Perform regression testing (manual and
AI-assisted) to ensure new releases don’t break existing functionality.

• Maintain traceability between requirements, test
cases, and defects.

• Log, triage, and track defects in tools such as
JIRA/Azure DevOps; work with developers to verify fixes.

• Prepare test summary reports, coverage metrics,
and quality sign-off documentation for releases.

• Collaborate with developers, product owners, and
DevOps to align testing with release/deployment schedules.

• Evaluate and recommend AI testing
tools/frameworks to expand automation coverage over time.

• On-call/off-hours testing flexibility — IVR
changes often deploy during low-traffic windows (nights/weekends)

Requirements

Required Qualifications:

•5–7 years of hands-on QA experience with hands-on
experience creating and prompting AI agents to generate and execute test cases
(AI-driven test automation).

• Must be proficient in Java, node JS, automation
frameworks and Test Design Patterns (Page Object Model, Factory, Singleton,
BDD)

• Strong manual testing fundamentals: test
plan/test case design, exploratory testing, bug reporting.

• IVR/telephony testing experience —
testing call flows, voice menus, DTMF (touch-tone) input, call routing,
transfers, hold/voicemail scenarios.

• Familiarity with IVR/telephony platforms — e.g., Avaya, Genesys, Nuance, Twilio, Five9, NICE inContact (pick whichever
your stack actually uses).

• Conversational fluency in French (spoken) — testers must be able to interact directly with the French-language voice bot
(IVR) and chat bot to validate prompts, natural language understanding,
call/chat flows, and response accuracy. French is mainly required for live
interaction/testing purposes.

• Understanding of prompt engineering concepts as
applied to test generation and execution workflows.

• Familiarity with defect tracking and test
management tools (JIRA, Azure DevOps, TestRail, or similar).

• Working knowledge of SDLC/Agile methodologies.

• Basic SQL skills for data validation.

• Ability to read logs/API responses to validate
results from AI-executed tests.

Preferred Qualifications:

• Experience with traditional automation
frameworks (Selenium, Playwright, Cypress)

• Exposure to API testing (Postman, REST Assured).

• Experience testing applications deployed on GCP
(or any cloud , GCP is preference)

• ISTQB or equivalent QA certification.

Benefits

Salary Range: $85,000 to $90,000 CAD/ year

The final compensation offered will depend on local market
conditions and geographic location, as well as job-related factors such as the
candidate’s knowledge, skills, qualifications, relevant experience, and
education/training. Compensation may also include additional components such as
benefits, and/or other incentives, where applicable. In accordance with new
employment standards requirements, we retain copies of this job posting and
applicant information for three (3) years after the posting is removed. We do
not use AI technology; all applications are also reviewed by our recruitment
team.

Infoya is an equal opportunity employer committed to
diversity and inclusion. We welcome applications from all qualified
individuals, regardless of race, color, religion, sex, sexual orientation,
gender identity, national origin, age, disability, protected veteran status, aboriginal
status, or any other legally protected factors.