Ai Quality Engineer - Test Automation Expert
Centraprise
Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Quality Engineer - Test Automation Expert in Winnipeg, MB vacancy
- ...largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients... ...who are passionate about quality, teamwork, and making an impact... ...looking for experienced Test Automation Specialists who are...SuggestedInternship
- Software quality and test automation define this remote-first Quality Engineer role at StackAdapt, open to candidates anywhere in Canada.StackAdapt seeks a Quality Engineer for a cross-functional agile environment supporting successful product releases. You will build reliable...SuggestedRemote work
- Take on a pivotal role as an AI Quality Assurance and Testing Engineer, focusing on the assessment of machine learning and generative AI models. Ensure high standards of quality, bias assessment, and responsible AI practices across applications. In this short-term contract...SuggestedTemporary work
- Turn AI-assisted testing into dependable quality checks at 360training, using automation frameworks, test analysis, and software quality expertise.This QA Automation Engineer role develops and maintains automated coverage for web applications, APIs, integrations, and end-to...Suggested
- Build AI-augmented testing for Citi’s Front Office Trading platform using Java, Selenium, Playwright, and modern artificial intelligence techniques.This experienced Automation Engineer develops scalable UI and API automation frameworks within Technology Applications Development...Suggested
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated...
- Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance...Remote work
- ...a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow... ...Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi... ...owners and business subject matter experts to identify critical workflows, realistic...
- ...Jonas Software in Canada is seeking an Automation Engineer to advance CORA Loyalty’s quality engineering and software delivery through scalable test automation, AI-enabled quality practices, and robust testing frameworks. You will collaborate with Software Engineering,...Remote work
- ...StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines. You’ll mentor QE teams...Remote work
- AI-driven test automation defines this Test Automation Specialist role at PLATO, focused on scalable frameworks, modern engineering, and practical AI applications.PLATO seeks experienced Test Automation Specialists with five-plus years in testing, automation, development, or...
- ...RBC is seeking a Lead Data Quality Engineer to create and execute comprehensive data testing strategies across platforms and ETL processes. You will mentor teams, validate data integrity, and drive governance-aligned test data solutions in a financial services setting. You...
- Build smarter Playwright tests with GitHub Copilot, CodeGen, and MCP tools in Veriday Inc.'s remote Senior Automation Engineer contract.This six-month Canadian engagement, potentially extendable... ...CI/CD pipelines. The role also evaluates AI tooling for test plans and work items.Key...Contract workRemote work
- ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner...
- ...Time REPORTS TO: Supervisor, Software Quality Assurance DIRECT REPORTS: N/A... ...lead the development and maintenance of test automation frameworks and scripts for Guidewire and... .... Mentor and guide junior automation engineers. Conduct code reviews for automated test...Full timeWork at office
- 360training is seeking a QA Automation Engineer to develop and maintain automated testing across our software development and deployment processes. You will work with... ...into CI/CD pipelines, improving release speed and quality. You will leverage AI-assisted testing tools to...Remote work
$81.2k - $122k per year
Senior Automation Test Engineer – VancityVancity is a member‑owned credit union committed to inclusion and social justice. We are looking for a Senior... ...security, and other teams. Acting as a subject‑matter expert on QA, automating web applications (Selenium WebDriver,...Permanent employmentFull timeTemporary workWork at officeFlexible hours- Drive automation initiatives as a Quality Engineering Lead at POMS. This remote role focuses on enhancing test automation frameworks and leading a global QA team. POMS is seeking a hands-on Quality Engineering Lead to transform manual testing into automation-driven quality...Remote work
- ...Ontinue, a leading AI-powered MXDR provider, is hiring a QA Automation Engineer in Canada to scale quality across a fast-moving engineering team. You’ll design automated tests for frontend, backend, and API flows using Playwright in TypeScript or C#, and coordinate release...
- Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform functional testing to ensure a seamless banking... ...using Java, Selenium/Playwright, and AI-assisted workflows. You will also deploy disposable...
- Engineer Python automation for EA-SPORTS FC quality verification at Electronic Arts, integrating CI/CD diagnostics and machine learning. This is hybrid work in... ...Software Engineer III, you will build tools that expand test coverage and detect defects earlier. You will apply...
- Lead AI-powered test automation at Freedom, shaping quality engineering across large-scale programs with modern frameworks, CI/CD, and responsible AI practices.This senior Test Automation Lead drives automation-first quality strategies across Freedom programs. You will design...
- Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions.This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain...Full timeRemote work
- AI test automation and software quality define this hands-on specialist role at PLATO, supporting modern engineering practices across Canada’s 100% Canada-based team.PLATO seeks experienced Test Automation Specialists with five or more years in testing, automation, development...
- Test manual and automated scenarios for Island’s enterprise workspace, using AI coding tools and agents to support quality delivery.As a Test Development Engineer on Island’s Quality Group engineering team, you will design, implement, and run tests. The work spans manual test...
- ...leader in the marketplace. Learn more at flexera.ComWe are looking for an experienced Quality Engineer with a strong background in setting up, writing, and building functional automation tests for our cutting-edge IT Asset Management solutionThe ideal candidate will play a...
- ...We are seeking an experienced Software Development Engineer in Test (SDET) with strong expertise in test automation, Robot Framework, Selenium, Parasoft, and database testing. The candidate will support testing across multiple platforms and technologies throughout the software...
- O2E Brands in Vancouver is seeking a Test Automation Architect to design, scale, and maintain automated testing frameworks, incorporating AI to optimize test generation and self-healing... ...time-to-market and ensures high-quality products across environments. You will lead...
- Build software quality at StackAdapt as a remote Senior Test Automation Engineer, using Playwright, API testing, and CI/CD automation across North America.This senior position supports product releases in a cross-functional agile environment. You will develop reliable automated...Remote work
- OverviewRole: Mobile Test Automation Engineer - Duration: 12 months - Location: Toronto - Work Style: Hybrid (4 days a week in office) Responsibilities... ...teams to define test strategy, acceptance criteria, and quality gates. Raise and track defects using JIRA with clear...Work at officeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Quality Engineer - Test Automation Expert. Be the first to apply!
Related searches
- quality engineer Winnipeg, MB
- ingénieur qualité Winnipeg, MB
- technicien qualité Winnipeg, MB
- quality engineer manufacturing Winnipeg, MB
- quality engineer- qms Winnipeg, MB
- entry level quality engineer Winnipeg, MB
- test automation specialist Winnipeg, MB
- automation application engineer Winnipeg, MB
- control and automation engineer Winnipeg, MB
- electrical automation engineer Winnipeg, MB

