Ai Quality Engineer - Test Automation Expert
Centraprise
Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Quality Engineer - Test Automation Expert in Winnipeg, MB vacancy
- ...largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients... ...who are passionate about quality, teamwork, and making an impact... ...looking for experienced Test Automation Specialists who are...SuggestedInternship
- Software quality and test automation define this remote-first Quality Engineer role at StackAdapt, open to candidates anywhere in Canada.StackAdapt seeks a Quality Engineer for a cross-functional agile environment supporting successful product releases. You will build reliable...SuggestedRemote work
- Turn AI-assisted testing into dependable quality checks at 360training, using automation frameworks, test analysis, and software quality expertise.This QA Automation Engineer role develops and maintains automated coverage for web applications, APIs, integrations, and end-to...Suggested
- Build AI-augmented testing for Citi’s Front Office Trading platform using Java, Selenium, Playwright, and modern artificial intelligence techniques.This experienced Automation Engineer develops scalable UI and API automation frameworks within Technology Applications Development...Suggested
- Take on a pivotal role as an AI Quality Assurance and Testing Engineer, focusing on the assessment of machine learning and generative AI models. Ensure high standards of quality, bias assessment, and responsible AI practices across applications. In this short-term contract...SuggestedTemporary work
- Use AI-assisted coding and testing tools at 360training to create reliable automation for applications, APIs, integrations, and business workflows.This QA Automation Engineer develops and maintains automated testing across the software development and deployment process. You...
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated...
- Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance...Remote work
- ...a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow... ...Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi... ...owners and business subject matter experts to identify critical workflows, realistic...
- ...Jonas Software in Canada is seeking an Automation Engineer to advance CORA Loyalty’s quality engineering and software delivery through scalable test automation, AI-enabled quality practices, and robust testing frameworks. You will collaborate with Software Engineering,...Remote work
- ...StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines. You’ll mentor QE teams...Remote work
- ...RBC is seeking a Lead Data Quality Engineer to create and execute comprehensive data testing strategies across platforms and ETL processes. You will mentor teams, validate data integrity, and drive governance-aligned test data solutions in a financial services setting. You...
- Build smarter Playwright tests with GitHub Copilot, CodeGen, and MCP tools in Veriday Inc.'s remote Senior Automation Engineer contract.This six-month Canadian engagement, potentially extendable... ...CI/CD pipelines. The role also evaluates AI tooling for test plans and work items.Key...Contract workRemote work
- AI-driven test automation defines this Test Automation Specialist role at PLATO, focused on scalable frameworks, modern engineering, and practical AI applications.PLATO seeks experienced Test Automation Specialists with five-plus years in testing, automation, development, or...
- ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner...
- ...Time REPORTS TO: Supervisor, Software Quality Assurance DIRECT REPORTS: N/A... ...lead the development and maintenance of test automation frameworks and scripts for Guidewire and... .... Mentor and guide junior automation engineers. Conduct code reviews for automated test...Full timeWork at office
- Drive automation initiatives as a Quality Engineering Lead at POMS. This remote role focuses on enhancing test automation frameworks and leading a global QA team. POMS is seeking a hands-on Quality Engineering Lead to transform manual testing into automation-driven quality...Remote work
- Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions.This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain...Full timeRemote work
- Build manual and automated testing expertise at Island, using AI coding tools to support secure enterprise product quality. This position is with Island’s Quality Group engineering team.As a Test Development Engineer, you will design, implement, and run test scenarios for Island...
- Engineer Python automation for EA-SPORTS FC quality verification at Electronic Arts, integrating CI/CD diagnostics and machine learning. This is hybrid work in... ...Software Engineer III, you will build tools that expand test coverage and detect defects earlier. You will apply...
- ...We are seeking an experienced Software Development Engineer in Test (SDET) with strong expertise in test automation, Robot Framework, Selenium, Parasoft, and database testing. The candidate will support testing across multiple platforms and technologies throughout the software...
- 360training is seeking a QA Automation Engineer to develop and maintain automated testing across our software development and deployment processes. You will work with... ...into CI/CD pipelines, improving release speed and quality. You will leverage AI-assisted testing tools to...Remote work
- Upgrade is seeking a Senior QA Automation Developer to own the end-to-end quality of a new product. You will build automated tests and perform functional testing to ensure a seamless banking... ...using Java, Selenium/Playwright, and AI-assisted workflows. You will also deploy disposable...
- ...Ontinue, a leading AI-powered MXDR provider, is hiring a QA Automation Engineer in Canada to scale quality across a fast-moving engineering team. You’ll design automated tests for frontend, backend, and API flows using Playwright in TypeScript or C#, and coordinate release...
- ...leader in the marketplace. Learn more at flexera.ComWe are looking for an experienced Quality Engineer with a strong background in setting up, writing, and building functional automation tests for our cutting-edge IT Asset Management solutionThe ideal candidate will play a...
- Lead AI-powered test automation at Freedom, shaping quality engineering across large-scale programs with modern frameworks, CI/CD, and responsible AI practices.This senior Test Automation Lead drives automation-first quality strategies across Freedom programs. You will design...
$81.2k - $122k per year
Senior Automation Test Engineer – VancityVancity is a member‑owned credit union committed to inclusion and social justice. We are looking for a Senior... ...security, and other teams. Acting as a subject‑matter expert on QA, automating web applications (Selenium WebDriver,...Permanent employmentFull timeTemporary workWork at officeFlexible hours- AI test automation and software quality define this hands-on specialist role at PLATO, supporting modern engineering practices across Canada’s 100% Canada-based team.PLATO seeks experienced Test Automation Specialists with five or more years in testing, automation, development...
- ...largest Indigenous-owned software testing and technology services company seeking experienced Test Automation Specialists. You will design... ...JavaScript, and PySpark, and apply AI tools to improve testing and... ...improvement, delivering quality software for client projects across...
- Test manual and automated scenarios for Island’s enterprise workspace, using AI coding tools and agents to support quality delivery.As a Test Development Engineer on Island’s Quality Group engineering team, you will design, implement, and run tests. The work spans manual test...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Quality Engineer - Test Automation Expert. Be the first to apply!
Related searches
- quality engineer Winnipeg, MB
- ingénieur qualité Winnipeg, MB
- technicien qualité Winnipeg, MB
- quality engineer manufacturing Winnipeg, MB
- quality engineer- qms Winnipeg, MB
- entry level quality engineer Winnipeg, MB
- test automation specialist Winnipeg, MB
- automation application engineer Winnipeg, MB
- control and automation engineer Winnipeg, MB
- electrical automation engineer Winnipeg, MB

