Ai Quality Engineer - Test Automation Expert
Centraprise
Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Quality Engineer - Test Automation Expert in Winnipeg, MB vacancy
- ...a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow... ...Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi... ...owners and business subject matter experts to identify critical workflows, realistic...Suggested
- ...Senior Automation Engineer (Project Manager) Saguenay-Lac-Saint-Jean, QC, Canada Type of position... ...from BBA’s network of recognized experts to support you in completing mandates and... ...technical and commercial proposals Do your qualities and values match our corporate culture?...SuggestedLong term contractTemporary workWork at officeLocal area
- ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have... .... Our convenient Price Café offers free Tea and Coffee! Engineering Automation Designer Price is a forward-thinking organization specializing...SuggestedFull time
- ...SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing quality for electrical... .... Key Responsibilities Failure Analysis and Testing Test customer-returned and internally non-conforming products...SuggestedPermanent employment
- ...largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients... ...looking for experienced Test Automation Specialists who are passionate about modern engineering practices and excited about how...SuggestedInternship
PLATO
Winnipeg, MB1 hour ago - ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly aluminum castings. The role requires close collaboration with suppliers, frequent onsite visits, and active involvement in...
- ...a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow... .... Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real business problems...
- ...Specialist, Instrumentation and Automation is responsible for the... ...role serves as a subject matter expert (SME), providing technical support... ...of production, laboratory, and test equipment. • Ensure work is... ...in compliance with procedures, quality standards, and regulatory...Work at officeFlexible hoursNight shiftRotating shiftAfternoon shift
- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to... ...conversational experiences, and AI-powered automation across multiple business functions. This... ...of software engineering best practices, testing, debugging, and performance optimization...Full timeInternshipRemote workRelocation
- ...doors to new opportunities and growth. THE POSITION The Quality Engineer leads the development, implementation, and continuous... ...customer and regulatory requirements. Support the integration of automated quality inspection systems to optimize inspection processes...Full timeRemote work
- Software quality and test automation define this remote-first Quality Engineer role at StackAdapt, open to candidates anywhere in Canada.StackAdapt seeks a Quality Engineer for a cross-functional agile environment supporting successful product releases. You will build reliable...Remote work
StackAdapt Inc.
Winnipeg, MB1 hour ago - ...on-the-job training and team of experts mean you’ll be set up for... ...and product efficiency. As a Quality Inspector , you will ensure that all aircraft components, engines, and systems are maintained, repaired... ...performance of any functional tests performed to verify safe...Long term contractTemporary workTraineeshipInternshipImmediate startFlexible hoursShift workWeekend work
- ...successful career in materials testing and inspection services by... ...that’s rock solid. We perform quality assurance and quality control... ...the boundaries as leaders and experts in our field and encourage our... ...experienced technologists and engineers. Your Capabilities and Credentials...For contractorsFlexible hoursWeekend work
- Use AI-assisted coding and testing tools at 360training to create reliable automation for applications, APIs, integrations, and business workflows.This QA Automation Engineer develops and maintains automated testing across the software development and deployment process. You...
360training
Winnipeg, MB1 hour ago - Turn AI-assisted testing into dependable quality checks at 360training, using automation frameworks, test analysis, and software quality expertise.This QA Automation Engineer role develops and maintains automated coverage for web applications, APIs, integrations, and end-to...
360training
Winnipeg, MB1 hour ago - Take on a pivotal role as an AI Quality Assurance and Testing Engineer, focusing on the assessment of machine learning and generative AI models. Ensure high standards of quality, bias assessment, and responsible AI practices across applications. In this short-term contract...Temporary work
Infotek Consulting Inc.
Winnipeg, MB1 hour ago - Build AI-augmented testing for Citi’s Front Office Trading platform using Java, Selenium, Playwright, and modern artificial intelligence techniques.This experienced Automation Engineer develops scalable UI and API automation frameworks within Technology Applications Development...
Citi Group
Winnipeg, MB1 hour ago - ...commitment to people. Our dependable quality, reliable delivery, and... ...free Tea and Coffee. Automation and Controls Specialist - GRD... ...member of the Manufacturing Engineering Team, the Automation and Controls... ...Continuously learning and becoming an expert in problem solving,...Remplacement
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated...
CrowdStrike Inc.
Winnipeg, MB1 hour ago - ...Summary Reporting to the Sr. Director, Quality, the Director, Quality Assurance leads QA... ..., and finished products; review of test results; evaluation of batch and production... ...Bachelor’s degree in Science, Pharmacy, Engineering, or a related field. An advanced degree is...Flexible hours
- Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance...Remote work
CrowdStrike Inc.
Winnipeg, MB1 hour ago - ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
- ...Jonas Software in Canada is seeking an Automation Engineer to advance CORA Loyalty’s quality engineering and software delivery through scalable test automation, AI-enabled quality practices, and robust testing frameworks. You will collaborate with Software Engineering,...Remote work
Jonas Software
Winnipeg, MB1 hour ago - ...protecting and saving lives. Job Summary The Specialist I, Quality Compliance is responsible for supporting and representing Emergent... ..., and regulatory trends, serving as a compliance subject matter expert for the site. • Provide compliance assessments, recommendations...Flexible hours
- ...StackAdapt is hiring a Staff Quality Engineer to lead the quality strategy for AI/agentic systems. You will design evaluation frameworks for non-deterministic AI, build scalable automated test suites, and set quality benchmarks across CI/CD pipelines. You’ll mentor QE teams...Remote work
Devconnectplatform
Winnipeg, MB1 hour ago - Build smarter Playwright tests with GitHub Copilot, CodeGen, and MCP tools in Veriday Inc.'s remote Senior Automation Engineer contract.This six-month Canadian engagement, potentially extendable... ...CI/CD pipelines. The role also evaluates AI tooling for test plans and work items.Key...Contract workRemote work
Veriday
Winnipeg, MB1 hour ago - ...RBC is seeking a Lead Data Quality Engineer to create and execute comprehensive data testing strategies across platforms and ETL processes. You will mentor teams, validate data integrity, and drive governance-aligned test data solutions in a financial services setting. You...
ODAIA
Winnipeg, MB1 hour ago - Quality Engineer Job Summary Reporting directly to the Quality Assurance Manager, Quality Engineer performs execution of Quality Engineering systems including; handling of nonconforming materials, Corrective/Preventive Actions, failure reporting, analysis and corrective action...Full time
Linamar Corporation
Winnipeg, MB12 days ago - AI-driven test automation defines this Test Automation Specialist role at PLATO, focused on scalable frameworks, modern engineering, and practical AI applications.PLATO seeks experienced Test Automation Specialists with five-plus years in testing, automation, development, or...
PLATO
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Quality Engineer - Test Automation Expert. Be the first to apply!
Related searches
- quality engineer Winnipeg, MB
- ingénieur qualité Winnipeg, MB
- technicien qualité Winnipeg, MB
- quality engineer manufacturing Winnipeg, MB
- quality engineer- qms Winnipeg, MB
- entry level quality engineer Winnipeg, MB
- test automation specialist Winnipeg, MB
- automation application engineer Winnipeg, MB
- control and automation engineer Winnipeg, MB
- electrical automation engineer Winnipeg, MB