Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Quality Engineer - Test Automation Expert

Centraprise

Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities: - Build and maintain automated tests for AI workflows and behaviors - Test multi-turn scenarios, scripts, and approval checks - Collaborate with engineering to define quality metrics - Debug quality issues by tracing requests and logs - Identify risks and document testing processes
Requirements: - 4+ years in QA engineering or similar hands-on roles - Strong skills in Python for production-quality tests - Experience with testing LLMs and AI systems - Familiarity with pytest or similar testing frameworks - Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Quality Engineer - Test Automation Expert in Winnipeg, MB vacancy
  •  ...a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow...  ...Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi...  ...owners and business subject matter experts to identify critical workflows, realistic... 
    Suggested

    Price Industries Limited

    Winnipeg, MB
    7 days ago
  •  ...Senior Automation Engineer (Project Manager) Saguenay-Lac-Saint-Jean, QC, Canada Type of position...  ...from BBA’s network of recognized experts to support you in completing mandates and...  ...technical and commercial proposals Do your qualities and values match our corporate culture?... 
    Suggested
    Long term contract
    Temporary work
    Work at office
    Local area

    BBA Consultants

    Winnipeg, MB
    7 days ago
  •  ...service, innovation and a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow-up service have...  .... Our convenient Price Café offers free Tea and Coffee! Engineering Automation Designer Price is a forward-thinking organization specializing... 
    Suggested
    Full time

    PRICE INDUSTRIES LIMITED

    Winnipeg, MB
    6 days ago
  •  ...SKF at. Position Overview We are seeking a skilled Quality Electrical Engineer to support customer and manufacturing quality for electrical...  .... Key Responsibilities Failure Analysis and Testing Test customer-returned and internally non-conforming products... 
    Suggested
    Permanent employment

    SKF Group

    Winnipeg, MB
    7 days ago
  •  ...largest Indigenous-owned software testing and technology services company. For nearly 30 years, our expert teams have helped our clients...  ...who are passionate about quality, teamwork, and making an impact...  ...looking for experienced Test Automation Specialists who are... 
    Suggested
    Internship

    PLATO

    Winnipeg, MB
    1 hour ago
  •  ...We are seeking a highly experienced and hands-on Supplier Quality Engineer (SQE) with strong expertise in casting and machining processes, particularly aluminum castings. The role requires close collaboration with suppliers, frequent onsite visits, and active involvement in... 

    Global Connect Technologies

    Winnipeg, MB
    7 days ago
  • Join as a Senior Automation Engineer, focused on enhancing testing precision and efficiency. Drive quality in testing processes and collaborate with teams to implement cutting-edge automation strategies. This position is ideal for a highly skilled QA professional with a... 

    Synechron

    Winnipeg, MB
    1 hour ago
  •  ...a commitment to people. Our dependable quality, reliable delivery, and knowledgeable follow...  .... Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents, and automation solutions that solve real business problems... 

    Price Industries Limited

    Winnipeg, MB
    7 days ago
  •  ...Specialist, Instrumentation and Automation is responsible for the...  ...role serves as a subject matter expert (SME), providing technical support...  ...of production, laboratory, and test equipment. • Ensure work is...  ...in compliance with procedures, quality standards, and regulatory... 
    Work at office
    Flexible hours
    Night shift
    Rotating shift
    Afternoon shift

    Emergent Biosolutions

    Winnipeg, MB
    6 days ago
  •  ...doors to new opportunities and growth.  THE POSITION   The  Quality Engineer  leads the development, implementation, and continuous...  ...customer and regulatory requirements.  Support the integration of automated quality inspection systems to optimize inspection processes... 
    Full time
    Remote work

    Smartrend Manufacturing Group

    Winnipeg, MB
    16 days ago
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to...  ...conversational experiences, and AI-powered automation across multiple business functions. This...  ...of software engineering best practices, testing, debugging, and performance optimization... 
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    6 days ago
  •  ...define qualityengineering and test strategy across Agile...  ...Developers, and Scrum teams to ensure quality delivery Ensure quality...  ...experience insoftware testing/quality engineering Proven experience leading...  ...hands-on experience withtest automation tools and frameworks... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • Software quality and test automation define this remote-first Quality Engineer role at StackAdapt, open to candidates anywhere in Canada.StackAdapt seeks a Quality Engineer for a cross-functional agile environment supporting successful product releases. You will build reliable... 
    Remote work

    StackAdapt Inc.

    Winnipeg, MB
    1 hour ago
  • Senior Quality Engineer – Test Automation, AI Testing & Java/PythonQuality Engineer– Test Automation, Java/Python & GenAI Roles and Responsibilities: Partner with DevOps,Development, Product, andQE teams todesign and executeexploratory, automated,and AI-focusedtests that... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...on-the-job training and team of experts mean you’ll be set up for...  ...and product efficiency. As a Quality Inspector , you will ensure that all aircraft components, engines, and systems are maintained, repaired...  ...performance of any functional tests performed to verify safe... 
    Long term contract
    Temporary work
    Traineeship
    Internship
    Immediate start
    Flexible hours
    Shift work
    Weekend work

    StandardAero

    Winnipeg, MB
    12 days ago
  •  ...successful career in materials testing and inspection services by...  ...that’s rock solid. We perform quality assurance and quality control...  ...the boundaries as leaders and experts in our field and encourage our...  ...experienced technologists and engineers. Your Capabilities and Credentials... 
    For contractors
    Flexible hours
    Weekend work

    Stantec

    Winnipeg, MB
    7 days ago
  • Build AI test automation with Java or Python as a Senior Quality Engineer focused on prompt behavior, accuracy, and reliable releases.This senior position requires five-plus years in quality engineering, quality assurance, test automation, or software development. You will create... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...About the role We are seeking a highly skilled and self-motivated Senior AI Test Automation Engineer to join our Quality Engineering team. The ideal candidate will have extensive experience in test automation, database validation, AI-assisted testing, and modern quality... 

    PureFacts Financial Solutions

    Winnipeg, MB
    1 hour ago
  • Take on a pivotal role as an AI Quality Assurance and Testing Engineer, focusing on the assessment of machine learning and generative AI models. Ensure high standards of quality, bias assessment, and responsible AI practices across applications. In this short-term contract... 
    Temporary work

    Infotek Consulting Inc.

    Winnipeg, MB
    1 hour ago
  • Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated... 

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Summary   Reporting to the Sr. Director, Quality, the Director, Quality Assurance leads QA...  ..., and finished products; review of test results; evaluation of batch and production...  ...Bachelor’s degree in Science, Pharmacy, Engineering, or a related field. An advanced degree is... 
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    6 days ago
  • Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working remotely with Python and distributed systems.This hands-on role supports the Detonations and Threat Analysis Platform Engineering team. You will develop functional, integration, and performance... 
    Remote work

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  •  ...commitment to people. Our dependable quality, reliable delivery, and...  ...free Tea and Coffee. Automation and Controls Specialist - GRD...  ...member of the Manufacturing Engineering Team, the Automation and Controls...  ...Continuously learning and becoming an expert in problem solving,... 
    Remplacement

    Price Industries Limited

    Winnipeg, MB
    7 days ago
  • $90k - $117k per year

    As an Automation Test Lead, you will lead AI-powered Quality Engineering and test automation solutions, including developing testing strategies and frameworks, integrating testing into CI/CD pipelines, validating AI behavior and integrations, and promoting responsible AI practices... 
    Work at office
    3 days per week

    Cognizant Technology Solutions Corporation

    Winnipeg, MB
    1 hour ago
  •  ...Jonas Software in Canada is seeking an Automation Engineer to advance CORA Loyalty’s quality engineering and software delivery through scalable test automation, AI-enabled quality practices, and robust testing frameworks. You will collaborate with Software Engineering,... 
    Remote work

    Jonas Software

    Winnipeg, MB
    1 hour ago
  •  ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour... 

    Synechron

    Winnipeg, MB
    7 days ago
  • Excel as a Senior Test Automation Engineer at PureFacts, specializing in AI-driven testing methodologies in Toronto. Transform software quality and efficiency with AI technologies. In this role, you will join the Quality Engineering team to innovate and optimize testing strategies... 

    PureFacts Financial Solutions

    Winnipeg, MB
    1 hour ago
  • Lead AI chatbot validation through Java, Python, and scalable automation frameworks while partnering with DevOps teams on CI/CD quality checks.This Senior Quality Engineer / SDET role supports DevOps enablement by delivering exploratory, automated, and AI-focused testing. You... 

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software... 

    Talentola

    Winnipeg, MB
    7 days ago
  •  ...protecting and saving lives. Job Summary  The Specialist I, Quality Compliance is responsible for supporting and representing Emergent...  ..., and regulatory trends, serving as a compliance subject matter expert for the site. • Provide compliance assessments, recommendations... 
    Flexible hours

    Emergent Biosolutions

    Winnipeg, MB
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Quality Engineer - Test Automation Expert. Be the first to apply!