Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Sdet Ai Evaluation And Performance Testing

CrowdStrike Canada ULC

Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike’s platform engineering team needs automation across functional, integration, and performance testing. You will also measure correctness, safety, latency, cost, tool use, and trajectory through eval-driven development.Key Responsibilities:
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Sdet Ai Evaluation And Performance Testing in Winnipeg, MB vacancy
  • Define reliable AI agent testing at CrowdStrike with Python and distributed systems expertise....  ...will create functional, integration, and performance automation for distributed systems. The...  ..., and AI scoring pipelinesEnforce CI evaluation gates before releasesDetect unreliable... 
    Performance

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management... 
    Performance
    Long term contract

    gov

    Winnipeg, MB
    7 days ago
  • CrowdStrike Canada ULC is seeking an experienced SDET to define how AI agents are tested, evaluated and trusted in production. You will build and maintain automated test suites for a cloud-based cybersecurity platform, extend agentic tooling, and ensure robust test coverage... 
    Suggested

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  •  ...hiring a remote, Canada-based Software Development Engineer in Test to support its Detonations and Threat Analysis Platform Engineering...  ...cloud cybersecurity platform and contributes to testing and evaluation of AI agents. The candidate will design and implement automated tests... 
    Suggested
    Remote work

    Skillhub Solutions Inc.

    Winnipeg, MB
    1 hour ago
  • Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development...  ...You will support functional, integration, performance, and end-to-end validation.Key... 
    Performance

    CrowdStrike Inc.

    Winnipeg, MB
    1 hour ago
  •  ...overall Quality Assurance strategy, testing frameworks, and global QA...  ...standards of reliability, performance, and security. Ce que vous...  ...deployment security. Drive test planning, execution strategy,...  ..., Tableau, Jira Dashboards AI tooling: Claude, Codex... Qualifications... 
    Performance
    Shift work

    Simpro Software Canada ULC

    Winnipeg, MB
    7 days ago
  •  ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner... 
    Performance

    Rootly

    Winnipeg, MB
    1 hour ago
  • Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint...  ...critical utility software workflows.As a Senior SDET, you will create automation foundations...  ...risk-based prioritization. You will also evaluate AI-assisted tools for test generation,... 

    SpryPoint Services Inc.

    Winnipeg, MB
    1 hour ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...As senior software development engineer in Test, we are looking for a candidate who can make...  ...of high availability, failure scenarios, performance, stress and security. Champion cluster... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Senior Software Development Engineer in Test (Sr. SDET) to join our Engineering team. In this...  ...products meet the highest standards of performance and reliability for thousands of security...  ...feedback to peers. - Research and evaluate new testing tools, methodologies, and emerging... 
    Performance
    Long term contract
    Work at office
    Local area
    Remote work
    Work from home
    Worldwide
    Flexible hours

    Trackforce

    Winnipeg, MB
    1 hour ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...Senior Software Development Engineer in Test (SDET) to join the Release Integration Testing...  ...Investigate and debug complex cross-stack failures, perform root cause analysis, collaborate with... 
    Performance
    Work at office
    Remote work
    3 days per week

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Canada, this Software Development Engineer in Test role centers on full-stack automation,...  ...engineering, and reliable releases for Joist.As an SDET at EverPro, you will support Joist,...  ...agile product development. The work includes AI-assisted quality practices and fast feedback... 
    For contractors
    Remote work

    Joist Software Inc.

    Winnipeg, MB
    1 hour ago
  •  ...senior Software Development Engineer in Test role requires eight to twelve years of...  ...spans APIs, user interfaces, databases, performance, messaging, and AI-assisted testing.Key Responsibilities:...  ...governance and technical direction to global SDET teamsRequirements: Bachelor’s degree... 
    Performance
    Contract work
    Remote work

    Rose International

    Winnipeg, MB
    1 hour ago
  •  ...the Americas.We are looking for a Senior SDET to help build our test automation from the ground up. You will...  ...confidence to ship, and bring modern AI‑assisted tooling into how we work. This...  ...trustworthy, so failures mean something Evaluate and apply AI‑assisted testing tools (... 
    Performance
    Internship

    SpryPoint Services Inc.

    Winnipeg, MB
    1 hour ago
  • Build scalable test automation for Joist with Playwright, Appium, and BrowserStack while working...  ..., and API layers using modern frameworks, AI tools, and detailed debugging. The work...  ...teamRequirements: Five to seven years in SDET rolesExperience with BrowserStack,... 
    For contractors
    Remote work

    Joist

    Winnipeg, MB
    1 hour ago
  • Nous sommes à la recherche d'un(e) Senior SDET / Software Engineer in Test possédant une solide expertise en Java , Spring Boot et en...  ...applications Cloud-native . Expérience en tests de performance et de fiabilité . Expérience en Infrastructure as... 
    Performance
    1 day per week

    Highspring

    Winnipeg, MB
    1 hour ago
  •  ...Nous sommes à la recherche d’un(e) développeur(euse) logiciel en test (SDET) pour se joindre à notre équipe Video Systems Test. Dans ce...  ...améliorerez notre infrastructure de test et contribuerez à valider les performances, l’évolutivité et la fiabilité de nos systèmes vidéo. Le... 
    Performance
    Flexible hours

    Genetec Inc.

    Winnipeg, MB
    1 hour ago
  •  ...EXFO Inc. recherche un ingénieur en développement logiciel de tests (SDET) avec 5 à 7 ans d’expérience pour concevoir et faire évoluer les capacités de tests automatisés utilisées par nos plateformes de surveillance de la fibre et de visibilité réseau. Vous travaillerez... 

    EXFO

    Winnipeg, MB
    1 hour ago
  • Lead automation testing with Selenium, Parasoft, and Robot Framework in a senior SDET role requiring six-plus years of experience.This SDET position focuses on automating tests across platforms and technologies throughout the full development lifecycle. Apply expertise in C#... 

    Qwalton Private Limited

    Winnipeg, MB
    1 hour ago
  • Build software quality through test automation and CI/CD engineering as a Senior SDET in Calgary, working in a hybrid model.Reporting to the Software Development Manager, this senior engineering role develops maintainable automation across APIs, integrations, and web applications... 
    Contract work

    Hrblock

    Winnipeg, MB
    1 hour ago
  •  ...Technologies, Inc., we are building the next generation of cloud computing and AI acceleration across the Akamai Connected Cloud. Join the Compute team to own VM/fleet test strategy, performance gates, and hypervisor validation for the IaaS platform. The role emphasizes reproducible... 
    Performance
    Remote work

    Akamai Technologies, Inc.

    Winnipeg, MB
    1 hour ago
  • Okta Inc. is seeking an experienced Software Development Engineer in Test (SDET) to join the Android platform team. You will lead test automation for Okta Verify Android app and SDKs, develop scripts, and expand the automation framework across devices. You will collaborate with... 

    Okta Inc.

    Winnipeg, MB
    1 hour ago
  • Build scalable test infrastructure for Cerebras Systems’ AI platform, combining software development, distributed systems, and hardware integration in hybrid offices.As a Senior SDET within Release Integration Testing, you will develop tooling that validates complex AI inference... 
    Work at office

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Systems in Burnaby, Canada, seeks an experienced Software Development Engineer in Test (SDET) to design, develop, and maintain Python-based test automation frameworks for API, UI, system, and performance testing. You will enforce SOLID, TDD/BDD, and CI/CD practices to deliver... 
    Performance
    Shift work

    OSI Maritime Systems

    Winnipeg, MB
    1 hour ago
  •  ...to become the world's largest AI-led technology services company...  ...consistency. Create and execute test scenarios, test cases, and...  ...issues, and knowledge gaps. Perform chatbot conversation analysis and...  ...demonstrated experience in QA, SDET, or test automation. Experience... 
    Long term contract

    Tata Consultancy Services Limited

    Winnipeg, MB
    1 hour ago
  •  ...Plotly is seeking a Senior Software Developer in Test (SDET) to join our team and drive quality across Dash Enterprise products. You will design, develop, and execute comprehensive testing strategies, contribute to bug fixes, and lead automation efforts with Cypress, Playwright... 
    Remote work

    Plotly

    Winnipeg, MB
    1 hour ago
  •  ...Canada | Posted on 09/28/2026Work Model: Hybrid – 2 days per week in office Primary SkillRole DescriptionWe are seeking a Performance Test Engineer with strong hands-on experience in LoadRunner to design, execute, and analyze performance tests for enterprise... 
    Performance
    Work at office
    2 days per week

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  •  ...technologies that address complex scientific challenges to improve our world. They have engaged ROSS to recruit a Test Automation Developer with a focus on Performance Automation Testing.This is a stable, long-term 12-month contract with the possibility of extension or... 
    Performance
    Long term contract
    Permanent employment
    Work at office

    ROSS

    Winnipeg, MB
    1 hour ago
  • Master performance testing with JMeter and Python as a hands-on Performance Tester in Tecsys’s digital-first work environment. Work remotely with flexibility and collaborative workspaces.As a Performance Tester, you will investigate unexplained issues across applications, Kubernetes... 
    Performance
    Remote work

    Tecsys Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Ingénieur(e) senior en développement logiciel de tests (SDET)Nous sommes à la recherche d’un(e)...  ...avec Unity. Réaliser des tests de performance et identifier les problématiques liées aux...  ...identify performance-related issues. Support AI initiatives and AI-related validation.... 
    Performance
    Remote work
    Worldwide
    Day shift

    Side

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sdet Ai Evaluation And Performance Testing. Be the first to apply!