Sdet Ai Evaluation And Performance Testing
CrowdStrike Canada ULC
Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike’s platform engineering team needs automation across functional, integration, and performance testing. You will also measure correctness, safety, latency, cost, tool use, and trajectory through eval-driven development.Key Responsibilities:
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Sdet Ai Evaluation And Performance Testing in Winnipeg, MB vacancy
- Define reliable AI agent testing at CrowdStrike with Python and distributed systems expertise.... ...will create functional, integration, and performance automation for distributed systems. The... ..., and AI scoring pipelinesEnforce CI evaluation gates before releasesDetect unreliable...Performance
- ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management...PerformanceLong term contract
- CrowdStrike Canada ULC is seeking an experienced SDET to define how AI agents are tested, evaluated and trusted in production. You will build and maintain automated test suites for a cloud-based cybersecurity platform, extend agentic tooling, and ensure robust test coverage...Suggested
- ...hiring a remote, Canada-based Software Development Engineer in Test to support its Detonations and Threat Analysis Platform Engineering... ...cloud cybersecurity platform and contributes to testing and evaluation of AI agents. The candidate will design and implement automated tests...SuggestedRemote work
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development... ...You will support functional, integration, performance, and end-to-end validation.Key...Performance
- ...overall Quality Assurance strategy, testing frameworks, and global QA... ...standards of reliability, performance, and security. Ce que vous... ...deployment security. Drive test planning, execution strategy,... ..., Tableau, Jira Dashboards AI tooling: Claude, Codex... Qualifications...PerformanceShift work
- ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner...Performance
- Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint... ...critical utility software workflows.As a Senior SDET, you will create automation foundations... ...risk-based prioritization. You will also evaluate AI-assisted tools for test generation,...
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...As senior software development engineer in Test, we are looking for a candidate who can make... ...of high availability, failure scenarios, performance, stress and security. Champion cluster...Performance
- ...Senior Software Development Engineer in Test (Sr. SDET) to join our Engineering team. In this... ...products meet the highest standards of performance and reliability for thousands of security... ...feedback to peers. - Research and evaluate new testing tools, methodologies, and emerging...PerformanceLong term contractWork at officeLocal areaRemote workWork from homeWorldwideFlexible hours
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...Senior Software Development Engineer in Test (SDET) to join the Release Integration Testing... ...Investigate and debug complex cross-stack failures, perform root cause analysis, collaborate with...PerformanceWork at officeRemote work3 days per week
- ...Canada, this Software Development Engineer in Test role centers on full-stack automation,... ...engineering, and reliable releases for Joist.As an SDET at EverPro, you will support Joist,... ...agile product development. The work includes AI-assisted quality practices and fast feedback...For contractorsRemote work
- ...senior Software Development Engineer in Test role requires eight to twelve years of... ...spans APIs, user interfaces, databases, performance, messaging, and AI-assisted testing.Key Responsibilities:... ...governance and technical direction to global SDET teamsRequirements: Bachelor’s degree...PerformanceContract workRemote work
- ...the Americas.We are looking for a Senior SDET to help build our test automation from the ground up. You will... ...confidence to ship, and bring modern AI‑assisted tooling into how we work. This... ...trustworthy, so failures mean something Evaluate and apply AI‑assisted testing tools (...PerformanceInternship
- Build scalable test automation for Joist with Playwright, Appium, and BrowserStack while working... ..., and API layers using modern frameworks, AI tools, and detailed debugging. The work... ...teamRequirements: Five to seven years in SDET rolesExperience with BrowserStack,...For contractorsRemote work
- Nous sommes à la recherche d'un(e) Senior SDET / Software Engineer in Test possédant une solide expertise en Java , Spring Boot et en... ...applications Cloud-native . Expérience en tests de performance et de fiabilité . Expérience en Infrastructure as...Performance1 day per week
- ...Nous sommes à la recherche d’un(e) développeur(euse) logiciel en test (SDET) pour se joindre à notre équipe Video Systems Test. Dans ce... ...améliorerez notre infrastructure de test et contribuerez à valider les performances, l’évolutivité et la fiabilité de nos systèmes vidéo. Le...PerformanceFlexible hours
- ...EXFO Inc. recherche un ingénieur en développement logiciel de tests (SDET) avec 5 à 7 ans d’expérience pour concevoir et faire évoluer les capacités de tests automatisés utilisées par nos plateformes de surveillance de la fibre et de visibilité réseau. Vous travaillerez...
- Lead automation testing with Selenium, Parasoft, and Robot Framework in a senior SDET role requiring six-plus years of experience.This SDET position focuses on automating tests across platforms and technologies throughout the full development lifecycle. Apply expertise in C#...
- Build software quality through test automation and CI/CD engineering as a Senior SDET in Calgary, working in a hybrid model.Reporting to the Software Development Manager, this senior engineering role develops maintainable automation across APIs, integrations, and web applications...Contract work
- ...Technologies, Inc., we are building the next generation of cloud computing and AI acceleration across the Akamai Connected Cloud. Join the Compute team to own VM/fleet test strategy, performance gates, and hypervisor validation for the IaaS platform. The role emphasizes reproducible...PerformanceRemote work
- Okta Inc. is seeking an experienced Software Development Engineer in Test (SDET) to join the Android platform team. You will lead test automation for Okta Verify Android app and SDKs, develop scripts, and expand the automation framework across devices. You will collaborate with...
- Build scalable test infrastructure for Cerebras Systems’ AI platform, combining software development, distributed systems, and hardware integration in hybrid offices.As a Senior SDET within Release Integration Testing, you will develop tooling that validates complex AI inference...Work at office
- ...Systems in Burnaby, Canada, seeks an experienced Software Development Engineer in Test (SDET) to design, develop, and maintain Python-based test automation frameworks for API, UI, system, and performance testing. You will enforce SOLID, TDD/BDD, and CI/CD practices to deliver...PerformanceShift work
- ...to become the world's largest AI-led technology services company... ...consistency. Create and execute test scenarios, test cases, and... ...issues, and knowledge gaps. Perform chatbot conversation analysis and... ...demonstrated experience in QA, SDET, or test automation. Experience...Long term contract
- ...Plotly is seeking a Senior Software Developer in Test (SDET) to join our team and drive quality across Dash Enterprise products. You will design, develop, and execute comprehensive testing strategies, contribute to bug fixes, and lead automation efforts with Cypress, Playwright...Remote work
- ...Canada | Posted on 09/28/2026Work Model: Hybrid – 2 days per week in office Primary SkillRole DescriptionWe are seeking a Performance Test Engineer with strong hands-on experience in LoadRunner to design, execute, and analyze performance tests for enterprise...PerformanceWork at office2 days per week
- ...technologies that address complex scientific challenges to improve our world. They have engaged ROSS to recruit a Test Automation Developer with a focus on Performance Automation Testing.This is a stable, long-term 12-month contract with the possibility of extension or...PerformanceLong term contractPermanent employmentWork at office
- Master performance testing with JMeter and Python as a hands-on Performance Tester in Tecsys’s digital-first work environment. Work remotely with flexibility and collaborative workspaces.As a Performance Tester, you will investigate unexplained issues across applications, Kubernetes...PerformanceRemote work
- ...Ingénieur(e) senior en développement logiciel de tests (SDET)Nous sommes à la recherche d’un(e)... ...avec Unity. Réaliser des tests de performance et identifier les problématiques liées aux... ...identify performance-related issues. Support AI initiatives and AI-related validation....PerformanceRemote workWorldwideDay shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sdet Ai Evaluation And Performance Testing. Be the first to apply!
Related searches
- junior software tester Winnipeg, MB
- acting performance Winnipeg, MB
- performance engineer Winnipeg, MB
- performance testing Winnipeg, MB
- building performance specialist Winnipeg, MB
- drive test Winnipeg, MB
- penetration testing Winnipeg, MB
- drug testing Winnipeg, MB
- test evaluator Winnipeg, MB
- api testing Winnipeg, MB

