Sdet Ai Evaluation And Performance Testing
CrowdStrike Canada ULC
Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike’s platform engineering team needs automation across functional, integration, and performance testing. You will also measure correctness, safety, latency, cost, tool use, and trajectory through eval-driven development.Key Responsibilities:
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Sdet Ai Evaluation And Performance Testing in Winnipeg, MB vacancy
- ...Nous sommes à la recherche d’un(e) développeur(euse) logiciel en test (SDET) pour se joindre à notre équipe Video Systems Test. Dans ce... ...améliorerez notre infrastructure de test et contribuerez à valider les performances, l’évolutivité et la fiabilité de nos systèmes vidéo. Le...PerformanceFlexible hours
- Lead AI-assisted testing and in-sprint automation as a hands-on Senior SDET supporting quality engineering across global teams.This Senior SDET drives practical test automation and performance engineering while providing global technical leadership. You will integrate AI-driven...PerformanceShift work
- Define reliable AI agent testing at CrowdStrike with Python and distributed systems expertise.... ...will create functional, integration, and performance automation for distributed systems. The... ..., and AI scoring pipelinesEnforce CI evaluation gates before releasesDetect unreliable...Performance
- ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management...PerformanceLong term contract
- CrowdStrike Canada ULC is seeking an experienced SDET to define how AI agents are tested, evaluated and trusted in production. You will build and maintain automated test suites for a cloud-based cybersecurity platform, extend agentic tooling, and ensure robust test coverage...Suggested
- ...hiring a remote, Canada-based Software Development Engineer in Test to support its Detonations and Threat Analysis Platform Engineering... ...cloud cybersecurity platform and contributes to testing and evaluation of AI agents. The candidate will design and implement automated tests...Remote work
- Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development... ...You will support functional, integration, performance, and end-to-end validation.Key...Performance
- ...overall Quality Assurance strategy, testing frameworks, and global QA... ...standards of reliability, performance, and security. Ce que vous... ...deployment security. Drive test planning, execution strategy,... ..., Tableau, Jira Dashboards AI tooling: Claude, Codex... Qualifications...PerformanceShift work
- Varicent in Canada seeks a Senior Software Development Engineer in Test to strengthen quality across our AI-powered ELT platform, leading test automation and quality standards within a cross-functional team. You will design scalable testing frameworks for web, API, and data...Remote work
- ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner...Performance
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...As senior software development engineer in Test, we are looking for a candidate who can make... ...of high availability, failure scenarios, performance, stress and security. Champion cluster...Performance
- ...Senior Software Development Engineer in Test (Sr. SDET) to join our Engineering team. In this... ...products meet the highest standards of performance and reliability for thousands of security... ...feedback to peers. - Research and evaluate new testing tools, methodologies, and emerging...PerformanceLong term contractWork at officeLocal areaRemote workWork from homeWorldwideFlexible hours
- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...Senior Software Development Engineer in Test (SDET) to join the Release Integration Testing... ...Investigate and debug complex cross-stack failures, perform root cause analysis, collaborate with...PerformanceWork at officeRemote work3 days per week
- ...senior Software Development Engineer in Test role requires eight to twelve years of... ...spans APIs, user interfaces, databases, performance, messaging, and AI-assisted testing.Key Responsibilities:... ...governance and technical direction to global SDET teamsRequirements: Bachelor’s degree...PerformanceContract workRemote work
- Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint... ...critical utility software workflows.As a Senior SDET, you will create automation foundations... ...risk-based prioritization. You will also evaluate AI-assisted tools for test generation,...
- ...Canada, this Software Development Engineer in Test role centers on full-stack automation,... ...engineering, and reliable releases for Joist.As an SDET at EverPro, you will support Joist,... ...agile product development. The work includes AI-assisted quality practices and fast feedback...For contractorsRemote work
- Build scalable test automation for Joist with Playwright, Appium, and BrowserStack while working... ..., and API layers using modern frameworks, AI tools, and detailed debugging. The work... ...teamRequirements: Five to seven years in SDET rolesExperience with BrowserStack,...For contractorsRemote work
- ...the Americas.We are looking for a Senior SDET to help build our test automation from the ground up. You will... ...confidence to ship, and bring modern AI‑assisted tooling into how we work. This... ...trustworthy, so failures mean something Evaluate and apply AI‑assisted testing tools (...PerformanceInternship
- Shape enterprise test automation at Thinkific using Playwright and scalable frameworks. Work across web, API, integration, and component testing.As a Senior Software Development Engineer in Test, you will guide organizational testing strategy within Platform Engineering. Build...
- Build software quality through test automation and CI/CD engineering as a Senior SDET in Calgary, working in a hybrid model.Reporting to the Software Development Manager, this senior engineering role develops maintainable automation across APIs, integrations, and web applications...Contract work
- Lead automation testing with Selenium, Parasoft, and Robot Framework in a senior SDET role requiring six-plus years of experience.This SDET position focuses on automating tests across platforms and technologies throughout the full development lifecycle. Apply expertise in C#...
- Nous sommes à la recherche d'un(e) Senior SDET / Software Engineer in Test possédant une solide expertise en Java , Spring Boot et en... ...applications Cloud-native . Expérience en tests de performance et de fiabilité . Expérience en Infrastructure as...Performance1 day per week
- ...Technologies, Inc., we are building the next generation of cloud computing and AI acceleration across the Akamai Connected Cloud. Join the Compute team to own VM/fleet test strategy, performance gates, and hypervisor validation for the IaaS platform. The role emphasizes reproducible...PerformanceRemote work
- ...EXFO Inc. recherche un ingénieur en développement logiciel de tests (SDET) avec 5 à 7 ans d’expérience pour concevoir et faire évoluer les capacités de tests automatisés utilisées par nos plateformes de surveillance de la fibre et de visibilité réseau. Vous travaillerez...
- A technology company is looking for a highly skilled Software Engineer specializing in Continuous Integration and Test Frameworks. Responsibilities include optimizing CI pipelines, designing automation frameworks, and providing support to teams. The ideal candidate has 4+ years...
- Okta Inc. is seeking an experienced Software Development Engineer in Test (SDET) to join the Android platform team. You will lead test automation for Okta Verify Android app and SDKs, develop scripts, and expand the automation framework across devices. You will collaborate with...
- Build scalable test infrastructure for Cerebras Systems’ AI platform, combining software development, distributed systems, and hardware integration in hybrid offices.As a Senior SDET within Release Integration Testing, you will develop tooling that validates complex AI inference...Work at office
- Ingénieur(e) senior en développement logiciel de tests (SDET)Nous sommes à la recherche d’un(e)... ...avec Unity. Réaliser des tests de performance et identifier les problématiques liées aux... ...identify performance-related issues. Support AI initiatives and AI-related validation....PerformanceRemote workWorldwideDay shift
$100k - $130k per year
Senior QA Automation Engineer / SDET (Canada-only) Digital Banking... ...Development Engineers in Test (SDETs) who combine strong technical... ...workflows. Support performance, security, and accessibility testing... ...establish automated quality gates for AI-assisted software development....PerformanceHourly payRemplacementFull timeContract workRemote work- ...Systems in Burnaby, Canada, seeks an experienced Software Development Engineer in Test (SDET) to design, develop, and maintain Python-based test automation frameworks for API, UI, system, and performance testing. You will enforce SOLID, TDD/BDD, and CI/CD practices to deliver...PerformanceShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sdet Ai Evaluation And Performance Testing. Be the first to apply!
Related searches
- junior software tester Winnipeg, MB
- building performance specialist Winnipeg, MB
- performance testing Winnipeg, MB
- performance engineer Winnipeg, MB
- acting performance Winnipeg, MB
- drug testing Winnipeg, MB
- test evaluator Winnipeg, MB
- api testing Winnipeg, MB
- test administrator Winnipeg, MB
- penetration testing Winnipeg, MB

