Sdet Ai Evaluation And Performance Testing
CrowdStrike Canada ULC
Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike’s platform engineering team needs automation across functional, integration, and performance testing. You will also measure correctness, safety, latency, cost, tool use, and trajectory through eval-driven development.Key Responsibilities:
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Sdet Ai Evaluation And Performance Testing in Winnipeg, MB vacancy
- ...Nous sommes à la recherche d’un(e) développeur(euse) logiciel en test (SDET) pour se joindre à notre équipe Video Systems Test. Dans ce... ...améliorerez notre infrastructure de test et contribuerez à valider les performances, l’évolutivité et la fiabilité de nos systèmes vidéo. Le...PerformanceFlexible hours
Genetec
Winnipeg, MB1 hour ago - Define reliable AI agent testing at CrowdStrike with Python and distributed systems expertise.... ...will create functional, integration, and performance automation for distributed systems. The... ..., and AI scoring pipelinesEnforce CI evaluation gates before releasesDetect unreliable...Performance
CrowdStrike Inc.
Winnipeg, MB1 hour ago - Lead AI-assisted testing and in-sprint automation as a hands-on Senior SDET supporting quality engineering across global teams.This Senior SDET drives practical test automation and performance engineering while providing global technical leadership. You will integrate AI-driven...PerformanceShift work
IT Connex
Winnipeg, MB1 hour ago - ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management...PerformanceLong term contract
- CrowdStrike Canada ULC is seeking an experienced SDET to define how AI agents are tested, evaluated and trusted in production. You will build and maintain automated test suites for a cloud-based cybersecurity platform, extend agentic tooling, and ensure robust test coverage...Suggested
CrowdStrike Inc.
Winnipeg, MB1 hour ago - ...hiring a remote, Canada-based Software Development Engineer in Test to support its Detonations and Threat Analysis Platform Engineering... ...cloud cybersecurity platform and contributes to testing and evaluation of AI agents. The candidate will design and implement automated tests...Remote work
Skillhub Solutions Inc.
Winnipeg, MB1 hour ago - Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development... ...You will support functional, integration, performance, and end-to-end validation.Key...Performance
CrowdStrike Inc.
Winnipeg, MB1 hour ago - ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner...Performance
Rootly
Winnipeg, MB1 hour ago - ...overall Quality Assurance strategy, testing frameworks, and global QA... ...standards of reliability, performance, and security. Ce que vous... ...deployment security. Drive test planning, execution strategy,... ..., Tableau, Jira Dashboards AI tooling: Claude, Codex... Qualifications...PerformanceShift work
- ...Senior Software Development Engineer in Test (Sr. SDET) to join our Engineering team. In this... ...products meet the highest standards of performance and reliability for thousands of security... ...feedback to peers. - Research and evaluate new testing tools, methodologies, and emerging...PerformanceLong term contractWork at officeLocal areaRemote workWork from homeWorldwideFlexible hours
Trackforce
Winnipeg, MB1 hour ago - Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...Senior Software Development Engineer in Test (SDET) to join the Release Integration Testing... ...Investigate and debug complex cross-stack failures, perform root cause analysis, collaborate with...PerformanceWork at officeRemote work3 days per week
Cerebras
Winnipeg, MB1 hour ago - Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint... ...critical utility software workflows.As a Senior SDET, you will create automation foundations... ...risk-based prioritization. You will also evaluate AI-assisted tools for test generation,...
SpryPoint Services Inc.
Winnipeg, MB1 hour ago - Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...As senior software development engineer in Test, we are looking for a candidate who can make... ...of high availability, failure scenarios, performance, stress and security. Champion cluster...Performance
Cerebras
Winnipeg, MB1 hour ago - ...senior Software Development Engineer in Test role requires eight to twelve years of... ...spans APIs, user interfaces, databases, performance, messaging, and AI-assisted testing.Key Responsibilities:... ...governance and technical direction to global SDET teamsRequirements: Bachelor’s degree...PerformanceContract workRemote work
Rose International
Winnipeg, MB1 hour ago - ...the Americas.We are looking for a Senior SDET to help build our test automation from the ground up. You will... ...confidence to ship, and bring modern AI‑assisted tooling into how we work. This... ...trustworthy, so failures mean something Evaluate and apply AI‑assisted testing tools (...PerformanceInternship
SpryPoint Services Inc.
Winnipeg, MB1 hour ago - Nous sommes à la recherche d'un(e) Senior SDET / Software Engineer in Test possédant une solide expertise en Java , Spring Boot et en... ...applications Cloud-native . Expérience en tests de performance et de fiabilité . Expérience en Infrastructure as...Performance1 day per week
Highspring
Winnipeg, MB1 hour ago - Build software quality through test automation and CI/CD engineering as a Senior SDET in Calgary, working in a hybrid model.Reporting to the Software Development Manager, this senior engineering role develops maintainable automation across APIs, integrations, and web applications...Contract work
Hrblock
Winnipeg, MB1 hour ago - ...EXFO Inc. recherche un ingénieur en développement logiciel de tests (SDET) avec 5 à 7 ans d’expérience pour concevoir et faire évoluer les capacités de tests automatisés utilisées par nos plateformes de surveillance de la fibre et de visibilité réseau. Vous travaillerez...
EXFO
Winnipeg, MB1 hour ago - ...Technologies, Inc., we are building the next generation of cloud computing and AI acceleration across the Akamai Connected Cloud. Join the Compute team to own VM/fleet test strategy, performance gates, and hypervisor validation for the IaaS platform. The role emphasizes reproducible...PerformanceRemote work
Akamai Technologies, Inc.
Winnipeg, MB1 hour ago - Okta Inc. is seeking an experienced Software Development Engineer in Test (SDET) to join the Android platform team. You will lead test automation for Okta Verify Android app and SDKs, develop scripts, and expand the automation framework across devices. You will collaborate with...
Okta Inc.
Winnipeg, MB1 hour ago - ...Systems in Burnaby, Canada, seeks an experienced Software Development Engineer in Test (SDET) to design, develop, and maintain Python-based test automation frameworks for API, UI, system, and performance testing. You will enforce SOLID, TDD/BDD, and CI/CD practices to deliver...PerformanceShift work
OSI Maritime Systems
Winnipeg, MB1 hour ago - Build scalable test infrastructure for Cerebras Systems’ AI platform, combining software development, distributed systems, and hardware integration in hybrid offices.As a Senior SDET within Release Integration Testing, you will develop tooling that validates complex AI inference...Work at office
Cerebras
Winnipeg, MB1 hour ago - ...Jobgether, listed on behalf of a partner company, seeks a Senior Software Developer in Test in Canada. You will design and implement automated test strategies across web apps, APIs, and cloud environments, combining test automation with hands-on development. You will mentor...Remote work
Jobgether
Winnipeg, MB1 hour ago - ...to become the world's largest AI-led technology services company... ...consistency. Create and execute test scenarios, test cases, and... ...issues, and knowledge gaps. Perform chatbot conversation analysis and... ...demonstrated experience in QA, SDET, or test automation. Experience...Long term contract
Tata Consultancy Services Limited
Winnipeg, MB1 hour ago - ...Plotly is seeking a Senior Software Developer in Test (SDET) to join our team and drive quality across Dash Enterprise products. You will design, develop, and execute comprehensive testing strategies, contribute to bug fixes, and lead automation efforts with Cypress, Playwright...Remote work
Plotly
Winnipeg, MB1 hour ago - Build AI test automation at CrowdStrike as a Software Development Engineer in Test, working... ...develop functional, integration, and performance automation for cloud-based cybersecurity... ...work includes agentic test generation, evaluation-driven development, and reliable production...PerformanceRemote work
CrowdStrike Inc.
Winnipeg, MB1 hour ago - ...Senior Software Development Engineer in Test (SDET) - Digital Banking based in Canada. The... ...in ensuring the quality, reliability, and performance of modern digital banking solutions. This... ...practices through CI/CD automation, AI-assisted development, and innovative quality...PerformanceRemplacementFull timeContract workRemote workFlexible hours
Jobgether
Winnipeg, MB1 hour ago - Specialize in VuGen scripting and complex SQL queries while applying performance testing expertise across internet and legacy application environments.This Performance Test Analyst role requires more than five years of performance testing experience across varied application...Performance
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - Use Apache JMeter to engineer reliable performance testing for TCS, covering web applications, APIs, and batch processes. Work spans load and stress... ...independently plan, script, execute, and analyze performance tests. You will create custom JMeter logic, review requirements, and...Performance
Tata Consultancy Services Limited
Winnipeg, MB1 hour ago $100k - $130k per year
Senior QA Automation Engineer / SDET (Canada-only) Digital Banking... ...Development Engineers in Test (SDETs) who combine strong technical... ...workflows. Support performance, security, and accessibility testing... ...establish automated quality gates for AI-assisted software development....PerformanceHourly payRemplacementFull timeContract workRemote workAequilibrium
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sdet Ai Evaluation And Performance Testing. Be the first to apply!
Related searches
- junior software tester Winnipeg, MB
- building performance specialist Winnipeg, MB
- performance testing Winnipeg, MB
- performance engineer Winnipeg, MB
- acting performance Winnipeg, MB
- drug testing Winnipeg, MB
- test evaluator Winnipeg, MB
- api testing Winnipeg, MB
- test administrator Winnipeg, MB
- penetration testing Winnipeg, MB