Sdet Ai Evaluation And Performance Testing
CrowdStrike Canada ULC
Shape trusted AI evaluation with performance testing and CI/CD expertise as a Software Development Engineer in Test at CrowdStrike. Work on scalable cybersecurity services.As an SDET, you will help define how AI agents are tested, evaluated, and trusted in production. CrowdStrike’s platform engineering team needs automation across functional, integration, and performance testing. You will also measure correctness, safety, latency, cost, tool use, and trajectory through eval-driven development.Key Responsibilities:
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Maintain golden datasets and AI agent scoring pipelinesEnforce CI evaluation gates before releasesDetect hallucinations, flaky tests, and judge biasDesign realistic workloads for distributed servicesReview systems and agent designs for testabilityRequirements:
Computer Science degree or equivalent experienceFive-plus years of software quality experiencePython preferred for evaluation and agent workCI/CD test framework development experienceLocust or k6 performance testing experienceBring verification-first thinking, evaluation discipline, and performance expertise to CrowdStrike’s AI-powered testing practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Sdet Ai Evaluation And Performance Testing in Winnipeg, MB vacancy
- ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management...PerformanceLong term contract
- ...overall Quality Assurance strategy, testing frameworks, and global QA... ...standards of reliability, performance, and security. Ce que vous... ...deployment security. Drive test planning, execution strategy,... ..., Tableau, Jira Dashboards AI tooling: Claude, Codex... Qualifications...PerformanceShift work
- ...Join Workada as a Remote Video Production Evaluator dedicated to improving AI technology through precise evaluations. This full-time role focuses on quality assessment... ...comprehensive evaluations will enhance system performance and ensure accuracy in tech applications. Key...PerformanceFull timeRemote work
- ...lasting and successful career in materials testing and inspection services by starting with a... ...our team does work that’s rock solid. We perform quality assurance and quality control services... ...Preparation of field and laboratory test reports The successful candidate will join...SuggestedFor contractorsFlexible hoursWeekend work
- ...bringing them the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come join one... ...Competitive compensation We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing...PerformanceRemote workWorldwideFlexible hours
- ...that. • Our convenient Price Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi-site... ...ROLE PURPOSE Build and lead a pragmatic test automation and performance assurance program that improves the reliability of enterprise systems...Performance
- ...Whitecliffe Global is seeking a senior performance marketer to set paid media strategy for its international campuses. You will direct multiple agencies, allocate budgets by market, and tie media spend to enrolments using GA4 and offline conversion tracking. You will connect...Performance
$27 per hour
...Best Employers for Women in 2026 and recognized by Newsweek as one of the World's Most Trustworthy Companies in 2026. About Channel Performance: The Channel Performance Service Line is home to the largest mystery shopping agency in the world. We complete over one million...PerformanceHourly payPermanent employmentFor contractorsSecond jobRemote workWorldwideMonday to fridayFlexible hours- ...and our culture of Relentless Performance has enabled over 99% of Miratech... ...looking for a skilled Senior AI Engineer with Python,... ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong... ...software engineering best practices, testing, debugging, and performance...PerformanceFull timeInternshipRemote workRelocation
- ...free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll... ...requirements into technical solutions. • Evaluate, monitor, and optimize models and applications for performance, reliability, and scalability. • Document technical...Performance
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Performance
- ...today, we want to hear from you. Position Summary The People AI Solutions Designer is the builder. Where the People AI Deployment... ...real users, instrument them, and improve based on actual usage and performance. Tune prompts, logic, and integrations to raise quality,...Performance
- ...Salesforce, the leading AI CRM, seeks a Senior Technical Consultant to drive enterprise deployments and AI-driven delivery. You'll partner with clients and internal teams to define architectures, implement solutions, and manage release cycles across desktop, cloud, and mobile...
- ...Lead responsible AI adoption at YVR through digital governance, IT service management, and practical controls supporting safe airport operations. As Manager, Technology Services, you will oversee AI and digital tool governance across YVR. Reporting to the Director, Data...
- ...generation of ERP, CRM, MES, and manufacturing systems. You will define target architecture, drive fit-to-standard solutions, and infuse AI into business processes from design to invoicing. You will collaborate with cross-functional teams across product, manufacturing, and...
- ...at scale, collaborating with Product, Engineering, Design, Research, Product Analytics, Data Engineering and others. You will build and prototype analysis pipelines, leverage AI to accelerate execution, and communicate insights to cross-functional teams across the company....
- ...Nous sommes à la recherche d’un(e) développeur(euse) logiciel en test (SDET) pour se joindre à notre équipe Video Systems Test. Dans ce... ...améliorerez notre infrastructure de test et contribuerez à valider les performances, l’évolutivité et la fiabilité de nos systèmes vidéo. Le...PerformanceFlexible hours
Genetec
Winnipeg, MB1 hour ago - Define reliable AI agent testing at CrowdStrike with Python and distributed systems expertise.... ...will create functional, integration, and performance automation for distributed systems. The... ..., and AI scoring pipelinesEnforce CI evaluation gates before releasesDetect unreliable...Performance
CrowdStrike
Winnipeg, MB1 hour ago - Lead AI-assisted testing and in-sprint automation as a hands-on Senior SDET supporting quality engineering across global teams.This Senior SDET drives practical test automation and performance engineering while providing global technical leadership. You will integrate AI-driven...PerformanceShift work
IT Connex
Winnipeg, MB1 hour ago - CrowdStrike Canada ULC is seeking an experienced SDET to define how AI agents are tested, evaluated and trusted in production. You will build and maintain automated test suites for a cloud-based cybersecurity platform, extend agentic tooling, and ensure robust test coverage...
CrowdStrike Inc.
Winnipeg, MB1 hour ago - ...Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows. You will partner...Performance
Rootly
Winnipeg, MB1 hour ago - ...Senior Software Development Engineer in Test (Sr. SDET) to join our Engineering team. In this... ...products meet the highest standards of performance and reliability for thousands of security... ...feedback to peers. - Research and evaluate new testing tools, methodologies, and emerging...PerformanceLong term contractWork at officeLocal areaRemote workWork from homeWorldwideFlexible hours
Trackforce
Winnipeg, MB1 hour ago - Design test automation and code with Python, Java, JavaScript, or TypeScript at SpryPoint... ...critical utility software workflows.As a Senior SDET, you will create automation foundations... ...risk-based prioritization. You will also evaluate AI-assisted tools for test generation,...
SpryPoint Services Inc.
Winnipeg, MB1 hour ago - Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...Senior Software Development Engineer in Test (SDET) to join the Release Integration Testing... ...Investigate and debug complex cross-stack failures, perform root cause analysis, collaborate with...PerformanceWork at officeRemote work3 days per week
Cerebras
Winnipeg, MB1 hour ago - Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...As senior software development engineer in Test, we are looking for a candidate who can make... ...of high availability, failure scenarios, performance, stress and security. Champion cluster...Performance
Cerebras
Winnipeg, MB1 hour ago - ...Varicent in Toronto, Canada, is seeking a Senior SDET to advance automated testing and quality engineering for its ELT platform. This remote-friendly role blends software development with AI-enabled testing approaches to improve reliability and delivery speed. You will...Remote work
Wwshemi
Winnipeg, MB1 hour ago - Build scalable test automation for Varicent’s AI-powered ELT platform, applying API testing and advanced SQL in a quality engineering role. Remote and hybrid options are available across most regions.As a Senior Software Developer in Test, you will shape testing practices across...Remote work
Varicent
Winnipeg, MB1 hour ago - ...senior Software Development Engineer in Test role requires eight to twelve years of... ...spans APIs, user interfaces, databases, performance, messaging, and AI-assisted testing.Key Responsibilities:... ...governance and technical direction to global SDET teamsRequirements: Bachelor’s degree...PerformanceContract workRemote work
Rose International
Winnipeg, MB1 hour ago - Nous sommes à la recherche d'un(e) Senior SDET / Software Engineer in Test possédant une solide expertise en Java , Spring Boot et en... ...applications Cloud-native . Expérience en tests de performance et de fiabilité . Expérience en Infrastructure as...Performance1 day per week
Highspring
Winnipeg, MB1 hour ago - ...the Americas.We are looking for a Senior SDET to help build our test automation from the ground up. You will... ...confidence to ship, and bring modern AI‑assisted tooling into how we work. This... ...trustworthy, so failures mean something Evaluate and apply AI‑assisted testing tools (...PerformanceInternship
SpryPoint Services Inc.
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sdet Ai Evaluation And Performance Testing. Be the first to apply!
Related searches
- junior software tester Winnipeg, MB
- building performance specialist Winnipeg, MB
- performance testing Winnipeg, MB
- performance engineer Winnipeg, MB
- acting performance Winnipeg, MB
- drug testing Winnipeg, MB
- test evaluator Winnipeg, MB
- api testing Winnipeg, MB
- test administrator Winnipeg, MB
- penetration testing Winnipeg, MB