Senior Ml Kernel Performance Engineer
$150.7k - $251.7k per yearAmazon Inc.
Description
Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology.This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting‑edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.Explore the product and our history! job responsibilities
Role
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:— design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models— Analyze and optimize kernel-level performance across multiple generations of Neuron hardware— Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks— Implement compiler optimizations such as fusion, sharding, tiling, and scheduling— Work directly with customers to enable and optimize their ML models on AWS accelerators— Collaborate across teams to develop innovative kernel optimization techniquesA day in the life
As You Design And Code Solutions To Help Our Team Drive Efficiencies In Software Architecture, You’ll Create Metrics, Implement Automation And Other Improvements, And Resolve The Root Cause Of Software Defects. You’ll AlsoBuild high-impact solutions to deliver to our large customer base.Participate in design discussions, code review, and communicate with internal and external stakeholders.Work cross‑functionally to help drive business decisions with your technical input.Work in a startup‑like development environment, where you’re always working on the most important stuff.Basic Qualifications
5+ years of non‑internship professional software development experience5+ years of programming with at least one software programming language experience5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experienceExperience as a mentor, tech lead or leading an engineering teamPreferred Qualifications
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experienceBachelor's degree in computer science or equivalent* Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures* Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm* Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA* Experience developing high performance libraries for HPC applications* Proficiency in low-level performance optimization for GPUs* Experience with LLVM/MLIR backend development for GPUs* Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends* Experience with parallel programming and optimization techniques* Understanding of GPU memory hierarchies and optimization strategiesAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annuallyCompany
Amazon Development Centre Canada ULCJob ID: A10526701
#J-18808-Ljbffr
Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.The Acceleration Kernel Library team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers' demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what's possible in AI acceleration.The Amazon Neuron SDK, developed by the Annapurna Labs team at Amazon, is the backbone for accelerating deep learning and GenAI workloads on Amazon's Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you'll help shape the future of AI acceleration technology.This is an opportunity to work on cutting-edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish cutting‑edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on Amazon's ML accelerators.Explore the product and our history! job responsibilities
Role
Our kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you'll bring expertise in low-level optimization, system architecture, and ML model acceleration. In this role, you will:— design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models— Analyze and optimize kernel-level performance across multiple generations of Neuron hardware— Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks— Implement compiler optimizations such as fusion, sharding, tiling, and scheduling— Work directly with customers to enable and optimize their ML models on AWS accelerators— Collaborate across teams to develop innovative kernel optimization techniquesA day in the life
As You Design And Code Solutions To Help Our Team Drive Efficiencies In Software Architecture, You’ll Create Metrics, Implement Automation And Other Improvements, And Resolve The Root Cause Of Software Defects. You’ll AlsoBuild high-impact solutions to deliver to our large customer base.Participate in design discussions, code review, and communicate with internal and external stakeholders.Work cross‑functionally to help drive business decisions with your technical input.Work in a startup‑like development environment, where you’re always working on the most important stuff.Basic Qualifications
5+ years of non‑internship professional software development experience5+ years of programming with at least one software programming language experience5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experienceExperience as a mentor, tech lead or leading an engineering teamPreferred Qualifications
5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experienceBachelor's degree in computer science or equivalent* Expertise in accelerator architectures for ML or HPC such as GPUs, CPUs, FPGAs, or custom architectures* Experience with GPU kernel optimization and GPGPU computing such as CUDA, NKI, Triton, OpenCL, SYCL, or ROCm* Demonstrated experience with NVIDIA PTX and/or AMD GPU ISA* Experience developing high performance libraries for HPC applications* Proficiency in low-level performance optimization for GPUs* Experience with LLVM/MLIR backend development for GPUs* Knowledge of ML frameworks (PyTorch, TensorFlow) and their GPU backends* Experience with parallel programming and optimization techniques* Understanding of GPU memory hierarchies and optimization strategiesAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.CAN, ON, Toronto - 150,700.00 - 251,700.00 CAD annuallyCompany
Amazon Development Centre Canada ULCJob ID: A10526701
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Ml Kernel Performance Engineer in Winnipeg, MB vacancy
- Elevate your career with Amazon as a Machine Learning Kernel Performance Engineer, focusing on high-performance kernels. Join the Annapurna Labs team... ...shape the future of AI acceleration technology. In this senior role, contribute your expertise in ML model acceleration while...SeniorPerformanceInternship
- Amazon Web Services (AWS) Annapurna Labs seeks a ML Kernel Performance Engineer for AWS Neuron, to push high-performance kernel development for Inferentia and Trainium. You will design and optimize kernels, collaborate across compiler, runtime, framework, and hardware teams,...Performance
- Baseten is seeking a GPU Kernel Engineer to design and optimize high-performance GPU kernels for AI workloads. You will work on low-level optimization, leveraging CUDA C++ and tensor cores to accelerate core ML operations, with exposure to state-of-the-art inference systems...Performance
- Advance machine learning acceleration through kernel optimization, GPU expertise, and parallel programming for Amazon's Neuron platform in Toronto.As a Senior GPU and ML Kernel Optimization Engineer, you will work at the hardware-software boundary within Amazon's Acceleration...SeniorPerformance
$114.8k - $191.8k per year
ML Kernel Performance Engineer, AWS Neuron, Annapurna LabsThe Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and...PerformanceInternshipWork from home- Optimize machine learning performance at Waabi through CPU and GPU profiling, memory analysis, and efficient training frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across model...SeniorPerformance
- ...inference. About The RoleThe Core ML team develops novel machine... ...capabilities of the Cerebras Wafer-Scale Engine. Our work spans efficient LLM... ..., runtimes, and low-level kernels to implement new algorithmic capabilities, diagnose performance bottlenecks, and turn research prototypes...Performance
- ...the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come... ...reach. Falcon is built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a...SeniorPerformanceRemote workWorldwideFlexible hours
- Senior Staff ML Compiler and Performance EngineerMarkham, Ontario Senior Staff Compiler EngineerCanada - RemoteWe are partnered with a global leader in... ...search for a Senior-Staff level compiler optimization engineer to join their growing AI/ML R&D team. General Summary...SeniorPerformance
$120k - $195k per year
...several prestigious awards, such as Best Engineering Team, Best Company for Diversity,... ...maintain the highest standards of quality and performance in everything we do.Job Description Who... ...developing and maintaining the Linux kernel in EOS. This includes keeping pace with...SeniorPerformance$180k - $360k per year
...us and help build the platform engineers turn to ship AI products. The RoleWe’re seeking a GPU Kernel Engineer to join our team... ...your code directly impacts the performance of state-of-the-art machine learning... ...GPU kernels for key ML operations, including matrix multiplications...PerformanceFlexible hours- Advance Linux kernel networking at Arista Networks through C development, upstream collaboration, and customer-focused problem solving for EOS.This senior engineering role supports the Linux Kernel team responsible for EOS across data center, campus, and routing environments...Senior
- Kernel Engineer (AI Accelerator)We are seeking a full remote Kernel Engineer to join a heavily funded... ...of the accelerators, identifying performance bottlenecks and power efficiency improvements... ...North AmericaSeniority level: Mid-Senior levelEmployment type: Full-timeJob function...SeniorPerformanceRemote work
$80 per hour
SENIOR MACHINE LEARNING ENGINEER (Azure MLOps; Enterprise AI & Data Centre of Excellence) Requisition... ...data distribution that could affect performance when deploying the model in the real... ...Automate, VSCode, Git, Jira, Azure (ML Studio, AI Foundry), Databricks.Deep...SeniorPerformanceHourly payFor contractorsWork at office- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the... ...offices. Ideal candidates have 5+ years of high-performance coding experience in C++ or Python and...PerformanceRemote work
- ...Qualcomm Canada ULC is advancing on-device AI by developing ML/AI compilers for efficient mapping of workloads on Qualcomm hardware. You will contribute to compiler development, optimize performance and power, and study ML workloads to inform future HW/SW features, with a focus...Performance
- ...Physical AI. We're a small, fast-moving team of engineers and researchers from leading AI labs,... ..., GPU utilization, memory pressure, and kernel efficiency with PyTorch Profiler, Nsight... ...-aware placement, scaling efficiency, performance isolation, and diagnosing failures that emerge...Performance
- ...Chez Ubisoft, programmez des systèmes ML en C++ avec une expertise en moteurs d’inférence, tests, performance et architecture logicielle. Ce poste de programmeur principal C++ contribue à la feuille de route des applications d’apprentissage automatique. Vous développerez...SeniorPerformanceApprenticeship
- ...collaborative team at Katalyst Data Management (KDM)! KDM is seeking a Senior AI/ML Engineer to help design, build, and operate the infrastructure that... ...full‑text search, ranking/relevance, indexing strategy, and performance optimization. Experience working in cloud environments...SeniorPerformanceFull timeCasual workWork at officeLocal areaWorldwideMonday to friday
- ...profile model runtime and memory to pinpoint performance bottlenecks.Identify and evaluate... ...frameworks. Examples include designing new CUDA kernels, quantization‑aware training and... ...deployment techniques.Work with researchers and ML engineers on best‑practices for optimal resource...SeniorPerformance
$150k - $180k per year
Senior Silicon ML EngineerCognichip Location: Toronto, ON, CA FULL_TIME Salary: 150,000–180,000 CAD / year At Cognichip, we’re not just... ...nexus of silicon design and machine learning. As a Silicon ML Engineer on our team, you’ll fuse knowledge of chip design and ML into...SeniorFull timeInternship- Join Behavox as a Senior DevOps Engineer and advance your career in machine learning infrastructure. Your role focuses on scalable development within AWS and GCP environments to optimize ML models. This position offers a unique greenfield opportunity to create high-impact...Senior
- # Senior AI/ML EngineerLimbic173k-192k CADFull-timeremote· seniorCanadallmpythontypescriptjavascriptsqlListed via Jobicy · posted 22 Oct 2026... ..., not on DevConnect.Apply on Jobicy## DescriptionSenior AI/ML Engineer, remote in Canada: own the AI that assesses patients for US...SeniorRemote work
- ...architectures, combined with auto-tuned high performance for production environments across... ..., high-performance deep learning kernels and tooling to accelerate machine learning... ...problèmes spécifiques du domaine d'IA.Software Engineer, Systems ML - Frameworks / Compilers / DL-Kernels |...PerformanceApprenticeshipFlexible hours
- Engineer the next generation of AI/ML tooling as a Senior Software Engineer. Focus on building infrastructure that enhances ML deployment and training methodologies... ...ML • Develop ML platform offerings for better performance • Partner with teams to implement comprehensive solutions...SeniorPerformance
- ...through CivCheck and Guided AI Plan Review. We seek a Senior MLOps Engineer to design robust ML infrastructure, enabling reliable production from research... ...to productionize models while driving cost and performance optimizations. This remote role offers travel and collaboration...SeniorPerformanceRemote work
$120k - $145k per year
...growth.Reporting to the Director of Engineering & Predictive Analytics, the Senior Software Engineer will contribute... ...analytics products that leverage AI and ML.This position is part of the... ...skills, seniority, geographic location, performance, shift, travel requirements, sales...SeniorPerformanceWork at officeRemote workFlexible hoursShift work$176.76k - $232k per year
Description & RequirementsWho we are lululemon is an innovative performance apparel company for yoga, running, training, and other... ...drives enterprise efficiency. Core responsibilitiesAs a Senior AI/ML Engineer, you will lead the delivery of scalable AI/ML solutions to business...SeniorPerformancePermanent employmentContract workPart timeWork visa- Become a Senior Applied ML Engineer with MaintainX, a leader in cloud-based asset intelligence. Spearhead advancements in predictive maintenance... ...Create effective data pipelines for model training • Enhance ML performance using advanced techniques Requirements: • 7+ years of...SeniorPerformance
- Position SummaryThe AI/ML Engineer will design, develop, integrate and deploy AI and machine... ...maintainability Evaluate AI solution quality, performance, accuracy, cost and scalability Apply... ...as LangChain, LlamaIndex or Semantic Kernel Familiarity with vector databases,...Performance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Kernel Performance Engineer. Be the first to apply!
Related searches
- machine learning engineer Winnipeg, MB
- junior machine learning developer Winnipeg, MB
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB
- senior project manager Winnipeg, MB
- senior communications Winnipeg, MB
- sr. IT support analyst Winnipeg, MB

