Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ml Kernel Performance Engineer, Aws Neuron, Annapurna Labs

$114.8k - $191.8k per year

Ml Jobs

ML Kernel Performance Engineer, AWS Neuron, Annapurna LabsThe Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium.
The Acceleration Kernel Library team is at the forefront of maximizing performance for AWS’s custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions, ensuring every FLOP counts in delivering optimal performance for our customers’ demanding workloads. We combine deep hardware knowledge with ML expertise to push the boundaries of what’s possible in AI acceleration.
The AWS Neuron SDK, developed by the Annapurna Labs team at AWS, is the backbone for accelerating deep learning and GenAI workloads on Amazon’s Inferentia and Trainium ML accelerators. This comprehensive toolkit includes an ML compiler, runtime, and application framework that seamlessly integrates with popular ML frameworks like PyTorch, enabling unparalleled ML inference and training performance.
As part of the broader Neuron Compiler organization, our team works across multiple technology layers - from frameworks and compilers to runtime and collectives. We not only optimize current performance but also contribute to future architecture designs, working closely with customers to enable their models and ensure optimal performance. This role offers a unique opportunity to work at the intersection of machine learning, high-performance computing, and distributed architectures, where you’ll help shape the future of AI acceleration technology.
This is an opportunity to work on cutting‑edge products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business‑critical features, publish cutting‑edge research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We’re inventing. We’re experimenting. It is a very unique learning culture. The team works closely with customers on their model enablement, providing direct support and optimization expertise to ensure their machine learning workloads achieve optimal performance on AWS ML accelerators.
Explore the product and our history!

Key job responsibilitiesOur kernel engineers collaborate across compiler, runtime, framework, and hardware teams to optimize machine learning workloads for our global customer base. Working at the intersection of software, hardware, and machine learning systems, you’ll bring expertise in low-level optimization, system architecture, and ML model acceleration.
Design and implement high-performance compute kernels for ML operations, leveraging the Neuron architecture and programming models
Analyze and optimize kernel-level performance across multiple generations of Neuron hardware
Conduct detailed performance analysis using profiling tools to identify and resolve bottlenecks
Implement compiler optimizations such as fusion, sharding, tiling, and scheduling
Work directly with customers to enable and optimize their ML models on AWS accelerators
Collaborate across teams to develop innovative kernel optimization techniques
A day in the lifeAs you design and code solutions to help our team drive efficiencies in software architecture, you’ll create metrics, implement automation and other improvements, and resolve the root cause of software defects. You’ll also:
Build high-impact solutions to deliver to our large customer base.
Participate in design discussions, code review, and communicate with internal and external stakeholders.
Work cross-functionally to help drive business decisions with your technical input.
Work in a startup-like development environment, where you’re always working on the most important stuff.
About the teamAmazon values diverse experiences. Even if you do not meet all of the qualifications and skills listed in the job description, we encourage candidates to apply. If your career is just starting, hasn’t followed a traditional path, or includes alternative experiences, don’t let it stop you from applying.
Inclusive Team CultureHere at Amazon, we embrace our differences. We are committed to furthering our culture of inclusion. We have ten employee’led affinity groups, reaching 40,000 employees in over 190 chapters globally. We have innovative benefit offerings, and host annual and ongoing learning experiences, including our Conversations on Race and Ethnicity (CORE) and AmazeCon (gender diversity) conferences. Amazon’s culture of inclusion is reinforced within our 16 Leadership Principles, which remind team members to seek diverse perspectives, learn and be curious, and earn trust.
Work/Life BalanceOur team puts a high value on work–life balance. It isn’t about how many hours you spend at home or at work;
it’s about the flow youestablish that brings energy to both parts of your life. We believe striking the right balance between your personal and professional life is critical to life–long happiness and fulfillment. We offer flexibility in working hours and encourage you to find your own balance between your work and personal lives.
Basic Qualifications
3+ years of non‑internship professional software development experience
2+ years of non‑internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
Experience programming with at least one software programming language
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor’s degree in computer science or equivalent
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign‑on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well‑being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.
CAN, ON, Toronto - 114,800.00 - 191,800.00 CAD annually
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ml Kernel Performance Engineer, Aws Neuron, Annapurna Labs in Winnipeg, MB vacancy
  • $114.8k - $191.8k per year

    DescriptionThe Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Annapurna Labs team at Amazon... 
    Amazon Web Service
    Performance
    Internship
    Work from home

    Amazon Web Services (AWS)

    Winnipeg, MB
    1 hour ago
  • $150.7k - $251.7k per year

    Description Annapurna Labs team at Amazon builds Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom...  ...accelerators, Inferentia and Trainium.The Acceleration Kernel Library team is at the forefront of maximizing... 
    Amazon Web Service
    Performance
    Internship

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • Amazon Web Services (AWS) Annapurna Labs seeks a ML Kernel Performance Engineer for AWS Neuron, to push high-performance kernel development for Inferentia and Trainium. You will design and optimize kernels, collaborate across compiler, runtime, framework, and hardware teams,... 
    Amazon Web Service
    Performance

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • Elevate your career with Amazon as a Machine Learning Kernel Performance Engineer, focusing on high-performance kernels. Join the Annapurna Labs team to shape the future of AI acceleration technology. In this senior role, contribute your expertise in ML model acceleration... 
    Amazon Web Service
    Performance
    Internship

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • $214.2k - $357.8k per year

    Description The Product: AWS Machine Learning accelerators are at the forefront...  ...Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud. Trainium...  ...a cutting edge software stack, the AWS Neuron Software Development Kit (SDK), which... 
    Amazon Web Service
    Performance
    Work from home
    Relocation

    Amazon Web Services (AWS)

    Winnipeg, MB
    1 hour ago
  • Baseten is seeking a GPU Kernel Engineer to design and optimize high-performance GPU kernels for AI workloads. You will work on low-level optimization, leveraging CUDA C++ and tensor cores to accelerate core ML operations, with exposure to state-of-the-art inference systems... 
    Performance

    Baseten

    Winnipeg, MB
    1 hour ago
  • $104.9k - $175.1k per year

     ...you’ll be developing hardware solution for AWS data center including AWS Inferentia,...  ...looking for a passionate Design Verification Engineer to join our newly formed team responsible...  ..., algorithms, functionality, and performance with strong overall debugging skills Experience... 
    Amazon Web Service
    Performance
    Work from home

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Cerebras works with the leading model labs, global enterprises, and...  ...inference. About The RoleThe Core ML team develops novel machine...  ...of the Cerebras Wafer-Scale Engine. Our work spans efficient LLM training...  ..., runtimes, and low-level kernels to implement new algorithmic... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Advance machine learning acceleration through kernel optimization, GPU expertise, and parallel programming for Amazon's Neuron platform in Toronto.As a Senior GPU and ML Kernel Optimization Engineer, you will work at the hardware-software boundary within Amazon's Acceleration... 
    Performance

    Ml Jobs

    Winnipeg, MB
    1 hour ago
  • $179.8k - $300.2k per year

    DescriptionAnnapurna Labs, designs custom silicon powering AWS’s cloud infrastructure. Custom SoCs live at the heart of Amazon ML servers — including Inferentia and Trainium Systems — delivering high-performance ML inference and training at cloud scale. Annapurna Labs, designs... 
    Amazon Web Service
    Performance

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • $114.8k - $191.8k per year

    Description Annapurna Labs designs silicon and software that accelerates innovation. Customers choose us to create cloud solutions that...  ...and deliver results that help our customers change the world.AWS Neuron is the complete software stack for the AWS Trainium and Inferentia... 
    Amazon Web Service
    Performance
    Internship
    Work from home

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • $161.1k - $269k per year

    DescriptionAmazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, and our Custom Silicon organization...  .... We are looking for a passionate Design Verification Engineer to join our newly formed team responsible for verifying high-speed... 
    Amazon Web Service
    Work from home

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • Remote - Canada Robots & Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work...  ...the model AWS Trainium or Inferentia (Neuron SDK) experience is a strong plus; if you... 
    Amazon Web Service
    Remote work

    Robots & Pencils

    Winnipeg, MB
    1 hour ago
  • Optimize machine learning performance at Waabi through CPU and GPU profiling, memory...  ...and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks...  ...technologies including custom CUDA kernels, quantization-aware training and... 
    Performance

    Waabi

    Winnipeg, MB
    1 hour ago
  • $180k - $360k per year

     ...us and help build the platform engineers turn to ship AI products. The RoleWe’re seeking a GPU Kernel Engineer to join our team...  ...your code directly impacts the performance of state-of-the-art machine learning...  ...GPU kernels for key ML operations, including matrix multiplications... 
    Amazon Web Service
    Performance
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...We're a small, fast-moving team of engineers and researchers from leading AI labs, tackling some of the most...  ...utilization, memory pressure, and kernel efficiency with PyTorch Profiler,...  ...aware placement, scaling efficiency, performance isolation, and diagnosing failures... 
    Performance

    Veeda AI

    Winnipeg, MB
    1 hour ago
  • Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the...  ...offices. Ideal candidates have 5+ years of high-performance coding experience in C++ or Python and... 
    Performance
    Remote work

    Cohere

    Winnipeg, MB
    1 hour ago
  • Senior Staff ML Compiler and Performance EngineerMarkham, Ontario Senior Staff Compiler EngineerCanada - RemoteWe are partnered with a global leader...  ...the search for a Senior-Staff level compiler optimization engineer to join their growing AI/ML R&D team. General Summary:... 
    Performance

    Talentlab

    Winnipeg, MB
    1 hour ago
  • Kernel Engineer (AI Accelerator)We are seeking a full remote Kernel Engineer to join a heavily funded ($150m+ Series B) team building next...  ...realizing the full capabilities of the accelerators, identifying performance bottlenecks and power efficiency improvements. You’ll build... 
    Performance
    Remote work

    Acceler8 Talent

    Winnipeg, MB
    1 hour ago
  •  ...Qualcomm Canada ULC is advancing on-device AI by developing ML/AI compilers for efficient mapping of workloads on Qualcomm hardware. You will contribute to compiler development, optimize performance and power, and study ML workloads to inform future HW/SW features, with a focus... 
    Performance

    QUALCOMM, Inc.

    Winnipeg, MB
    1 hour ago
  • $110k - $130k per year

     ...candidate will design and implement machine learning pipelines using AWS SageMaker and develop Generative AI applications. Candidates should...  ...of experience in IT, with strong knowledge of AWS services and ML frameworks. This full-time role offers a competitive salary between... 
    Amazon Web Service
    Full time

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • Vanguard is seeking an experienced ML Engineer to design, develop, and deploy end-to-end AI/ML solutions with a focus on data ingestion, feature...  ...deployment. You will build scalable, cloud-native apps using AWS SageMaker, Docker, and Kubernetes, while ensuring governance and... 
    Amazon Web Service

    The Vanguard Group

    Winnipeg, MB
    1 hour ago
  • ML Engineer (Python, MLOps, IA générative), lab IA et données, Montréal (télétravail) Poste permanent chez Abbeal : transformer des prototypes de machine learning...  ...backendPratiques MLOps, Docker et KubernetesCloud AWS, GCP ou Azure, Git et CI/CDAutonomie, rigueur et... 
    Amazon Web Service
    Permanent employment
    Remote work

    Abbeal

    Winnipeg, MB
    1 hour ago
  • Investigate complex performance issues across cloud applications as a hands-on Performance Tester...  ..., and practical knowledge of Kubernetes, AWS, Java/JVM, and PostgreSQL. You will...  ...indexingRequirements: Five or more years of performance engineering experienceRecent cloud and Kubernetes... 
    Amazon Web Service
    Performance
    Manual labor
    Remote work

    Tecsys

    Winnipeg, MB
    1 hour ago
  • $95k - $145k per year

     ...several prestigious awards, such as Best Engineering Team, Best Company for Diversity, Compensation...  ...the highest standards of quality and performance in everything we do. Job DescriptionWho You’ll Work WithArista’s Linux Kernel team is responsible for developing and maintaining... 
    Performance

    Arista Networks

    Winnipeg, MB
    1 hour ago
  •  ...bringing them the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come join...  ...on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a... 
    Performance
    Remote work
    Worldwide
    Flexible hours

    Azul

    Winnipeg, MB
    6 days ago
  •  ...architectures, combined with auto-tuned high performance for production environments across...  ..., high-performance deep learning kernels and tooling to accelerate machine learning...  ...problèmes spécifiques du domaine d'IA.Software Engineer, Systems ML - Frameworks / Compilers / DL-Kernels |... 
    Performance
    Apprenticeship
    Flexible hours

    Meta

    Winnipeg, MB
    1 hour ago
  • $110k - $130k per year

    Responsibilities AWS Cloud Computing Design and implement ML pipelines using AWS SageMaker, including data preprocessing...  ...deployed models, ensuring performance and reliability. Qualifications...  ...AI concepts (LLMs, prompt engineering). Proficiency in Python and ML... 
    Amazon Web Service
    Performance

    Astra-North Infoteck Inc.

    Winnipeg, MB
    1 hour ago
  • AWS Professional Services is seeking ML/GenAI experts to help Canadian public sector clients leverage AWS services for production-ready ML solutions. You will partner with ML engineers and cloud architects to design, build, and deploy innovative GenAI workloads using Bedrock... 
    Amazon Web Service

    Amazon Web Services (AWS)

    Winnipeg, MB
    1 hour ago
  • Amazon Web Services (AWS) Professional Services is seeking a skilled ML Engineer to join our Delivery Consulting team in Canada (Calgary). In this role, you will design, implement, and manage AWS AI/ML and GenAI solutions that meet customers' technical requirements and business... 
    Amazon Web Service

    Amazon Inc.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ml Kernel Performance Engineer, Aws Neuron, Annapurna Labs. Be the first to apply!