Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Dev Engineer, Machine Learning Compilers, Edge Ai Compiler And Runtime Team

$114.8k - $191.8k per year

Amazon Inc.

DescriptionAmazon Devices is an inventive research and development company that designs and engineers high-profile consumer products like the Kindle family, Fire Tablets, Fire TV, Health & Wellness devices, Amazon Echo, and Astro. We are building the next generation of edge AI capabilities through our advanced compression platform, compiler and custom neural accelerator silicon. Come join us to accelerate deep learning networks on edge processors and beyond.
We are looking for a talented and passionate software engineer to be part of an exciting technology creation team at Amazon. You will have an enormous opportunity to make a large impact on the design, architecture, and implementation of deep learning technologies embedded into consumer products used every day, by people you know. The position provides an unique opportunity to contribute and make an impact from hardware design stage followed by pre and post silicon development as well as productizing it on consumer devices.
In this role you will be work along side partner science teams to develop the compiler infrastructure and lower deep learning workloads to heterogeneous device backends. You will also partner up with peer science teams to innovate on model quantization and compression techniques for efficient execution on hardware.
Key Job Responsibilities
Design and develop software stack for deep learning accelerator
Develop Compiler passes for graph ingestions, optimizations and partitioning.
Develop backend code generation capabilities across heterogeneous platforms
Profile, analyze and optimize system level performance, develop new tooling where necessary
Participate in design reviews, API development, and documentation
Successfully collaborate with hardware, software, applied science and product teams to onboard more and more user experiences to be powered by Deep Learning accelerator.
Mentor and provide guidance to junior engineers
A Day in the LifeYou join a small team building the compiler that brings large AI models to a new generation of custom silicon. The chip has a fraction of the memory of a phone, and the compiler is what makes language models run on it at all. The team is small enough that each engineer owns a meaningful piece of the system end to end. There is no layer between you and the problem.
The morning starts with results from an overnight run. A piece of the compiler you own just produced its tightest result yet on a real model. You ship the change for hardware validation.
You spend the afternoon directing AI agents through the codebase, reviewing their changes, and steering the design.
Before lunch, you load your compiled model onto the chip and run it through a demo app you wrote yourself, watching tokens stream out of silicon you helped make work. Later, you meet with the research team. They depend on your component. You sketch a cleaner interface together.
About The TeamWe sit at the intersection of AI models and custom silicon, and our work decides what is possible at the edge.
Engineers here bring deep experience across compilers and program analysis, optimization algorithms, computer architecture, machine learning systems, and the practical craft of getting large software to run reliably under tight constraints. People have shipped production code generators, tuned schedulers for novel hardware, and worked at every layer from the model down to the bare metal.
Because the team is small, you work alongside that experience daily, not at a distance. You partner directly with researchers shaping the models, hardware engineers shaping the silicon, and firmware engineers shaping the runtime. You learn how each layer constrains and unlocks the others, and you see your decisions land end to end.
This is a place to build technical depth quickly and own work that matters from day one.
Basic Qualifications
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
3+ years of non-internship professional software development experience
3+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience
Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Experience in embedded development in C/C++
Knowledge of system performance, memory management, and parallel computing principles
Experience building compiler for application specific accelerators or custom instruction set
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.
CAN, BC, Vancouver - 114,800.00 - 191,800.00 CAD annually
CompanyAmazon Development Centre Canada ULC
Job ID: A10539293
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Software Dev Engineer, Machine Learning Compilers, Edge Ai Compiler And Runtime Team in Winnipeg, MB vacancy
  • $170.4k - $234.3k per year

     ...future of physical operations and be on a team that’s shaping an exciting array of...  ...term. About the role: The Samsara AI team builds end-to-end AI solutions for our...  ...ML infrastructure for Samsara. As a Staff Machine Learning Engineer, you will be working with petabyte... 
    Suggested
    Long term contract
    Internship
    Remote work
    Relocation package
    Flexible hours

    Samsara Inc.

    Winnipeg, MB
    1 hour ago
  • Optimize edge AI systems with Python, C++, or Rust as a remote Staff Machine Learning Engineer serving candidates across Canada. Work with petabyte-scale data.As a Staff Machine Learning Engineer on Samsara’s AI team, you will build end-to-end solutions and core machine learning... 
    Suggested
    Long term contract
    Remote work

    Samsara

    Winnipeg, MB
    1 hour ago
  • $129.2k - $174.8k per year

     ...Clio is the global leader in legal AI technology, empowering legal professionals and law firms of every size to work smarter...  ...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is... 
    Suggested
    Work at office
    Local area
    Flexible hours
    1 day per week

    Clio

    Winnipeg, MB
    7 days ago
  •  ...deep-tech startup at the forefront of the AI revolution. We are building a new class...  ...processors (AMPL™) designed for the extreme edge. Our technology enables complex AI, from...  ...are seeking a seasoned and innovative Machine Learning Lead to own the technical strategy and execute... 
    Suggested
    Remote work
    Relocation

    Blumind

    Winnipeg, MB
    1 hour ago
  •  ...Development Centre Canada ULC in Vancouver, BC seeks an experienced software engineer to design and implement software for a deep learning accelerator. You will collaborate across hardware, software, and applied science teams to bring models to edge silicon and productize them on... 
    Suggested

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise. This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform capabilities for model development... 

    The Institute for Performance and Learning

    Winnipeg, MB
    7 days ago
  • Develop AWS Neuron software for machine learning acceleration in Toronto, combining backend systems, web interfaces, CLI workflows, and performance analysis.As a Senior Software Development Engineer, you will work on Neuron Explorer, which profiles, debugs, and analyzes workloads... 

    Amazon Inc.

    Winnipeg, MB
    1 hour ago
  • Company: Qualcomm Canada ULCJob Area: Engineering Group, Engineering Group Machine Learning EngineeringGeneral Summary: AI is revolutionizing how we solve complex, cross-domain challenges—and Generative AI (GenAI) and Agentic AI is at the forefront of this transformation... 

    Qualcomm

    Winnipeg, MB
    1 hour ago
  • $114.4k - $164.4k per year

    Company Qualcomm Canada ULCJob Area Engineering Group, Engineering Group Machine Learning EngineeringGeneral Summary AI’s ability to solve complex problems across multiple domains is transformative. In the AI Software team, we build the Qualcomm AI Engine direct... 
    Work from home

    Qualcomm

    Winnipeg, MB
    1 hour ago
  • $135k - $185k per year

    We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning... 

    NVIDIA Corporation

    Winnipeg, MB
    1 hour ago
  • Ema builds AI employees that carry out complex workflows across enterprise applications. Our ML team works on the loop that makes them better: production...  ...run optimizes for themData engines and evaluation. Mine...  ...user- and tenant-level learnings. Separate failures of retrieval... 

    Ema

    Winnipeg, MB
    1 hour ago
  •  ...is building the world's leading Agentic AI platform to transform enterprise productivity...  ..., Coinbase, Flipkart, and Okta, our team includes engineers from premier tech companies and...  ...re looking for innovative and passionate Machine Learning Engineers to join our team. You... 

    Ema

    Winnipeg, MB
    1 hour ago
  • Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms...  ...Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop software... 

    Sapphire Stream Technology

    Winnipeg, MB
    1 hour ago
  •  ...and close the loop on real-world edge cases What we are looking for ~ Degree in CS, engineering, math, or equivalent hands-on depth...  ...and modern ML tooling; document AI or OCR a plus ~ Comfort owning problems end to end in a small team Degree in CS, engineering,... 

    NutraMate Technologies Inc.

    Winnipeg, MB
    1 hour ago
  • Build software for custom ML accelerator silicon at Amazon, using C++, Python,...  ...disciplines.This Software Development Engineer role focuses on accelerator-stack...  ...and optimization. You may work with compiler toolchains, device drivers, runtime libraries, profiling tools,... 

    Amazon

    Winnipeg, MB
    1 hour ago
  • Build machine learning software for automotive manufacturing with Python and production model deployment. Work hybrid in Woodstock, Ontario, with weekly Cambridge travel.As an ML software engineer consultant, you will develop applications through full software development cycles... 
    Work at office

    Procom

    Winnipeg, MB
    1 hour ago
  • Build production-grade AI/ML systems in Toronto, using strong Python skills and machine learning expertise to solve real-world problems. This consulting role focuses on scalable models.As an AI Engineer, you will work with structured and unstructured data while productizing... 

    Ample Insight

    Winnipeg, MB
    1 hour ago
  • Join Workday as a Lead Software Development Engineer specializing in AI platforms in Vancouver, BC. Play a key role in developing cutting-edge AI features that enhance the user experience. As a leader within the team, you will collaborate with engineers and ML experts to build... 

    Workday, Inc. (old)

    Winnipeg, MB
    1 hour ago
  • $86k - $130k per year

     ...sustainable pension plan. An industry leading global investor with teams in Toronto to London, New York, Singapore, Sydney and other...  ...anywhere — come build tomorrow together with us. Lead, AI/Machine Learning Engineer The Lead, AI/Machine Learning Engineer will join... 
    Long term contract
    Temporary work
    Internship
    Work at office
    Flexible hours

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...inference for the world's most dynamic AI companies, like Cursor, Notion,...  ...of AI to bring cutting-edge models into production. We're growing...  ...us and help build the platform engineers turn to ship AI products....  .... You’ll join a small founding team of Baseten Voice AI, focused on... 
    Long term contract
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...optimizing just in time (JIT) compiler in Azul Platform Prime. It compiles...  ...into highly optimized machine code and delivers Java performance...  ...a Senior Compiler Performance Engineer to own major performance areas...  ...will work in a distributed team of compiler experts, with direct... 
    Remote work
    Worldwide
    Flexible hours

    Azul

    Winnipeg, MB
    7 days ago
  •  ...important work of your career.About the team Stripe processes over $1T in payments...  ...makes Stripe one of the best places to do machine learning. The ML Infra team builds services and tools...  ...developments happening in the field of AI, we are positioned to accelerate the adoption... 

    EngineersOfAI

    Winnipeg, MB
    1 hour ago
  • Elevate your career as an AI Engineer with Triunity Software in Calgary, AB. Focus on designing impactful AI solutions and advancing your skills in machine learning technologies. We are seeking an AI Engineer at Triunity Software to join our collaborative team in Calgary... 

    Triunity Software, Inc.

    Winnipeg, MB
    1 hour ago
  • Design production-ready AI and machine learning solutions remotely within Ontario, using Python, RAG, and leading large language models.Trojan Technologies seeks an AI Engineer to build and scale capabilities across remote monitoring and business workflows. You will develop... 
    Remote work

    Trojan Technologies

    Winnipeg, MB
    1 hour ago
  • Develop machine learning tools at Digital Domain using C++ and Python for animation, character effects, and grooming systems. Work fully remotely from British Columbia or in Vancouver.As a Software Engineer, you will create innovative tooling for visual effects production. You... 
    Remote work

    Digital Domain

    Winnipeg, MB
    1 hour ago
  • Key job responsibilities Collaborate with cross-disciplinary teams that may include hardware design, firmware, compiler, runtime, and ML engineers to develop software that enables and optimizes custom ML accelerator siliconDesign, develop, and test software across the accelerator... 

    Amazon

    Winnipeg, MB
    1 hour ago
  •  ...precision and impact. What Data team at Hive looks like Hive’s R&...  .... As a Senior Data Engineer, you’ll play a vital role in evolving...  ...and what you build. You use AI coding agents (e.g. Claude Code...  ...Python ML tooling (pandas, scikit-learn; familiarity with PyTorch or... 
    Summer work
    Remote work
    Flexible hours

    Hive

    Winnipeg, MB
    1 hour ago
  • Transform business innovation at Vanguard as a Senior AI & Machine Learning Engineer. In this role, you'll design and build scalable AI solutions that drive operational effectiveness across the enterprise. We seek a skilled candidate with a strong software engineering background... 

    Vanguard

    Winnipeg, MB
    1 hour ago
  • Build AI/ML solutions for Manulife’s Canada Retirement business as a Senior Software Engineer focused on RAG and agentic SDLC practices.This senior engineering role designs, develops, tests, and maintains production applications and services. You will apply Java, C#, Python... 

    Company 1 - The Manufacturers Life Insurance Company

    Winnipeg, MB
    1 hour ago
  • Ema is seeking a Machine Learning Software Engineer to enhance AI employee performance through innovative workflows. Engage in applied research and engineering to optimize agent behavior in diverse enterprise applications. As a key member of Ema's ML team, you will explore... 

    Ema

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Dev Engineer, Machine Learning Compilers, Edge Ai Compiler And Runtime Team. Be the first to apply!