Software Dev Engineer, Machine Learning Compilers, Edge Ai Compiler And Runtime Team
$114.8k - $191.8k per yearAmazon Inc.
DescriptionAmazon Devices is an inventive research and development company that designs and engineers high-profile consumer products like the Kindle family, Fire Tablets, Fire TV, Health & Wellness devices, Amazon Echo, and Astro. We are building the next generation of edge AI capabilities through our advanced compression platform, compiler and custom neural accelerator silicon. Come join us to accelerate deep learning networks on edge processors and beyond.
We are looking for a talented and passionate software engineer to be part of an exciting technology creation team at Amazon. You will have an enormous opportunity to make a large impact on the design, architecture, and implementation of deep learning technologies embedded into consumer products used every day, by people you know. The position provides an unique opportunity to contribute and make an impact from hardware design stage followed by pre and post silicon development as well as productizing it on consumer devices.
In this role you will be work along side partner science teams to develop the compiler infrastructure and lower deep learning workloads to heterogeneous device backends. You will also partner up with peer science teams to innovate on model quantization and compression techniques for efficient execution on hardware.
Key Job Responsibilities
Design and develop software stack for deep learning accelerator
Develop Compiler passes for graph ingestions, optimizations and partitioning.
Develop backend code generation capabilities across heterogeneous platforms
Profile, analyze and optimize system level performance, develop new tooling where necessary
Participate in design reviews, API development, and documentation
Successfully collaborate with hardware, software, applied science and product teams to onboard more and more user experiences to be powered by Deep Learning accelerator.
Mentor and provide guidance to junior engineers
A Day in the LifeYou join a small team building the compiler that brings large AI models to a new generation of custom silicon. The chip has a fraction of the memory of a phone, and the compiler is what makes language models run on it at all. The team is small enough that each engineer owns a meaningful piece of the system end to end. There is no layer between you and the problem.
The morning starts with results from an overnight run. A piece of the compiler you own just produced its tightest result yet on a real model. You ship the change for hardware validation.
You spend the afternoon directing AI agents through the codebase, reviewing their changes, and steering the design.
Before lunch, you load your compiled model onto the chip and run it through a demo app you wrote yourself, watching tokens stream out of silicon you helped make work. Later, you meet with the research team. They depend on your component. You sketch a cleaner interface together.
About The TeamWe sit at the intersection of AI models and custom silicon, and our work decides what is possible at the edge.
Engineers here bring deep experience across compilers and program analysis, optimization algorithms, computer architecture, machine learning systems, and the practical craft of getting large software to run reliably under tight constraints. People have shipped production code generators, tuned schedulers for novel hardware, and worked at every layer from the model down to the bare metal.
Because the team is small, you work alongside that experience daily, not at a distance. You partner directly with researchers shaping the models, hardware engineers shaping the silicon, and firmware engineers shaping the runtime. You learn how each layer constrains and unlocks the others, and you see your decisions land end to end.
This is a place to build technical depth quickly and own work that matters from day one.
Basic Qualifications
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
3+ years of non-internship professional software development experience
3+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience
Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Experience in embedded development in C/C++
Knowledge of system performance, memory management, and parallel computing principles
Experience building compiler for application specific accelerators or custom instruction set
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.
CAN, BC, Vancouver - 114,800.00 - 191,800.00 CAD annually
CompanyAmazon Development Centre Canada ULC
Job ID: A10539293
#J-18808-Ljbffr
We are looking for a talented and passionate software engineer to be part of an exciting technology creation team at Amazon. You will have an enormous opportunity to make a large impact on the design, architecture, and implementation of deep learning technologies embedded into consumer products used every day, by people you know. The position provides an unique opportunity to contribute and make an impact from hardware design stage followed by pre and post silicon development as well as productizing it on consumer devices.
In this role you will be work along side partner science teams to develop the compiler infrastructure and lower deep learning workloads to heterogeneous device backends. You will also partner up with peer science teams to innovate on model quantization and compression techniques for efficient execution on hardware.
Key Job Responsibilities
Design and develop software stack for deep learning accelerator
Develop Compiler passes for graph ingestions, optimizations and partitioning.
Develop backend code generation capabilities across heterogeneous platforms
Profile, analyze and optimize system level performance, develop new tooling where necessary
Participate in design reviews, API development, and documentation
Successfully collaborate with hardware, software, applied science and product teams to onboard more and more user experiences to be powered by Deep Learning accelerator.
Mentor and provide guidance to junior engineers
A Day in the LifeYou join a small team building the compiler that brings large AI models to a new generation of custom silicon. The chip has a fraction of the memory of a phone, and the compiler is what makes language models run on it at all. The team is small enough that each engineer owns a meaningful piece of the system end to end. There is no layer between you and the problem.
The morning starts with results from an overnight run. A piece of the compiler you own just produced its tightest result yet on a real model. You ship the change for hardware validation.
You spend the afternoon directing AI agents through the codebase, reviewing their changes, and steering the design.
Before lunch, you load your compiled model onto the chip and run it through a demo app you wrote yourself, watching tokens stream out of silicon you helped make work. Later, you meet with the research team. They depend on your component. You sketch a cleaner interface together.
About The TeamWe sit at the intersection of AI models and custom silicon, and our work decides what is possible at the edge.
Engineers here bring deep experience across compilers and program analysis, optimization algorithms, computer architecture, machine learning systems, and the practical craft of getting large software to run reliably under tight constraints. People have shipped production code generators, tuned schedulers for novel hardware, and worked at every layer from the model down to the bare metal.
Because the team is small, you work alongside that experience daily, not at a distance. You partner directly with researchers shaping the models, hardware engineers shaping the silicon, and firmware engineers shaping the runtime. You learn how each layer constrains and unlocks the others, and you see your decisions land end to end.
This is a place to build technical depth quickly and own work that matters from day one.
Basic Qualifications
2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
3+ years of non-internship professional software development experience
3+ years of programming using a modern programming language such as Java, C++, or C#, including object-oriented design experience
Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware
Preferred Qualifications
3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
Bachelor's degree in computer science or equivalent
Experience in embedded development in C/C++
Knowledge of system performance, memory management, and parallel computing principles
Experience building compiler for application specific accelerators or custom instruction set
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.
CAN, BC, Vancouver - 114,800.00 - 191,800.00 CAD annually
CompanyAmazon Development Centre Canada ULC
Job ID: A10539293
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Software Dev Engineer, Machine Learning Compilers, Edge Ai Compiler And Runtime Team in Winnipeg, MB vacancy
$170.4k - $234.3k per year
...future of physical operations and be on a team that’s shaping an exciting array of... ...term. About the role: The Samsara AI team builds end-to-end AI solutions for our... ...ML infrastructure for Samsara. As a Staff Machine Learning Engineer, you will be working with petabyte...SuggestedLong term contractInternshipRemote workRelocation packageFlexible hours- Optimize edge AI systems with Python, C++, or Rust as a remote Staff Machine Learning Engineer serving candidates across Canada. Work with petabyte-scale data.As a Staff Machine Learning Engineer on Samsara’s AI team, you will build end-to-end solutions and core machine learning...SuggestedLong term contractRemote work
$129.2k - $174.8k per year
...Clio is the global leader in legal AI technology, empowering legal professionals and law firms of every size to work smarter... ...faster, and more securely. We are currently seeking a Machine Learning Engineer to join our rapidly growing engineering team. This role is...SuggestedWork at officeLocal areaFlexible hours1 day per week- ...deep-tech startup at the forefront of the AI revolution. We are building a new class... ...processors (AMPL™) designed for the extreme edge. Our technology enables complex AI, from... ...are seeking a seasoned and innovative Machine Learning Lead to own the technical strategy and execute...SuggestedRemote workRelocation
- ...Build scalable machine learning platforms at PointClickCare using Python, Java, and MLOps expertise. This role supports AI products across healthcare. As a Senior Machine Learning Systems Engineer, you will design, build, and operate platform capabilities for model development...Suggested
- ...Development Centre Canada ULC in Vancouver, BC seeks an experienced software engineer to design and implement software for a deep learning accelerator. You will collaborate across hardware, software, and applied science teams to bring models to edge silicon and productize them on...
$114.4k - $164.4k per year
Company Qualcomm Canada ULCJob Area Engineering Group, Engineering Group Machine Learning EngineeringGeneral Summary AI’s ability to solve complex problems across multiple domains is transformative. In the AI Software team, we build the Qualcomm AI Engine direct...$135k - $185k per year
We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning...- Company: Qualcomm Canada ULCJob Area: Engineering Group, Engineering Group Machine Learning EngineeringGeneral Summary: AI is revolutionizing how we solve complex, cross-domain challenges—and Generative AI (GenAI) and Agentic AI is at the forefront of this transformation...
- Develop AWS Neuron software for machine learning acceleration in Toronto, combining backend systems, web interfaces, CLI workflows, and performance analysis.As a Senior Software Development Engineer, you will work on Neuron Explorer, which profiles, debugs, and analyzes workloads...
- Build software for custom ML accelerator silicon at Amazon, using C++, Python,... ...disciplines.This Software Development Engineer role focuses on accelerator-stack... ...and optimization. You may work with compiler toolchains, device drivers, runtime libraries, profiling tools,...
- Ema builds AI employees that carry out complex workflows across enterprise applications. Our ML team works on the loop that makes them better: production... ...run optimizes for themData engines and evaluation. Mine... ...user- and tenant-level learnings. Separate failures of retrieval...
- ...and close the loop on real-world edge cases What we are looking for ~ Degree in CS, engineering, math, or equivalent hands-on depth... ...and modern ML tooling; document AI or OCR a plus ~ Comfort owning problems end to end in a small team Degree in CS, engineering,...
- Build production-grade AI/ML systems in Toronto, using strong Python skills and machine learning expertise to solve real-world problems. This consulting role focuses on scalable models.As an AI Engineer, you will work with structured and unstructured data while productizing...
- ...is building the world's leading Agentic AI platform to transform enterprise productivity... ..., Coinbase, Flipkart, and Okta, our team includes engineers from premier tech companies and... ...re looking for innovative and passionate Machine Learning Engineers to join our team. You...
- Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms... ...Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will develop software...
- Join Workday as a Lead Software Development Engineer specializing in AI platforms in Vancouver, BC. Play a key role in developing cutting-edge AI features that enhance the user experience. As a leader within the team, you will collaborate with engineers and ML experts to build...
- Build machine learning software for automotive manufacturing with Python and production model deployment. Work hybrid in Woodstock, Ontario, with weekly Cambridge travel.As an ML software engineer consultant, you will develop applications through full software development cycles...Work at office
$86k - $130k per year
...sustainable pension plan. An industry leading global investor with teams in Toronto to London, New York, Singapore, Sydney and other... ...anywhere — come build tomorrow together with us. Lead, AI/Machine Learning Engineer The Lead, AI/Machine Learning Engineer will join...Long term contractTemporary workInternshipWork at officeFlexible hours$165k - $330k per year
...inference for the world's most dynamic AI companies, like Cursor, Notion,... ...of AI to bring cutting-edge models into production. We're growing... ...us and help build the platform engineers turn to ship AI products.... .... You’ll join a small founding team of Baseten Voice AI, focused on...Long term contractFlexible hours- Key job responsibilities Collaborate with cross-disciplinary teams that may include hardware design, firmware, compiler, runtime, and ML engineers to develop software that enables and optimizes custom ML accelerator siliconDesign, develop, and test software across the accelerator...
- ...optimizing just in time (JIT) compiler in Azul Platform Prime. It compiles... ...into highly optimized machine code and delivers Java performance... ...a Senior Compiler Performance Engineer to own major performance areas... ...will work in a distributed team of compiler experts, with direct...Remote workWorldwideFlexible hours
- Design production-ready AI and machine learning solutions remotely within Ontario, using Python, RAG, and leading large language models.Trojan Technologies seeks an AI Engineer to build and scale capabilities across remote monitoring and business workflows. You will develop...Remote work
- ...important work of your career.About the team Stripe processes over $1T in payments... ...makes Stripe one of the best places to do machine learning. The ML Infra team builds services and tools... ...developments happening in the field of AI, we are positioned to accelerate the adoption...
- Elevate your career as an AI Engineer with Triunity Software in Calgary, AB. Focus on designing impactful AI solutions and advancing your skills in machine learning technologies. We are seeking an AI Engineer at Triunity Software to join our collaborative team in Calgary...
- ...precision and impact. What Data team at Hive looks like Hive’s R&... .... As a Senior Data Engineer, you’ll play a vital role in evolving... ...and what you build. You use AI coding agents (e.g. Claude Code... ...Python ML tooling (pandas, scikit-learn; familiarity with PyTorch or...Summer workRemote workFlexible hours
- ...analytics products at Aquatic Informatics in Vancouver, working remotely with optional Wednesday office collaboration. Apply AI, ML, and software engineering skills.As a Senior Software Engineer, you will develop intelligent water technologies with engineers, data scientists,...Work at officeRemote work
- Design production AI solutions at Nutrien using Python, generative AI, and machine learning engineering expertise. Build reusable capabilities for agriculture.This senior hands-on engineer translates business opportunities into deployed AI solutions and reusable capabilities...For contractors
- Join the forefront of AI solutions as a Machine Learning Engineer specializing in advanced model development and team mentorship. Focus on integrating ML capabilities for dynamic applications. As a Machine Learning Engineer, you will design and deploy high-performance ML...
- Ema is seeking a Machine Learning Software Engineer to enhance AI employee performance through innovative workflows. Engage in applied research and engineering to optimize agent behavior in diverse enterprise applications. As a key member of Ema's ML team, you will explore...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Dev Engineer, Machine Learning Compilers, Edge Ai Compiler And Runtime Team. Be the first to apply!
Related searches
- software engineer part time Winnipeg, MB
- software engineer Winnipeg, MB
- software design engineer Winnipeg, MB
- software engineer - computer Winnipeg, MB
- software developer internship no experience Winnipeg, MB
- ingénieur logiciel Winnipeg, MB
- software engineer co-op Winnipeg, MB
- software development engineer Winnipeg, MB
- software developer Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB

