Senior Ml Inference & Compiler Architect
$135k - $185k per yearNVIDIA Corporation
A leading technology company located in Toronto is seeking a Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a strong background in C/C++, compiler development, and deep learning frameworks. This role involves close collaboration with hardware teams, benchmarking performance metrics, and contributing innovative solutions for NVIDIA's platforms. The base salary ranges from 135,000 CAD to 185,000 CAD, depending on level and experience.#J-18808-Ljbffr
- Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing...Senior
- Senior Staff ML Compiler and Performance EngineerMarkham, Ontario Senior Staff Compiler EngineerCanada - RemoteWe are partnered with a global leader in the semiconductor industry, assisting in the search for a Senior-Staff level compiler optimization engineer to join their...Senior
- ...future of Java. Falcon is the optimizing just in time (JIT) compiler in Azul Platform Prime. It compiles hot Java bytecode into highly... ...do not reach. Falcon is built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of...SeniorRemote workWorldwideFlexible hours
- ...deliver industry-leading training and inference speeds; over 10 times faster than... ...-Scale Engine. We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous... ...closely with model enablement, compiler, runtime, cloud infrastructure,...Senior
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset... ...(classifiers, LLM‑based evaluators) and familiarity with LLM inference optimization (e.g. vLLM, SGLang). Familiarity with containerized...SeniorInternship
$155.89k - $220.07k per year
The Compiler Engineering team in Data Center Group at Intel has an opportunity available for a Senior Compiler Engineer. At Intel, we are building the... ...ecosystems such as PyTorch, inference engines, and machine-... ....Partnering with hardware architects and platform teams to enable...SeniorLocal areaShift work$155.89k - $220.07k per year
...Details: Job Description: The Compiler Engineering team within Intel... ...talented and passionate Senior Compiler Engineers to help shape... ...machine learning frameworks, and inference platforms. Responsibilities... ...closely with hardware architects to influence the design and enablement...SeniorLocal areaImmediate startShift work- ...with a focus on the performance, reliability, and scalability of inference systems. Join us and help influence how billions of gaming experiences... ...-latency, high‑throughput serving infrastructure Partner with ML engineers to ensure online serving infrastructure scales with...Work at officeWorldwide
- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads. The role offers remote-friendly...Remote work
- Lead Triton compiler development at Intel in Toronto through hybrid work, applying C++ and... ...accelerated computing.This experienced-hire Senior Compiler Engineer develops technologies... ...tooling componentsCollaborate with hardware architects and AI framework developersResolve...Senior
- ...Chez Ubisoft, programmez des systèmes ML en C++ avec une expertise en moteurs d’inférence, tests, performance et architecture logicielle. Ce poste de programmeur principal C++ contribue à la feuille de route des applications d’apprentissage automatique. Vous développerez...SeniorApprenticeship
- AWS Professional Services is seeking ML/GenAI experts to help Canadian public sector clients leverage AWS services for production-ready ML solutions. You will partner with ML engineers and cloud architects to design, build, and deploy innovative GenAI workloads using Bedrock...Senior
- ## Associate Technical Architect - MLApply: Canada - Remote: Full time: Posted 2 Days... ...Year awards in the past 10 years* 3 AWS AI/ML Partner of the Year awards* 3 NVIDIA... ...sources, Training jobs, real-time and batch Inference, and Processing Jobs.* Good Experience developing...Full timeManual laborRemote workWorldwide
- eBay’s AI/ML team within the Selling organization is seeking an Applied Researcher to design and advance our research agenda across machine learning and generative AI. You will contribute to price guidance modeling and the expanding selling-agent platform, translating research...
$135k - $185k per year
We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop... ...and optimizations for our LPX inference and compiler stack. You will work... ...Collaborate closely with hardware architects and design teams to feedback software...Senior$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for... .... This role ensures that our trained models—from classical ML to generative AI—run efficiently across TR’s multi cloud footprint...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- Analyze compiler performance at Intel in Toronto through C++, LLVM, and heterogeneous computing... ...demanding AI and HPC workloads.As a Senior Compiler Engineer, you will advance compiler... ...systemsCollaborate with hardware architects on future Intel siliconRequirements: Bachelor...Senior
- ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud... ..., profiling, or system observability tools. Experience with ML inference infrastructure, model serving systems, or GPU‑...SeniorInternship
$114.89k - $162.19k per year
...Details: Job Description: The Compiler Engineering team within Intel'... ...ecosystems, including PyTorch, inference frameworks, and machine... ...technologies under the guidance of senior engineers.Building expertise in... ...applications. Exposure to AI/ML frameworks and inference stacks...SeniorInternshipManual laborLocal areaImmediate startShift work$150.7k - $251.7k per year
...performance for Amazon's custom ML accelerators. Working at the... ...comprehensive toolkit includes an ML compiler, runtime, and application... ..., enabling unparalleled ML inference and training performance.As part... ...architectures. You will architect and implement business-critical...SeniorInternship- Amazon inc. recrute des consultants IA/ML et GenAI pour soutenir des projets du secteur public canadien. Vous concevrez et déploierez... ...solutions ML/GenAI, en collaboration avec des ML Engineers, des Cloud Architects et des développeurs, en utilisant des services AWS comme Bedrock...Senior
$155.89k - $220.07k per year
...that empower modern computing. Come join us and help build the compiler technologies that drive the next generation of AI and accelerated... ..., or tooling technologies. Collaborate with hardware architects, compiler engineers, AI framework developers, and performance engineers...SeniorInternshipLocal areaImmediate startShift work$140k - $170k per year
...prioritize purpose, flexibility, connection, and recognition, so our people can thrive and love what they do, most days. Job Title:AI/ML Architect – Principal (Vacant Role) WhatYou’llDo Architect and deliver enterprise-scale AI/ML solutions including data pipelines,...InternshipWork at office- Shape scalable AI/ML architecture at 3Pillar Global, defining technical direction across domains with cloud platforms, MLOps, and responsible AI practices.As an AI/ML Architect, you will establish blueprints for AI/ML, Generative AI, Agentic AI, and MCP systems. You will advise...
- ...iA Financial Group is seeking a Solution Architect, Digital Products, to shape architecture for digital platforms, corporate websites, and Martech solutions. You will lead integration, security, and performance efforts, ensuring solutions align with business value and architecture...Senior
- ...IC Resources in Toronto seeks senior to staff-level Compiler Engineers to tackle challenges at the intersection of software, hardware and performance-... ...LLVM-based toolchains and bespoke compilers, optimizing AI/ML workloads while collaborating with architecture and silicon...Senior
$80 per hour
SENIOR DATA ANALYTICAL SPECIALIST/SCIENTIST (Azure ML; Enterprise AI & Data Centre of Excellence) Requisition #:... ...closely with Data Engineers, Data Architects, Product Managers, and technology... ...variance, overfitting and statistical inference.Advanced hands-on proficiency in...SeniorHourly payFor contractorsWork at office- Support AI and HPC software ecosystems as a Senior Compiler Engineer with Intel’s hybrid Toronto team, collaborating across hardware and compilers.Intel’s Compiler Engineering team develops technologies connecting CPUs, GPUs, accelerators, and software frameworks. This role...Senior
$165k - $330k per year
...Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies,... ...will partner directly with customers to architect, build, and deploy high-scale production AI... ...preference for Python due to its relevance in ML projects.Drive customer impact by...InternshipFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference & Compiler Architect. Be the first to apply!
- junior architect Winnipeg, MB
- summer intern architect Winnipeg, MB
- junior architectural designer Winnipeg, MB
- intern architect Winnipeg, MB
- architecte architecture Winnipeg, MB
- design architect Winnipeg, MB
- architectural designer work from home Winnipeg, MB
- collaborateur d architecte Winnipeg, MB
- architectural designer Winnipeg, MB
- architect assistant Winnipeg, MB

