Senior Ml Inference & Compiler Architect
$135k - $185k per yearNVIDIA Corporation
A leading technology company located in Toronto is seeking a Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a strong background in C/C++, compiler development, and deep learning frameworks. This role involves close collaboration with hardware teams, benchmarking performance metrics, and contributing innovative solutions for NVIDIA's platforms. The base salary ranges from 135,000 CAD to 185,000 CAD, depending on level and experience.#J-18808-Ljbffr
- Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing...Senior
- ...deliver industry-leading training and inference speeds; over 10 times faster... ...-Scale Engine. We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this... ...work closely with model enablement, compiler, runtime, cloud infrastructure, product...Senior
- A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong...SeniorFlexible hours
- Senior Staff ML Compiler and Performance EngineerMarkham, Ontario Senior Staff Compiler EngineerCanada - RemoteWe are partnered with a global leader in the semiconductor industry, assisting in the search for a Senior-Staff level compiler optimization engineer to join their...Senior
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
- ...future of Java. Falcon is the optimizing just in time (JIT) compiler in Azul Platform Prime. It compiles hot Java bytecode into highly... ...do not reach. Falcon is built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of...SeniorRemote workWorldwideFlexible hours
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset... ...(classifiers, LLM‑based evaluators) and familiarity with LLM inference optimization (e.g. vLLM, SGLang). Familiarity with containerized...SeniorInternship
- ...with a focus on the performance, reliability, and scalability of inference systems. Join us and help influence how billions of gaming experiences... ...-latency, high‑throughput serving infrastructure Partner with ML engineers to ensure online serving infrastructure scales with...Work at officeWorldwide
$155.89k - $220.07k per year
The Compiler Engineering team in Data Center Group at Intel has an opportunity available for a Senior Compiler Engineer. At Intel, we are building the... ...ecosystems such as PyTorch, inference engines, and machine-... ....Partnering with hardware architects and platform teams to enable...SeniorLocal areaShift work- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads. The role offers remote-friendly...Remote work
- ...Job Description: The Compiler Engineering team within Intel's Data... ...seeking talented and passionate Senior Compiler Engineers to help... ...machine learning frameworks, and inference platforms.... ...Collaborate closely with hardware architects to influence the design and enablement...Senior
- ...Qualcomm Canada ULC is advancing on-device AI by developing ML/AI compilers for efficient mapping of workloads on Qualcomm hardware. You will contribute to compiler development, optimize performance and power, and study ML workloads to inform future HW/SW features, with a focus...
- AWS Professional Services is seeking ML/GenAI experts to help Canadian public sector clients leverage AWS services for production-ready ML solutions. You will partner with ML engineers and cloud architects to design, build, and deploy innovative GenAI workloads using Bedrock...Senior
- ...platforms - from AI accelerators to advanced silicon and compiler stacks in the heart of Toronto.We’re looking for Senior to Staff-level Compiler Engineers to join teams... ...custom compiler toolchainsOptimisation for AI / ML workloadsClose collaboration with architecture and...Senior
- Senior Data Architect / Data Modeller, AI/ML & CloudLocation: Toronto, ON (Hybrid, 3 days onsite per week, near Union Station) Language: Strong written... ...AI-ready data solutions supporting model training, inference, RAG, feature engineering, and ML pipelines. You'll...SeniorContract work3 days per week
- Job TitleAI/ML Architect LocationToronto, ON (Hybrid, 3 days onsite per week) Seniority LevelMid‑Senior level Employment TypeContract IndustryIT Services and Consulting Responsibilities Lead design and implementation of Responsible AI Governance frameworks....Senior3 days per week
- ## Associate Technical Architect - MLApply: Canada - Remote: Full time: Posted 2 Days... ...Year awards in the past 10 years* 3 AWS AI/ML Partner of the Year awards* 3 NVIDIA... ...sources, Training jobs, real-time and batch Inference, and Processing Jobs.* Good Experience developing...Full timeManual laborRemote workWorldwide
- ...Chez Ubisoft, programmez des systèmes ML en C++ avec une expertise en moteurs d’inférence, tests, performance et architecture logicielle. Ce poste de programmeur principal C++ contribue à la feuille de route des applications d’apprentissage automatique. Vous développerez...SeniorApprenticeship
- ...Interim Engineering Intern - Systems on the Machine Learning Systems Team in Markham, Ontario. You will work at the intersection of ML, compilers, and AI hardware, collaborating with software, firmware, and hardware teams to optimize AI models on Qualcomm's NPU. The role...Interim roleInternship
- eBay’s AI/ML team within the Selling organization is seeking an Applied Researcher to design and advance our research agenda across machine learning and generative AI. You will contribute to price guidance modeling and the expanding selling-agent platform, translating research...
- ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud... ..., profiling, or system observability tools. Experience with ML inference infrastructure, model serving systems, or GPU‑...SeniorInternship
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for... .... This role ensures that our trained models—from classical ML to generative AI—run efficiently across TR’s multi cloud footprint...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- ...skilled Machine Learning Engineer with hands-on experience in Google Cloud Platform (GCP) and Vertex AI to design, build, and deploy scalable ML solutions. You will operationalize models across data ingestion to serving and monitoring. You will collaborate with data scientists...Senior
$150.7k - $251.7k per year
...performance for Amazon's custom ML accelerators. Working at the... ...comprehensive toolkit includes an ML compiler, runtime, and application... ..., enabling unparalleled ML inference and training performance.As part... ...architectures. You will architect and implement business-critical...SeniorInternship- Amazon inc. recrute des consultants IA/ML et GenAI pour soutenir des projets du secteur public canadien. Vous concevrez et déploierez... ...solutions ML/GenAI, en collaboration avec des ML Engineers, des Cloud Architects et des développeurs, en utilisant des services AWS comme Bedrock...Senior
- Shape scalable AI/ML architecture at 3Pillar Global, defining technical direction across domains with cloud platforms, MLOps, and responsible AI practices.As an AI/ML Architect, you will establish blueprints for AI/ML, Generative AI, Agentic AI, and MCP systems. You will advise...
- Analyze compiler performance at Intel in Toronto through C++, LLVM, and heterogeneous computing... ...demanding AI and HPC workloads.As a Senior Compiler Engineer, you will advance compiler... ...systemsCollaborate with hardware architects on future Intel siliconRequirements: Bachelor...Senior
$140k - $170k per year
...prioritize purpose, flexibility, connection, and recognition, so our people can thrive and love what they do, most days. Job Title:AI/ML Architect – Principal (Vacant Role) WhatYou’llDo Architect and deliver enterprise-scale AI/ML solutions including data pipelines,...InternshipWork at office$114.89k - $162.19k per year
...Details: Job Description: The Compiler Engineering team within Intel'... ...ecosystems, including PyTorch, inference frameworks, and machine... ...technologies under the guidance of senior engineers.Building expertise in... ...applications. Exposure to AI/ML frameworks and inference stacks...SeniorInternshipManual laborLocal areaImmediate startShift work$135k - $185k per year
We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop... ...and optimizations for our LPX inference and compiler stack. You will work... ...Collaborate closely with hardware architects and design teams to feedback software...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference & Compiler Architect. Be the first to apply!
- architecte architecture Winnipeg, MB
- junior architectural designer Winnipeg, MB
- junior architect Winnipeg, MB
- design architect Winnipeg, MB
- architectural designer work from home Winnipeg, MB
- architect Winnipeg, MB
- summer intern architect Winnipeg, MB
- architect assistant Winnipeg, MB
- collaborateur d architecte Winnipeg, MB
- architectural designer Winnipeg, MB

