Staff Ml Systems Engineer, Inference & Performance
Cohere
Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads.The role offers remote-friendly work with opportunities across global offices. Ideal candidates have 5+ years of high-performance coding experience in C++ or Python and familiarity with LLM ecosystems and CUDA optimizations.
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Staff Ml Systems Engineer, Inference & Performance in Winnipeg, MB vacancy
- ...impact converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ...You’ll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference...PerformanceWork at officeWorldwide
- ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver...Suggested
- ...a small, fast-moving team of engineers and researchers from leading... ...rather than inheriting a default. Inference Throughput Optimization:... ...with PyTorch Profiler, Nsight Systems, Nsight Compute, and torch.utils... ..., scaling efficiency, performance isolation, and diagnosing failures...Performance
- Senior Staff ML Compiler and Performance EngineerMarkham, Ontario Senior Staff Compiler EngineerCanada - RemoteWe are partnered with a global leader... ...the search for a Senior-Staff level compiler optimization engineer to join their growing AI/ML R&D team. General Summary:...Performance
- Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale AMD GPU infrastructure... ..., observability, and high performance. You will write production-grade...Performance
- Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic... ...with LLM optimization techniques • Strong experience with ML libraries like PyTorch • Deep understanding of GPU architecture...Performance
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...us and help build the platform engineers turn to ship AI products.About... ...We're looking for inference performance engineers who want to make the... ...batching).Strong familiarity with ML libraries, especially PyTorch,...PerformanceFlexible hours- Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing...
- ...Cerebras Systems builds the world's largest AI chip, 56 times larger... ...-leading training and inference speeds; over 10 times faster... ...on the Cerebras Wafer-Scale Engine. We are hiring a Software... ...observable, and exceptionally performant. You will write production...Performance
- Cerebras Systems builds the world's largest AI chip, 56 times larger... ...industry-leading training and inference speeds; over 10 times faster... ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer... ...to build and evolve the ML API layer that makes this heterogeneous...Performance
- Staff Quantum Engineer (Qubit System Performance) at Photonic Inc, British Columbia, Canada (Hybrid). A lead-level full time position in the Engineering team, listed under hardware engineering. As Staff Quantum Engineer – Performance at Photonic, you are a leader on the spin...PerformanceFull time
- Cerebras Systems builds the world's largest AI chip, 56 times larger... ...-leading training and inference speeds; over 10 times faster... ...Collaborate closely with hardware engineers to isolate and resolve system... ...Familiarity with performance analysis, system telemetry, and...Performance
- ...interpretable, and steerable AI systems. We want AI to be safe and... ...group of committed researchers, engineers, policy experts, and business... .... About the roleOur Inference team is responsible for building... ...giving our scientists the high-performance inference infrastructure they...PerformanceLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
$150.7k - $251.7k per year
...team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions... ...like PyTorch, enabling unparalleled ML inference and training performance.As part of the...PerformanceInternship- ...Chez Ubisoft, programmez des systèmes ML en C++ avec une expertise en moteurs d’inférence, tests, performance et architecture logicielle. Ce poste de programmeur principal C++ contribue à la feuille de route des applications d’apprentissage automatique. Vous développerez...PerformanceApprenticeship
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...Contract work
- Cerebras Systems builds the world's largest AI chip, 56 times larger... ...industry-leading training and inference speeds; over 10 times faster than... ...on the Cerebras Wafer-Scale Engine. We are hiring a Senior... ...Engineer to build and evolve the ML API layer that makes this heterogeneous...Performance
- ...highly experienced Back-End Software Engineer who wants to work on core systems that shape how the platform (Model... ...where reliability, security, performance, and simplicity all matter, and where... ...shelf solutionsModel Vault is Cohere’s inference platform for deploying and...PerformanceRemote work
- ...closely with autonomy and algorithm engineers to scale safe self-driving systems using an AI-first approach.Expand the... ...and benchmark new CUDA kernels for inference.Comprehensively profile model runtime and memory to pinpoint performance bottlenecks.Qualifications: MS/PhD...Performance
$135k - $185k per year
...Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a... ...close collaboration with hardware teams, benchmarking performance metrics, and contributing innovative solutions for...Performance- Build production AI systems remotely from Canada using deep PyTorch expertise across AWS Trainium and Amazon SageMaker training pipelines.Robots & Pencils seeks a Staff ML Engineer to operate and train models on Trainium-powered SageMaker infrastructure. You will reason across...Remote work
$165k - $330k per year
...BasetenBaseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...at the intersection of high-performance computing (HPC) and Large... ...benchmarking and analysis. System Profiling: Use profilers like...PerformanceFlexible hours- ...& Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work forward... ...with Amazon SageMaker for training and/or inference Comfort working close to the hardware layer: you...Remote work
- ...the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come... ...not reach. Falcon is built on LLVM.We are looking for a Staff Compiler Performance Engineer to set the technical direction for Falcon performance. This...PerformanceRemote workWorldwide
- ...Benevity is seeking a Senior AI Systems Engineer to build and run GenAI systems powering Benevity'... ...product managers. You will work with Staff engineers on architecture, mentor engineers... ...engineers, and help raise the bar for production ML practices while balancing latency, cost...
- Baseten is seeking a GPU Kernel Engineer to design and optimize high-performance GPU kernels for AI workloads. You will work on low... ...C++ and tensor cores to accelerate core ML operations, with exposure to state-of-the-art inference systems. The role offers growth potential...Performance
$72.06k - $138.94k per year
At Capgemini Engineering, the world leader in engineering services, we... ...a hands-on machine learning systems engineer to optimize production... ...-grade large language model inference across current and next-generation... ...representative load, price-performance, long-context and multi-chip...PerformanceFull timeLocal area- ...Machine Learning Specialist in Montreal. The role focuses on designing and implementing critical systems for machine learning models while optimizing deep learning performance. You will engage with a talented team using advanced technologies and will be involved in significant...Performance
- Amazon Web Services (AWS) Annapurna Labs seeks a ML Kernel Performance Engineer for AWS Neuron, to push high-performance kernel development for Inferentia and Trainium. You will design and optimize kernels, collaborate across compiler, runtime, framework, and hardware teams,...Performance
usd300k per year
...Chai has quickly established itself as one of the fastest-growing AI startups in Palo Alto. About the jobWe are seeking a Staff ML Infra Engineer with 3+ years of experience in building scalable ML infrastructure from the ground up, and who can manage and grow our Engineering...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Ml Systems Engineer, Inference & Performance. Be the first to apply!
Related searches
- project engineer assistant project manager Winnipeg, MB
- assistant electrical engineer Winnipeg, MB
- machine learning engineer Winnipeg, MB
- junior machine learning developer Winnipeg, MB
- building performance specialist Winnipeg, MB
- performance testing Winnipeg, MB
- performance engineer Winnipeg, MB
- acting performance Winnipeg, MB
- machine learning Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB

