Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Ml Systems Engineer, Inference & Performance

Cohere

Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads.The role offers remote-friendly work with opportunities across global offices. Ideal candidates have 5+ years of high-performance coding experience in C++ or Python and familiarity with LLM ecosystems and CUDA optimizations.
#J-18808-Ljbffr
Vacancy posted 56 minutes ago
Similar jobs that could be interesting for youBased on the Staff Ml Systems Engineer, Inference & Performance in Winnipeg, MB vacancy
  •  ...impact converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure...  ...You’ll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference... 
    Performance
    Work at office
    Worldwide

    Unity Technologies

    Winnipeg, MB
    58 minutes ago
  •  ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver... 
    Suggested

    Cerebras

    Winnipeg, MB
    59 minutes ago
  •  ...a small, fast-moving team of engineers and researchers from leading...  ...rather than inheriting a default. Inference Throughput Optimization:...  ...with PyTorch Profiler, Nsight Systems, Nsight Compute, and torch.utils...  ..., scaling efficiency, performance isolation, and diagnosing failures... 
    Performance

    Veeda AI

    Winnipeg, MB
    57 minutes ago
  • Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale AMD GPU infrastructure...  ..., observability, and high performance. You will write production-grade... 
    Performance

    FDE Times

    Winnipeg, MB
    58 minutes ago
  • Senior Staff ML Compiler and Performance EngineerMarkham, Ontario Senior Staff Compiler EngineerCanada - RemoteWe are partnered with a global leader...  ...the search for a Senior-Staff level compiler optimization engineer to join their growing AI/ML R&D team. General Summary:... 
    Performance

    Talentlab

    Winnipeg, MB
    54 minutes ago
  • Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic...  ...with LLM optimization techniques • Strong experience with ML libraries like PyTorch • Deep understanding of GPU architecture... 
    Performance

    Baseten

    Winnipeg, MB
    59 minutes ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic...  ...us and help build the platform engineers turn to ship AI products.About...  ...We're looking for inference performance engineers who want to make the...  ...batching).Strong familiarity with ML libraries, especially PyTorch,... 
    Performance
    Flexible hours

    Baseten

    Winnipeg, MB
    50 minutes ago
  • $164.6k - $235.1k per year

    A leading streaming service is seeking a Staff Software Engineer for its ML Infrastructure team in Toronto. The role focuses on designing low-latency distributed systems and optimizing machine learning application performance. The ideal candidate has over 8 years in distributed... 
    Performance

    Tubi

    Winnipeg, MB
    52 minutes ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture...  ...deliver industry-leading training and inference speeds; over 10 times faster than GPU...  .... About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute to... 
    Performance

    Cerebras

    Winnipeg, MB
    55 minutes ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger...  ...industry-leading training and inference speeds; over 10 times faster...  ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer...  ...to build and evolve the ML API layer that makes this heterogeneous... 
    Performance

    Cerebras

    Winnipeg, MB
    58 minutes ago
  •  ...Cerebras Systems builds the world's largest AI chip, 56 times larger...  ...-leading training and inference speeds; over 10 times faster...  ...on the Cerebras Wafer-Scale Engine. We are hiring a Software...  ...observable, and exceptionally performant. You will write production... 
    Performance

    FDE Times

    Winnipeg, MB
    53 minutes ago
  • Staff Quantum Engineer (Qubit System Performance) at Photonic Inc, British Columbia, Canada (Hybrid). A lead-level full time position in the Engineering team, listed under hardware engineering. As Staff Quantum Engineer – Performance at Photonic, you are a leader on the spin... 
    Performance
    Full time

    Entangled Future

    Winnipeg, MB
    57 minutes ago
  • Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society...  ...systems. About the roleOur Inference team is responsible for... 
    Performance
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    Winnipeg, MB
    54 minutes ago
  • A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong... 
    Performance
    Flexible hours

    Cohere

    Winnipeg, MB
    54 minutes ago
  • Optimize machine learning performance at Waabi through CPU and GPU profiling, memory analysis, and efficient training frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across model... 
    Performance

    Waabi

    Winnipeg, MB
    49 minutes ago
  • $150.7k - $251.7k per year

     ...team is at the forefront of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions...  ...like PyTorch, enabling unparalleled ML inference and training performance.As part of the... 
    Performance
    Internship

    Amazon Inc.

    Winnipeg, MB
    55 minutes ago
  • Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging... 
    Contract work

    Randstad

    Winnipeg, MB
    53 minutes ago
  • $164.6k - $235.1k per year

    About The RoleAs a Staff Software Engineer on the ML Infrastructure team, you will collaborate closely with the Machine Learning and Product teams to build world‑class machine learning inference platforms. These platforms power essential services like personalized recommendations... 
    Remplacement
    Long term contract
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi

    Winnipeg, MB
    57 minutes ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger...  ...-leading training and inference speeds; over 10 times faster...  ...Collaborate closely with hardware engineers to isolate and resolve system...  ...Familiarity with performance analysis, system telemetry, and... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger...  ...industry-leading training and inference speeds; over 10 times faster than...  ...on the Cerebras Wafer-Scale Engine. We are hiring a Senior...  ...Engineer to build and evolve the ML API layer that makes this heterogeneous... 
    Performance

    Cerebras

    Winnipeg, MB
    53 minutes ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto...  ...Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.Collaborate with... 
    Performance

    Brix

    Winnipeg, MB
    50 minutes ago
  •  ...Chez Ubisoft, programmez des systèmes ML en C++ avec une expertise en moteurs d’inférence, tests, performance et architecture logicielle. Ce poste de programmeur principal C++ contribue à la feuille de route des applications d’apprentissage automatique. Vous développerez... 
    Performance
    Apprenticeship

    Ubisoft Entertainment Inc.

    Winnipeg, MB
    5 days ago
  •  ...generation of supercomputing, high-performance computing, cloud, and AI....  ...Senior Software Development Engineer to own the end-to-end model...  ...at scale and high-performance inference serving. The PersonThis role...  ...metrics, and built the systems infrastructure (orchestration... 
    Performance
    Internship
    Manual labor

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    52 minutes ago
  •  ...highly experienced Back-End Software Engineer who wants to work on core systems that shape how the platform (Model...  ...where reliability, security, performance, and simplicity all matter, and where...  ...shelf solutionsModel Vault is Cohere’s inference platform for deploying and... 
    Performance
    Remote work

    Cohere

    Winnipeg, MB
    51 minutes ago
  • # (Canada) Principal ML System EngineerPointClickCareRemoteCanadaDevOps & InfrastructurePosted...  ..., working closely with other engineering teams across the organization to identify...  ...architecture for reliability, observability, and performance of ML systems in production, including... 
    Performance
    Long term contract
    Work at office
    Remote work
    Flexible hours

    Coinscapture

    Winnipeg, MB
    49 minutes ago
  •  ...closely with autonomy and algorithm engineers to scale safe self-driving systems using an AI-first approach.Expand the...  ...and benchmark new CUDA kernels for inference.Comprehensively profile model runtime and memory to pinpoint performance bottlenecks.Qualifications: MS/PhD... 
    Performance

    Waabi

    Winnipeg, MB
    57 minutes ago
  • $165k - $330k per year

     ...BasetenBaseten powers mission-critical inference for the world's most dynamic...  ...and help build the platform engineers turn to ship AI products....  ...at the intersection of high-performance computing (HPC) and Large...  ...benchmarking and analysis. System Profiling: Use profilers like... 
    Performance
    Flexible hours

    Baseten

    Winnipeg, MB
    54 minutes ago
  •  ...& Pencils is an AWS Partner building production AI systems for enterprise clients who need real engineering, not proofs of concept that never ship. We work forward...  ...with Amazon SageMaker for training and/or inference Comfort working close to the hardware layer: you... 
    Remote work

    Robots & Pencils

    Winnipeg, MB
    59 minutes ago
  • Build production AI systems remotely from Canada using deep PyTorch expertise across AWS Trainium and Amazon SageMaker training pipelines.Robots & Pencils seeks a Staff ML Engineer to operate and train models on Trainium-powered SageMaker infrastructure. You will reason across... 
    Remote work

    Robots & Pencils

    Winnipeg, MB
    54 minutes ago
  • Develop foundational AI systems in Montreal as a hybrid engineer connecting high-level frameworks with low-level...  ..., Python, Linux development, and performance-focused systems programming.Key Responsibilities...  ...bottlenecks in training and inference workloadsPerform deep software-... 
    Performance

    Delos Data

    Winnipeg, MB
    58 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Ml Systems Engineer, Inference & Performance. Be the first to apply!