Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend Engineer For Inference Optimization

Best AI Tools Wiki

Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services.
Candidates for this position must have over five years of backend engineering experience and strong programming skills in Go, Rust, or C++. You'll work on building backend services that enhance Cohere's enterprise API, focusing on batching strategies and performance optimization.
Key Responsibilities: - Establish low-latency serving infrastructure for model inference - Develop backend services for the enterprise-level API - Implement batching strategies to maximize throughput efficiency - Optimize model serving and inference processes - Collaborate within a remote-first culture
Requirements: - 5+ years of relevant backend engineering experience - Proficiency in Go, Rust, or C++ - Experience with low-latency and high-throughput systems - Knowledge of model serving optimization - Familiarity with gRPC, REST APIs, and microservices
Utilize your expertise in backend engineering to drive innovations in model inference at Cohere.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Backend Engineer For Inference Optimization in Winnipeg, MB vacancy
  • Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong... 
    Suggested
    Work at office

    Best AI Tools Wiki

    Winnipeg, MB
    1 hour ago
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference...  ..., and service boundaries around models. You will optimize real-world performance while supporting mobile and... 
    Suggested

    Sarsfield Group

    Winnipeg, MB
    1 hour ago
  •  ...converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure...  ..., reliability, and scalability of inference systems. Join us and help influence...  ...like Prometheus and Grafana Manage and optimize cloud infrastructure on GCP,... 
    Suggested
    Work at office
    Worldwide

    Unity Technologies

    Winnipeg, MB
    59 minutes ago
  •  ...for a highly experienced Back-End Software Engineer who wants to work on core systems that...  ...the-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating...  ...enterprise workloadsEvolve and scale the backend systems that power Model Vault, including... 
    Suggested
    Remote work

    Cohere

    Winnipeg, MB
    1 hour ago
  •  ...Affirm, Inc. is seeking an experienced Capacity Modeling Engineer to own quarterly goals for the team and lead engineers through ambiguity while delivering capacity plans for peak sales events. You will translate demand forecasts into resource settings across regions and environments... 
    Suggested

    Affirm, Inc.

    Winnipeg, MB
    7 days ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...RoleWe're hiring a Software Engineer to help contribute to projects...  ...certificates, TLS, mTLS). Experience optimizing latency, throughput, and...  .... Strong proficiency in backend or systems languages such as... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic...  ...and help build the platform engineers turn to ship AI products....  ...and other teams to make new optimizations broadly available to customers...  ...operating distributed systems, backend infrastructure, or large-scale... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...ambiguous, customer-specific inference challenges—ranging from multi...  ...-cluster environments. Optimize "AI-in-a-box" and private...  ...comfortable moving fluidly between backend data pipelines and... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    FDE Times

    Winnipeg, MB
    1 hour ago
  •  ...Shape backend platforms for EA game development with C#/.NET, RESTful APIs, and scalable systems in a hybrid collaborative environment. This experienced Software Engineer III joins Electronic Arts’ Quality Verification and Standards team. You will lead backend components... 
    Full time

    Electronic Arts

    Winnipeg, MB
    2 days ago
  • $165k - $330k per year

     ...Baseten Baseten powers mission-critical inference for the world's most dynamic AI...  ...Capital. Join us and help build the platform engineers turn to ship AI products.THE ROLE As...  ...technical topics.Experience in building or optimizing AI/ML projects is highly valued.Benefits... 
    Internship
    Flexible hours

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  •  ...Lisplogics is seeking a resilient backend lead in Montreal to design, build and maintain real-time optimization back-end systems. You will translate operations research models into production services and present results to clients in French. You will set standards, mentor... 

    Lisplogics

    Winnipeg, MB
    1 hour ago
  •  ...industry-leading training and inference speeds; over 10 times...  ...’re hiring a Senior Frontend Engineer to own and scale critical parts...  ...Next.Js, TypeScript) and design backend services (GraphQL, Postgres,...  ...architectural decisions and know when to optimize vs move fast. Ability to... 
    Long term contract
    Shift work

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer...  ...across models and accelerator backends. This role sits at the...  ...Improve serving performance. Optimize streaming behavior, time to first... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen...  ...infrastructure • Strong knowledge of backend languages like Go or C++ • Familiarity...  ...protocols like TLS and mTLS • Ability to optimize for latency and throughput in high-QPS... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and optimize our GPU serving stack, working across our... 

    Cerebras

    Winnipeg, MB
    59 minutes ago
  • Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment. At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance... 

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU...  ...(TTFT) at massive scale. As an Engineering Manager, Inference Router, you will lead...  ...cloud/platform, hardware, and ML teams to optimize end‑to‑end performance. Team Leadership... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  • $100k - $145k per year

    Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting...  ...an AI Inference Engineer is responsible for productionizing, optimizing, and scaling AI and LLM workloads that power TR’s AI driven products... 
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic...  ...and help build the platform engineers turn to ship AI products....  ...the stack, from the inference engine and runtime through scheduling...  ...routing algorithms.Profile and optimize inference end to end, from... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Build machine learning inference APIs with Python and distributed systems expertise at Cerebras...  ...Cerebras decode.As a Senior Software Engineer, you will develop production software across...  ...behavior across models and accelerator backends. You will own features through validation... 

    FDE Times

    Winnipeg, MB
    1 hour ago
  •  ...growing group of committed researchers, engineers, policy experts, and business leaders working...  ...AI systems. About the roleOur Inference team is responsible for building and maintaining...  ...Familiarity with LLM inference optimization, batching, and caching strategies Experience... 
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    FDE Times

    Winnipeg, MB
    1 hour ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location...  ...350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-... 

    Brix

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

    About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge...  ..., and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEAs an Engineer on the Dedicated... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • We are looking for a skilled and execution-driven Backend Engineer to design, build, and scale core backend services powering AllScales business...  ...API design, business logic implementation, and system optimization. Build high-performance and scalable backend services using... 
    Long term contract

    WavesReach

    Winnipeg, MB
    1 hour ago
  • $136.7k - $182.3k per year

     ...We are looking for an experienced Backend Platform Engineer to build, maintain, and scale the infrastructure...  ...the development, maintenance, and optimization of backend APIs and job queues...  ...infrastructure scaling and optimize GPU-based inference workloads. Strengthen... 
    Long term contract
    Seasonal work
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    1 hour ago
  • $200k per year

     ...fast, and hiring a mission-aligned Backend Engineer / SRE to help us power the next generation...  ...Engineer / SRE, you’ll maintain, optimize, and scale Coverstar’s backend systems...  ...to build and scale model training and inference pipelines.Design and maintain data pipelines... 
    Long term contract
    Internship
    Immediate start
    Remote work

    Coverstar

    Winnipeg, MB
    1 hour ago
  • Job TitleBackend Engineer Python (API & Platform Engineering) LocationToronto, Ontario (Onsite...  ...OverviewWe are seeking a skilled Python Backend Engineer to build and scale high-...  ...teams to deliver end‑to‑end solutions. Optimize performance, security, and observability... 

    Princeton IT Services, Inc

    Winnipeg, MB
    1 hour ago
  •  ...world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs,...  ...consistent experience across models and accelerator backends. This hands-on role touches streaming, tool... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Stream Technology (SST) is a technology and engineering solutions company specializing in...  ...Machine Learning Software Engineer – GPU & AI Optimization to join our growing engineering team...  ...tuning across machine learning inference frameworks and computing platforms.Analyze... 

    Sapphire Stream Technology

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend Engineer For Inference Optimization. Be the first to apply!