Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Backend Engineer — Model Inference

Best AI Tools Wiki

Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements
5+ years of backend engineering experienceStrong proficiency in Go, Rust, or C++Experience with high-throughput, low-latency systemsKnowledge of model serving and inference optimizationExperience with gRPC, REST APIs, and microservicesNice to Have
Experience with vLLM, TensorRT-LLM, or similarFamiliarity with GPU memory managementExperience with continuous batching techniquesEquity in a well-funded AI startup Premium health and dentalRemote-first cultureHome office budgetAnnual learning stipendFlexible PTOSkills
Go Rust Model Serving Backend Engineering gRPC Inference OptimizationThis listing was posted on 2026-02-17 and is almost certainly closed. It is kept for reference — check the employer’s own careers page for current openings.Vincony has all 400+ AI models in one place — compare responses, AI debate, Image/Video/Voice generator, and 20 more tools to help you learn and build with AI.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Backend Engineer — Model Inference in Winnipeg, MB vacancy
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered... 
    Suggested

    Sarsfield Group

    Winnipeg, MB
    2 hours ago
  • Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services. Candidates for this position must have over five years of backend engineering... 
    Suggested
    Remote work

    Best AI Tools Wiki

    Winnipeg, MB
    2 hours ago
  •  ...impact converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the...  ...the performance, reliability, and scalability of inference systems. Join us and help influence how billions... 
    Suggested
    Work at office
    Worldwide

    Unity Technologies

    Winnipeg, MB
    2 hours ago
  •  ...experienced Back-End Software Engineer who wants to work on core systems...  ...that shape how the platform (Model Vault) operatesYou will help...  ...solutionsModel Vault is Cohere’s inference platform for deploying and...  ...workloadsEvolve and scale the backend systems that power Model Vault... 
    Suggested
    Remote work

    Cohere

    Winnipeg, MB
    2 hours ago
  • A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong... 
    Suggested
    Flexible hours

    Cohere

    Winnipeg, MB
    2 hours ago
  •  ...RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving. The PersonThis role demands someone who has shipped... 
    Internship
    Manual labor

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...Affirm, Inc. is seeking an experienced Capacity Modeling Engineer to own quarterly goals for the team and lead engineers through ambiguity while delivering capacity plans for peak sales events. You will translate demand forecasts into resource settings across regions and environments... 

    Affirm, Inc.

    Winnipeg, MB
    7 days ago
  • $153k - $213k per year

    # Senior Software Engineer, Backend (Capacity Modeling)AffirmRemote Canada · posted Oct 21, 2026On this pageRole detailsAbout this opportunityMore jobs...  ...capacity plans. They build and maintain statistical capacity models that map traffic inputs (e.g., checkout volume, app opens... 
    Work at office
    Remote work
    Flexible hours

    New York tech

    Winnipeg, MB
    2 hours ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...works with the leading model labs, global enterprises, and...  ...the RoleWe're hiring a Software Engineer to help contribute to projects...  ...plus. Strong proficiency in backend or systems languages such as Go... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic...  ...frontier of AI to bring cutting-edge models into production. We're growing...  ...and help build the platform engineers turn to ship AI products.About...  ...distributed systems, backend infrastructure, or large-scale... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  •  ...Affirm is hiring a Senior Software Engineer, Backend (Capacity Modeling) for a remote Canada role. You will own quarterly goals, guide engineers through ambiguity, and ensure successful delivery of capacity modeling initiatives that translate demand forecasts into scalable... 
    Remote work

    New York tech

    Winnipeg, MB
    2 hours ago
  •  ...build cutting-edge foundation AI models and end-to-end products that...  ...is a team of researchers, engineers, designers, and more, who are...  ...ambiguous, customer-specific inference challenges—ranging from multi-...  ...comfortable moving fluidly between backend data pipelines and infrastructure... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    FDE Times

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

     ...Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies...  ...the frontier of AI to bring cutting-edge models into production. We're growing quickly...  ...Capital. Join us and help build the platform engineers turn to ship AI products.THE ROLE As a... 
    Internship
    Flexible hours

    Urban Ridge Supplies

    Winnipeg, MB
    2 hours ago
  •  ...Shape backend platforms for EA game development with C#/.NET, RESTful APIs, and scalable systems in a hybrid collaborative environment. This experienced Software Engineer III joins Electronic Arts’ Quality Verification and Standards team. You will lead backend components... 
    Full time

    Electronic Arts

    Winnipeg, MB
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...works with the leading model labs, global enterprises, and...  ...RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts...  ...Next.Js, TypeScript) and design backend services (GraphQL, Postgres,... 
    Long term contract
    Shift work

    Cerebras

    Winnipeg, MB
    2 hours ago
  • Build machine learning inference APIs with Python and distributed systems...  ...decode.As a Senior Software Engineer, you will develop production...  ...software across inference APIs, model integration, and request-...  ...across models and accelerator backends. You will own features through... 

    FDE Times

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

    About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies...  ...the frontier of AI to bring cutting‑edge models into production. We're growing quickly...  .... Join us and help build the platform engineers turn to ship AI products. THE ROLEAs an... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  .... Cerebras works with the leading model labs, global enterprises, and cutting-edge...  ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  • $100k - $145k per year

    Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for...  ...Architecture, and Enterprise AI teams to onboard new research models into production. About The Role Within Platform... 
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    2 hours ago
  • Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  •  ...industry-leading training and inference speeds; over 10 times faster...  ...works with the leading model labs, global enterprises, and...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer...  ...across models and accelerator backends. This role sits at the... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  • Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic...  ...Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime... 

    Baseten

    Winnipeg, MB
    2 hours ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic...  ...frontier of AI to bring cutting-edge models into production. We're growing...  ...and help build the platform engineers turn to ship AI products.About...  ...the stack, from the inference engine and runtime through scheduling... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...computation. Cerebras works with the leading model labs, global enterprises, and cutting-...  ...(TTFT) at massive scale. As an Engineering Manager, Inference Router, you will lead... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  • $136.7k - $182.3k per year

     ..., so we pair a small, senior engineering team with the reach of one of...  ...scaling it globally, and the backend has to stay fast, safe for kids...  ...ML Serving engineer on GPU inference. Mature our observability: metrics...  ...can see what each request, model and service actually costs.... 
    Casual work

    Spin Master Ltd.

    Winnipeg, MB
    2 hours ago
  • Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying...  ...with Kubernetes and cloud infrastructure • Strong knowledge of backend languages like Go or C++ • Familiarity with security... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  •  ...AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services...  ...across models and accelerator backends. This hands-on role touches streaming... 

    Cerebras

    Winnipeg, MB
    2 hours ago
  •  ...growing group of committed researchers, engineers, policy experts, and business leaders working...  ...AI systems. About the roleOur Inference team is responsible for building and maintaining...  .... We bring Claude to life by serving our models via the industry’s largest compute-... 
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    FDE Times

    Winnipeg, MB
    2 hours ago
  • Overview The Backend Engineer on the AI Platform team plays a critical role in building and evolving the backend systems that power internal...  ...AI-enabled applicationsDevelop well-structured APIs, domain models, service interfaces, and business logic that are easy to understand... 
    Long term contract
    Local area
    Remote work
    Flexible hours

    Bayview Fund Management, LLC

    Winnipeg, MB
    2 hours ago
  • $136.7k - $182.3k per year

     ...We are looking for an experienced Backend Platform Engineer to build, maintain, and scale the infrastructure...  ...scaling and optimize GPU-based inference workloads. Strengthen observability...  ...infrastructure expenses at the request, model, and service levels. Take ownership... 
    Long term contract
    Seasonal work
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Backend Engineer — Model Inference. Be the first to apply!