Backend Engineer — Model Inference
Best AI Tools Wiki
Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements
5+ years of backend engineering experienceStrong proficiency in Go, Rust, or C++Experience with high-throughput, low-latency systemsKnowledge of model serving and inference optimizationExperience with gRPC, REST APIs, and microservicesNice to Have
Experience with vLLM, TensorRT-LLM, or similarFamiliarity with GPU memory managementExperience with continuous batching techniquesEquity in a well-funded AI startup Premium health and dentalRemote-first cultureHome office budgetAnnual learning stipendFlexible PTOSkills
Go Rust Model Serving Backend Engineering gRPC Inference OptimizationThis listing was posted on 2026-02-17 and is almost certainly closed. It is kept for reference — check the employer’s own careers page for current openings.Vincony has all 400+ AI models in one place — compare responses, AI debate, Image/Video/Voice generator, and 20 more tools to help you learn and build with AI.
#J-18808-Ljbffr
5+ years of backend engineering experienceStrong proficiency in Go, Rust, or C++Experience with high-throughput, low-latency systemsKnowledge of model serving and inference optimizationExperience with gRPC, REST APIs, and microservicesNice to Have
Experience with vLLM, TensorRT-LLM, or similarFamiliarity with GPU memory managementExperience with continuous batching techniquesEquity in a well-funded AI startup Premium health and dentalRemote-first cultureHome office budgetAnnual learning stipendFlexible PTOSkills
Go Rust Model Serving Backend Engineering gRPC Inference OptimizationThis listing was posted on 2026-02-17 and is almost certainly closed. It is kept for reference — check the employer’s own careers page for current openings.Vincony has all 400+ AI models in one place — compare responses, AI debate, Image/Video/Voice generator, and 20 more tools to help you learn and build with AI.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer — Model Inference. Be the first to apply!
