Senior Ai Inference Software Engineer

Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model integration, request-routing services, and inference APIs. Your work supports streaming, multimodal inputs, tool use, structured outputs, and model configuration.Key Responsibilities:
Design and operate features for chat and text generationMaintain request and response semantics across inference backendsExtend integrations with vLLM, PyTorch, and Hugging FaceImprove latency, throughput, batching, and resource efficiencyInvestigate incidents and strengthen resilience and responseRequirements:
Five or more years owning production software componentsPython strength plus Go, C++, Rust, or another service languageExperience spanning service, framework, runtime, or infrastructure boundariesFamiliarity with REST, gRPC, or streaming protocolsStrong communication, technical leadership, and mentoring experienceBring production software judgment to Cerebras AI inference through model serving, API evolution, routing, and performance improvement.
#J-18808-Ljbffr