Senior Ml Inference Api Engineer

Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing services. Your work spans API design, model serving, and distributed systems, supporting consistent behavior across models and accelerator backends. You will own features through validation, rollout, and production operation.Key Responsibilities:
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr