Senior Ml Inference Api Engineer
FDE Times
Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing services. Your work spans API design, model serving, and distributed systems, supporting consistent behavior across models and accelerator backends. You will own features through validation, rollout, and production operation.Key Responsibilities:
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference Api Engineer. Be the first to apply!
Related searches
- machine learning engineer Winnipeg, MB
- junior machine learning developer Winnipeg, MB
- senior financial accountant Winnipeg, MB
- senior sales consultant Winnipeg, MB
- senior communications specialist Winnipeg, MB
- senior bookkeeper Winnipeg, MB
- senior system administrator Winnipeg, MB
- senior technical recruiter Winnipeg, MB
- senior director Winnipeg, MB
- senior technical specialist Winnipeg, MB
