Senior Ml Inference Api Engineer
FDE Times
Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing services. Your work spans API design, model serving, and distributed systems, supporting consistent behavior across models and accelerator backends. You will own features through validation, rollout, and production operation.Key Responsibilities:
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior Ml Inference Api Engineer in Winnipeg, MB vacancy
- ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous...Senior
- A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong...SeniorFlexible hours
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
- ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving...Suggested
$135k - $185k per year
A leading technology company located in Toronto is seeking a Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a strong background in C/C++, compiler development, and...Senior- A dynamic tech company in Calgary is on the lookout for a Back-End Engineer. In this role, you'll develop core back-end systems with Python and PostgreSQL, work in tandem with front-end engineers, and contribute to critical product features. The ideal candidate will have significant...SeniorRelocation package
- ...We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ..., and scalability of inference systems. Join us and help influence... ...Partner with ML engineers to ensure online serving... ...] is the world’s leading game engine, powering play for more than 3...Work at officeWorldwide
- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads. The role offers remote-friendly...Remote work
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI... ...This role ensures that our trained models—from classical ML to generative AI—run efficiently across TR’s multi cloud footprint...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- ...collaborative team at Katalyst Data Management (KDM)! KDM is seeking a Senior AI/ML Engineer to help design, build, and operate the infrastructure that... ...GPU environments supporting AI workloads, including inference/model serving, OCR and vision models, embeddings, and large‑...SeniorFull timeCasual workWork at officeLocal areaWorldwideMonday to friday
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...inference. About The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the... ...core systems — design and implement APIs, services, and UI that power the Developer...SeniorLong term contractShift work
$80 per hour
SENIOR MACHINE LEARNING ENGINEER (Azure MLOps; Enterprise AI & Data Centre of Excellence) Requisition #:... ...AI Foundry, MLOps, CI/CD, containers, APIs, automation, model deployment, monitoring... ...Power Automate, VSCode, Git, Jira, Azure (ML Studio, AI Foundry), Databricks.Deep...SeniorHourly payFor contractorsWork at office- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Senior
$176.76k - $232k per year
...drives enterprise efficiency. Core responsibilitiesAs a Senior AI/ML Engineer, you will lead the delivery of scalable AI/ML solutions to business... ...tuning to architectures and system design for serving AI/ML inference solutions in production. You will help drive AI/ML...SeniorPermanent employmentContract workPart timeWork visa- ...for a highly experienced Back-End Software Engineer who wants to work on core systems that... ...the-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating... ...across clouds and hardware platformsDesign APIs and distributed systems with strong guarantees...SeniorRemote work
- Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems. We... ...together to build beneficial AI systems. About the roleOur Inference team is responsible for building and maintaining the...SeniorLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional... ...observability of pipelines Requirements: • 5+ years in AI/ML environments • Proficiency in GPU programming and CUDA • Experience...Senior
- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto... ...Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.Collaborate...Senior
$165k - $330k per year
...BasetenBaseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...production. From the CLI and SDKs to APIs, observability, and debugging... ...oriented tools Interest in ML/AI infrastructure and...Flexible hours- ...industry-leading training and inference speeds; over 10 times faster... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software... ...working across our custom inference APIs, the vLLM serving runtime, the... ...-LLM, or another open-source ML systems project. Experience...
$150.7k - $251.7k per year
...of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions... ...frameworks like PyTorch, enabling unparalleled ML inference and training performance.As part of the broader...SeniorInternship- ...Aspire Software We are hiring for an AI-ML Engineer to join our growing team at Ampliphi in... ...portfolio-level insights, and we're looking for a senior engineer who wants to help build and shape... ...(Fargate, Lambda, RDS, S3), CloudWatch, API GatewayDevOps & Tooling: GitHub Actions...SeniorWork at office
$165k - $330k per year
...Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies,... .... Join us and help build the platform engineers turn to to ship AI products.About Baseten... ...preference for Python due to its relevance in ML projects.Drive customer impact by designing...InternshipFlexible hours$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...us and help build the platform engineers turn to ship AI products.About... .... It also powers Model APIs, our hosted endpoints for the... ...inference engineering. Prior ML or LLM experience isn't required...Flexible hours$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic AI... ...us and help build the platform engineers turn to ship AI products.About... ...ProductionHow we built the new fastest API for GLM-5.2Live draft model... ...).Strong familiarity with ML libraries, especially PyTorch,...Flexible hours- Senior Data Engineer, ML Platform The roleYou sit on the ML team beside Machine Learning Engineers and own the data infrastructure for model training, inference and monitoring. Today strong software engineers do the data work without lineage, pipeline observability or quality...SeniorLong term contract
- ...frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across... ...including custom CUDA kernels, quantization-aware training and inference, and compilation techniques. Collaboration with...Senior
- Design secure APIs and platform integrations as a Senior Software Developer in DNV’s Digital & Transformation organization... ...work.Working across Data & AI Engineering and partner teams, you will build... ...FastAPI endpoints. Your work includes API contracts, integration patterns, SQL...Senior
- Design platform APIs with Node.Js and TypeScript at Instant Risk Coverage, working... ...insurance partners and customers.As a Senior Core Platform Engineer, you will shape IRC’s technical foundations... ...service boundaries, data modelling, API contracts, and foundational patternsEstablish...Senior
$176k - $200k per year
At Asana, we believe AI represents the future of work, and APIs are at the heart of how AI connects with the tools where work happens. As a Software Engineer on our API and Developer Platform team in Vancouver, you will help make our developer platform come to life for AI,...SeniorLong term contractWork at officeLocal areaWork from homeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference Api Engineer. Be the first to apply!
Related searches
- machine learning engineer Winnipeg, MB
- junior machine learning developer Winnipeg, MB
- senior financial accountant Winnipeg, MB
- senior sales consultant Winnipeg, MB
- senior communications specialist Winnipeg, MB
- senior bookkeeper Winnipeg, MB
- senior system administrator Winnipeg, MB
- senior technical recruiter Winnipeg, MB
- senior director Winnipeg, MB
- senior technical specialist Winnipeg, MB

