Senior Ml Inference Api Engineer
FDE Times
Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing services. Your work spans API design, model serving, and distributed systems, supporting consistent behavior across models and accelerator backends. You will own features through validation, rollout, and production operation.Key Responsibilities:
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr
Design, implement, test, and operate inference API featuresIntegrate foundation models, tokenizers, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeImprove latency, throughput, and resource efficiencyBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
At least five years of software engineering experienceStrong Python programming and proficiency in another service languageProduction API design, validation, compatibility, and testing experienceLinux, containers, orchestration systems, and CI/CD experienceBachelor’s degree or equivalent practical experienceApply software engineering, API design, and distributed systems expertise to Cerebras inference platforms and production machine learning services.
#J-18808-Ljbffr
Vacancy posted 58 minutes ago
Similar jobs that could be interesting for youBased on the Senior Ml Inference Api Engineer in Winnipeg, MB vacancy
- ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve the ML API layer that makes this heterogeneous...Senior
- ...Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving...Suggested
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
- A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong...SeniorFlexible hours
$135k - $185k per year
A leading technology company located in Toronto is seeking a Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a strong background in C/C++, compiler development, and...Senior- ...We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ..., and scalability of inference systems. Join us and help influence... ...Partner with ML engineers to ensure online serving... ...] is the world’s leading game engine, powering play for more than 3...Work at officeWorldwide
- A dynamic tech company in Calgary is on the lookout for a Back-End Engineer. In this role, you'll develop core back-end systems with Python and PostgreSQL, work in tandem with front-end engineers, and contribute to critical product features. The ideal candidate will have significant...SeniorRelocation package
- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on building reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce latency, and boost throughput across diverse workloads. The role offers remote-friendly...Remote work
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI... ...This role ensures that our trained models—from classical ML to generative AI—run efficiently across TR’s multi cloud footprint...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- ...collaborative team at Katalyst Data Management (KDM)! KDM is seeking a Senior AI/ML Engineer to help design, build, and operate the infrastructure that... ...GPU environments supporting AI workloads, including inference/model serving, OCR and vision models, embeddings, and large‑...SeniorFull timeCasual workWork at officeLocal areaWorldwideMonday to friday
$80 per hour
SENIOR MACHINE LEARNING ENGINEER (Azure MLOps; Enterprise AI & Data Centre of Excellence) Requisition #:... ...AI Foundry, MLOps, CI/CD, containers, APIs, automation, model deployment, monitoring... ...Power Automate, VSCode, Git, Jira, Azure (ML Studio, AI Foundry), Databricks.Deep...SeniorHourly payFor contractorsWork at office- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Senior
- ...deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...inference. About The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the... ...core systems — design and implement APIs, services, and UI that power the Developer...SeniorLong term contractShift work
$176.76k - $232k per year
...drives enterprise efficiency. Core responsibilitiesAs a Senior AI/ML Engineer, you will lead the delivery of scalable AI/ML solutions to business... ...tuning to architectures and system design for serving AI/ML inference solutions in production. You will help drive AI/ML...SeniorPermanent employmentContract workPart timeWork visa- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto... ...Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.Collaborate...Senior
- ...as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems. About the roleOur Inference team is responsible for building and maintaining the critical systems...SeniorLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional... ...observability of pipelines Requirements: • 5+ years in AI/ML environments • Proficiency in GPU programming and CUDA • Experience...Senior
- ...industry-leading training and inference speeds; over 10 times faster... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software... ...working across our custom inference APIs, the vLLM serving runtime, the... ...-LLM, or another open-source ML systems project. Experience...
- ...for a highly experienced Back-End Software Engineer who wants to work on core systems that... ...the-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating... ...across clouds and hardware platformsDesign APIs and distributed systems with strong guarantees...SeniorRemote work
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic AI... ...us and help build the platform engineers turn to ship AI products.About... ...ProductionHow we built the new fastest API for GLM-5.2Live draft model... ...).Strong familiarity with ML libraries, especially PyTorch,...Flexible hours- Design platform APIs with Node.Js and TypeScript at Instant Risk Coverage, working... ...insurance partners and customers.As a Senior Core Platform Engineer, you will shape IRC’s technical foundations... ...service boundaries, data modelling, API contracts, and foundational patternsEstablish...Senior
$165k - $330k per year
...Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies,... .... Join us and help build the platform engineers turn to ship AI products.THE ROLE As a... ...preference for Python due to its relevance in ML projects.Drive customer impact by designing...InternshipFlexible hours- ...Aspire Software We are hiring for an AI-ML Engineer to join our growing team at Ampliphi in... ...portfolio-level insights, and we're looking for a senior engineer who wants to help build and shape... ...(Fargate, Lambda, RDS, S3), CloudWatch, API GatewayDevOps & Tooling: GitHub Actions...SeniorWork at office
- Senior Data Engineer, ML Platform The roleYou sit on the ML team beside Machine Learning Engineers and own the data infrastructure for model training, inference and monitoring. Today strong software engineers do the data work without lineage, pipeline observability or quality...SeniorLong term contract
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...us and help build the platform engineers turn to ship AI products.About... .... It also powers Model APIs, our hosted endpoints for the... ...inference engineering. Prior ML or LLM experience isn't required...Flexible hours$165k - $330k per year
...BasetenBaseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...production. From the CLI and SDKs to APIs, observability, and debugging... ...oriented tools Interest in ML/AI infrastructure and...Flexible hours- ...and developer experience. About the role As a Senior Software Engineer specializing in the AI & ML ecosystem , you'll be a core contributor owning and evolving... ...-powered agents, and real-time feature stores for ML inference. You understand these workflows not from the outside,...SeniorLocal areaRemote workWorldwideHome officeFlexible hoursShift work
$176k - $200k per year
At Asana, we believe AI represents the future of work, and APIs are at the heart of how AI connects with the tools where work happens. As a Software Engineer on our API and Developer Platform team in Vancouver, you will help make our developer platform come to life for AI,...SeniorLong term contractWork at officeLocal areaWork from homeWorldwide$150.7k - $251.7k per year
...of maximizing performance for Amazon's custom ML accelerators. Working at the hardware-software boundary, our engineers craft high-performance kernels for ML functions... ...frameworks like PyTorch, enabling unparalleled ML inference and training performance.As part of the broader...SeniorInternship- Design secure APIs and platform integrations as a Senior Software Developer in DNV’s Digital & Transformation organization... ...work.Working across Data & AI Engineering and partner teams, you will build... ...FastAPI endpoints. Your work includes API contracts, integration patterns, SQL...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ml Inference Api Engineer. Be the first to apply!
Related searches
- machine learning engineer Winnipeg, MB
- junior machine learning developer Winnipeg, MB
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB
- senior project manager Winnipeg, MB
- senior communications Winnipeg, MB
- sr. IT support analyst Winnipeg, MB

