Backend Ai Inference Engineer
Sarsfield Group
Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered features, and service boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.Key Responsibilities:
Build and operate backend systems serving AI featuresDesign inference pipelines and orchestration layersDefine service boundaries around modelsMonitor, log, alert, and respond to incidentsOptimize latency and throughput across inference systemsRequirements:
Experience running high-throughput, low-latency servicesFamiliarity with LLMs, embeddings, and multimodal inferenceExperience with Python, NodeJs, and PyTorchKnowledge of SQL, noSQL, and DockerBias toward shipping and learning from production behaviorApply backend engineering expertise across AI inference, orchestration, reliability, latency, and production API performance.
#J-18808-Ljbffr
Build and operate backend systems serving AI featuresDesign inference pipelines and orchestration layersDefine service boundaries around modelsMonitor, log, alert, and respond to incidentsOptimize latency and throughput across inference systemsRequirements:
Experience running high-throughput, low-latency servicesFamiliarity with LLMs, embeddings, and multimodal inferenceExperience with Python, NodeJs, and PyTorchKnowledge of SQL, noSQL, and DockerBias toward shipping and learning from production behaviorApply backend engineering expertise across AI inference, orchestration, reliability, latency, and production API performance.
#J-18808-Ljbffr
Vacancy posted 17 minutes ago
Similar jobs that could be interesting for youBased on the Backend Ai Inference Engineer in Winnipeg, MB vacancy
- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and... ...continuous batching techniquesEquity in a well-funded AI startup Premium health and dentalRemote-first cultureHome...SuggestedWork at office
- Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services. Candidates for this position must have over five years of backend engineering...SuggestedRemote work
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.About Baseten Baseten powers...SuggestedInternshipFlexible hours- ...experiences they love. Our Vector Gamer AI team sits at the heart of that mission,... ...at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ...performance, reliability, and scalability of inference systems. Join us and help influence how...SuggestedWork at officeWorldwide
- ...experienced Back-End Software Engineer who wants to work on core systems... ...Vault is Cohere’s inference platform for deploying and operating... ...a customer and the underlying AI infrastructure, including identity... ...workloadsEvolve and scale the backend systems that power Model Vault...SuggestedRemote work
- Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning... ...and cloud infrastructure • Strong knowledge of backend languages like Go or C++ • Familiarity with...
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production...Work at officeLocal areaFlexible hours2 days per week3 days per week- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo... ...EquityResponsibilities Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency....
- ...today such email, notes, tasks, calendar and they’re not AI-native. Our client’s mission is to build proactive applications... ...time on valuable and meaningful things.Role As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction...
- Build AI Platform services remotely from Canada using Python or Kotlin, distributed... ...global infrastructure.As a Senior Software Engineer, Backend, you will design and launch governed AI... ...workloads from pilots toward production inference and agents.Key Responsibilities: Own...Remote work
- Spellbook is the most comprehensive AI copilot for transactional... ...The RoleYou’ll build the backend systems that power Spellbook’s... ...on, high-ownership role for an engineer who cares about product outcomes... ...latency, high-reliability search, inference, and orchestration layers for...Contract workFlexible hours
- ...supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen... ...looking for a Senior Software Development Engineer to own the end-to-end model execution... ...infrastructure at scale and high-performance inference serving. The PersonThis role demands...InternshipManual labor
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products. Baseten powers mission-critical...Long term contractFlexible hours- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional teams to deploy and scale cutting-edge AI workloads. In this influential role, you will be embedded within Platform Engineering...
- Build production AI backend systems with Python, FastAPI or Flask, and background processing as a Senior AI Engineer. Focus on scalable, reliable delivery.This senior role develops practical... ..., testable Python codeDebug backend, inference, and UI integration issuesConduct...
- ...email, notes, tasks, calendar and they’re not AI-native. Our mission is to build proactive... ...You Will Need Experience with backend, full-stack, or platform developmentExperience... ...operate as a small, senior, hands-on team. Engineers own features end-to-end — from design discussion...
- ...Systems builds the world's largest AI chip, 56 times larger than... ...industry-leading training and inference speeds; over 10 times... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software... ...across models and accelerator backends. This role sits at the...
- Build AI underwriting systems with Python and backend expertise at nesto, in a remote-first role open across Canada. Shape... ...technology.As a Senior Applied AI Engineer, you will lead major projects for... ...’s AI underwriting and lending engine. Apply LLMs, retrieval-augmented generation...Remote work
- ...the server-side systems and APIs powering AI products, from data pipelines to scalable... ...with flexible hours. You will collaborate asynchronously with engineers and researchers across time zones to deliver robust infrastructure for AI training and inference. #J-18808-LjbffrHourly payContract workRemote workFlexible hours
- Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise... .... You will own the architecture for complex inference challenges, enable low latency and high throughput,...
- ...performance, and equipment management into one seamless platform. With AI-powered tools and a fully owned payroll infrastructure, Deel... ...leader in the transformation of global work. SummaryThe Backend Engineer, AI plays a critical role in shipping features faster while...InternshipWork at officeLocal areaRemote workFlexible hours
- Engineer reliable AI backends for Network Solutions with Python, FastAPI, distributed systems, and production LLM integrations.Newfold Digital seeks a hands on Senior Applied AI Engineer to build services supporting its digital presence products. You will develop asynchronous...
$153k - $213k per year
...on what matters most. Affirms engineering team is building a large-scale... ...large changes to systems. The AI Platform team owns affirm’s... ...developer productivity to production inference and agents. What You’ll Do... ..., developing and launching backend systems at scale using...Work at officeRemote workFlexible hours- Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale AMD GPU infrastructure to ensure reliability, numerical correctness, observability, and high performance...
$111k - $160k per year
...that help people, businesses and governments realize their greatest potential.Title and Summary Senior Software Engineer (Sanctions Service & AI Inference)Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect and...InternshipWorldwide- OverviewThe Lead Backend Engineer on the AI Platform team plays a critical role in building, evolving, and leading the backend systems and engineering practices that power internal products, customer‑facing capabilities, AI‑enabled workflows, and operational decision‑making...Long term contractLocal areaRemote work
- Use Ruby/Rails, automated testing, and AI coding tools as a Backend Engineer at GitLab, working remotely from Canada with minimal guidance.You will contribute to Source Code repository services as an Intermediate Backend Engineer. Your work includes production backend applications...Contract workRemote work
- Help Quo apply AI to customer data and onboarding while building backend services with Node, TypeScript, and modern observability.As a Senior Backend Engineer, you will spend most of your time coding, architecting, and owning complex components. You may provide technical guidance...
- Build reliable AI infrastructure with Python and distributed systems at Lydia AI, working hybrid in Toronto to advance ORCA's platform.As a Senior Backend and AI Platform Engineer, you will improve ORCA's execution architecture and establish AI-native engineering practices....
- FullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You... ...into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML engineering...Flexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Ai Inference Engineer. Be the first to apply!

