Backend Ai Inference Engineer
Sarsfield Group
Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered features, and service boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.Key Responsibilities:
Build and operate backend systems serving AI featuresDesign inference pipelines and orchestration layersDefine service boundaries around modelsMonitor, log, alert, and respond to incidentsOptimize latency and throughput across inference systemsRequirements:
Experience running high-throughput, low-latency servicesFamiliarity with LLMs, embeddings, and multimodal inferenceExperience with Python, NodeJs, and PyTorchKnowledge of SQL, noSQL, and DockerBias toward shipping and learning from production behaviorApply backend engineering expertise across AI inference, orchestration, reliability, latency, and production API performance.
#J-18808-Ljbffr
Build and operate backend systems serving AI featuresDesign inference pipelines and orchestration layersDefine service boundaries around modelsMonitor, log, alert, and respond to incidentsOptimize latency and throughput across inference systemsRequirements:
Experience running high-throughput, low-latency servicesFamiliarity with LLMs, embeddings, and multimodal inferenceExperience with Python, NodeJs, and PyTorchKnowledge of SQL, noSQL, and DockerBias toward shipping and learning from production behaviorApply backend engineering expertise across AI inference, orchestration, reliability, latency, and production API performance.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Backend Ai Inference Engineer in Winnipeg, MB vacancy
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.About Baseten Baseten powers...SuggestedInternshipFlexible hours- ...experienced Back-End Software Engineer who wants to work on core systems... ...Vault is Cohere’s inference platform for deploying and operating... ...a customer and the underlying AI infrastructure, including identity... ...workloadsEvolve and scale the backend systems that power Model Vault...SuggestedRemote work
- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Suggested
- ...experiences they love. Our Vector Gamer AI team sits at the heart of that mission,... ...at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ...performance, reliability, and scalability of inference systems. Join us and help influence how...SuggestedWork at officeWorldwide
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production...SuggestedWork at officeLocal areaFlexible hours2 days per week3 days per week- ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference... ...across models and accelerator backends. This hands-on role touches streaming,...
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products. Baseten powers mission-critical...Long term contractFlexible hours- Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise... .... You will own the architecture for complex inference challenges, enable low latency and high throughput,...
- ...Systems builds the world's largest AI chip, 56 times larger than... ...industry-leading training and inference speeds; over 10 times... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software... ...across models and accelerator backends. This role sits at the...
- Spellbook is the most comprehensive AI copilot for transactional... ...The RoleYou’ll build the backend systems that power Spellbook’s... ...on, high-ownership role for an engineer who cares about product outcomes... ...latency, high-reliability search, inference, and orchestration layers for...Contract workFlexible hours
- Build AI Platform services remotely from Canada using Python or Kotlin, distributed... ...global infrastructure.As a Senior Software Engineer, Backend, you will design and launch governed AI... ...workloads from pilots toward production inference and agents.Key Responsibilities: Own...Remote work
- Build production AI systems with Python or Node.Js in Pelmorex’... ...month contract role.As a Software Engineer, AI, you will help Pelmorex... ...partners. The work combines backend microservices, RESTful APIs, cloud... ...integrating multimodal LLM inference into live pipelinesBring backend...Contract workFlexible hours
- ...today such email, notes, tasks, calendar and they’re not AI-native. Our client’s mission is to build proactive applications... ...time on valuable and meaningful things.Role As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction...
- Build production AI backend systems with Python, FastAPI or Flask, and background processing as a Senior AI Engineer. Focus on scalable, reliable delivery.This senior role develops practical... ..., testable Python codeDebug backend, inference, and UI integration issuesConduct...
- Build backend AI systems that improve internal workflows and operations, owning features from design through production deployment and monitoring.This Backend Engineer role supports AI-powered internal systems for Our Client. You will build production software, intelligent...
- ...performance, and equipment management into one seamless platform. With AI-powered tools and a fully owned payroll infrastructure, Deel... ...leader in the transformation of global work. SummaryThe Backend Engineer, AI plays a critical role in shipping features faster while...InternshipWork at officeLocal areaRemote workFlexible hours
- ...email, notes, tasks, calendar and they’re not AI-native. Our mission is to build proactive... ...You Will Need Experience with backend, full-stack, or platform developmentExperience... ...operate as a small, senior, hands-on team. Engineers own features end-to-end — from design discussion...
- Build AI underwriting systems with Python and backend expertise at nesto, in a remote-first role open across Canada. Shape... ...technology.As a Senior Applied AI Engineer, you will lead major projects for... ...’s AI underwriting and lending engine. Apply LLMs, retrieval-augmented generation...Remote work
- ...Affirm, Inc. is seeking an experienced Capacity Modeling Engineer to own quarterly goals for the team and lead engineers through ambiguity while delivering capacity plans for peak sales events. You will translate demand forecasts into resource settings across regions and environments...
- ...leading security-first enterprise AI company. We build cutting-edge... ...is a team of researchers, engineers, designers, and more, who are... ...ambiguous, customer-specific inference challenges—ranging from multi-... ...comfortable moving fluidly between backend data pipelines and...Full timeWork at officeLocal areaRemote workHome office
- FullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You... ...into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML engineering...Flexible hours
- Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale AMD GPU infrastructure to ensure reliability, numerical correctness, observability, and high performance...
- ...rapid-growth technology firm in Toronto is seeking a Staff LLMOps Engineer to lead the design and optimization of large language model... ...architecting deployment pipelines and ensuring high-performance AI applications. Competitive salary and equity are included in the offer...
$153k - $213k per year
...what matters most. Affirm's engineering team is building a large-scale... ...changes to systems. The AI Platform team owns affirm's paved... ...productivity to production inference and agents. What You’ll Do... ...designing, developing and launching backend systems at scale using...Work at officeRemote workFlexible hours$190k - $300k per year
...Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion,... ...us and help build the platform engineers turn to ship AI products. THE ROLEWe... ...with product, design, and backend teams to launch impactful features...Flexible hours- Drive innovation as a Senior Backend Engineer with a remote-first AI-native platform team focused on marketing and creative insights. You will leverage your expertise in Node.js and TypeScript to craft robust backend systems that scale effectively. Join a fast-growing Series...Remote work
- Join Obvio AI as a Backend Software Engineer to enhance road safety systems using AI technology. Collaborate with product, ML, and operations teams to build scalable and secure backend services. In this key role, you will contribute to the development of critical annotation...
- Build and evaluate production-grade Rust services remotely from Canada, applying backend engineering expertise to AI training and software validation.This senior-level work centers on backend implementations, architectural assessment, and measurable technical outcomes. You...Work at officeRemote work
- Elevate your engineering career with Sureel AI as a Senior Backend Engineer, focusing on platforms and AI infrastructure. Utilize advanced backend skills to contribute to innovative media rights solutions. This senior role requires extensive experience in backend engineering...
- Spellbook is seeking a backend engineer to build and scale high‑reliability services that power AI-driven contract work. You will own core platform concerns, design scalable data models, and partner with product and design to balance latency, accuracy, and reliability. You...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Ai Inference Engineer. Be the first to apply!

