Distributed Systems Engineer At Baseten
Baseten
Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer At Baseten in Winnipeg, MB vacancy
- Lead distributed systems engineering for Cloudflare Browser Isolation, using Go, Rust, and TypeScript across Cloudflare’s global network.This Senior Systems Engineer role spans service orchestration, browser sessions, observability, and production reliability. You will lead...SuggestedRemote work
Cloudflare, Inc.
Winnipeg, MB1 hour ago - Lead distributed systems engineering at Cerebras Systems, building Kubernetes-based inference infrastructure for globally distributed AI workloads.As a Staff Engineer on the Inference Platform team, you will own orchestration connecting cloud components with machine learning...Suggested
Cerebras
Winnipeg, MB1 hour ago - Strengthen Affim's highly available distributed systems with AWS, MySQL, and Kubernetes from a remote-first Canadian work setting.This Senior Software Engineer role supports Capacity Modeling, where forecasted demand becomes concrete infrastructure guidance. You will help model...SuggestedRemote work
Affirm, Inc.
Winnipeg, MB1 hour ago - ...remotely with Rust, C++, or Go while solving distributed systems challenges for InfluxData’s cloud-native database.As a senior engineer, you will develop the next generation of... ...columnar storage and a DataFusion-based query engine. You will work autonomously across Import/Export...SuggestedRemote work
Remote Genie
Winnipeg, MB1 hour ago - Build highly available distributed systems for Affirm’s observability platform, working remotely in Canada with Python or Kotlin backend expertise.This Staff Software Engineer will lead technical direction for a platform processing metrics, logs, and traces across hundreds of...SuggestedRemote work
Affirm, Inc.
Winnipeg, MB1 hour ago - Lead highly available distributed systems for Affirm Card from a remote Canada location, using AWS, Kubernetes, Python, or Kotlin. Shape durable... ....Affirm’s Card Experiences team needs a Staff Software Engineer to guide systems and execution across the cardholder journey....Immediate startRemote work
Candidate
Winnipeg, MB1 hour ago - Engineer distributed Java systems that protect Canadian consumers and financial institutions. Work across scalable APIs, production services, and full lifecycle delivery.This permanent Software Engineer position supports a client in digital identity, cybersecurity, and telecommunications...Permanent employment
emergiTEL Inc.
Winnipeg, MB1 hour ago - Remote-first Staff Software Engineer opportunity focused on distributed systems, event sourcing, and reliable order processing for restaurant operations.This Staff Software Engineer will shape and scale the Orders Platform while remaining hands-on. You will model, replicate...Remote work
Jobgether
Winnipeg, MB1 hour ago - Shape distributed systems with strong architecture, Java, and Spring Boot expertise as a senior hands-on individual contributor. Own engineering work from requirements and design through testing, delivery, and production.Citi seeks a senior software engineer who thinks clearly...
Citigroup Inc.
Winnipeg, MB1 hour ago - Shape Docker’s distributed backend and platform work remotely while leading two teams across secure builds, services, and production systems.As Engineering Manager, you will lead Secure Build and SCS Services, combining portfolio leadership with credible technical engagement...Remote work
Docker, Inc.
Winnipeg, MB1 hour ago - Plan ATCO Electric’s 25kV distribution grid in Grand Prairie, Alberta, using power systems planning and electrical design expertise. Engineer and Senior Engineer levels are available.Reporting to the Supervising Engineer, this position supports operational planning for ATCO...
ATCO
Winnipeg, MB1 hour ago - Build cloud and distributed systems for a quantitative equity fund, working across hybrid infrastructure with Vancouver’s technology team. Apply programming and systems engineering expertise.As an Infrastructure Software Engineer, you will own the technology infrastructure life...
Connor, Clark & Lunn Investment Management
Winnipeg, MB1 hour ago - Build production infrastructure at Ramp using distributed systems expertise and strong software engineering fundamentals. Own critical systems end to end across the stack.As a Production Engineer, you will write clean, tested production code for Ramp’s financial transaction...
Ramp
Winnipeg, MB1 hour ago - Apply distributed computing and networking expertise to Salesforce’s cloud-native database engineering work within a hybrid, collaborative team. Solve complex scalability challenges... ...focuses on database internals and distributed systems for large, mission-critical platforms. You...
Leadout Capital
Winnipeg, MB1 hour ago - Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB seeks a Software Engineer for the Atlas Agent Engine team. You will build the developer CLI, SDKs, and distributed systems...Remote work
MongoDB Inc.
Winnipeg, MB1 hour ago - Guide reliable distributed services and engineering capability for Xero’s Payments Platform team in Vancouver. The hybrid model combines home and office... ...team deliveryRequirements: Deliver highly available systems with strong operational practicesGrow engineers through hiring...Work at office
Xero
Winnipeg, MB1 hour ago - Build resilient distributed systems at Salesforce using Kafka, Kubernetes, and Java across critical internal cloud infrastructure. Operate services at production scale.This senior-level software engineering role supports the Ajna Kafka-as-a-Service platform. You will design,...
110 salesforce.com Canada Corporation
Winnipeg, MB1 hour ago $165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic... .... Join us and help build the platform engineers turn to ship AI products.About Baseten... ..., we are building the global operating system for distributed, heterogeneous AI hardware. We believe...Flexible hoursBaseten
Winnipeg, MB1 hour ago- Lead complex distributed systems work with Kake as a remote Senior Rust Engineer focused on concurrency, scalability, and production reliability.Kake’s global community of senior engineers needs experienced Rust specialists for mission-critical applications. You will tackle...Remote work
Kake
Winnipeg, MB1 hour ago - Build large-scale distributed backend systems for Agentforce as a Lead Software Engineer at Salesforce, based in San Francisco.You will help create intelligent product setup and configuration workflows through agent-assisted experiences. The work spans agent runtime, capability...
Salesforce, Inc.
Winnipeg, MB1 hour ago - Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work...Work at officeWorldwide
FDE Times
Winnipeg, MB1 hour ago - Architect distributed systems for Nubank’s Money Boxes platform, combining high-concurrency design with transactional ledgering across international... ...office presence two days weekly.As Senior Staff Software Engineer, you will serve as chief technical authority for Money Boxes...Work at office
Nubank
Winnipeg, MB1 hour ago - Design distributed systems for Workstream’s hourly workforce platform as a Senior Full Stack Engineer, using cloud technologies, databases, and test-driven development. This is hybrid.Workstream builds HR, payroll, and hiring technology for businesses serving hourly employees...Hourly pay
Workstream
Winnipeg, MB1 hour ago - Build reliable distributed systems for Affrim’s remote Canada engineering organization, using Kubernetes and cloud technologies at exceptional scale.This Staff Software Engineer will lead the Observability team’s technical direction while designing and operating backend systems...Remote work
Affirm, Inc.
Winnipeg, MB1 hour ago - Build backend systems for real-time grid decisions at Soma Energy, using distributed systems expertise and Python, Go, Rust, or C++.As a Senior Engineer, you will own major services from design through reliable production operation. You will build infrastructure, APIs, and distributed...
Soma Energy Inc.
Winnipeg, MB1 hour ago - ...-assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with production...Full timeRemote work
Jeeves
Winnipeg, MB1 hour ago - Lead distributed systems architecture and backend engineering as a Staff Software Engineer II at KeyCite, shaping business-critical platforms across teams.This senior engineering role covers end-to-end delivery for large-scale production systems. You will modernize established...
Thomson Reuters
Winnipeg, MB1 hour ago $58k - $104k per year
...immediate 8-16 month Co-op opening for an Engineer. About the team: Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation... ...and engineers to develop proof-of-concept systems and product components for AI-native cloud...InternshipImmediate startHuawei Technologies Canada Co., Ltd.
Winnipeg, MB1 hour ago- Design scalable backend systems with Java, Python, Go, or C# as a fully remote Senior Software Engineer at WhatJobs Direct. Build reliable services for demanding applications... ...development experience. You will develop distributed applications, RESTful APIs, and database solutions...Remote work
Placements24
Winnipeg, MB1 hour ago - Lead distributed systems architecture for AWS Foundational Data & Storage Services, focusing on durability, availability, and latency. Work remotely... ...Canada, Inc. is hiring Principal, Senior, and Distinguished Engineers for deep systems challenges. This senior engineering work...InternshipRemote work
Amazon Web Services (AWS)
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer At Baseten. Be the first to apply!
