Distributed Systems Engineer At Baseten
Baseten
Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer At Baseten in Winnipeg, MB vacancy
$80k - $135k per year
The RoleAIM is a deep-tech startup building advanced high-power laser systems to protect people from weaponised drones. We are seeking highly motivated Distributed Systems Engineers, experienced in Go (\ "golang\"), and based in Vancouver, BC. At AIM, you will work closely...SuggestedFull timeImmediate startFlexible hours- Engineer distributed Java systems that protect Canadian consumers and financial institutions. Work across scalable APIs, production services, and full lifecycle delivery.This permanent Software Engineer position supports a client in digital identity, cybersecurity, and telecommunications...SuggestedPermanent employment
- Build reliable distributed systems for Affirms’ Card Experiences team, using AWS, Kubernetes, Python, or Kotlin in a remote-first Canadian role. AI matters.This Staff Software Engineer position focuses on technical strategy, scalable backend architecture, and dependable cardholder...SuggestedRemote work
- ...remotely with Rust, C++, or Go while solving distributed systems challenges for InfluxData’s cloud-native database.As a senior engineer, you will develop the next generation of... ...columnar storage and a DataFusion-based query engine. You will work autonomously across Import/Export...SuggestedRemote work
- Lead highly available distributed systems for Affirm Card from a remote Canada location, using AWS, Kubernetes, Python, or Kotlin. Shape durable... ....Affirm’s Card Experiences team needs a Staff Software Engineer to guide systems and execution across the cardholder journey....SuggestedImmediate startRemote work
- Build production infrastructure at Ramp using distributed systems expertise and strong software engineering fundamentals. Own critical systems end to end across the stack.As a Production Engineer, you will write clean, tested production code for Ramp’s financial transaction...
- Build distributed systems at Instacart with Go and PostgreSQL while working remotely across Ontario, Alberta, British Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store services and datastores serving Search, Ads, shopper, customer...InternshipRemote work
- Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB seeks a Software Engineer for the Atlas Agent Engine team. You will build the developer CLI, SDKs, and distributed systems...Remote work
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic... .... Join us and help build the platform engineers turn to ship AI products.About Baseten... ..., we are building the global operating system for distributed, heterogeneous AI hardware. We believe...Flexible hours- Design distributed systems for Workstream’s hourly workforce platform as a Senior Full Stack Engineer, using cloud technologies, databases, and test-driven development. This is hybrid.Workstream builds HR, payroll, and hiring technology for businesses serving hourly employees...Hourly pay
- ...First enables remote work within your province.This Software Engineer II position focuses on production services that route and authorize... ...incident response. The role also offers hands-on exposure to distributed systems, cryptography, and payment processing.Key Responsibilities:...Remote workFlexible hours
- Apply hands-on software architecture and distributed systems expertise as Blue J’s primarily remote Engineering Manager near Toronto.This technically engaged management role supports engineers building reliable content systems for AI-powered tax research. You will develop a...Remote work
- ...established media tech company as an Embedded Systems Architect, focusing on embedded Linux... ...Design software for cutting-edge media distribution products • Engage in discussions to... ...code and design reviews • Mentor junior engineers and improve engineering processes Requirements...Internship
- Build Go backend services and event-driven systems at Kaseya, supporting Kubernetes platforms, reliable messaging, and... ...reliability across products.As a Platform Backend Engineer, you will develop and operate distributed systems for event processing, workflow execution, and...Work at office
- Lead complex distributed systems work with Kake as a remote Senior Rust Engineer focused on concurrency, scalability, and production reliability.Kake’s global community of senior engineers needs experienced Rust specialists for mission-critical applications. You will tackle...Remote work
- Lead distributed systems for Affirm Card Experiences from a remote Canada setting, combining backend scale, operational ownership, and customer-focused product delivery.This Staff Software Engineer, Fullstack role connects architecture with the cardholder journey from ordering...Remote work
- Design scalable, reliable distributed systems for AI security as a Senior Software Engineer. Work with North America product, security, and infrastructure teams.This early engineering seat addresses how large organisations securely adopt Generative AI. You will design services...
- Build reliable distributed systems for Affrim’s remote Canada engineering organization, using Kubernetes and cloud technologies at exceptional scale.This Staff Software Engineer will lead the Observability team’s technical direction while designing and operating backend systems...Remote work
- Shape high-performance distributed backend systems onsite in Toronto, combining Python, system design, scalability, security, and observability.Apexon needs a senior Backend Engineer for mission-critical financial platforms and enterprise-scale technology. The role emphasizes...
- Lead distributed systems architecture and backend engineering at KeyCite, modernizing platforms while protecting customer-facing reliability. This hybrid role sets technical direction across teams.As a Staff Software Engineer II, you will guide complex production systems from...
- Build Java services for Salesforce’s Kafka platform, applying distributed systems expertise across globally operated cloud environments.The Software Engineering SMTS role supports internal engineering teams through resilient messaging infrastructure. You will design, develop...
- Lead distributed systems for Affirm cardholder journeys remotely across Canada, combining AWS, Kubernetes, and operational ownership.As a Staff Software Engineer on the Card Experiences team, you will develop highly available systems supporting card ordering and use. You will...Remote work
- Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work...Work at officeWorldwide
- ...throughput edge data pipelines with Go or C++ as a Senior Software Engineer at Cisco, working in a hybrid or remote environment.On Cisco’... ...Splunk Integrated Data Platform. This senior role emphasizes distributed systems, concurrency, memory management, and high-volume data...Remote work
- Analyze SQL data and production systems as a Systems Reliability Engineer supporting Levi Strauss & Co. in Etobicoke, ON. Improve reliability across distribution platforms.This full-time position supports Distribution & Logistics IT and business-critical systems moving products...Full time
- Become an Intermediate Engineer with WSP in British Columbia, specializing in distribution power systems. Your role will focus on enhancing energy infrastructure through detailed design and project coordination. At WSP, we're seeking a Distribution Line Engineer to join...
- Design highly available, scalable systems at AWS in Vancouver using distributed systems software expertise and technical leadership. Shape foundational services... ...Centre Canada ULC seeks a senior software development engineer for Transactional Services. You will build systems...
- Amazon Development Centre Canada ULC in Vancouver is seeking a Software Development Engineer to build foundational features for large-scale distributed systems. You will design robust APIs, contribute to code reviews, and own parts of the production lifecycle under senior guidance...
- Design scalable backend systems with Java, Python, Go, or C# as a fully remote Senior Software Engineer at WhatJobs Direct. Build reliable services for demanding applications... ...development experience. You will develop distributed applications, RESTful APIs, and database solutions...Remote work
- Explore an innovative role as a Distributed Systems Engineer in Vancouver with AIM, a pioneer in advanced laser technology. Use your Go proficiency to enhance the effectiveness of real-time responses to drone threats. This full-time role focuses on the development and improvement...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer At Baseten. Be the first to apply!

