Distributed Systems Engineer At Baseten
Baseten
Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer At Baseten in Winnipeg, MB vacancy
- ...North America’s leading manufacturer and distributor of air distribution products ( The founding principles of Price have never changed... ...Price Café offers free Tea and Coffee. Finishing Systems Engineering Assistant (8 Month Term – Winter 2027) The successful candidate...SuggestedFor contractors
$20 per hour
.... Outgoing Processing: Handle folding, manual insertion for distribution jobs, and outgoing Registered Letter Mail. Daily Digitization... ...workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its...SuggestedHourly payWeekly payContract workFor contractorsManual laborImmediate startMonday to fridayFlexible hoursShift work$89.91k - $113.73k per year
The Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies and compliance testing services for electric utilities and other clients in power industry. We are the vendor of the cutting-edge power system...SuggestedFull timeImmediate startRemote work- ...533 Job Summary: The Mail and Supply Distribution Clerk is responsible for receiving and... ...general physical activities in order to distribute and deliver incoming and outgoing supplies... ...Health information management systems computer experience Previous experience...SuggestedHourly payCasual workImmediate startShift work
- Overview Languages English Education Bachelor's degree Experience 2 years to less than 3 years Tasks Evaluate daily operations Plan and organize daily operations Plan for changes to schedules and policies Prepare reports for senior management ...Suggested
$80k - $135k per year
The RoleAIM is a deep-tech startup building advanced high-power laser systems to protect people from weaponised drones. We are seeking highly motivated Distributed Systems Engineers, experienced in Go (\ "golang\"), and based in Vancouver, BC. At AIM, you will work closely...Full timeImmediate startFlexible hours- Build high-throughput backend systems at StackAdapt using Go and distributed systems expertise to power programmatic advertising inventory integrations.As a Senior Software Engineer on the Inventory team, you will lead engineers designing scalable, low-latency services. Your...
- Lead distributed systems engineering at Intellistack, shaping scalable customer-facing platforms with Java, Python, C#, or comparable expertise. Work from a hybrid hub.As Principal Software Engineer, you will set technical direction for critical platform areas and deliver reliable...
- ...individuals with an appetite for the excitement and constant changes of the IT industry. Summary: The Consultant, ICT Systems Engineering at Epic is responsible for timely and effective resolutions to end-user productivity issues as they relate to IT-serviced...Full timeWork at officeRemote workFlexible hours3 days per week
- Architect distributed systems and real-time services remotely, applying cloud infrastructure expertise to secure, high-volume fintech platforms... ...backend challenges with precision.This Senior Backend Engineer role focuses on architecture, development, and maintenance across...Remote work
- Work on Amazon MemoryDB’s distributed data systems, designing replication, durability, and query capabilities with C/C++ in Vancouver.This Software Development Engineer joins AWS’s Data Plane team for ElastiCache and MemoryDB. You will build large-scale in-memory storage systems...Internship
- Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB seeks a Software Engineer for the Atlas Agent Engine team. You will build the developer CLI, SDKs, and distributed systems...Remote work
- Build high-scale event-driven systems at Movable Ink, applying distributed systems expertise to behavioral signals and automated marketing triggers. The role... ...architecture with implementation.As Lead Software Engineer for the Behavioural team, you will solve challenging backend...
- Build distributed systems at Instacart with Go and PostgreSQL while working remotely across Ontario, Alberta, British Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store services and datastores serving Search, Ads, shopper, customer...InternshipRemote work
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic... .... Join us and help build the platform engineers turn to ship AI products.About Baseten... ..., we are building the global operating system for distributed, heterogeneous AI hardware. We believe...Flexible hours- ...leading manufacturer and distributor of air distribution products ( The founding principles of... ..., and feasibility. • Partner with system architects, developers, and product owners... ...Business Administration, Information Systems, Engineering, or a related discipline. 3....Work at office
- ...invited to be a part of that. Embedded Systems Designer – Antec Controls We are... ...root cause investigations • Maintaining engineering documentation, design records, specifications... ...fundamentals including grounding, power distribution and signal integrity • Experience...
- Become an Intermediate Engineer with WSP in British Columbia, specializing in distribution power systems. Your role will focus on enhancing energy infrastructure through detailed design and project coordination. At WSP, we're seeking a Distribution Line Engineer to join...
- ...-assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with production...Full timeRemote work
- Use distributed systems expertise to build Harvey’s AI-powered legal tools platform in Toronto. This hybrid role includes relocation assistance... ...firms and enterprise customers. As a Staff Backend Software Engineer, you will own systems that support notifications, permissions...Relocation package
- Build backend systems for real-time grid decisions at Soma Energy, using distributed systems expertise and Python, Go, Rust, or C++.As a Senior Engineer, you will own major services from design through reliable production operation. You will build infrastructure, APIs, and distributed...
- Lead complex distributed systems work with Kake as a remote Senior Rust Engineer focused on concurrency, scalability, and production reliability.Kake’s global community of senior engineers needs experienced Rust specialists for mission-critical applications. You will tackle...Remote work
- Engineer reliable NLP infrastructure with Python and C++ in Vancouver, supporting onsite work... ..., reliability, and cost-efficient systems for language detection, sentiment analysis... ...data structures and algorithms knowledgeUse distributed systems, NLP engineering, and performance...3 days per week
- Build Go backend services and event-driven systems at Kaseya, supporting Kubernetes platforms, reliable messaging, and... ...reliability across products.As a Platform Backend Engineer, you will develop and operate distributed systems for event processing, workflow execution, and...Work at office
- Amazon Development Centre Canada ULC in Vancouver is seeking a Software Development Engineer to build foundational features for large-scale distributed systems. You will design robust APIs, contribute to code reviews, and own parts of the production lifecycle under senior guidance...
- Shape distributed systems at Amazon as a full-time Software Development Engineer intern, working in an office Monday through Friday.Amazon seeks interns and co-ops for Robotics teams developing products and services at significant scale. You will collaborate with experienced...Full timeInternshipWork at officeMonday to friday
- Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work...Work at officeWorldwide
- Join Baseten as a Python Engineer and develop transformative AI solutions for dynamic companies. Leverage your technical skills to deliver high-scale AI applications that enhance customer experiences. In this role, you will work closely with clients, driving projects from...Internship
- Design low-latency crypto infrastructure for Robinhood’s Toronto engineering team, solving large-scale distributed systems challenges on-site.This Senior Software Engineer role focuses on backend services, infrastructure, and data systems supporting crypto, Web3, and wallet...
- Lead distributed systems architecture and backend engineering at KeyCite, modernizing platforms while protecting customer-facing reliability. This hybrid role sets technical direction across teams.As a Staff Software Engineer II, you will guide complex production systems from...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer At Baseten. Be the first to apply!

