Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distributed Systems Engineer At Baseten

Baseten

Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer At Baseten in Winnipeg, MB vacancy
  • Build production infrastructure at Ramp using distributed systems expertise and strong software engineering fundamentals. Own critical systems end to end across the stack.As a Production Engineer, you will write clean, tested production code for Ramp’s financial transaction... 
    Suggested

    Ramp

    Winnipeg, MB
    2 hours ago
  • Engineer distributed Java systems that protect Canadian consumers and financial institutions. Work across scalable APIs, production services, and full lifecycle delivery.This permanent Software Engineer position supports a client in digital identity, cybersecurity, and telecommunications... 
    Suggested
    Permanent employment

    emergiTEL Inc.

    Winnipeg, MB
    2 hours ago
  • Build reliable distributed systems for Affirms’ Card Experiences team, using AWS, Kubernetes, Python, or Kotlin in a remote-first Canadian role. AI matters.This Staff Software Engineer position focuses on technical strategy, scalable backend architecture, and dependable cardholder... 
    Suggested
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Lead highly available distributed systems for Affirm Card from a remote Canada location, using AWS, Kubernetes, Python, or Kotlin. Shape durable...  ....Affirm’s Card Experiences team needs a Staff Software Engineer to guide systems and execution across the cardholder journey.... 
    Suggested
    Immediate start
    Remote work

    Candidate

    Winnipeg, MB
    2 hours ago
  • Build cloud and distributed systems for a quantitative equity fund, working across hybrid infrastructure with Vancouver’s technology team. Apply programming and systems engineering expertise.As an Infrastructure Software Engineer, you will own the technology infrastructure life... 
    Suggested

    Connor, Clark & Lunn Investment Management

    Winnipeg, MB
    2 hours ago
  • Build highly available distributed systems for Affirm’s observability platform, working remotely in Canada with Python or Kotlin backend expertise.This Staff Software Engineer will lead technical direction for a platform processing metrics, logs, and traces across hundreds of... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB seeks a Software Engineer for the Atlas Agent Engine team. You will build the developer CLI, SDKs, and distributed systems... 
    Remote work

    MongoDB Inc.

    Winnipeg, MB
    2 hours ago
  • Shape Docker’s distributed backend and platform work remotely while leading two teams across secure builds, services, and production systems.As Engineering Manager, you will lead Secure Build and SCS Services, combining portfolio leadership with credible technical engagement... 
    Remote work

    Docker, Inc.

    Winnipeg, MB
    2 hours ago
  • Remote-first Staff Software Engineer opportunity focused on distributed systems, event sourcing, and reliable order processing for restaurant operations.This Staff Software Engineer will shape and scale the Orders Platform while remaining hands-on. You will model, replicate... 
    Remote work

    Jobgether

    Winnipeg, MB
    2 hours ago
  • Lead distributed systems engineering for Cloudflare Browser Isolation, using Go, Rust, and TypeScript across Cloudflare’s global network.This Senior Systems Engineer role spans service orchestration, browser sessions, observability, and production reliability. You will lead... 
    Remote work

    Cloudflare, Inc.

    Winnipeg, MB
    2 hours ago
  • Apply distributed computing and networking expertise to Salesforce’s cloud-native database engineering work within a hybrid, collaborative team. Solve complex scalability challenges...  ...focuses on database internals and distributed systems for large, mission-critical platforms. You... 

    Leadout Capital

    Winnipeg, MB
    2 hours ago
  • Plan ATCO Electric’s 25kV distribution grid in Grand Prairie, Alberta, using power systems planning and electrical design expertise. Engineer and Senior Engineer levels are available.Reporting to the Supervising Engineer, this position supports operational planning for ATCO... 

    ATCO

    Winnipeg, MB
    2 hours ago
  •  ...remotely with Rust, C++, or Go while solving distributed systems challenges for InfluxData’s cloud-native database.As a senior engineer, you will develop the next generation of...  ...columnar storage and a DataFusion-based query engine. You will work autonomously across Import/Export... 
    Remote work

    Remote Genie

    Winnipeg, MB
    2 hours ago
  • Strengthen Affim's highly available distributed systems with AWS, MySQL, and Kubernetes from a remote-first Canadian work setting.This Senior Software Engineer role supports Capacity Modeling, where forecasted demand becomes concrete infrastructure guidance. You will help model... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic...  .... Join us and help build the platform engineers turn to ship AI products.About Baseten...  ..., we are building the global operating system for distributed, heterogeneous AI hardware. We believe... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  •  ...-assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with production... 
    Full time
    Remote work

    Jeeves

    Winnipeg, MB
    2 hours ago
  • Design scalable, reliable distributed systems for AI security as a Senior Software Engineer. Work with North America product, security, and infrastructure teams.This early engineering seat addresses how large organisations securely adopt Generative AI. You will design services... 

    CyberForce Global

    Winnipeg, MB
    2 hours ago
  • Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work... 
    Work at office
    Worldwide

    FDE Times

    Winnipeg, MB
    2 hours ago
  • Build Amazon ECS and Fargate features using distributed systems expertise, Linux development, and data analysis for containerized applications.Amazon ECS seeks a Software Development Engineer to deliver its container orchestration service and accelerate cloud container adoption... 

    Amazon.com, Inc.

    Winnipeg, MB
    2 hours ago
  • Explore an innovative role as a Distributed Systems Engineer in Vancouver with AIM, a pioneer in advanced laser technology. Use your Go proficiency to enhance the effectiveness of real-time responses to drone threats. This full-time role focuses on the development and improvement... 
    Full time

    AIM Defence

    Winnipeg, MB
    2 hours ago
  • Design highly available, scalable systems at AWS in Vancouver using distributed systems software expertise and technical leadership. Shape foundational services...  ...Centre Canada ULC seeks a senior software development engineer for Transactional Services. You will build systems... 

    Amazon Web Services (AWS)

    Winnipeg, MB
    2 hours ago
  • Lead distributed systems for Affirm Card Experiences from a remote Canada setting, combining backend scale, operational ownership, and customer-focused product delivery.This Staff Software Engineer, Fullstack role connects architecture with the cardholder journey from ordering... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...throughput edge data pipelines with Go or C++ as a Senior Software Engineer at Cisco, working in a hybrid or remote environment.On Cisco’...  ...Splunk Integrated Data Platform. This senior role emphasizes distributed systems, concurrency, memory management, and high-volume data... 
    Remote work

    Cisco

    Winnipeg, MB
    2 hours ago
  • Build reliable cloud systems with Go at Grafana Cloud, working remotely across distributed telemetry databases and Kubernetes infrastructure. Shape products used for observability.As a Senior Backend Software Engineer, you will design, build, operate, and maintain critical systems... 
    Remote work

    Grafana

    Winnipeg, MB
    2 hours ago
  • Build reliable distributed systems for Affrim’s remote Canada engineering organization, using Kubernetes and cloud technologies at exceptional scale.This Staff Software Engineer will lead the Observability team’s technical direction while designing and operating backend systems... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Scale fault-tolerant distributed systems for Affirm’s AI workloads as a remote Senior Software Engineer serving approved models and agents.As part of the AI Platform team, you will move AI workloads from pilot to production across millions of users and transactions. The work... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Shape chaos engineering at Affir m by leading distributed systems validation, fault injection, and production safety practices remotely nationwide.This seasoned Engineering Manager will lead the Resilience Engineering team and make failure testing a first-class engineering... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Lead complex distributed systems work with Kake as a remote Senior Rust Engineer focused on concurrency, scalability, and production reliability.Kake’s global community of senior engineers needs experienced Rust specialists for mission-critical applications. You will tackle... 
    Remote work

    Kake

    Winnipeg, MB
    2 hours ago
  • Lead distributed systems architecture for AWS Foundational Data & Storage Services, focusing on durability, availability, and latency. Work remotely...  ...Canada, Inc. is hiring Principal, Senior, and Distinguished Engineers for deep systems challenges. This senior engineering work... 
    Internship
    Remote work

    Amazon Web Services (AWS)

    Winnipeg, MB
    2 hours ago
  • Design distributed infrastructure for autonomous agents at Cohere, combining systems depth with ML intuition. Work remotely or from global offices.This Senior Staff Software Engineer role addresses complex platform challenges with few established patterns. You will build capabilities... 
    Remote work

    FDE Times

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distributed Systems Engineer At Baseten. Be the first to apply!