Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Distributed Systems Engineer At Baseten

Baseten

Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities: - Build infrastructure for distributed LLM inference - Design and operate advanced Model APIs - Implement API versioning, validation, and quotas - Instrument observability metrics and logs - Debug complex systems across Kubernetes and GPU
Requirements: - 3+ years in distributed systems or large-scale APIs - Proven experience in reliable backend services - Strong understanding of performance profiling and testing - Comfort in debugging across application layers - Excellent collaboration and documentation skills
Bring your expertise to Baseten and contribute to shaping the future of AI products.#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer At Baseten in Winnipeg, MB vacancy
  • $80k - $135k per year

    The RoleAIM is a deep-tech startup building advanced high-power laser systems to protect people from weaponised drones. We are seeking highly motivated Distributed Systems Engineers, experienced in Go (\ "golang\"), and based in Vancouver, BC. At AIM, you will work closely... 
    Suggested
    Full time
    Immediate start
    Flexible hours

    AIM Defence

    Winnipeg, MB
    2 hours ago
  • Engineer distributed Java systems that protect Canadian consumers and financial institutions. Work across scalable APIs, production services, and full lifecycle delivery.This permanent Software Engineer position supports a client in digital identity, cybersecurity, and telecommunications... 
    Suggested
    Permanent employment

    emergiTEL Inc.

    Winnipeg, MB
    2 hours ago
  • Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB seeks a Software Engineer for the Atlas Agent Engine team. You will build the developer CLI, SDKs, and distributed systems... 
    Suggested
    Remote work

    MongoDB Inc.

    Winnipeg, MB
    2 hours ago
  • Build distributed systems at Instacart with Go and PostgreSQL while working remotely across Ontario, Alberta, British Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store services and datastores serving Search, Ads, shopper, customer... 
    Suggested
    Internship
    Remote work

    Remote Genie

    Winnipeg, MB
    2 hours ago
  • Build reliable distributed systems for Affirms’ Card Experiences team, using AWS, Kubernetes, Python, or Kotlin in a remote-first Canadian role. AI matters.This Staff Software Engineer position focuses on technical strategy, scalable backend architecture, and dependable cardholder... 
    Suggested
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Lead highly available distributed systems for Affirm Card from a remote Canada location, using AWS, Kubernetes, Python, or Kotlin. Shape durable...  ....Affirm’s Card Experiences team needs a Staff Software Engineer to guide systems and execution across the cardholder journey.... 
    Immediate start
    Remote work

    Candidate

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic...  .... Join us and help build the platform engineers turn to ship AI products.About Baseten...  ..., we are building the global operating system for distributed, heterogeneous AI hardware. We believe... 
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  • Join Baseten as a Python Engineer and develop transformative AI solutions for dynamic companies. Leverage your technical skills to deliver high-scale AI applications that enhance customer experiences. In this role, you will work closely with clients, driving projects from... 
    Internship

    Baseten

    Winnipeg, MB
    2 hours ago
  • Design low-latency crypto infrastructure for Robinhood’s Toronto engineering team, solving large-scale distributed systems challenges on-site.This Senior Software Engineer role focuses on backend services, infrastructure, and data systems supporting crypto, Web3, and wallet... 

    Neobankbeat

    Winnipeg, MB
    2 hours ago
  • Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work... 
    Work at office
    Worldwide

    FDE Times

    Winnipeg, MB
    2 hours ago
  • $58k - $104k per year

     ...immediate 8-16 month Co-op opening for an Engineer. About the team: Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's technical innovation...  ...and engineers to develop proof-of-concept systems and product components for AI-native cloud... 
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Winnipeg, MB
    2 hours ago
  • Shape distributed systems at Amazon as a full-time Software Development Engineer intern, working in an office Monday through Friday.Amazon seeks interns and co-ops for Robotics teams developing products and services at significant scale. You will collaborate with experienced... 
    Full time
    Internship
    Work at office
    Monday to friday

    Alternance Amazon

    Winnipeg, MB
    2 hours ago
  • Build backend systems for real-time grid decisions at Soma Energy, using distributed systems expertise and Python, Go, Rust, or C++.As a Senior Engineer, you will own major services from design through reliable production operation. You will build infrastructure, APIs, and distributed... 

    Soma Energy Inc.

    Winnipeg, MB
    2 hours ago
  •  ...established media tech company as an Embedded Systems Architect, focusing on embedded Linux...  ...Design software for cutting-edge media distribution products • Engage in discussions to...  ...code and design reviews • Mentor junior engineers and improve engineering processes Requirements... 
    Internship

    5V Video

    Winnipeg, MB
    2 hours ago
  • Design scalable, reliable distributed systems for AI security as a Senior Software Engineer. Work with North America product, security, and infrastructure teams.This early engineering seat addresses how large organisations securely adopt Generative AI. You will design services... 

    CyberForce Global

    Winnipeg, MB
    2 hours ago
  •  ...extraordinary scale. Own reliability, performance, and availability.As a Senior Cloud Engineer on the Product Metrics team, you will design, build, operate, and maintain business-critical distributed systems. The platform stores trillions of records in ClickHouse and processes... 
    Remote work

    ClickHouse

    Winnipeg, MB
    2 hours ago
  • Amazon Development Centre Canada ULC in Vancouver is seeking a Software Development Engineer to build foundational features for large-scale distributed systems. You will design robust APIs, contribute to code reviews, and own parts of the production lifecycle under senior guidance... 

    Amazon Web Services (AWS)

    Winnipeg, MB
    2 hours ago
  • Become an Intermediate Engineer with WSP in British Columbia, specializing in distribution power systems. Your role will focus on enhancing energy infrastructure through detailed design and project coordination. At WSP, we're seeking a Distribution Line Engineer to join... 

    WSP Global Inc.

    Winnipeg, MB
    2 hours ago
  • Build reliable cloud systems with Go at Grafana Cloud, working remotely across distributed telemetry databases and Kubernetes infrastructure. Shape products used for observability.As a Senior Backend Software Engineer, you will design, build, operate, and maintain critical systems... 
    Remote work

    Grafana

    Winnipeg, MB
    2 hours ago
  • Lead distributed systems architecture and backend engineering at KeyCite, modernizing platforms while protecting customer-facing reliability. This hybrid role sets technical direction across teams.As a Staff Software Engineer II, you will guide complex production systems from... 

    Thomson Reuters

    Winnipeg, MB
    2 hours ago
  • Lead complex distributed systems work with Kake as a remote Senior Rust Engineer focused on concurrency, scalability, and production reliability.Kake’s global community of senior engineers needs experienced Rust specialists for mission-critical applications. You will tackle... 
    Remote work

    Kake

    Winnipeg, MB
    2 hours ago
  • Architect distributed systems for Nubank’s Money Boxes platform, combining high-concurrency design with transactional ledgering across international...  ...office presence two days weekly.As Senior Staff Software Engineer, you will serve as chief technical authority for Money Boxes... 
    Work at office

    Nubank

    Winnipeg, MB
    2 hours ago
  •  ...First enables remote work within your province.This Software Engineer II position focuses on production services that route and authorize...  ...incident response. The role also offers hands-on exposure to distributed systems, cryptography, and payment processing.Key Responsibilities:... 
    Remote work
    Flexible hours

    Marqeta, Inc.

    Winnipeg, MB
    2 hours ago
  • Design planetary-scale distributed systems for identity threat protection, using cloud architecture and security expertise at the company. Work location is not specified.As a Staff Software Engineer, you will serve as a technical cornerstone within the Identity Threat Protection... 
    Remote work

    Okta Inc.

    Winnipeg, MB
    2 hours ago
  • Lead distributed systems for Affirm cardholder journeys remotely across Canada, combining AWS, Kubernetes, and operational ownership.As a Staff Software Engineer on the Card Experiences team, you will develop highly available systems supporting card ordering and use. You will... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    2 hours ago
  • Design scalable backend systems with Java, Python, Go, or C# as a fully remote Senior Software Engineer at WhatJobs Direct. Build reliable services for demanding applications...  ...development experience. You will develop distributed applications, RESTful APIs, and database solutions... 
    Remote work

    Placements24

    Winnipeg, MB
    2 hours ago
  • Engineer reliable NLP infrastructure with Python and C++ in Vancouver, supporting onsite work...  ..., reliability, and cost-efficient systems for language detection, sentiment analysis...  ...data structures and algorithms knowledgeUse distributed systems, NLP engineering, and performance... 
    3 days per week

    TEEMA Group

    Winnipeg, MB
    2 hours ago
  • Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment. At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance... 

    Baseten

    Winnipeg, MB
    2 hours ago
  • Design distributed infrastructure for autonomous agents at Cohere, combining systems depth with ML intuition. Work remotely or from global offices.This Senior Staff Software Engineer role addresses complex platform challenges with few established patterns. You will build capabilities... 
    Remote work

    FDE Times

    Winnipeg, MB
    2 hours ago
  •  ...throughput edge data pipelines with Go or C++ as a Senior Software Engineer at Cisco, working in a hybrid or remote environment.On Cisco’...  ...Splunk Integrated Data Platform. This senior role emphasizes distributed systems, concurrency, memory management, and high-volume data... 
    Remote work

    Cisco

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Distributed Systems Engineer At Baseten. Be the first to apply!