Distributed Systems Engineer at Baseten
Baseten
Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability. At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities. Key Responsibilities:
- Build infrastructure for distributed LLM inference
- Design and operate advanced Model APIs
- Implement API versioning, validation, and quotas
- Instrument observability metrics and logs
- Debug complex systems across Kubernetes and GPU
- 3+ years in distributed systems or large-scale APIs
- Proven experience in reliable backend services
- Strong understanding of performance profiling and testing
- Comfort in debugging across application layers
- Excellent collaboration and documentation skills
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Distributed Systems Engineer at Baseten in Montréal, QC vacancy
- Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment. At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance...Suggested
- ...We are seeking a senior distributed machine learning (ML) research developer to join our team... ...field (e.g., computer science, computer engineering, software engineering) is required. An... ...related to machine learning or distributed ML systems is preferred but not required if the...SuggestedFull timeWork at office
- ...twenty years. Job Summary We are looking for a Controls Systems Engineer to design and maintain the control logic for our APU systems,... ...battery management for commercial vehicles without idling the engine. Key Responsibilities Developing and maintaining control...SuggestedFull time
- ...and manages passenger Wi-Fi and on-board passenger infotainment systems. Nomad also provides remote online condition-based monitoring and... ...an exciting opportunity for an experienced Senior Linux System Engineer to join our global Engineering division in Montreal, Canada....SuggestedWork at officeFlexible hours
- ...Job Responsibility: MANNARINO Systems & Software Inc. is a leader in providing safety-critical... ..., software, hardware and certification engineering services to the aerospace, defense, space... ...Requirements Experience with electric engine control Experience with Matlab /...SuggestedLong term contractFull timeWork at office
- ...posting is intended for you to express your interest in future opportunities within AtkinsRéalis. We are looking for a Systems Integration Engineer who is passionate about complex multidisciplinary rail projects and enjoys solving problems and finding solutions that meet...Full timeInternshipWork at officeFlexible hours
- ...posting is intended for you to express your interest in future opportunities within AtkinsRéalis. We are looking for a Systems Integration Engineer who is passionate about complex multidisciplinary rail projects and enjoys solving problems and finding solutions that meet...Full timeInternshipWork at officeFlexible hours
- ...Description TASKS YOU WILL ACCOMPLISH Act as a systems engineer and carry out pneumatics discipline activities. Assure integration and interface management of assigned systems and coordinate with internal groups & suppliers. Define pneumatic system architecture,...Full timeTemporary workWorldwide
- ...More in reach. Lead globally. Transform engineering. Deliver what matters. At Sedgman, we're redefining how engineering works at scale. As Director Engineering, Systems & Digital, you will step into a global leadership role shaping engineering governance, systems and...Long term contract
- ...scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure... ...depend on. You’ll design and operate the distributed systems that power billions of daily decisions,... ...[NYSE: U] is the world’s leading game engine, powering play for more than 3 billion...Work at officeWorldwideRelocation package
- ...Montréal is an internationally recognized engineering university. Located in the heart of... ...medical imaging, automation and control systems, energy and electrical networks, microelectronics... ..., learning and optimization, and distributed, multi-agent, and networked control systems...Permanent employmentFull timeLocal areaImmediate startRelocation package
- ...the organisations that can't take risks with their data or their systems, like airports, banks, power grids, and governments. So our... ...on someone else's servers. We are looking for a foundational engineer to work directly with leadership in defining system architecture...Manual labor
- ...Description ROLE SUMMARY Our client is hiring a highly technical Systems Engineer to join its North American R&D and solutioning hub. This... ..., services and applications Scalable backend services and distributed systems High-level and detailed system architecture...Long term contractFull time
- ...Cohere is seeking a Senior Product Security Engineer to tackle security challenges across our AI production stack. You will review architecture... ...AI products, define secure defaults, and scale guardrails across multi-tenant systems in a remote-friendly setup. #J-18808-LjbffrRemote work
- ...TASKS YOU WILL ACCOMPLISH The MRB Liaison Engineer – Systems supports aircraft production by resolving system-related non-conformances and providing engineering dispositions that ensure continued compliance with safety, quality, and certification requirements. This position...Full timeWork at officeWorldwideWeekend workDay shiftAfternoon shift
- ...Sedgman GmbH seeks a Director Engineering, Systems & Digital to lead global governance, systems and digital capability across its international engineering network. You will shape delivery transformation, embed best practices, and champion AI-enabled solutions to improve productivity...Long term contract
- ...Canada is part of the SYSTRA group, an international consulting and engineering group, a world leader in the design of transport... ...industry in Canada! Missions/Main Duties Independently leads systems engineering tasks and contributes to multidisciplinary project...
- ...We’re seeking someone to join our team as a Site Reliability Engineering Specialist to support the reliability, performance, and operational... ...for this role. Strong knowledge of Linux/Unix operating systems and production support environments. Strong scripting and automation...Full timeWork at officeRemote work
- ...Montreal to design, train, and optimize foundational ML algorithms and systems. You will lead end-to-end development, from conceptual ideas to... ...architecture, and strong communication across researchers and engineers. Montreal-based opportunity with competitive compensation. #J-...
$125.04k - $171.93k per year
...energy projects in Quebec and internationally, we are seeking a Principal Electrical Engineer who will play a key role in the design and coordination of medium-voltage (MV) collector systems for wind farms. The successful candidate will serve as the technical authority...Full timeInternshipLocal areaFlexible hours$250k per year
...work together to identify unique market opportunities. The company is looking for an experienced C++ Engineer with 5+ years of experience developing low-latency systems. Experience within financial services, trading, or HFT would be ideal, although candidates from other...Permanent employment- ...aspects and deliverables related to traction power supply and distribution systems for transit and rail projects. Your Role Prepare and... ...Autodesk BIM 360. About You DEP or DEC in Electrical Engineering or any other relevant academic training. More than 3...Full timeInternshipFlexible hours
- ...recherche un(e) Spécialiste Support et Distribution. Votre rôle principal sera d’assurer des... ...makers to help them create, master, distribute and promote their music. We love music... ...Studied in recording, music or engineering is an asset Experience working in a...Full timeContract workWork at officeLocal area
$180k - $360k per year
...About Baseten Baseten powers mission-critical inference for the... ...and help build the platform engineers turn to ship AI products.... ...the performance of software systems, particularly in the context... ...engine. Worked on large-scale distributed serving: autoscaling, load balancing...Flexible hours$180k - $360k per year
...About Baseten Baseten powers mission-critical inference for the world's most dynamic... .... Join us and help build the platform engineers turn to ship AI products. About Baseten... .... THE ROLE We're looking for distributed systems engineers and product-minded generalists...Flexible hours$94.08k - $129.36k per year
...responsibilities will include evaluating and onboarding new Independent Software Vendors (ISVs), which encompasses negotiating and executing Distribution and / or Reseller agreements, Product Merchandising, New Provider Enablement with internal teams and external partners, and...Permanent employmentFull timeWorldwide- ...plugins Genetec, aux intégrations et aux systèmes tiers connectés. Ce poste exige une solide... ...: As part of the Plugins Support Engineering team, the Technical Support Engineer is responsible... ...integrations, and connected third-party systems. This role requires strong...Long term contractFull timeRemote workFlexible hours
- ...the place for you! In 1984, we started out as a team of three engineers. Today, we have grown to become a global organization with over... ...at scale. What we are looking for Workflow orchestration & system design: Track record architecting resilient execution workflows,...Long term contractWork at officeRemote workFlexible hours
- ...activement à accélérer la transition vers une mobilité plus durable. Nous recherchons un·e Gestionnaire, gestion des canaux de distribution – Résidentiel pour piloter la performance et l’exécution de notre réseau de partenaires qui distribuent les solutions FLO Home au...Daily paidFull timeSummer workRemote workWork from homeDay shift2 days per week
$52.5k per year
...qui contribuent au bon fonctionnement des systèmes essentiels de projets résidentiels,... ...ensemble des secteurs de l’industrie de la distribution en gros des produits de construction en... ...expertise, and service that support critical systems in residential, commercial, industrial,...Long term contractFull timeApprenticeshipTraineeshipWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Systems Engineer at Baseten. Be the first to apply!
