Software Engineer - Infrastructure
$165k - $330k per yearBaseten
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLEAs an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.
EXAMPLE INITIATIVES
Multi-cloud capacity management
Inference on B200 GPUs
Multi-node inference
Fractional H100 GPUs for efficient model serving
Responsibilities
Develop infrastructure components for our ML inference platform using Python and Go
Implement and maintain Kubernetes deployments for model serving
Contribute to our inference orchestration layer for model deployments
Build and enhance monitoring systems for model performance metrics
Implement efficient resource management solutions for ML workloads
Support infrastructure automation to improve ML deployment workflows
Work closely with team members to implement technical solutions
Help balance performance optimization with system reliability
Participate in technical discussions around infrastructure improvements
Learn and apply infrastructure best practices
Requirements
Bachelor's degree or higher in Computer Science or related field
Proficient coding abilities in one or more popular programming or scripting languages;
Go proficiency is a plus
Working knowledge of Kubernetes and containerization
Basic understanding of machine learning concepts and model serving
Familiarity with distributed systems concepts
Experience with basic monitoring and logging tools
Interest in ML/AI infrastructure and willingness to learn
Strong collaboration and communication skills
Benefits
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Compensation Range: $165K - $330K
#J-18808-Ljbffr
THE ROLEAs an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance.
EXAMPLE INITIATIVES
Multi-cloud capacity management
Inference on B200 GPUs
Multi-node inference
Fractional H100 GPUs for efficient model serving
Responsibilities
Develop infrastructure components for our ML inference platform using Python and Go
Implement and maintain Kubernetes deployments for model serving
Contribute to our inference orchestration layer for model deployments
Build and enhance monitoring systems for model performance metrics
Implement efficient resource management solutions for ML workloads
Support infrastructure automation to improve ML deployment workflows
Work closely with team members to implement technical solutions
Help balance performance optimization with system reliability
Participate in technical discussions around infrastructure improvements
Learn and apply infrastructure best practices
Requirements
Bachelor's degree or higher in Computer Science or related field
Proficient coding abilities in one or more popular programming or scripting languages;
Go proficiency is a plus
Working knowledge of Kubernetes and containerization
Basic understanding of machine learning concepts and model serving
Familiarity with distributed systems concepts
Experience with basic monitoring and logging tools
Interest in ML/AI infrastructure and willingness to learn
Strong collaboration and communication skills
Benefits
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Compensation Range: $165K - $330K
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Software Engineer - Infrastructure in Winnipeg, MB vacancy
- ...KeycardAt Keycard, we're building identity and access infrastructure for the agent-native era, where software isn't static but a dynamic, constantly changing... ...Heroku. The RoleWe're hiring two staff-level Software Engineers, Infrastructure to own how Keycard is built, shipped...SuggestedInternshipRemote work
- ...of the greatest threats AI presents: mass‑manufactured social engineering. Countless scams, deepfakes, and other social engineering attacks... ...looking for an experienced backend engineer to build out the infrastructure required to rapidly scale up our engineering organization. A...SuggestedInternshipWork at officeFlexible hours
$169k - $396.36k per year
...office Flexible PTO Quarterly team offsites What We're Looking ForWe’re looking for an experienced backend engineer to build out the infrastructure required to rapidly scale up our engineering organization. Built self-hosted Elasticsearch infrastructure on Kubernetes...SuggestedInternshipWork at officeFlexible hours$140k - $180k per year
...evidence-based platform. We are well-funded and have engineering offices in New York City, Toronto, and Vancouver.We are looking for an experienced Software Engineer to design, implement, and maintain our infrastructure solutions. The ideal candidate will have a strong background...SuggestedWork at officeLocal area- Software Engineer: Agent Infrastructure Backend / Distributed Systems · Toronto, Canada · Full-timeDesign and build the execution fabric, scheduling,... ...distributed compute: job schedulers and workflow orchestration engines; on-prem cluster management and deployment;...Suggested
- ...regulators around the world. About the Role As a Senior Software Engineer, you will play a key role in driving projects from implementation... ...design, deploy, and manage distributed systems using cloud infrastructure. Expertise in troubleshooting and debugging large codebases...Flexible hours
$135.2k - $258k per year
About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...customer churn.What you'll do As an engineer on the team, you'll be responsible for... ...2+ years of experience in backend software developmentAbility to write high-quality...Contract workInternshipWork at officeLocal areaRemote workWork from homeRelocation- Why this role? We’re building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want... ...teams rely on for training and evaluation jobs.As a Software Engineer, Data Infrastructure, you will Work directly on petabyte‑...Full timeWork at officeFlexible hours
- Build robust orchestration systems and developer tooling for Auth0’s platform infrastructure in a hybrid work model serving global identity operations.As a Software Engineer II, you will help develop the Control Server, APIs, and CLI tools managing environments on AWS and Azure...
- Strengthen scalable applications and processing infrastructure as an Associate Software Engineer using server-side development, SQL, and AWS.This Associate Software Engineer role focuses on outcomes, customer impact, and reliable technology. You will independently own large-...
- Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud...
- ...of global GDP, these industries are the infrastructure of our planet, including agriculture, construction... ...term. About the role:As a Senior Engineer in the Infrastructure org, you will help... ...of experience designing and building software, infrastructure, or distributed systems,...Long term contractFull timeRemote workFlexible hours
$147k - $196.6k per year
...the platforms that power them.We’re looking for a Manager of Software Engineering to join the Autonomous Vehicles Integrity Platform group.... ...leadership role responsible for guiding the AV Diagnostics Infrastructure team as it develops the fault detection and diagnostic foundation...$176.5k per year
...About The Team And Role Core Infrastructure builds and operates the... ...Senior, Staff, and Principal engineers building the Content Library... ...systems engineer who loves owning software end-to-end: design,... ...parquet crate, or building query engines and database internals. Contributions...Long term contractFor contractorsLocal areaHome officeFlexible hours- ...Provision, monitor, and optimize cloud infrastructure to support CI workloads, balancing cost... ...automation that improves developer velocity and engineering productivity. Contribute to the... ...in a DevOps, infrastructure, or software engineering role. Familiarity with CICD...
- Join the ML Infra team at Stripe as a Software Engineer specializing in infrastructure. You'll build vital systems that support machine learning applications while enhancing overall project efficiency. As part of a leading team, you will tackle challenges in the ML lifecycle...
- ...highly realistic closed-loop simulation engine built with the latest in generative AI technologies... ...! You Will Develop the tooling, infrastructure, and pipelines to support complex... ...in Python programming and strong software engineering fundamentals with real‑world...Full timeInternshipWork at officeWork from homeFlexible hours
$123.75k - $165k per year
# Senior Software Engineer, Infrastructure PlatformLatticeRemote Full Time Remote Posted 4 hours agoShare this job:WhatsApp LinkedIn X Facebook Email#### Job DescriptionHeadquarters: Remote - Canada This is Engineering at Lattice Lattice’s Engineering team is continuously...Full timeWork at officeRemote workWork from home$137.2k - $196k per year
Senior Software Engineer - Platforms & Infrastructure About the Role:The Infrastructure team at Tubi builds and operates the core platforms that power our services at scale. We provide reliable, scalable, and developer-friendly systems for compute, networking, observability...RemplacementLong term contractFull timeTemporary workWork at officeLocal areaFlexible hours2 days per week- Lead data infrastructure development at PDF, combining Go and C with scalable server-side applications... ...Canadian role supports globally used software.As a senior developer and team leader, you will shape designs, guide engineers, and build infrastructure for real-time customer...For subcontractorWork at office
- ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...will work closely with machine learning engineers, data scientists, and product... ...requirements 2+ years of professional software development experience with a solid background...
- ...what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft.... ...have: ~5+ years of engineering experience running production infrastructure at a large scale ~ Experience designing large, highly available...Full timeWork at officeRemote workFlexible hours
$180k - $250k per year
...reliability, and capabilities of our autonomy engine and electric propulsion systems.We... ...technologies including proprietary flight control software, avionics, high power density motors,... ...Overview Pyka is looking for a Cloud Infrastructure Manager to lead the team building and...Long term contractTemporary workImmediate startRemote work1 day per weekusd218k per year
...are we?Equinix is the world’s digital infrastructure company®, shortening the path to connectivity... ...and define product roadmaps Software ArchitectureParticipates in architectural... ...experienceBachelor’s in Computer Science or Computer Engineering The targeted pay range for this...Full timeWork at office$123.3k - $159.5k per year
# Software Engineer, AI/ML InfrastructureThumbtack123k-160k CADFull-timeremote· seniorCanadagopythonpostgresListed via Jobicy · posted 3 Oct... ...what we’ll build together.About the Machine Learning Infrastructure TeamAt Thumbtack, our challenges span a wide range of areas,...Seasonal workLocal area- About the Role Software engineering is undergoing its biggest transformation in decades.AI agents are no longer simply assisting developers... ...and CI/CD pipelines to agent sandboxes, testing infrastructure, repository architecture, and AI-native development workflows...Long term contractInternshipWork at officeLocal area3 days per week
- ...customers include some of the world’s largest airlines and ground handling providers. For more information, visit As a Staff Software Engineer, Infrastructure (Cloud), you will own the data infrastructure and cloud systems that power AeroVect's autonomous driving platform. You'...Long term contract
- ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft... ...the role. We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems,...Full timeManual laborWork at officeLocal areaRemote workHome office
- Elevate your engineering career as a Senior Software Engineer with Lyft's Foundational Infrastructure & Networking team. Leverage your skills in service mesh, cloud networking, and performance optimization in a hybrid work model. At Lyft, you will own key components of core...
$136k - $170k per year
At Lyft, our purpose is to serve and connect. Lyft's Infrastructure organization builds the high-scale foundation that every engineer at Lyft relies on to ship safe, performant, and reliable services.As a Senior Software Engineer on the Foundational Infrastructure & Networking...Hourly payWork at officeFlexible hours3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Infrastructure. Be the first to apply!
Related searches
- software developer internship no experience Winnipeg, MB
- software engineer intern Winnipeg, MB
- software developer Winnipeg, MB
- software developer remote Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB
- part time software developer Winnipeg, MB
- junior software engineer Winnipeg, MB
- software engineer part time Winnipeg, MB
- software developer intern Winnipeg, MB
- senior software developer Winnipeg, MB

