Software Engineer - Model Performance Systems
$165k - $330k per yearBaseten
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We’re growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We’re growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLEWe are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure;
you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work.
Responsibilities
Benchmarking: Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.G., long-context window, KV cache reuse, disaggregated serving).
DevEx Improvement: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
Tool Development: Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis.
System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions and build release workflow automation for the model runtimes stack.
Optimization Automation: Build tools to find the "Pareto frontier"—identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.
RequirementsThis is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor other engineers. We want to talk to you if you have:
A Love for Systems & Hardware: You aren’t just interested in the AI;
you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the "breaking point" of a system.
Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.
WHY THIS ROLE
Direct Impact: Your tools will be the gatekeeper for what defines "good" performance for our customers.
Deep Learning (Literally): You will gain world-class expertise in GPU orchestration and LLM inference that few engineers in the industry possess.
High Ownership: As the lead of a small team, you will have the autonomy to build tools from scratch and contribute to open-source projects.
Benefits
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Compensation Range: $165K - $330K
#J-18808-Ljbffr
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We’re growing quickly and recently raised our $1.5B Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products.
THE ROLEWe are looking for Software Engineers to join our team. This is a specialized, high-impact role sitting at the intersection of high-performance computing (HPC) and Large Language Model (LLM) engineering. You will not just be building the automated "speedometer and diagnostic" suite for our next-generation AI infrastructure;
you will be defining the roadmap, driving key technical decisions, and taking full ownership of the future of this work.
Responsibilities
Benchmarking: Evaluate, run and automate standard LLM quality benchmarks (GSM8K, MMLU) alongside custom performance suites for specific workloads (e.G., long-context window, KV cache reuse, disaggregated serving).
DevEx Improvement: Develop and maintain internal GPU-enabled development environments (similar to GitHub Codespaces). You will ensure the team has seamless, high-performance "dev machines" optimized for model experimentation.
Tool Development: Build and contribute to open-source tools such as InferenceMAX and genai-bench to automate model evaluation, benchmarking and analysis.
System Profiling: Use profilers like PyTorch Profiler, NVIDIA Nsight Systems and py-spy to collect performance profiles, identify bottlenecks, and debug the compute/networking stack.
Monitoring & Observability: Develop real-time dashboards and alerts to monitor system health, model startup times, and runtime performance.
Continuous Integration: Automate performance testing via CI/CD pipelines to catch regressions and build release workflow automation for the model runtimes stack.
Optimization Automation: Build tools to find the "Pareto frontier"—identifying the absolute best configuration (latency vs. cost vs. quality) for a given model and workload.
RequirementsThis is a mid-senior, high leverage role. We care about your technical depth, strong communication skills to drive cross-team efforts, ability to navigate vague requirements and mentor other engineers. We want to talk to you if you have:
A Love for Systems & Hardware: You aren’t just interested in the AI;
you want to understand GPU memory subsystems, InfiniBand, and how data moves across a cluster.
An Automation Mindset: You believe that if a task has to be done twice, it should be scripted. You have a passion for stress-testing and fuzzy testing to find the "breaking point" of a system.
Mathematical Curiosity: A desire to understand the underlying math of Transformers and how it translates into FLOPs and memory requirements.
Technical Toolkit: Familiarity with Python, and an eagerness to master the NVIDIA software stack. C++ familiarity is good to have.
WHY THIS ROLE
Direct Impact: Your tools will be the gatekeeper for what defines "good" performance for our customers.
Deep Learning (Literally): You will gain world-class expertise in GPU orchestration and LLM inference that few engineers in the industry possess.
High Ownership: As the lead of a small team, you will have the autonomy to build tools from scratch and contribute to open-source projects.
Benefits
Competitive compensation, including meaningful equity
(U.S. only) 100% coverage of medical, dental, and vision insurance for employee and dependents
Flexible PTO policy including company wide Winter Break (our offices are closed from Christmas Eve to New Year's Day!)
Paid parental leave
Fertility and family-building stipend through Carrot
(U.S. only) Company-facilitated 401(k)
Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.
At Baseten, we are committed to fostering a diverse and inclusive workplace. We provide equal employment opportunities to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, or veteran status.
We are an Equal Opportunity Employer and will consider qualified applicants with criminal histories in a manner consistent with applicable law (by example, the requirements of the San Francisco Fair Chance Ordinance, where applicable).
Compensation Range: $165K - $330K
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Software Engineer - Model Performance Systems in Winnipeg, MB vacancy
- Electronic Arts, with a hybrid work model in Burnaby, BC, is seeking a Systems Software Engineer to push core systems and the shared engine forward. The role involves prototyping, planning, and collaborating with engineers to build scalable tools and capabilities for our games...Performance
$120k - $160k per year
...Responsibilities Building a high-performance software stack that makes optimal use of quantum... ...devices in a distributed, heterogeneous system (CPU/GPU/FPGA) Develop high-performance... ...BSc in Computer Science, Engineering, Physics, Math, or a related field....Performance$119k - $148k per year
Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies and compliance testing services, as well... ...generator including wind and solar renewables, and load model development or validation via field testing, and...SuggestedFull time$120k - $140k per year
...Magnetized Target Fusion (“MTF”) technology, an engineering-driven approach to fusion energy.... ...’s No. 1 GreenTech Company of 2026.The Systems Modeling Engineer works with a team of subject... ...experts to build systems and process models, of a fusion power plant, that is used...Suggested- We are seeking a Model-Based Systems Engineer with hands-on experience in MBSE, SysML, and UML to support vehicle feature modeling, system architecture... ...Collabera is a leading Digital Solutions company providing software engineering solutions to the world’s most tech-forward...SuggestedFor contractorsLocal area
- Develop foundational AI systems in Montreal as a hybrid engineer connecting high-level frameworks with low-level software and GPU-scale execution.This System Software Engineer role suits... ...and execution primitives for models running across thousands of GPUs. The position...Performance
$180k - $360k per year
...of AI to bring cutting-edge models into production. We're growing... ...and help build the platform engineers turn to ship AI products.About... ...We're looking for inference performance engineers who want to make the... ...enhancing the performance of software systems, particularly in the...PerformanceFlexible hours$108.95k - $136.19k per year
...WorksDivision: Water & Wastewater System ServicesPay Range: $108,952 - $... ...the Manager, Wastewater System Performance, the Wastewater System Performance Engineer provides technical expertise... ...design, operation, investigation, modelling, performance assessment, or rehabilitation...PerformanceLong term contractPermanent employmentFor contractorsInternshipWork at officeLocal area3 days per week- ...re invited to be a part of that. Lab Systems Software Developer We are looking for a... ...will work directly with laboratory and engineering teams to build and maintain software solutions... ..., and resolve software defects and performance issues • Write clean, efficient, and...Performance
- ...developer to join their team in Toronto, focused on quantum computing. The role involves building a high-performance software stack and benchmarking tools for quantum systems. Candidates should have a BSc in a related field and experience with high-performance C++ and Python....Performance
$119k - $163k per year
...$163,000 / year DescriptionThis Quantum Engineer role at Photonic is part of the Spin‑Photon Qubit System Performance team. Leveraging your technical skills in quantum... ...of the Photonic nanofabrication, hardware, software, and modelling teams to accelerate progress...PerformanceLong term contractVisa sponsorshipRelocation packageFlexible hours- ...frameworks that protect and optimize critical system resources, including rate limiting,... ...customers and high-traffic eventsAdvise engineering teams on scalable, efficient feature design... ...schema design5+ years of experience as a software developer with strong knowledge of Java or...PerformanceLong term contractWork from home
- Use Python process modeling and engineering physics to shape General Fusion’s practical fusion energy systems. Work-from-home arrangements depend on team effectiveness.This Systems... ...stakeholder needs, risk, and performance trade-offsDocument technical work and present...PerformanceWork from home
$110k - $140k per year
A frontier tech energy company in Calgary is seeking a Process Engineer to drive innovation in solar thermal systems. This role involves leading the design of thermal/utility loops, running simulations, and collaborating across teams. The ideal candidate possesses a P.Eng....- Position Overview Roshel is seeking a Vehicle Systems Engineer - Performance and Benchmarking at their Brampton, Ontario facility. The person will... ...system/component level targetsPerform vehicle and sub-system model validation and calibration based on test data, generate...Performance
- ...powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing... ...The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training...PerformanceInternshipManual labor
$120k - $180k per year
System Software Engineer - AIAbout us:We are a startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center clusters. We are backed by top-tier VC firms and notable angel investors. The company is led...PerformanceInternshipRemote work- Drive AI innovation with the MTIA Software team at Meta as a Software Engineer specializing in performance optimization for deep learning. This role focuses on frameworks... ...with AI researchers to optimize deep learning models to developing compiler stacks that enhance performance...Performance
$89.91k - $113.73k per year
The Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies and compliance testing services for... ...generator including wind and solar renewables, and load model development or validation via field testing, and...PerformanceFull timeImmediate startRemote work$140k - $190k per year
ROLE: Senior Software & Systems Engineer START DATE: ASAP LOCATION: Remote or hybrid. We welcome remote applicants and encourage hybrid work... ....Database administration: schema changes, permissions, performance.Network Administration Management of firewalls and switches...PerformanceWork at officeImmediate startRemote workFlexible hours- ...automating enforcement in ways that traditional systems cannot. Our approach has already led to... ...streets safer. We're looking for a Software Engineer to join the backend team that powers... ...Build systems that prioritize performance and reliability under real-world load...PerformanceInternshipLocal area
$130k - $160k per year
...Hybrid) | Reports to Director of Engineering About UrbanLogiqUrbanLogiq is... ...The RoleWe are hiring a Senior Software Engineer to develop and extend the systems layer of our platform: data pipelines... ...where volume, correctness, and performance all matter. Proven leadership...PerformanceFull timeOverseas$153k - $213k per year
...matters most. The Capacity Modeling team ensures Aff**irm can safely... ...maintain statistical capacity models that map traffic inputs (e.G.,... ...goals for your team, leading engineers on your team through ambiguity... ...and launching backend systems at scale using languages like...Work at officeRemote workFlexible hours- We are looking for a Backend Systems Engineer to join our growing team. You will be responsible... ...managementExpertise in building and maintaining high-performance, distributed systemsExperience with... ...working in a professional team of software engineers, and the tools and best...PerformanceInternshipLive InRemote work
$90k - $100k per year
...technologies integrate medical devices, software, and artificial intelligence... ...data, creating intelligent systems that enable earlier... ...clinical practice, research, engineering, data science, manufacturing,... ...world settings.Work with a high-performing and cross-functional team...Work at office- ...Café offers free Tea and Coffee. ERP Software Developer An ERP Software Developer designs... ...development, an understanding of ERP systems, excellent problem-solving skills, and the... ...of ERP systems to ensure optimal performance and reliability. • Provide technical support...Performance
- Build C++ systems for EA SPORTS UFC gameplay technology in Burnaby, working three days weekly onsite within Electronic Arts’ hybrid model.As a Systems Software Engineer, you will shape engine and platform technology supporting gameplay, animation, rendering, online, front end...Performance
- ...bringing them the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come join... ...on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a...PerformanceRemote workWorldwideFlexible hours
- ...minded people on our team. Build reliable financial systems through modern software engineering and enterprise integration. THE OPPORTUNITYAs a... ...enterprise software applications, ensuring scalability, performance, reliability, security, and maintainability. Define...PerformanceLocal area
- We are on the hunt for a Software Engineer to join Internal Tools + Systems team!As a Software Engineer, it’s your job to recognize strengths and weaknesses... ...define and refine scope of deliveries and ensure optimum performance.Excited by the opportunity to join a growing &...PerformanceLong term contractWork at officeImmediate startRemote workMonday to friday
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Model Performance Systems. Be the first to apply!
Related searches
- software developer internship no experience Winnipeg, MB
- software engineer intern Winnipeg, MB
- software developer Winnipeg, MB
- software developer remote Winnipeg, MB
- software engineer - ai machine learning Winnipeg, MB
- part time software developer Winnipeg, MB
- junior software engineer Winnipeg, MB
- software engineer part time Winnipeg, MB
- software developer intern Winnipeg, MB
- senior software developer Winnipeg, MB

