Inference Performance Engineer At Baseten
Baseten
Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment.
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Inference Performance Engineer At Baseten in Winnipeg, MB vacancy
- ...bringing them the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come join... ...on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a...PerformanceRemote workWorldwideFlexible hours
$180k - $360k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products.About Baseten... ...We're looking for inference performance engineers who want to make the world...PerformanceFlexible hours- Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency... ...to create an infrastructure that supports high-performance AI models in production. You'll be responsible...Performance
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to to ship AI products.About... ...across product, software development, performance engineering, and customer-facing...PerformanceInternshipFlexible hours- Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale... ...numerical correctness, observability, and high performance. You will write production-grade code,...Performance
- Join Baseten as a Python Engineer and develop transformative AI solutions for dynamic companies. Leverage your technical skills to deliver high-scale AI applications that enhance customer experiences. In this role, you will work closely with clients, driving projects from...Internship
- ...Senior Evaluation and Performance Analyst Department: Executive and Indigenous Affairs This Job Opening is limited to employees with the GNWT/WSCC in indeterminate and term positions. The Department of Executive and Indigenous Affairs works to provide overall management...PerformanceLong term contract
- ...Whitecliffe Global is seeking a senior performance marketer to set paid media strategy for its international campuses. You will direct multiple agencies, allocate budgets by market, and tie media spend to enrolments using GA4 and offline conversion tracking. You will connect...Performance
- ...and if you make it through the first 30 days you will probably be here for a long time. Our retention on this team is very good and that is not an accident. You will grow into senior strategy. We want people who want more responsibility. If you perform, you will grow....PerformanceRemote workWorldwideShift work
$180k - $360k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products.About Baseten... ...models with industry-leading performance, scalability, and reliability. It...PerformanceFlexible hours$27 per hour
...Best Employers for Women in 2026 and recognized by Newsweek as one of the World's Most Trustworthy Companies in 2026. About Channel Performance: The Channel Performance Service Line is home to the largest mystery shopping agency in the world. We complete over one million...PerformanceHourly payPermanent employmentFor contractorsSecond jobRemote workWorldwideMonday to fridayFlexible hours$165k - $330k per year
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies... .... Join us and help build the platform engineers turn to ship AI products. THE ROLEAs... ...critical inference deployments. Few teams at Baseten have as much breadth and visibility as...Flexible hours- Join Baseten as a Senior Site Reliability Engineer, enhancing the reliability of AI service infrastructure. Drive observability and automate operational processes to ensure seamless AI performance. As part of the SRE team, you’ll establish and maintain exemplary standards...Performance
- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the... ...boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.Key...Performance
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference... ...major technical areas. Reliability & Performance. Architect active-active systems with...Performance
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products. Baseten... ...Deployed Engineers, Model Performance Engineers, and sister engineering...PerformanceLong term contractFlexible hours- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...(TTFT) at massive scale. As an Engineering Manager, Inference Router, you will lead... ...hardware, and ML teams to optimize end‑to‑end performance. Team Leadership Build, manage,...Performance
- Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving... ...enterprise API, focusing on batching strategies and performance optimization. Key Responsibilities: • Establish low...PerformanceRemote work
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to... ...numerically correct, observable, and exceptionally performant. You will write production code,...Performance
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting... ...teams, and AI Services. Optimize LLMs and ML models for high-performance inference using techniques such as quantization, pruning,...PerformanceWork at officeLocal areaFlexible hours2 days per week3 days per week- ...Cohere is a team of researchers, engineers, designers, and more, who are... ...you want to architect high-performance, resilient machine learning... ...ambiguous, customer-specific inference challenges—ranging from multi... ...experience with modern inference engines and optimization stacks (e.g....PerformanceFull timeWork at officeLocal areaRemote workHome office
- Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create... ...AI systems. About the roleOur Inference team is responsible for building and maintaining... ...by giving our scientists the high-performance inference infrastructure they need to develop...PerformanceLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...Work at office
$72.06k - $138.94k per year
At Capgemini Engineering, the world leader in engineering services, we bring together a global... ...production-grade large language model inference across current and next-generation AWS Trainium... ...under representative load, price-performance, long-context and multi-chip scaling, and...PerformanceFull timeLocal area- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the Cerebras... ...across real-time vs batch processing, performance, and cost. Drive projects from 0 → 1...PerformanceLong term contractShift work
$165k - $330k per year
...BasetenBaseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...at the intersection of high-performance computing (HPC) and Large... ...networking opportunities. At Baseten, we are committed to...PerformanceFlexible hours- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to... ...lifecycle management. Improve serving performance. Optimize streaming behavior, time to first...Performance
- Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+ years...Performance
- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...? Are you energized by building high-performance, scalable and reliable machine learning... ...influence latency and throughput of inference. ~ Strong understanding or working experience...PerformanceFull timeWork at officeRemote workFlexible hours
- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location... ...Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.Collaborate with teammates...Performance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Performance Engineer At Baseten. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

