Inference Performance Engineer At Baseten
Baseten
Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment.
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Inference Performance Engineer At Baseten in Winnipeg, MB vacancy
$180k - $360k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products.About Baseten... ...We're looking for inference performance engineers who want to make the world...PerformanceFlexible hours- Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on... ...reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce... ...Ideal candidates have 5+ years of high-performance coding experience in C++ or Python and...PerformanceRemote work
- Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency... ...to create an infrastructure that supports high-performance AI models in production. You'll be responsible...Performance
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to to ship AI products.About... ...across product, software development, performance engineering, and customer-facing...PerformanceInternshipFlexible hours- Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale... ...numerical correctness, observability, and high performance. You will write production-grade code,...Performance
- Join Baseten as a Python Engineer and develop transformative AI solutions for dynamic companies. Leverage your technical skills to deliver high-scale AI applications that enhance customer experiences. In this role, you will work closely with clients, driving projects from...Internship
$180k - $360k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products.About Baseten... ...models with industry-leading performance, scalability, and reliability. It...PerformanceFlexible hours$165k - $330k per year
About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies... .... Join us and help build the platform engineers turn to ship AI products. THE ROLEAs... ...critical inference deployments. Few teams at Baseten have as much breadth and visibility as...Flexible hours- Join Baseten as a Senior Site Reliability Engineer, enhancing the reliability of AI service infrastructure. Drive observability and automate operational processes to ensure seamless AI performance. As part of the SRE team, you’ll establish and maintain exemplary standards...Performance
- ...bringing them the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come join... ...on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a...PerformanceRemote workWorldwideFlexible hours
- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the... ...boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.Key...Performance
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to... ...numerically correct, observable, and exceptionally performant. You will write production code,...Performance
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting... ...teams, and AI Services. Optimize LLMs and ML models for high-performance inference using techniques such as quantization, pruning,...PerformanceWork at officeLocal areaFlexible hours2 days per week3 days per week- Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving... ...enterprise API, focusing on batching strategies and performance optimization. Key Responsibilities: • Establish low...PerformanceRemote work
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion... ...us and help build the platform engineers turn to ship AI products. Baseten... ...Deployed Engineers, Model Performance Engineers, and sister engineering...PerformanceLong term contractFlexible hours- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference... ...major technical areas. Reliability & Performance. Architect active-active systems with...Performance
- ...Cohere is a team of researchers, engineers, designers, and more, who are... ...you want to architect high-performance, resilient machine learning... ...ambiguous, customer-specific inference challenges—ranging from multi... ...experience with modern inference engines and optimization stacks (e.g....PerformanceFull timeWork at officeLocal areaRemote workHome office
- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...Work at office
$72.06k - $138.94k per year
At Capgemini Engineering, the world leader in engineering services, we bring together a global... ...production-grade large language model inference across current and next-generation AWS Trainium... ...under representative load, price-performance, long-context and multi-chip scaling, and...PerformanceFull timeLocal area- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location... ...Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.Collaborate with teammates...Performance
- Shape AI inference software at Cerebras Systems with Python, model serving, and production... ...accelerator backends.This Senior Software Engineer role focuses on making disaggregated... ...through model serving, API evolution, routing, and performance improvement. #J-18808-LjbffrPerformance
- Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create... ...AI systems. About the roleOur Inference team is responsible for building and maintaining... ...by giving our scientists the high-performance inference infrastructure they need to develop...PerformanceLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-... ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to... ...lifecycle management. Improve serving performance. Optimize streaming behavior, time to first...Performance
- Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+ years...Performance
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU... ...The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the Cerebras... ...across real-time vs batch processing, performance, and cost. Drive projects from 0 → 1...PerformanceLong term contractShift work
$165k - $330k per year
...BasetenBaseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...at the intersection of high-performance computing (HPC) and Large... ...networking opportunities. At Baseten, we are committed to...PerformanceFlexible hours- Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing...
- Job Description The Compiler Engineering team within Intel's Data Center Group is seeking... ...CPUs, GPUs, and accelerators through high-performance, portable software. Our mission is to... ...software ecosystems, including PyTorch, inference frameworks, and machine learning workloads...PerformanceInternshipManual laborLocal areaShift work
- ...next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re... ...looking for a Senior Software Development Engineer to own the end-to-end model execution... ...infrastructure at scale and high-performance inference serving. The PersonThis role demands...PerformanceInternshipManual labor
- ...a highly experienced Back-End Software Engineer who wants to work on core systems that shape... ...platform where reliability, security, performance, and simplicity all matter, and where... ...-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating models...PerformanceRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Performance Engineer At Baseten. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB

