Inference Performance Engineer At Baseten
Baseten
Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment.
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Performance Engineer At Baseten. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB
