Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Inference Performance Engineer At Baseten

Baseten

Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment.
At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.
Key Responsibilities: - Implement advanced inference techniques for runtime optimization - Optimize end-to-end performance, identifying bottlenecks - Provide clear latency/throughput/cost tradeoffs to stakeholders - Bring up new model architectures on release day - Develop benchmarking frameworks for performance measurement
Requirements: - Degree in Computer Science, Engineering, or related field - Proficient in Python, C++, or similar languages - Familiarity with LLM optimization techniques - Strong experience with ML libraries like PyTorch - Deep understanding of GPU architecture
Make a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Inference Performance Engineer At Baseten in Winnipeg, MB vacancy
  • $180k - $360k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion...  ...us and help build the platform engineers turn to ship AI products.About Baseten...  ...We're looking for inference performance engineers who want to make the world... 
    Performance
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • Cohere is seeking an experienced engineer to join the Model Efficiency team, focusing on...  ...reliable ML systems and optimizing LLM inference. You will improve the inference stack, reduce...  ...Ideal candidates have 5+ years of high-performance coding experience in C++ or Python and... 
    Performance
    Remote work

    Cohere

    Winnipeg, MB
    1 hour ago
  • Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency...  ...to create an infrastructure that supports high-performance AI models in production. You'll be responsible... 
    Performance

    Baseten

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion...  ...us and help build the platform engineers turn to to ship AI products.About...  ...across product, software development, performance engineering, and customer-facing... 
    Performance
    Internship
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale...  ...numerical correctness, observability, and high performance. You will write production-grade code,... 
    Performance

    FDE Times

    Winnipeg, MB
    1 hour ago
  • Join Baseten as a Python Engineer and develop transformative AI solutions for dynamic companies. Leverage your technical skills to deliver high-scale AI applications that enhance customer experiences. In this role, you will work closely with clients, driving projects from... 
    Internship

    Baseten

    Winnipeg, MB
    1 hour ago
  • $180k - $360k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion...  ...us and help build the platform engineers turn to ship AI products.About Baseten...  ...models with industry-leading performance, scalability, and reliability. It... 
    Performance
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

    About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies...  .... Join us and help build the platform engineers turn to ship AI products. THE ROLEAs...  ...critical inference deployments. Few teams at Baseten have as much breadth and visibility as... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • Join Baseten as a Senior Site Reliability Engineer, enhancing the reliability of AI service infrastructure. Drive observability and automate operational processes to ensure seamless AI performance. As part of the SRE team, you’ll establish and maintain exemplary standards... 
    Performance

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...bringing them the tools and insight they need to deliver faster, more performant, more dependable, and less expensive Java services. Come join...  ...on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of Falcon. This is not a... 
    Performance
    Remote work
    Worldwide
    Flexible hours

    Azul

    Winnipeg, MB
    6 days ago
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the...  ...boundaries around models. You will optimize real-world performance while supporting mobile and desktop clients.Key... 
    Performance

    Sarsfield Group

    Winnipeg, MB
    1 hour ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to...  ...numerically correct, observable, and exceptionally performant. You will write production code,... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  • $100k - $145k per year

    Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting...  ...teams, and AI Services. Optimize LLMs and ML models for high-performance inference using techniques such as quantization, pruning,... 
    Performance
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  • Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving...  ...enterprise API, focusing on batching strategies and performance optimization. Key Responsibilities: • Establish low... 
    Performance
    Remote work

    Best AI Tools Wiki

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion...  ...us and help build the platform engineers turn to ship AI products. Baseten...  ...Deployed Engineers, Model Performance Engineers, and sister engineering... 
    Performance
    Long term contract
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU...  ...About the RoleWe're hiring a Software Engineer to help contribute to projects on our Inference...  ...major technical areas. Reliability & Performance. Architect active-active systems with... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...you want to architect high-performance, resilient machine learning...  ...ambiguous, customer-specific inference challenges—ranging from multi...  ...experience with modern inference engines and optimization stacks (e.g.... 
    Performance
    Full time
    Work at office
    Local area
    Remote work
    Home office

    FDE Times

    Winnipeg, MB
    1 hour ago
  • Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong... 
    Work at office

    Best AI Tools Wiki

    Winnipeg, MB
    1 hour ago
  • $72.06k - $138.94k per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global...  ...production-grade large language model inference across current and next-generation AWS Trainium...  ...under representative load, price-performance, long-context and multi-chip scaling, and... 
    Performance
    Full time
    Local area

    Capgemini Engineering

    Winnipeg, MB
    1 hour ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location...  ...Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.Collaborate with teammates... 
    Performance

    Brix

    Winnipeg, MB
    1 hour ago
  • Shape AI inference software at Cerebras Systems with Python, model serving, and production...  ...accelerator backends.This Senior Software Engineer role focuses on making disaggregated...  ...through model serving, API evolution, routing, and performance improvement. #J-18808-Ljbffr
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create...  ...AI systems. About the roleOur Inference team is responsible for building and maintaining...  ...by giving our scientists the high-performance inference infrastructure they need to develop... 
    Performance
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    Winnipeg, MB
    1 hour ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to...  ...lifecycle management. Improve serving performance. Optimize streaming behavior, time to first... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+ years... 
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU...  ...The RoleWe’re hiring a Senior Frontend Engineer to own and scale critical parts of the Cerebras...  ...across real-time vs batch processing, performance, and cost. Drive projects from 0 → 1... 
    Performance
    Long term contract
    Shift work

    Cerebras

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...BasetenBaseten powers mission-critical inference for the world's most dynamic...  ...and help build the platform engineers turn to ship AI products....  ...at the intersection of high-performance computing (HPC) and Large...  ...networking opportunities. At Baseten, we are committed to... 
    Performance
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • Build machine learning inference APIs with Python and distributed systems expertise at Cerebras Systems, connecting GPU prefill with Cerebras decode.As a Senior Software Engineer, you will develop production software across inference APIs, model integration, and request-routing... 

    FDE Times

    Winnipeg, MB
    1 hour ago
  • Job Description The Compiler Engineering team within Intel's Data Center Group is seeking...  ...CPUs, GPUs, and accelerators through high-performance, portable software. Our mission is to...  ...software ecosystems, including PyTorch, inference frameworks, and machine learning workloads... 
    Performance
    Internship
    Manual labor
    Local area
    Shift work

    Intel Corporation

    Winnipeg, MB
    1 hour ago
  •  ...next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re...  ...looking for a Senior Software Development Engineer to own the end-to-end model execution...  ...infrastructure at scale and high-performance inference serving. The PersonThis role demands... 
    Performance
    Internship
    Manual labor

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    1 hour ago
  •  ...a highly experienced Back-End Software Engineer who wants to work on core systems that shape...  ...platform where reliability, security, performance, and simplicity all matter, and where...  ...-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating models... 
    Performance
    Remote work

    Cohere

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Inference Performance Engineer At Baseten. Be the first to apply!