Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Llm Serving Optimization Engineer

Capgemini Engineering

Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans production inference.Capgemini Engineering’s engineer extends model coverage and tunes inference behavior across AWS Neuron and Trainium platforms. You will read and modify implementations involving attention, mixture-of-experts routing, and KV-cache management. Responsibilities include hybrid state-space models, kernel-level optimization, and clear communication of engineering trade-offs.Key Responsibilities:
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Llm Serving Optimization Engineer. Be the first to apply!