Senior Llm Serving Optimization Engineer
Capgemini Engineering
Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans production inference.Capgemini Engineering’s engineer extends model coverage and tunes inference behavior across AWS Neuron and Trainium platforms. You will read and modify implementations involving attention, mixture-of-experts routing, and KV-cache management. Responsibilities include hybrid state-space models, kernel-level optimization, and clear communication of engineering trade-offs.Key Responsibilities:
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Vacancy posted 29 minutes ago
Similar jobs that could be interesting for youBased on the Senior Llm Serving Optimization Engineer in Winnipeg, MB vacancy
$158.4k - $237.6k per year
...Technologies, Inc. Job AreaEngineering Group, Engineering Group Machine Learning Engineering LLM Serving Engineer (Cloud AI Engineering)Qualcomm is... ...advanced parallelism, speculative algorithms, model optimization, specialized kernels). Contribute to the development...SeniorWork from home$158.4k - $237.6k per year
A leading technology firm is hiring LLM Serving Engineers in Markham to develop scalable AI inference platforms. Candidates will work on machine learning packages and directly collaborate with various teams to drive advanced solutions. Ideal applicants should possess a Master...Suggested- Immiland Canada Inc. is seeking a Research Engineer to design, run, and scale training experiments for our next generation of large language models. You will own the full model lifecycle—from data to evaluation—writing code, running experiments, and turning ideas into production...Suggested
- ...this Role Vogo is seeking a Senior Manager, Pricing & Revenue... ...focused role responsible for optimizing wholesale rate performance, offer... ...hotel supply. You will serve as the subject-matter expert... ...pricing and work closely with Engineering, Data Science, Product, Partnerships...SeniorFull timeRemote workWorldwide
- Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that... ...architectures. You will fine-tune models, prepare textual data, optimize inference, and integrate NLP capabilities into user-...Senior
- Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration...Senior
$195k - $390k per year
...models. Join us to influence and build the next generation of Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language...SeniorFlexible hours- Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake... ...PythonDevelop backend services and FastAPI APIsBuild and optimize RAG pipelines, embeddings, and retrievalIntegrate OpenAI...SeniorRemote work
- ...Ontario, CanadaCompany Name: HITACHI ENERGY CANADA INC.Profession (Job Category): Engineering & ScienceJob Schedule: Full timeRemote: NoSenior Optimization Engineer The Opportunity As a Senior Optimization Engineer at Hitachi Energy, you will help develop the software and...SeniorFlexible hours
$114.4k - $164.4k per year
Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning... ...in embedded system development and optimization with application to a specific problem... ...experience in a role requiring interaction with senior leadership (e.G., Director and above)....SeniorImmediate startWork from home- Build reliable LLM platforms in Montreal with GitHub Copilot, Python, and CI/CD expertise... ...location role centers on production AI engineering.This Senior AI Application Developer position... ..., responsible AI, and operational cost optimization.Key Responsibilities: Manage...Senior
- Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will...SeniorRemote work
- Elevate your career remotely with Honeycomb as a Senior Software Engineer II specializing in LLM Observability. Leverage your expertise in AI systems and full-stack development while shaping observability tools for notable clients. In this senior role at Honeycomb, you will...SeniorRemote work
- Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions...Senior
- Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You will own agent loops, tool calling, retrieval, file context, and LLM traffic routing. The work uses Python, FastAPI or similar...Senior
- Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten... ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern... ..., Pipelines und eine Ausführungs-Engine für komplexe Produktsysteme. Dabei entwickelst...Senior
- Design workforce optimization solutions at Miratech using OR-Tools, constraint programming, and software engineering for enterprise contact centers. Remote work is available.As an Operations Research Engineer in the Workforce Management product stream, you will build optimization...SeniorRemote work
- Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred...Senior
- Miratech is seeking an Operations Research Engineer to join the Workforce Management (WFM) product stream and build optimization capabilities for large-scale contact centers. You will apply operations research, mathematical optimization, and algorithm design to transform business...SeniorRemote work
$127k - $225k per year
...has an immediate permanent opening for a Senior Engineer. About the team: The Computing Data... ...including software-hardware co-design and optimizing data efficiency at both the storage and... ...training pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside upstream...SeniorLong term contractPermanent employmentInternshipLocal areaImmediate start- Lead 4G and 5G RAN optimization from Toronto or Brampton, using network analytics to improve performance, capacity, reliability, and customer experience.Rogers seeks a Senior RAN Designer for its RAN Engineering and Innovation team. You will analyze KPIs, counters, traces, alarms...Senior
- Apply mathematical optimization and OR-Tools to workforce planning as a Senior Operations Research Engineer working remotely with enterprise-scale systems.This engineer develops... ...workforce planningImplement schedule optimization engines with OR-Tools and CP-SATOwn constraint...SeniorRemote work
- Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts...Senior
- ...and a people-first global community of senior engineers. Kake engineers are behind some of the world... ...(and love eating kake!). Senior AI/LLM Engineers with strong Python experience... ...capabilities to other systems. Build and optimize RAG pipelines, including embeddings,...SeniorRemote workFlexible hours
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
- Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies...Senior
$153k - $213k per year
Senior Software Engineer, Backend (ML Training and Serving)Remote Canada At Affi, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. About the team Machine...SeniorWork at officeRemote workFlexible hours$153k - $213k per year
...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Backend (ML Training and Serving) based in Canada. Join a Machine Learning engineering team building the critical infrastructure that...SeniorImmediate startRemote workFlexible hours- Affirm, Inc. is seeking a Senior Software Engineer (Backend) to join the ML Training & Serving team. This remote Canada role focuses on building scalable backend systems... ...infrastructure, and platform engineering to train and serve models across Affirm. You will own quarterly goals...SeniorRemote work
- ...Aritzia, with a Global Support Campus in Vancouver, seeks a Senior Data Visualization Engineer to design and deliver automated, distributed, self-serve analytics interfaces such as reports and dashboards. You will merge your understanding of digital experiences with data visualization...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Llm Serving Optimization Engineer. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

