Senior Llm Serving Optimization Engineer
Capgemini Engineering
Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans production inference.Capgemini Engineering’s engineer extends model coverage and tunes inference behavior across AWS Neuron and Trainium platforms. You will read and modify implementations involving attention, mixture-of-experts routing, and KV-cache management. Responsibilities include hybrid state-space models, kernel-level optimization, and clear communication of engineering trade-offs.Key Responsibilities:
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Llm Serving Optimization Engineer in Winnipeg, MB vacancy
$158.4k - $237.6k per year
...Technologies, Inc. Job AreaEngineering Group, Engineering Group Machine Learning Engineering LLM Serving Engineer (Cloud AI Engineering)Qualcomm is... ...advanced parallelism, speculative algorithms, model optimization, specialized kernels). Contribute to the development...SeniorWork from home$158.4k - $237.6k per year
A leading technology firm is hiring LLM Serving Engineers in Markham to develop scalable AI inference platforms. Candidates will work on machine learning packages and directly collaborate with various teams to drive advanced solutions. Ideal applicants should possess a Master...Suggested$195k - $390k per year
...models. Join us to influence and build the next generation of Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language...SeniorFlexible hours- Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that... ...architectures. You will fine-tune models, prepare textual data, optimize inference, and integrate NLP capabilities into user-...Senior
- Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration...Senior
- ...this Role Vogo is seeking a Senior Manager, Pricing & Revenue... ...focused role responsible for optimizing wholesale rate performance, offer... ...hotel supply. You will serve as the subject-matter expert... ...pricing and work closely with Engineering, Data Science, Product, Partnerships...SeniorFull timeRemote workWorldwide
- Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake... ...PythonDevelop backend services and FastAPI APIsBuild and optimize RAG pipelines, embeddings, and retrievalIntegrate OpenAI...SeniorRemote work
- ...Ontario, CanadaCompany Name: HITACHI ENERGY CANADA INC.Profession (Job Category): Engineering & ScienceJob Schedule: Full timeRemote: NoSenior Optimization Engineer The Opportunity As a Senior Optimization Engineer at Hitachi Energy, you will help develop the software and...SeniorFlexible hours
$114.4k - $164.4k per year
Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning... ...in embedded system development and optimization with application to a specific problem... ...experience in a role requiring interaction with senior leadership (e.G., Director and above)....SeniorImmediate startWork from home$127k - $225k per year
...has an immediate permanent opening for a Senior Engineer. About the team: The Computing... ...including software-hardware co-design and optimizing data efficiency at both the storage and... ...training pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside upstream...SeniorLong term contractPermanent employmentInternshipLocal areaImmediate start- Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You will own agent loops, tool calling, retrieval, file context, and LLM traffic routing. The work uses Python, FastAPI or similar...Senior
- Design scalable LLM solutions on Google Cloud using Vertex AI, BigQuery, and strong software engineering practices for production delivery.This Senior LLM Solutions Engineer role focuses on enterprise AI applications across architecture, integration, deployment, and support....Senior
- Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten... ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern... ..., Pipelines und eine Ausführungs-Engine für komplexe Produktsysteme. Dabei entwickelst...Senior
- Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies...Senior
- Optimize HVAC systems and Building Automation Systems for Vancouver-area facilities, combining energy engineering with field-based technical analysis.This senior role delivers building performance, recommissioning, and engineering projects for healthcare, institutional, commercial...Senior
- Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions...Senior
- Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development... ...-driven workflowsPromote AI-assisted engineering with GitHub CopilotRequirements:...SeniorWork at office
- Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will...SeniorRemote work
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
- Elevate your career remotely with Honeycomb as a Senior Software Engineer II specializing in LLM Observability. Leverage your expertise in AI systems and full-stack development while shaping observability tools for notable clients. In this senior role at Honeycomb, you will...SeniorRemote work
- Design workforce optimization solutions at Miratech using OR-Tools, constraint programming, and software engineering for enterprise contact centers. Remote work is available.As an Operations Research Engineer in the Workforce Management product stream, you will build optimization...SeniorRemote work
- Miratech is seeking an Operations Research Engineer to join the Workforce Management (WFM) product stream and build optimization capabilities for large-scale contact centers. You will apply operations research, mathematical optimization, and algorithm design to transform business...SeniorRemote work
- ...and a people-first global community of senior engineers. Kake engineers are behind some of the world... ...(and love eating kake!). Senior AI/LLM Engineers with strong Python experience... ...capabilities to other systems. Build and optimize RAG pipelines, including embeddings,...SeniorRemote workFlexible hours
- Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts...Senior
- Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred...Senior
$153k - $213k per year
Senior Software Engineer, Backend (ML Training and Serving)Remote Canada At Affi, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. About the team Machine...SeniorWork at officeRemote workFlexible hours- ...critical areas of their business. Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM Engineer with 1-4 years of experience in software development and 1-2 years in LLM solution...Work at officeLocal areaWork from homeWorldwideFlexible hours
$153k - $213k per year
...its mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be...SeniorWork at officeRemote workFlexible hours- ...Aritzia, with a Global Support Campus in Vancouver, seeks a Senior Data Visualization Engineer to design and deliver automated, distributed, self-serve analytics interfaces such as reports and dashboards. You will merge your understanding of digital experiences with data visualization...Senior
- Le Développeur Java Senior chez DELAN - IT Talent Solutions conçoit et développe des fonctionnalités IA générative (LLM) dans une plateforme SaaS en Java. Vous bâtissez des API REST robustes avec Spring Boot et intégrez les services IA au backend et à l interface web, tout...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Llm Serving Optimization Engineer. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB

