Senior Llm Serving Optimization Engineer
Capgemini Engineering
Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans production inference.Capgemini Engineering’s engineer extends model coverage and tunes inference behavior across AWS Neuron and Trainium platforms. You will read and modify implementations involving attention, mixture-of-experts routing, and KV-cache management. Responsibilities include hybrid state-space models, kernel-level optimization, and clear communication of engineering trade-offs.Key Responsibilities:
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Llm Serving Optimization Engineer in Winnipeg, MB vacancy
- Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration...Senior
- Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake... ...PythonDevelop backend services and FastAPI APIsBuild and optimize RAG pipelines, embeddings, and retrievalIntegrate OpenAI...SeniorRemote work
- ...this Role Vogo is seeking a Senior Manager, Pricing & Revenue... ...focused role responsible for optimizing wholesale rate performance, offer... ...hotel supply. You will serve as the subject-matter expert... ...pricing and work closely with Engineering, Data Science, Product, Partnerships...SeniorFull timeRemote workWorldwide
- Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that... ...architectures. You will fine-tune models, prepare textual data, optimize inference, and integrate NLP capabilities into user-...Senior
$127k - $225k per year
...has an immediate permanent opening for a Senior Engineer. About the team: The Computing... ...including software-hardware co-design and optimizing data efficiency at both the storage and... ...training pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside upstream...SeniorLong term contractPermanent employmentInternshipLocal areaImmediate start- Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will...SeniorRemote work
- Design scalable LLM solutions on Google Cloud using Vertex AI, BigQuery, and strong software engineering practices for production delivery.This Senior LLM Solutions Engineer role focuses on enterprise AI applications across architecture, integration, deployment, and support....Senior
- Elevate your career remotely with Honeycomb as a Senior Software Engineer II specializing in LLM Observability. Leverage your expertise in AI systems and full-stack development while shaping observability tools for notable clients. In this senior role at Honeycomb, you will...SeniorRemote work
- Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions...Senior
- Optimize HVAC systems and Building Automation Systems for Vancouver-area facilities, combining energy engineering with field-based technical analysis.This senior role delivers building performance, recommissioning, and engineering projects for healthcare, institutional, commercial...Senior
- Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts...Senior
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
- Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development... ...-driven workflowsPromote AI-assisted engineering with GitHub CopilotRequirements:...SeniorWork at office
- Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten... ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern... ..., Pipelines und eine Ausführungs-Engine für komplexe Produktsysteme. Dabei entwickelst...Senior
- Design workforce optimization solutions at Miratech using OR-Tools, constraint programming, and software engineering for enterprise contact centers. Remote work is available.As an Operations Research Engineer in the Workforce Management product stream, you will build optimization...SeniorRemote work
- Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred...Senior
- Miratech is seeking an Operations Research Engineer to join the Workforce Management (WFM) product stream and build optimization capabilities for large-scale contact centers. You will apply operations research, mathematical optimization, and algorithm design to transform business...SeniorRemote work
- Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You will own agent loops, tool calling, retrieval, file context, and LLM traffic routing. The work uses Python, FastAPI or similar...Senior
- Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies...Senior
- ...and a people-first global community of senior engineers. Kake engineers are behind some of the world... ...(and love eating kake!). Senior AI/LLM Engineers with strong Python experience... ...capabilities to other systems. Build and optimize RAG pipelines, including embeddings,...SeniorRemote workFlexible hours
$153k - $213k per year
...its mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be...SeniorWork at officeRemote workFlexible hours$153k - $213k per year
Senior Software Engineer, Backend (ML Training and Serving)Remote Canada At Affi, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. About the team Machine...SeniorWork at officeRemote workFlexible hours$153k - $213k per year
...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Backend (ML Training and Serving) based in Canada. Join a Machine Learning engineering team building the critical infrastructure that...SeniorImmediate startRemote workFlexible hours- Le Développeur Java Senior chez DELAN - IT Talent Solutions conçoit et développe des fonctionnalités IA générative (LLM) dans une plateforme SaaS en Java. Vous bâtissez des API REST robustes avec Spring Boot et intégrez les services IA au backend et à l interface web, tout...Senior
- ...critical areas of their business. Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM Engineer with 1-4 years of experience in software development and 1-2 years in LLM solution...Work at officeLocal areaWork from homeWorldwideFlexible hours
$250k - $280k per year
Senior Software Engineer II - LLM ObservabilityRemote - Canada What We’re Building Honeycomb is a service for the near and present future, defining observability and raising expectations of what developer tools can do! We’re working with well known companies like HelloFresh...SeniorInternshipWork at officeLocal areaRemote workWork from homeHome officeShift work- Optimize machine learning performance at Waabi through CPU and GPU profiling, memory analysis, and efficient training frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across model...Senior
$250k - $280k per year
...individual conversations so they can debug them. We’re bringing LLM and agent observability together, and we own both the data foundation... ...on top of it. You’ll work in a small, cross-functional group of engineers with a dedicated product manager and designer, shipping features...SeniorInternshipWork at officeRemote workWork from homeHome officeVisa sponsorshipShift work- Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM applications using FastAPI or Flask. The role... ..., and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while...Senior
- Develop production LLM infrastructure in Montreal with Python, model serving, evaluation, and observability for conversational phone and SMS products.This senior developer role spans shared machine learning... ...Six or more years of relevant engineering experienceTrack record...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Llm Serving Optimization Engineer. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB

