Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Llm Serving Optimization Engineer

Capgemini Engineering

Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans production inference.Capgemini Engineering’s engineer extends model coverage and tunes inference behavior across AWS Neuron and Trainium platforms. You will read and modify implementations involving attention, mixture-of-experts routing, and KV-cache management. Responsibilities include hybrid state-space models, kernel-level optimization, and clear communication of engineering trade-offs.Key Responsibilities:
Extend model coverage across hybrid and mixture-of-experts architecturesReuse and generalize existing inference implementations where practicalOptimize prefill, decode, batching, and parallelism behaviorProfile framework, compiler, or kernel-level accelerator workloadsDocument implementation choices and benchmark reproducibilityRequirements:
Strong Python and PyTorch skills with model implementation experienceHands-on LLM serving framework experience such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance experimentsKernel development using NKI, Triton, or CUDA preferredUse LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Llm Serving Optimization Engineer in Winnipeg, MB vacancy
  • Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration... 
    Senior

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake...  ...PythonDevelop backend services and FastAPI APIsBuild and optimize RAG pipelines, embeddings, and retrievalIntegrate OpenAI... 
    Senior
    Remote work

    Kake

    Winnipeg, MB
    1 hour ago
  •  ...this Role Vogo is seeking a Senior Manager, Pricing & Revenue...  ...focused role responsible for optimizing wholesale rate performance, offer...  ...hotel supply. You will serve as the subject-matter expert...  ...pricing and work closely with Engineering, Data Science, Product, Partnerships... 
    Senior
    Full time
    Remote work
    Worldwide

    vogo

    Winnipeg, MB
    2 days ago
  • Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that...  ...architectures. You will fine-tune models, prepare textual data, optimize inference, and integrate NLP capabilities into user-... 
    Senior

    Placements24

    Winnipeg, MB
    1 hour ago
  • $127k - $225k per year

     ...has an immediate permanent opening for a Senior Engineer. About the team: The Computing...  ...including software-hardware co-design and optimizing data efficiency at both the storage and...  ...training pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside upstream... 
    Senior
    Long term contract
    Permanent employment
    Internship
    Local area
    Immediate start

    Huawei Technologies Co.

    Winnipeg, MB
    1 hour ago
  • Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will... 
    Senior
    Remote work

    Wiser Solutions

    Winnipeg, MB
    1 hour ago
  • Design scalable LLM solutions on Google Cloud using Vertex AI, BigQuery, and strong software engineering practices for production delivery.This Senior LLM Solutions Engineer role focuses on enterprise AI applications across architecture, integration, deployment, and support.... 
    Senior

    enableIT

    Winnipeg, MB
    1 hour ago
  • Elevate your career remotely with Honeycomb as a Senior Software Engineer II specializing in LLM Observability. Leverage your expertise in AI systems and full-stack development while shaping observability tools for notable clients. In this senior role at Honeycomb, you will... 
    Senior
    Remote work

    Honeycomb.io

    Winnipeg, MB
    1 hour ago
  • Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions... 
    Senior

    AXIS (AXIS Capital)

    Winnipeg, MB
    1 hour ago
  • Optimize HVAC systems and Building Automation Systems for Vancouver-area facilities, combining energy engineering with field-based technical analysis.This senior role delivers building performance, recommissioning, and engineering projects for healthcare, institutional, commercial... 
    Senior

    Randstad

    Winnipeg, MB
    1 hour ago
  • Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts... 
    Senior

    Aimlroles

    Winnipeg, MB
    1 hour ago
  • Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across... 
    Senior
    Full time

    Encore Technical Solutions Inc.

    Winnipeg, MB
    1 hour ago
  • Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development...  ...-driven workflowsPromote AI-assisted engineering with GitHub CopilotRequirements:... 
    Senior
    Work at office

    Miratech

    Winnipeg, MB
    1 hour ago
  • Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten...  ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern...  ..., Pipelines und eine Ausführungs-Engine für komplexe Produktsysteme. Dabei entwickelst... 
    Senior

    NEXOWARE GmbH

    Winnipeg, MB
    1 hour ago
  • Design workforce optimization solutions at Miratech using OR-Tools, constraint programming, and software engineering for enterprise contact centers. Remote work is available.As an Operations Research Engineer in the Workforce Management product stream, you will build optimization... 
    Senior
    Remote work

    Miratech Group

    Winnipeg, MB
    1 hour ago
  • Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred... 
    Senior

    Wyatt Partners

    Winnipeg, MB
    1 hour ago
  • Miratech is seeking an Operations Research Engineer to join the Workforce Management (WFM) product stream and build optimization capabilities for large-scale contact centers. You will apply operations research, mathematical optimization, and algorithm design to transform business... 
    Senior
    Remote work

    Miratech

    Winnipeg, MB
    1 hour ago
  • Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You will own agent loops, tool calling, retrieval, file context, and LLM traffic routing. The work uses Python, FastAPI or similar... 
    Senior

    Supra ITS

    Winnipeg, MB
    1 hour ago
  • Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies... 
    Senior

    Diligent

    Winnipeg, MB
    1 hour ago
  •  ...and a people-first global community of senior engineers. Kake engineers are behind some of the world...  ...(and love eating kake!). Senior AI/LLM Engineers with strong Python experience...  ...capabilities to other systems. Build and optimize RAG pipelines, including embeddings,... 
    Senior
    Remote work
    Flexible hours

    Kake

    Winnipeg, MB
    1 hour ago
  • $153k - $213k per year

     ...its mission, powering decisions across underwriting, fraud, servicing, and personalization. We are seeking a Senior Software Engineer to join our ML Training & Serving engineering team, the team that builds and operates the critical infrastructure that enables models to be... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Winnipeg, MB
    1 hour ago
  • $153k - $213k per year

    Senior Software Engineer, Backend (ML Training and Serving)Remote Canada At Affi, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. About the team Machine... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Winnipeg, MB
    1 hour ago
  • $153k - $213k per year

     ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer, Backend (ML Training and Serving) based in Canada. Join a Machine Learning engineering team building the critical infrastructure that... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    1 hour ago
  • Le Développeur Java Senior chez DELAN - IT Talent Solutions conçoit et développe des fonctionnalités IA générative (LLM) dans une plateforme SaaS en Java. Vous bâtissez des API REST robustes avec Spring Boot et intégrez les services IA au backend et à l interface web, tout... 
    Senior

    Technologie Delan

    Winnipeg, MB
    1 hour ago
  •  ...critical areas of their business. Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM Engineer with 1-4 years of experience in software development and 1-2 years in LLM solution... 
    Work at office
    Local area
    Work from home
    Worldwide
    Flexible hours

    ZS

    Winnipeg, MB
    1 hour ago
  • $250k - $280k per year

    Senior Software Engineer II - LLM ObservabilityRemote - Canada What We’re Building Honeycomb is a service for the near and present future, defining observability and raising expectations of what developer tools can do! We’re working with well known companies like HelloFresh... 
    Senior
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Shift work

    Honeycomb.io

    Winnipeg, MB
    1 hour ago
  • Optimize machine learning performance at Waabi through CPU and GPU profiling, memory analysis, and efficient training frameworks. Support research and production systems.This Senior ML Training Optimization Engineer focuses on identifying performance bottlenecks across model... 
    Senior

    Waabi

    Winnipeg, MB
    1 hour ago
  • $250k - $280k per year

     ...individual conversations so they can debug them. We’re bringing LLM and agent observability together, and we own both the data foundation...  ...on top of it. You’ll work in a small, cross-functional group of engineers with a dedicated product manager and designer, shipping features... 
    Senior
    Internship
    Work at office
    Remote work
    Work from home
    Home office
    Visa sponsorship
    Shift work

    Candidate

    Winnipeg, MB
    1 hour ago
  • Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM applications using FastAPI or Flask. The role...  ..., and AI-powered data analytics platforms. You will optimize data pipelines for performance and scalability while... 
    Senior

    Smart IT Frame LLC

    Winnipeg, MB
    1 hour ago
  • Develop production LLM infrastructure in Montreal with Python, model serving, evaluation, and observability for conversational phone and SMS products.This senior developer role spans shared machine learning...  ...Six or more years of relevant engineering experienceTrack record... 
    Senior

    Clera Labs, Inc.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Llm Serving Optimization Engineer. Be the first to apply!