Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Distributed Llm Performance Engineer

Huawei Canada

Distributed LLM performance engineering powers Huawei Canada’s Ascend NPU training systems with MindSpeed, hybrid parallelism, and profiling expertise.This Senior System Engineer position focuses on foundation-model pre-training and post-training at scale. You will architect distributed pipelines using MindSpeed, Megatron, PyTorch FSDP, veRL, vLLM, and Ray. The work targets MFU, compute-communication overlap, rollout pipelining, and reliable numerical behavior.Key Responsibilities:
Scale pre-training and RL post-training pipelines across NPU clustersOptimize hybrid TP, PP, CP, EP, and ZeRO parallelismTune RL rollout and actor pipelining for training efficiencyImplement FP8, MXFP8, and mixed-precision training schemesEliminate pipeline bubbles, stalls, and HCCL communication overheadRequirements:
Three-plus years in HPC, accelerator operators, or distributed trainingPractical distributed training experience with listed frameworksProficiency in C/C++ and modern Python systems programmingHands-on PyTorch custom C++ or CANN extension developmentPerformance profiling experience on AI hardwareBuild scalable Ascend NPU training systems by combining distributed frameworks, parallelism tuning, profiling, and precision alignment.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Distributed Llm Performance Engineer in Winnipeg, MB vacancy
  •  ...they need to deliver faster, more performant, more dependable, and less expensive...  ...built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of...  ...workloads. You will work in a distributed team of compiler experts, with direct... 
    Senior
    Performance
    Remote work
    Worldwide
    Flexible hours

    Azul

    Winnipeg, MB
    9 days ago
  • Job Title: Senior Engineer, DistributionIconic Power Systems is a Canadian power infrastructure...  ...services across transmission, distribution, substations, and renewable energy. Driven...  ...schedules, and material take-offs. Perform engineering calculations, including pole... 
    Senior
    Work at office

    Iconic Power Systems Inc.

    Winnipeg, MB
    1 hour ago
  • Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration... 
    Senior
    Performance

    Cerebras

    Winnipeg, MB
    1 hour ago
  • $115k - $155k per year

     ...your Future with Qualus as a Professional Engineer on our Distribution Engineering team! We are seeking a Professional...  ..., certifications, experience, skills, seniority, geographic location, internal equity, performance, and business needs. Compensation ranges are... 
    Senior
    Performance
    Long term contract
    Full time
    Temporary work
    Flexible hours

    Qualus Corporation

    Winnipeg, MB
    1 hour ago
  • Division: Engineering, ElectricityLocation: Grand Prairie, ABEmbracechallengeand growth withATCOTeam...  ...opportunities at both the Engineer and Senior Engineer levels, and candidates may be...  ...’s 25kV operational planning of the distribution grid. This area of responsibility will... 
    Senior
    Long term contract

    ATCO

    Winnipeg, MB
    1 hour ago
  • Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that understand, generate, and process human language at scale.This senior position focuses on developing and deploying... 
    Senior

    Placements24

    Winnipeg, MB
    1 hour ago
  • Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake seeks senior engineers who design, build, and productionize AI systems. You will work across Python, FastAPI, LAG pipelines... 
    Senior
    Remote work

    Kake

    Winnipeg, MB
    1 hour ago
  • $195k - $390k per year

     ...language models. Join us to influence and build the next generation of Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language modelsTackle... 
    Senior
    Flexible hours

    NVIDIA Corporation

    Winnipeg, MB
    1 hour ago
  • Build distributed systems at Instacart with Go and PostgreSQL while working remotely across...  ...Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store...  ...experience with replication and performance tuningExperience designing scalable,... 
    Senior
    Performance
    Internship
    Remote work

    Remote Genie

    Winnipeg, MB
    1 hour ago
  • Hardline Engineering (EllisDon group of companies) is a privately owned...  ...design and development of distribution projects (new extensions, upgrades...  ...to site conditions. Perform quality control through audits...  ...Experience would be an asset. Senior PLS-CADD experience considered... 
    Senior

    EllisDon Corporation

    Winnipeg, MB
    1 hour ago
  • Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB...  ...reliably at scale. The work includes architecture, testing, performance, scalability, reliability, and developer experience... 
    Senior
    Performance
    Remote work

    MongoDB Inc.

    Winnipeg, MB
    1 hour ago
  • Your OpportunityWe are currently looking for a Senior Electrical Engineer to join our Distribution Design team in our Saskatchewan and Alberta offices. As a Technical...  ...requirements Review of project documentation and perform Engineer of Record duties (specifications, IFR/IFC... 
    Senior
    Long term contract
    Full time
    Temporary work
    Part time
    Casual work
    Work at office
    Work from home
    Flexible hours

    Stantec

    Winnipeg, MB
    1 hour ago
  • Architect distributed systems and real-time services remotely, applying cloud infrastructure...  ...challenges with precision.This Senior Backend Engineer role focuses on architecture, development...  ...reliability, security, and performance. The position requires strong distributed... 
    Senior
    Performance
    Remote work

    Placements24

    Winnipeg, MB
    1 hour ago
  • Design distributed execution with Python and Ray, Dask, Spark, or MPI for GeoSoftware...  ...diverse compute environments.As a Senior HPC and Platform Engineer, you will own execution, deployment,...  ...The work includes secure deployment, performance engineering, and platform operations... 
    Senior
    Performance
    Local area
    Remote work

    GeoSoftware

    Winnipeg, MB
    1 hour ago
  •  ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM...  ...architecture design, and ensuring the performance and reliability of our systems.What You...  ...design and development of scalable and distributed software systemsTranslate business to... 
    Performance
    Work at office
    Local area
    Work from home
    Worldwide
    Flexible hours

    ZS

    Winnipeg, MB
    1 hour ago
  • Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans...  ...such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance... 
    Senior
    Performance
    Remote work

    Capgemini Engineering

    Winnipeg, MB
    1 hour ago
  •  ...backend systems at StackAdapt using Go and distributed systems expertise to power...  ...advertising inventory integrations.As a Senior Software Engineer on the Inventory team, you will lead...  ...advertising exchanges, microservices, and performance optimization. These systems process... 
    Senior
    Performance

    StackAdapt

    Winnipeg, MB
    1 hour ago
  • Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten...  ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern...  ...und Event-Architekturen mit Fokus auf Performance, Skalierbarkeit und Observability.... 
    Senior
    Performance

    NEXOWARE GmbH

    Winnipeg, MB
    1 hour ago
  •  ...assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with... 
    Senior
    Full time
    Remote work

    Jeeves

    Winnipeg, MB
    1 hour ago
  • Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred... 
    Senior

    Wyatt Partners

    Winnipeg, MB
    1 hour ago
  • Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development...  ...-driven workflowsPromote AI-assisted engineering with GitHub CopilotRequirements:... 
    Senior
    Work at office

    Miratech

    Winnipeg, MB
    1 hour ago
  • $127k - $225k per year

     ...has an immediate permanent opening for a Senior Engineer. About the team: The Computing Data...  ...of this lab are to enhance algorithm performance and training efficiency across industries...  ...core compute operator development and distributed scaling performance across foundation model... 
    Senior
    Performance
    Long term contract
    Permanent employment
    Internship
    Local area
    Immediate start

    Huawei Canada

    Winnipeg, MB
    1 hour ago
  • Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will... 
    Senior
    Remote work

    Wiser Solutions

    Winnipeg, MB
    1 hour ago
  • Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You will own agent loops, tool calling, retrieval, file context, and LLM traffic routing. The work uses Python, FastAPI or similar... 
    Senior

    Supra ITS

    Winnipeg, MB
    1 hour ago
  • Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies... 
    Senior

    Diligent

    Winnipeg, MB
    1 hour ago
  • Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across... 
    Senior
    Full time

    Encore Technical Solutions Inc.

    Winnipeg, MB
    1 hour ago
  • $114.4k - $164.4k per year

    Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning Engineering General Summary:As a leading...  ...1+ year of work experience in a role requiring interaction with senior leadership (e.G., Director and above). Principal Duties and... 
    Senior
    Immediate start
    Work from home

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  • Lead electrical distribution design and technical reviews in Calgary’s hybrid Quarry Park office, using PLS-CADD, MicroStation, and AutoCAD.This Distribution Engineer role provides technical leadership across overhead and underground projects. You will develop calculations,... 
    Senior
    Work at office

    ACTalent

    Winnipeg, MB
    1 hour ago
  • Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts... 
    Senior

    Aimlroles

    Winnipeg, MB
    1 hour ago
  • Build reliable LLM platforms in Montreal with GitHub Copilot, Python, and CI/CD expertise. Fujitsu’s primary-location role centers on production AI engineering.This Senior AI Application Developer position delivers AI and LLM-powered features in production environments. You... 
    Senior

    Fujitsu

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Distributed Llm Performance Engineer. Be the first to apply!