Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Distributed Llm Performance Engineer

Huawei Canada

Distributed LLM performance engineering powers Huawei Canada’s Ascend NPU training systems with MindSpeed, hybrid parallelism, and profiling expertise.This Senior System Engineer position focuses on foundation-model pre-training and post-training at scale. You will architect distributed pipelines using MindSpeed, Megatron, PyTorch FSDP, veRL, vLLM, and Ray. The work targets MFU, compute-communication overlap, rollout pipelining, and reliable numerical behavior.Key Responsibilities:
Scale pre-training and RL post-training pipelines across NPU clustersOptimize hybrid TP, PP, CP, EP, and ZeRO parallelismTune RL rollout and actor pipelining for training efficiencyImplement FP8, MXFP8, and mixed-precision training schemesEliminate pipeline bubbles, stalls, and HCCL communication overheadRequirements:
Three-plus years in HPC, accelerator operators, or distributed trainingPractical distributed training experience with listed frameworksProficiency in C/C++ and modern Python systems programmingHands-on PyTorch custom C++ or CANN extension developmentPerformance profiling experience on AI hardwareBuild scalable Ascend NPU training systems by combining distributed frameworks, parallelism tuning, profiling, and precision alignment.
#J-18808-Ljbffr
Vacancy posted 48 minutes ago
Similar jobs that could be interesting for youBased on the Senior Distributed Llm Performance Engineer in Winnipeg, MB vacancy
  •  ...they need to deliver faster, more performant, more dependable, and less expensive...  ...built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of...  ...workloads. You will work in a distributed team of compiler experts, with direct... 
    Senior
    Performance
    Remote work
    Worldwide
    Flexible hours

    Azul

    Winnipeg, MB
    9 days ago
  • $115k - $155k per year

     ...your Future with Qualus as a Professional Engineer on our Distribution Engineering team! We are seeking a Professional...  ..., certifications, experience, skills, seniority, geographic location, internal equity, performance, and business needs. Compensation ranges are... 
    Senior
    Performance
    Long term contract
    Full time
    Temporary work
    Flexible hours

    Qualus Corporation

    Winnipeg, MB
    44 minutes ago
  • Division: Engineering, ElectricityLocation: Grand Prairie, ABEmbracechallengeand growth withATCOTeam...  ...opportunities at both the Engineer and Senior Engineer levels, and candidates may be...  ...’s 25kV operational planning of the distribution grid. This area of responsibility will... 
    Senior
    Long term contract

    ATCO

    Winnipeg, MB
    45 minutes ago
  • Job Title: Senior Engineer, DistributionIconic Power Systems is a Canadian power infrastructure...  ...services across transmission, distribution, substations, and renewable energy. Driven...  ...schedules, and material take-offs. Perform engineering calculations, including pole... 
    Senior
    Work at office

    Iconic Power Systems Inc.

    Winnipeg, MB
    50 minutes ago
  • Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration... 
    Senior
    Performance

    Cerebras

    Winnipeg, MB
    50 minutes ago
  • $195k - $390k per year

     ...language models. Join us to influence and build the next generation of Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language modelsTackle... 
    Senior
    Flexible hours

    NVIDIA Corporation

    Winnipeg, MB
    48 minutes ago
  • Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that understand, generate, and process human language at scale.This senior position focuses on developing and deploying... 
    Senior

    Placements24

    Winnipeg, MB
    48 minutes ago
  • Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake seeks senior engineers who design, build, and productionize AI systems. You will work across Python, FastAPI, LAG pipelines... 
    Senior
    Remote work

    Kake

    Winnipeg, MB
    49 minutes ago
  • Build distributed systems at Instacart with Go and PostgreSQL while working remotely across...  ...Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store...  ...experience with replication and performance tuningExperience designing scalable,... 
    Senior
    Performance
    Internship
    Remote work

    Remote Genie

    Winnipeg, MB
    41 minutes ago
  •  ...future. Your OpportunityWe are currently looking for a Senior Electrical Engineer to join our Distribution Design team in our Saskatchewan and Alberta offices....  ...requirements Review of project documentation and perform Engineer of Record duties (specifications, IFR/IFC... 
    Senior
    Long term contract
    Full time
    Temporary work
    Part time
    Casual work
    Work at office
    Work from home
    Flexible hours

    Stantec

    Winnipeg, MB
    43 minutes ago
  • Design distributed execution with Python and Ray, Dask, Spark, or MPI for GeoSoftware...  ...diverse compute environments.As a Senior HPC and Platform Engineer, you will own execution, deployment,...  ...The work includes secure deployment, performance engineering, and platform operations... 
    Senior
    Performance
    Local area
    Remote work

    GeoSoftware

    Winnipeg, MB
    49 minutes ago
  • Hardline Engineering (EllisDon group of companies) is a privately owned...  ...design and development of distribution projects (new extensions, upgrades...  ...to site conditions. Perform quality control through audits...  ...Experience would be an asset. Senior PLS-CADD experience considered... 
    Senior

    EllisDon Corporation

    Winnipeg, MB
    46 minutes ago
  • Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB...  ...reliably at scale. The work includes architecture, testing, performance, scalability, reliability, and developer experience... 
    Senior
    Performance
    Remote work

    MongoDB Inc.

    Winnipeg, MB
    49 minutes ago
  • Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans...  ...such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance... 
    Senior
    Performance
    Remote work

    Capgemini Engineering

    Winnipeg, MB
    50 minutes ago
  •  ...assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with... 
    Senior
    Full time
    Remote work

    Jeeves

    Winnipeg, MB
    42 minutes ago
  • $127k - $225k per year

     ...has an immediate permanent opening for a Senior Engineer. About the team: The Computing...  ...goals of this lab are to enhance algorithm performance and training efficiency across...  ...core compute operator development and distributed scaling performance across foundation model... 
    Senior
    Performance
    Long term contract
    Permanent employment
    Internship
    Local area
    Immediate start

    Huawei Technologies Co.

    Winnipeg, MB
    45 minutes ago
  • Lead electrical distribution design and technical reviews in Calgary’s hybrid Quarry Park office, using PLS-CADD, MicroStation, and AutoCAD.This Distribution Engineer role provides technical leadership across overhead and underground projects. You will develop calculations,... 
    Senior
    Work at office

    ACTalent

    Winnipeg, MB
    49 minutes ago
  • Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten...  ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern...  ...und Event-Architekturen mit Fokus auf Performance, Skalierbarkeit und Observability.... 
    Senior
    Performance

    NEXOWARE GmbH

    Winnipeg, MB
    40 minutes ago
  • Architect distributed systems and real-time services remotely, applying cloud infrastructure...  ...challenges with precision.This Senior Backend Engineer role focuses on architecture, development...  ...reliability, security, and performance. The position requires strong distributed... 
    Senior
    Performance
    Remote work

    Placements24

    Winnipeg, MB
    50 minutes ago
  •  ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM...  ...architecture design, and ensuring the performance and reliability of our systems.What You...  ...design and development of scalable and distributed software systemsTranslate business to... 
    Performance
    Work at office
    Local area
    Work from home
    Worldwide
    Flexible hours

    ZS

    Winnipeg, MB
    50 minutes ago
  •  ...backend systems at StackAdapt using Go and distributed systems expertise to power...  ...advertising inventory integrations.As a Senior Software Engineer on the Inventory team, you will lead...  ...advertising exchanges, microservices, and performance optimization. These systems process... 
    Senior
    Performance

    StackAdapt

    Winnipeg, MB
    46 minutes ago
  • Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies... 
    Senior

    Diligent

    Winnipeg, MB
    42 minutes ago
  • Build reliable LLM platforms in Montreal with GitHub Copilot, Python, and CI/CD expertise. Fujitsu’s primary-location role centers on production AI engineering.This Senior AI Application Developer position delivers AI and LLM-powered features in production environments. You... 
    Senior

    Fujitsu

    Winnipeg, MB
    47 minutes ago
  • Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions... 
    Senior

    AXIS Capital

    Winnipeg, MB
    51 minutes ago
  • $250k - $280k per year

    Senior Software Engineer II - LLM ObservabilityRemote - Canada What We’re Building Honeycomb is a service for the near and present future, defining...  ...(but humble) peers. How We Work We are a fully distributed company, which means we believe it is not where you sit,... 
    Senior
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Home office
    Shift work

    Honeycomb.io

    Winnipeg, MB
    41 minutes ago
  • $146k - $162k per year

    We’re looking for a Software Engineer to join our growing AI organization in Vancouver. Asana is pioneering a new category of technology...  ...rotations, and diagnose complex bugs across asynchronous or distributed systems. Break down feature specifications into clear engineering... 
    Long term contract
    Work at office
    Local area
    Work from home
    Worldwide

    ContentBuffer

    Winnipeg, MB
    43 minutes ago
  • $114.4k - $164.4k per year

    Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning Engineering General Summary:As a leading...  ...1+ year of work experience in a role requiring interaction with senior leadership (e.G., Director and above). Principal Duties and... 
    Senior
    Immediate start
    Work from home

    Urban Ridge Supplies

    Winnipeg, MB
    49 minutes ago
  • Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred... 
    Senior

    Wyatt Partners

    Winnipeg, MB
    45 minutes ago
  • Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will... 
    Senior
    Remote work

    Wiser Solutions

    Winnipeg, MB
    45 minutes ago
  •  ...and a people-first global community of senior engineers. Kake engineers are behind some of the world...  ...(and love eating kake!). Senior AI/LLM Engineers with strong Python experience...  ...and agentic workflows. Experience with distributed systems, streaming (e.g., Kafka), or... 
    Senior
    Remote work
    Flexible hours

    Kake

    Winnipeg, MB
    50 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Distributed Llm Performance Engineer. Be the first to apply!