Senior Distributed Llm Performance Engineer
Huawei Canada
Distributed LLM performance engineering powers Huawei Canada’s Ascend NPU training systems with MindSpeed, hybrid parallelism, and profiling expertise.This Senior System Engineer position focuses on foundation-model pre-training and post-training at scale. You will architect distributed pipelines using MindSpeed, Megatron, PyTorch FSDP, veRL, vLLM, and Ray. The work targets MFU, compute-communication overlap, rollout pipelining, and reliable numerical behavior.Key Responsibilities:
Scale pre-training and RL post-training pipelines across NPU clustersOptimize hybrid TP, PP, CP, EP, and ZeRO parallelismTune RL rollout and actor pipelining for training efficiencyImplement FP8, MXFP8, and mixed-precision training schemesEliminate pipeline bubbles, stalls, and HCCL communication overheadRequirements:
Three-plus years in HPC, accelerator operators, or distributed trainingPractical distributed training experience with listed frameworksProficiency in C/C++ and modern Python systems programmingHands-on PyTorch custom C++ or CANN extension developmentPerformance profiling experience on AI hardwareBuild scalable Ascend NPU training systems by combining distributed frameworks, parallelism tuning, profiling, and precision alignment.
#J-18808-Ljbffr
Scale pre-training and RL post-training pipelines across NPU clustersOptimize hybrid TP, PP, CP, EP, and ZeRO parallelismTune RL rollout and actor pipelining for training efficiencyImplement FP8, MXFP8, and mixed-precision training schemesEliminate pipeline bubbles, stalls, and HCCL communication overheadRequirements:
Three-plus years in HPC, accelerator operators, or distributed trainingPractical distributed training experience with listed frameworksProficiency in C/C++ and modern Python systems programmingHands-on PyTorch custom C++ or CANN extension developmentPerformance profiling experience on AI hardwareBuild scalable Ascend NPU training systems by combining distributed frameworks, parallelism tuning, profiling, and precision alignment.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Distributed Llm Performance Engineer in Winnipeg, MB vacancy
- ...they need to deliver faster, more performant, more dependable, and less expensive... ...built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of... ...workloads. You will work in a distributed team of compiler experts, with direct...SeniorPerformanceRemote workWorldwideFlexible hours
- Job Title: Senior Engineer, DistributionIconic Power Systems is a Canadian power infrastructure... ...services across transmission, distribution, substations, and renewable energy. Driven... ...schedules, and material take-offs. Perform engineering calculations, including pole...SeniorWork at office
- Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration...SeniorPerformance
$115k - $155k per year
...your Future with Qualus as a Professional Engineer on our Distribution Engineering team! We are seeking a Professional... ..., certifications, experience, skills, seniority, geographic location, internal equity, performance, and business needs. Compensation ranges are...SeniorPerformanceLong term contractFull timeTemporary workFlexible hours- Division: Engineering, ElectricityLocation: Grand Prairie, ABEmbracechallengeand growth withATCOTeam... ...opportunities at both the Engineer and Senior Engineer levels, and candidates may be... ...’s 25kV operational planning of the distribution grid. This area of responsibility will...SeniorLong term contract
- Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that understand, generate, and process human language at scale.This senior position focuses on developing and deploying...Senior
- Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake seeks senior engineers who design, build, and productionize AI systems. You will work across Python, FastAPI, LAG pipelines...SeniorRemote work
$195k - $390k per year
...language models. Join us to influence and build the next generation of Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language modelsTackle...SeniorFlexible hours- Build distributed systems at Instacart with Go and PostgreSQL while working remotely across... ...Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store... ...experience with replication and performance tuningExperience designing scalable,...SeniorPerformanceInternshipRemote work
- Hardline Engineering (EllisDon group of companies) is a privately owned... ...design and development of distribution projects (new extensions, upgrades... ...to site conditions. Perform quality control through audits... ...Experience would be an asset. Senior PLS-CADD experience considered...Senior
- Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB... ...reliably at scale. The work includes architecture, testing, performance, scalability, reliability, and developer experience...SeniorPerformanceRemote work
- Your OpportunityWe are currently looking for a Senior Electrical Engineer to join our Distribution Design team in our Saskatchewan and Alberta offices. As a Technical... ...requirements Review of project documentation and perform Engineer of Record duties (specifications, IFR/IFC...SeniorLong term contractFull timeTemporary workPart timeCasual workWork at officeWork from homeFlexible hours
- Architect distributed systems and real-time services remotely, applying cloud infrastructure... ...challenges with precision.This Senior Backend Engineer role focuses on architecture, development... ...reliability, security, and performance. The position requires strong distributed...SeniorPerformanceRemote work
- Design distributed execution with Python and Ray, Dask, Spark, or MPI for GeoSoftware... ...diverse compute environments.As a Senior HPC and Platform Engineer, you will own execution, deployment,... ...The work includes secure deployment, performance engineering, and platform operations...SeniorPerformanceLocal areaRemote work
- ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM... ...architecture design, and ensuring the performance and reliability of our systems.What You... ...design and development of scalable and distributed software systemsTranslate business to...PerformanceWork at officeLocal areaWork from homeWorldwideFlexible hours
- Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans... ...such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance...SeniorPerformanceRemote work
- ...backend systems at StackAdapt using Go and distributed systems expertise to power... ...advertising inventory integrations.As a Senior Software Engineer on the Inventory team, you will lead... ...advertising exchanges, microservices, and performance optimization. These systems process...SeniorPerformance
- Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten... ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern... ...und Event-Architekturen mit Fokus auf Performance, Skalierbarkeit und Observability....SeniorPerformance
- ...assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with...SeniorFull timeRemote work
- Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred...Senior
- Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development... ...-driven workflowsPromote AI-assisted engineering with GitHub CopilotRequirements:...SeniorWork at office
$127k - $225k per year
...has an immediate permanent opening for a Senior Engineer. About the team: The Computing Data... ...of this lab are to enhance algorithm performance and training efficiency across industries... ...core compute operator development and distributed scaling performance across foundation model...SeniorPerformanceLong term contractPermanent employmentInternshipLocal areaImmediate start- Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will...SeniorRemote work
- Python and LLM application engineering define this backend role at Supra ITS. Build production agent runtimes for cloud and on-premise deployments.You will own agent loops, tool calling, retrieval, file context, and LLM traffic routing. The work uses Python, FastAPI or similar...Senior
- Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies...Senior
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
$114.4k - $164.4k per year
Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning Engineering General Summary:As a leading... ...1+ year of work experience in a role requiring interaction with senior leadership (e.G., Director and above). Principal Duties and...SeniorImmediate startWork from home- Lead electrical distribution design and technical reviews in Calgary’s hybrid Quarry Park office, using PLS-CADD, MicroStation, and AutoCAD.This Distribution Engineer role provides technical leadership across overhead and underground projects. You will develop calculations,...SeniorWork at office
- Shape LLM platform observability at BMO, using OpenTelemetry, Prometheus, and Grafana in a hybrid engineering environment.The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts...Senior
- Build reliable LLM platforms in Montreal with GitHub Copilot, Python, and CI/CD expertise. Fujitsu’s primary-location role centers on production AI engineering.This Senior AI Application Developer position delivers AI and LLM-powered features in production environments. You...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Distributed Llm Performance Engineer. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

