Senior Distributed Llm Performance Engineer
Huawei Canada
Distributed LLM performance engineering powers Huawei Canada’s Ascend NPU training systems with MindSpeed, hybrid parallelism, and profiling expertise.This Senior System Engineer position focuses on foundation-model pre-training and post-training at scale. You will architect distributed pipelines using MindSpeed, Megatron, PyTorch FSDP, veRL, vLLM, and Ray. The work targets MFU, compute-communication overlap, rollout pipelining, and reliable numerical behavior.Key Responsibilities:
Scale pre-training and RL post-training pipelines across NPU clustersOptimize hybrid TP, PP, CP, EP, and ZeRO parallelismTune RL rollout and actor pipelining for training efficiencyImplement FP8, MXFP8, and mixed-precision training schemesEliminate pipeline bubbles, stalls, and HCCL communication overheadRequirements:
Three-plus years in HPC, accelerator operators, or distributed trainingPractical distributed training experience with listed frameworksProficiency in C/C++ and modern Python systems programmingHands-on PyTorch custom C++ or CANN extension developmentPerformance profiling experience on AI hardwareBuild scalable Ascend NPU training systems by combining distributed frameworks, parallelism tuning, profiling, and precision alignment.
#J-18808-Ljbffr
Scale pre-training and RL post-training pipelines across NPU clustersOptimize hybrid TP, PP, CP, EP, and ZeRO parallelismTune RL rollout and actor pipelining for training efficiencyImplement FP8, MXFP8, and mixed-precision training schemesEliminate pipeline bubbles, stalls, and HCCL communication overheadRequirements:
Three-plus years in HPC, accelerator operators, or distributed trainingPractical distributed training experience with listed frameworksProficiency in C/C++ and modern Python systems programmingHands-on PyTorch custom C++ or CANN extension developmentPerformance profiling experience on AI hardwareBuild scalable Ascend NPU training systems by combining distributed frameworks, parallelism tuning, profiling, and precision alignment.
#J-18808-Ljbffr
Vacancy posted 48 minutes ago
Similar jobs that could be interesting for youBased on the Senior Distributed Llm Performance Engineer in Winnipeg, MB vacancy
- ...they need to deliver faster, more performant, more dependable, and less expensive... ...built on LLVM. We are looking for a Senior Compiler Performance Engineer to own major performance areas of... ...workloads. You will work in a distributed team of compiler experts, with direct...SeniorPerformanceRemote workWorldwideFlexible hours
$115k - $155k per year
...your Future with Qualus as a Professional Engineer on our Distribution Engineering team! We are seeking a Professional... ..., certifications, experience, skills, seniority, geographic location, internal equity, performance, and business needs. Compensation ranges are...SeniorPerformanceLong term contractFull timeTemporary workFlexible hours- Division: Engineering, ElectricityLocation: Grand Prairie, ABEmbracechallengeand growth withATCOTeam... ...opportunities at both the Engineer and Senior Engineer levels, and candidates may be... ...’s 25kV operational planning of the distribution grid. This area of responsibility will...SeniorLong term contract
- Job Title: Senior Engineer, DistributionIconic Power Systems is a Canadian power infrastructure... ...services across transmission, distribution, substations, and renewable energy. Driven... ...schedules, and material take-offs. Perform engineering calculations, including pole...SeniorWork at office
- Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration...SeniorPerformance
$195k - $390k per year
...language models. Join us to influence and build the next generation of Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language modelsTackle...SeniorFlexible hours- Build advanced language systems as a Senior AI Engineer in Kimberley, applying NLP and LLM expertise within a hybrid work model. Develop scalable solutions that understand, generate, and process human language at scale.This senior position focuses on developing and deploying...Senior
- Python and LLM engineering define this remote Senior AI/LLM Engineer position with Kake, building production-ready applications and systems at scale.Kake seeks senior engineers who design, build, and productionize AI systems. You will work across Python, FastAPI, LAG pipelines...SeniorRemote work
- Build distributed systems at Instacart with Go and PostgreSQL while working remotely across... ...Columbia, or Nova Scotia.As a Senior Software Engineer, you will build and operate Catalog Store... ...experience with replication and performance tuningExperience designing scalable,...SeniorPerformanceInternshipRemote work
- ...future. Your OpportunityWe are currently looking for a Senior Electrical Engineer to join our Distribution Design team in our Saskatchewan and Alberta offices.... ...requirements Review of project documentation and perform Engineer of Record duties (specifications, IFR/IFC...SeniorLong term contractFull timeTemporary workPart timeCasual workWork at officeWork from homeFlexible hours
- Design distributed execution with Python and Ray, Dask, Spark, or MPI for GeoSoftware... ...diverse compute environments.As a Senior HPC and Platform Engineer, you will own execution, deployment,... ...The work includes secure deployment, performance engineering, and platform operations...SeniorPerformanceLocal areaRemote work
- Hardline Engineering (EllisDon group of companies) is a privately owned... ...design and development of distribution projects (new extensions, upgrades... ...to site conditions. Perform quality control through audits... ...Experience would be an asset. Senior PLS-CADD experience considered...Senior
- Build Atlas Agent Engine remotely from Canada, applying distributed systems expertise to runtime, memory, retrieval, identity, and governance layers.MongoDB... ...reliably at scale. The work includes architecture, testing, performance, scalability, reliability, and developer experience...SeniorPerformanceRemote work
- Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans... ...such as vLLMDeep understanding of LLM inference performance trade-offsExperience designing rigorous performance...SeniorPerformanceRemote work
- ...assisted backend features for Jeeves from a full-time remote setting, combining LLM integrations with distributed financial systems. Collaborate across global engineering and data teams.In this Senior Backend Engineer position, you will connect experimental AI work with...SeniorFull timeRemote work
$127k - $225k per year
...has an immediate permanent opening for a Senior Engineer. About the team: The Computing... ...goals of this lab are to enhance algorithm performance and training efficiency across... ...core compute operator development and distributed scaling performance across foundation model...SeniorPerformanceLong term contractPermanent employmentInternshipLocal areaImmediate start- Lead electrical distribution design and technical reviews in Calgary’s hybrid Quarry Park office, using PLS-CADD, MicroStation, and AutoCAD.This Distribution Engineer role provides technical leadership across overhead and underground projects. You will develop calculations,...SeniorWork at office
- Entwickle Backend-Services für LLM-Agenten mit Spring Boot, Java und ereignisgesteuerten... ...an einer eigenständigen Plattform.Als Senior Software Engineer baust und betreibst du den Backend-Kern... ...und Event-Architekturen mit Fokus auf Performance, Skalierbarkeit und Observability....SeniorPerformance
- Architect distributed systems and real-time services remotely, applying cloud infrastructure... ...challenges with precision.This Senior Backend Engineer role focuses on architecture, development... ...reliability, security, and performance. The position requires strong distributed...SeniorPerformanceRemote work
- ...passion to drive life-changing impact to ZS.LLM Engineer We are seeking a highly skilled LLM... ...architecture design, and ensuring the performance and reliability of our systems.What You... ...design and development of scalable and distributed software systemsTranslate business to...PerformanceWork at officeLocal areaWork from homeWorldwideFlexible hours
- ...backend systems at StackAdapt using Go and distributed systems expertise to power... ...advertising inventory integrations.As a Senior Software Engineer on the Inventory team, you will lead... ...advertising exchanges, microservices, and performance optimization. These systems process...SeniorPerformance
- Turn LLM research into commercial-quality systems with secure AWS Serverless architecture at Diligent’s Vancouver technical center.As a Senior Staff Software Engineer on Platform AI, you will lead through influence across multiple teams. You will evaluate emerging AI technologies...Senior
- Build reliable LLM platforms in Montreal with GitHub Copilot, Python, and CI/CD expertise. Fujitsu’s primary-location role centers on production AI engineering.This Senior AI Application Developer position delivers AI and LLM-powered features in production environments. You...Senior
- Develop LLM workflows and data pipelines for AXIS Capital’s enterprise AI platforms using Databricks, PySpark, and Python. The work supports business teams.This Senior AI Platform Engineer builds reusable capabilities for underwriting, claims, operations, and strategic functions...Senior
$250k - $280k per year
Senior Software Engineer II - LLM ObservabilityRemote - Canada What We’re Building Honeycomb is a service for the near and present future, defining... ...(but humble) peers. How We Work We are a fully distributed company, which means we believe it is not where you sit,...SeniorInternshipWork at officeLocal areaRemote workWork from homeHome officeShift work$146k - $162k per year
We’re looking for a Software Engineer to join our growing AI organization in Vancouver. Asana is pioneering a new category of technology... ...rotations, and diagnose complex bugs across asynchronous or distributed systems. Break down feature specifications into clear engineering...Long term contractWork at officeLocal areaWork from homeWorldwide$114.4k - $164.4k per year
Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group Machine Learning Engineering General Summary:As a leading... ...1+ year of work experience in a role requiring interaction with senior leadership (e.G., Director and above). Principal Duties and...SeniorImmediate startWork from home- Senior Machine Learning Engineer – LLM’sTech scale up developing democratized AI Technology, backed by one of the worlds leading AI investors with multiple successes & exits.You’ll have experience with LLM’s and Reinforcement learning.BA in Computer Science (Masters or PhD preferred...Senior
- Design RAG systems and LLM features for Wiser Solutions remotely, using embeddings and retrieval to solve real customer problems.This Senior Machine Learning Engineer builds AI applications that reach production across product matching, classification, and extraction. You will...SeniorRemote work
- ...and a people-first global community of senior engineers. Kake engineers are behind some of the world... ...(and love eating kake!). Senior AI/LLM Engineers with strong Python experience... ...and agentic workflows. Experience with distributed systems, streaming (e.g., Kafka), or...SeniorRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Distributed Llm Performance Engineer. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

