Ai Systems Engineer - Ai Model (Training & Inference)
Advanced Micro Devices, Inc.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.
The PersonThis role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.
Key ResponsibilitiesTraining Infrastructure & Enablement
Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
Inference Optimization & Serving
Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.
Cross-Cutting
Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.
Preferred Experience
Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.
Preferred Academic Credentials
Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
LOCATIONMarkham, Canada
This role is not eligible for visa sponsorship.
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
#J-18808-Ljbffr
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.
The PersonThis role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.
Key ResponsibilitiesTraining Infrastructure & Enablement
Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
Inference Optimization & Serving
Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.
Cross-Cutting
Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.
Preferred Experience
Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.
Preferred Academic Credentials
Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
LOCATIONMarkham, Canada
This role is not eligible for visa sponsorship.
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Systems Engineer - Ai Model (Training & Inference) in Winnipeg, MB vacancy
- ...An opportunity exists for a Bridge Engineer-in-Training to become part of our dynamic Transportation... ..., specifying, and engineering bridge systems and products for a variety of transportation... .... Experience with structural modeling and design software such as SAP2000 or...TrainingFull timeContract workFor contractorsSummer workWork at officeLocal area
- ...Are you a passionate and driven young engineer looking to make a real impact on your community? Stantec is a global engineering consulting... ...to register (or already registered) as an Engineering-In-Training with EGM. Valid Canadian driver’s license with access to a vehicle...TrainingFor contractorsLocal areaFlexible hours
- AMD is seeking a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs, covering training infrastructure at scale and high-performance inference serving. You will ship LLMs on real hardware, optimize GPU kernels, and ensure frontier...Training
- ...helping you reach your potential through training and education. Community... ...Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications... ..., deep learning, and generative AI models to solve specific business problems....Training
$89.91k - $113.73k per year
The Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies... ...and solar renewables, and load model development or validation via... ...core competencies. Internationally-trained engineers may be considered if...SuggestedFull timeImmediate startRemote work- A leading technology company in Markham, Canada, seeks a Principal Software Development Engineer focused on generative AI training and inference. You will collaborate with a talented team to innovate efficient techniques for model scaling. Required qualifications include a relevant...Training
- ...We are committed to helping you reach your potential through training and education. • Community Involvement - Generously supporting... ...Price Café offers free Tea and Coffee. Finishing Systems Engineering Assistant (8 Month Term – Winter 2027) The successful candidate...TrainingFor contractors
- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join... ...agents and applications with enterprise systems, services, and APIs. Support modern AI... ...Nice to Have Hands-on experience with Model Context Protocol (MCP) and Agent-to-Agent...Full timeInternshipRemote workRelocation
- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto, CAEmployment type : Full-timeSalary : $250k - $350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference...
- Flexspring, Inc. is seeking a skilled AI Model Training and Deployment Developer to join our engineering team, building the next generation of our AI tools and services. You will contribute to designing, training, and deploying AI models using low-code platforms and integrate...Training
- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...Work at office
- ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver...
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance... ...in AI application development Expertise in SQL, data modeling, and engineering Knowledge of concurrency and...
- Bridge AI research and production through model post-training at Cohere, using Python, JAX, and supercompute infrastructure. Work remotely or in global offices... ...infrastructureRequirements: Extremely strong software engineering skillsProficiency in Python, JAX, PyTorch, and XLA/...TrainingRemote work
- ...Aerospace Engine Mechanic Training Program (GTRO) Winnipeg, Manitoba Build an Aviation Career You’re Proud Of At StandardAero, we use our ingenuity and know-how to find solutions for the simple to the most complex challenges in aviation. Together, we get the job done...TrainingLong term contractTemporary workTraineeshipSecond job
$127k - $225k per year
...permanent opening for a Senior Engineer. About the team: The... ...enhance algorithm performance and training efficiency across industries,... ...About the job: As a Senior System Engineer, you will drive core... ...performance across foundation model pre-training and post-training...TrainingLong term contractPermanent employmentInternshipLocal areaImmediate start- ...seeking a Member of Technical Staff (Post training team) to help advance model training technologies.... ...Ideal candidates possess strong software engineering skills and should be proficient in Python... ...diverse team pushing the boundaries of AI research while enjoying a supportive...Training
$165k - $330k per year
...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ...of AI to bring cutting-edge models into production. We're growing quickly... ...Join us and help build the platform engineers turn to ship AI products.THE ROLE...InternshipFlexible hours$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for... ...Architecture, and Enterprise AI teams to onboard new research models into production. About The Role Within Platform Engineering...Work at officeLocal areaFlexible hours2 days per week3 days per week- A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong...Flexible hours
- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered...
$114.4k - $164.4k per year
Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group... ...Summary:As a member of the Low Power AI Solution team, you will conduct advanced research on model efficiency, model compression techniques, and ML system optimization to push the boundaries...TrainingWork from home- Are you a passionate and driven young engineer looking to make a real impact on your community? Stantec is a global engineering consulting firm dedicated to creating sustainable and innovative solutions. We are looking for enthusiastic individuals to join our team and embark...TrainingFull timeLocal area
- Advance high-speed AI inference infrastructure at Cerebras Systems through latency optimization, reliability engineering, and production software.As a Staff Engineer, you will help build the next-generation architecture of a globally distributed inference platform. The Inference...
- ...of the IT industry. Summary: The Consultant, ICT Systems Engineering at Epic is responsible for timely and effective resolutions to... ...point for all Managed service issues Provide mentorship/training to the rest of the team Qualifications: Minimum of 5+ years...TrainingFull timeWork at officeRemote workFlexible hours3 days per week
$46.5k per year
...Position: Temporary Manager in Training Hours: 40 Weekly Deadline to apply... ...consultation-based customer service models Ability to develop and train staff through positive coaching and... ...Microsoft suit, and adaptable to other systems as required Basic HR skills in...TrainingTemporary workFlexible hoursAfternoon shift$120k - $140k per year
...Magnetized Target Fusion (“MTF”) technology, an engineering-driven approach to fusion energy.... ...’s No. 1 GreenTech Company of 2026.The Systems Modeling Engineer works with a team of subject matter... ...registration,Experience applying AI to accelerate systems modeling and requirements...- NVIDIA is seeking a Senior Engineer to drive performance modeling, evaluation, and post-training of large language models specialized in code generation, software engineering... ...work at the intersection of model training, inference optimization, and empirical analysis to improve...Training
- ...reach your potential through training and education. Community Involvement... ...diagrams, and interaction models that illustrate current... ...feasibility. • Partner with system architects, developers, and product... ..., Information Systems, Engineering, or a related discipline. 3...TrainingWork at office
- ...experiences they love. Our Vector Gamer AI team sits at the heart of that... ...scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the distributed systems that power billions of daily...TrainingWork at officeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Systems Engineer - Ai Model (Training & Inference). Be the first to apply!


