Ai Systems Engineer - Ai Model (Training & Inference)
Advanced Micro Devices, Inc.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.
The PersonThis role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.
Key ResponsibilitiesTraining Infrastructure & Enablement
Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
Inference Optimization & Serving
Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.
Cross-Cutting
Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.
Preferred Experience
Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.
Preferred Academic Credentials
Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
LOCATIONMarkham, Canada
This role is not eligible for visa sponsorship.
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
#J-18808-Ljbffr
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.
The PersonThis role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.
Key ResponsibilitiesTraining Infrastructure & Enablement
Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
Inference Optimization & Serving
Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.
Cross-Cutting
Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.
Preferred Experience
Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.
Preferred Academic Credentials
Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
LOCATIONMarkham, Canada
This role is not eligible for visa sponsorship.
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
#J-18808-Ljbffr
Vacancy posted 43 minutes ago
Similar jobs that could be interesting for youBased on the Ai Systems Engineer - Ai Model (Training & Inference) in Winnipeg, MB vacancy
- ...An opportunity exists for a Bridge Engineer-in-Training to become part of our dynamic Transportation... ..., specifying, and engineering bridge systems and products for a variety of transportation... .... Experience with structural modeling and design software such as SAP2000 or...TrainingFull timeContract workFor contractorsSummer workWork at officeLocal area
- ...Are you a passionate and driven young engineer looking to make a real impact on your community? Stantec is a global engineering consulting... ...to register (or already registered) as an Engineering-In-Training with EGM. Valid Canadian driver’s license with access to a vehicle...TrainingFor contractorsLocal areaFlexible hours
- ...Mining and Industrial Skills Training in Tanzania! Are you a skilled... ...machining operations, pump systems, dewatering infrastructure, hydraulics... ...so they can confidently train future technicians and tradespeople... ...qualification) in Mechanical Engineering, Manufacturing Engineering,...TrainingPermanent employmentApprenticeshipTraineeshipLocal areaFree visa
- ...helping you reach your potential through training and education. Community... ...Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications... ..., deep learning, and generative AI models to solve specific business problems....Training
$89.91k - $113.73k per year
The Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies... ...and solar renewables, and load model development or validation via... ...core competencies. Internationally-trained engineers may be considered if...SuggestedFull timeImmediate startRemote work- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join... ...agents and applications with enterprise systems, services, and APIs. Support modern AI... ...Nice to Have Hands-on experience with Model Context Protocol (MCP) and Agent-to-Agent...Full timeInternshipRemote workRelocation
- ...We are committed to helping you reach your potential through training and education. • Community Involvement - Generously supporting... ...Price Café offers free Tea and Coffee. Finishing Systems Engineering Assistant (8 Month Term – Winter 2027) The successful candidate...TrainingFor contractors
- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance... ...in AI application development Expertise in SQL, data modeling, and engineering Knowledge of concurrency and...
- ...Aerospace Engine Mechanic Training Program (GTRO) Winnipeg, Manitoba Build an Aviation Career You’re Proud Of At StandardAero, we use our ingenuity and know-how to find solutions for the simple to the most complex challenges in aviation. Together, we get the job done...TrainingLong term contractTemporary workTraineeshipSecond job
$46.5k per year
...Position: Temporary Manager in Training Hours: 40 Weekly Deadline to apply... ...consultation-based customer service models Ability to develop and train staff through positive coaching and... ...Microsoft suit, and adaptable to other systems as required Basic HR skills in...TrainingTemporary workFlexible hoursAfternoon shift- ...changes of the IT industry. Summary: The Consultant, ICT Systems Engineering at Epic is responsible for timely and effective resolutions to... ...point for all Managed service issues Provide mentorship/training to the rest of the team Qualifications: Minimum of 5+ years...TrainingFull timeContract workWork at officeRemote workFlexible hours3 days per week
- ...reach your potential through training and education. Community Involvement... ...diagrams, and interaction models that illustrate current... ...feasibility. • Partner with system architects, developers, and product... ..., Information Systems, Engineering, or a related discipline. 3...TrainingWork at office
- ...just starting your career, re-entering the workforce, or looking for a new job, this is where you belong. Assistant Store Manager In Training Ready to lead with purpose? Join Real Canadian Superstore as an Assistant Store Manager in Training and build the skills to...TrainingLong term contractPermanent employmentTemporary workInternshipImmediate start
- ...provider of real-time power simulation systems, catering to utilities, research... ...The Simulation Specialist/Engineer at RTDS Technologies Inc. will join the Simulation & Model Development team and will be... ...ability and willingness to use AI tools to improve productivity, decision...Summer workImmediate start
- AMD is seeking a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs, covering training infrastructure at scale and high-performance inference serving. You will ship LLMs on real hardware, optimize GPU kernels, and ensure frontier...Training
- ...helping you reach your potential through training and education. Community Involvement -... ...invited to be a part of that. Embedded Systems Designer – Antec Controls We are... ...root cause investigations • Maintaining engineering documentation, design records, specifications...Training
- ...experience is not required. Comprehensive training modules, manufacturer resources, and collaborative... ..., complex third-party reimbursement systems, and unfamiliar medication categories.... ...within our database. Although Randstad uses AI as a tool, candidate selection and hiring...TrainingLong term contractPermanent employmentFull timeTemporary workDirect hireImmediate startMonday to fridayShift workAfternoon shiftWeekday work
- A leading technology company in Markham, Canada, seeks a Principal Software Development Engineer focused on generative AI training and inference. You will collaborate with a talented team to innovate efficient techniques for model scaling. Required qualifications include a relevant...Training
$80k - $95k per year
...Job Description Gather and document business requirements for systems used across manufacturing operations. Work directly with business... ...your experience, we encourage you to apply. This role may use AI‑assisted tools to support initial screening. All assessments and decisions...Permanent employment- ...helping you reach your potential through training and education. Community Involvement -... ...’re invited to be a part of that. Lab Systems Software Developer We are looking for... ...you will work directly with laboratory and engineering teams to build and maintain software...Training
usd112k per year
...Properties is recruiting ambitious real estate agents to build a Dubai-based career. The role includes relocation support, comprehensive training, and RERA licensing assistance. You will be trained from zero and work on commission with the potential to earn substantial...TrainingRelocationRelocation package- ...together across manufacturing, engineering, customer care, service,... ...highly visible Finance Business Systems team that sits at the intersection... ..., Tax, Technology, Analytics, AI, and Business Transformation.... ...balance. Access on-the-job training in a continuous learning environment...TrainingPermanent employmentFull timeWork at officeImmediate startMonday to friday
- Flexspring, Inc. is seeking a skilled AI Model Training and Deployment Developer to join our engineering team, building the next generation of our AI tools and services. You will contribute to designing, training, and deploying AI models using low-code platforms and integrate...Training
- ...helping you reach your potential through training and education. Community Involvement -... ...Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi-site Manufacturing... ...Bachelor's degree in Computer Science, Software Engineering, Information Technology, Computer...Training
- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto, CAEmployment type : Full-timeSalary : $250k - $350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference...
- ...Our Winnipeg Branch office is currently recruiting for a Fire System Sales Representative to be responsible for acquiring and maintaining... ...with multiple trades Experience dealing with Contractors, Engineers & Distribution Experience within the construction market Proven...Full timeFor contractorsWork at office
- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...Work at office
- ...The individual needs to have strong Accounting and Information System backgrounds and be able to work seamlessly with both Accounting and... ...for more flexibility in the way we work, we offer a hybrid work model and flexible dress code for our eligible office-based workforce in...Work at officeFlexible hours
- ...includes Fitness related App’s. Personal and Professional Development - We are committed to helping you reach your potential through training and education. Community Involvement - Generously supporting health, charities, youth, and education opportunities is our passion,...Training
- ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Ai Systems Engineer - Ai Model (Training & Inference). Be the first to apply!

