Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Systems Engineer - Ai Model (Training & Inference)

Advanced Micro Devices, Inc.

ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.
The PersonThis role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.
Key ResponsibilitiesTraining Infrastructure & Enablement
Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
Inference Optimization & Serving
Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.
Cross-Cutting
Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.
Preferred Experience
Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.
Preferred Academic Credentials
Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
LOCATIONMarkham, Canada
This role is not eligible for visa sponsorship.
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
#J-18808-Ljbffr
Vacancy posted 43 minutes ago
Similar jobs that could be interesting for youBased on the Ai Systems Engineer - Ai Model (Training & Inference) in Winnipeg, MB vacancy
  •  ...An opportunity exists for a Bridge Engineer-in-Training to become part of our dynamic Transportation...  ..., specifying, and engineering bridge systems and products for a variety of transportation...  ....  Experience with structural modeling and design software such as SAP2000 or... 
    Training
    Full time
    Contract work
    For contractors
    Summer work
    Work at office
    Local area

    Stantec

    Winnipeg, MB
    10 days ago
  •  ...Are you a passionate and driven young engineer looking to make a real impact on your community? Stantec is a global engineering consulting...  ...to register (or already registered) as an Engineering-In-Training with EGM.  Valid Canadian driver’s license with access to a vehicle... 
    Training
    For contractors
    Local area
    Flexible hours

    Stantec

    Winnipeg, MB
    10 days ago
  •  ...Mining and Industrial Skills Training in Tanzania! Are you a skilled...  ...machining operations, pump systems, dewatering infrastructure, hydraulics...  ...so they can confidently train future technicians and tradespeople...  ...qualification) in Mechanical Engineering, Manufacturing Engineering,... 
    Training
    Permanent employment
    Apprenticeship
    Traineeship
    Local area
    Free visa

    Cuso International

    Winnipeg, MB
    46 minutes ago
  •  ...helping you reach your potential through training and education. Community...  ...Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications...  ..., deep learning, and generative AI models to solve specific business problems.... 
    Training

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  • $89.91k - $113.73k per year

    The Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies...  ...and solar renewables, and load model development or validation via...  ...core competencies. Internationally-trained engineers may be considered if... 
    Suggested
    Full time
    Immediate start
    Remote work

    Powertech Labs

    Winnipeg, MB
    8 days ago
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join...  ...agents and applications with enterprise systems, services, and APIs. Support modern AI...  ...Nice to Have Hands-on experience with Model Context Protocol (MCP) and Agent-to-Agent... 
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    10 days ago
  •  ...We are committed to helping you reach your potential through training and education. • Community Involvement - Generously supporting...  ...Price Café offers free Tea and Coffee. Finishing Systems Engineering Assistant (8 Month Term – Winter 2027) The successful candidate... 
    Training
    For contractors

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  •  ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance...  ...in AI application development Expertise in SQL, data modeling, and engineering Knowledge of concurrency and... 

    Talentola

    Winnipeg, MB
    10 days ago
  •  ...Aerospace Engine Mechanic Training Program (GTRO) Winnipeg, Manitoba  Build an Aviation Career You’re Proud Of At StandardAero, we use our ingenuity and know-how to find solutions for the simple to the most complex challenges in aviation. Together, we get the job done... 
    Training
    Long term contract
    Temporary work
    Traineeship
    Second job

    StandardAero

    Winnipeg, MB
    23 days ago
  • $46.5k per year

     ...Position: Temporary Manager in Training Hours: 40 Weekly Deadline to apply...  ...consultation-based customer service models Ability to develop and train staff through positive coaching and...  ...Microsoft suit, and adaptable to other systems as required Basic HR skills in... 
    Training
    Temporary work
    Flexible hours
    Afternoon shift

    Internal Job Board

    Winnipeg, MB
    4 days ago
  •  ...changes of the IT industry. Summary: The Consultant, ICT Systems Engineering at Epic is responsible for timely and effective resolutions to...  ...point for all Managed service issues Provide mentorship/training to the rest of the team Qualifications: Minimum of 5+ years... 
    Training
    Full time
    Contract work
    Work at office
    Remote work
    Flexible hours
    3 days per week

    Bell Canada

    Winnipeg, MB
    9 days ago
  •  ...reach your potential through training and education. Community Involvement...  ...diagrams, and interaction models that illustrate current...  ...feasibility. • Partner with system architects, developers, and product...  ..., Information Systems, Engineering, or a related discipline. 3... 
    Training
    Work at office

    Price Industries Limited

    Winnipeg, MB
    6 days ago
  •  ...just starting your career, re-entering the workforce, or looking for a new job, this is where you belong.  Assistant Store Manager In Training Ready to lead with purpose? Join Real Canadian Superstore as an Assistant Store Manager in Training and build the skills to... 
    Training
    Long term contract
    Permanent employment
    Temporary work
    Internship
    Immediate start

    Loblaw Companies Limited

    Winnipeg, MB
    10 days ago
  •  ...provider of real-time power simulation systems, catering to utilities, research...  ...The Simulation Specialist/Engineer at RTDS Technologies Inc. will join the Simulation & Model Development team and will be...  ...ability and willingness to use AI tools to improve productivity, decision... 
    Summer work
    Immediate start

    Ametek, Inc.

    Winnipeg, MB
    7 days ago
  • AMD is seeking a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs, covering training infrastructure at scale and high-performance inference serving. You will ship LLMs on real hardware, optimize GPU kernels, and ensure frontier... 
    Training

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    38 minutes ago
  •  ...helping you reach your potential through training and education. Community Involvement -...  ...invited to be a part of that. Embedded Systems Designer – Antec Controls We are...  ...root cause investigations • Maintaining engineering documentation, design records, specifications... 
    Training

    Price Industries Limited

    Winnipeg, MB
    6 days ago
  •  ...experience is not required. Comprehensive training modules, manufacturer resources, and collaborative...  ..., complex third-party reimbursement systems, and unfamiliar medication categories....  ...within our database. Although Randstad uses AI as a tool, candidate selection and hiring... 
    Training
    Long term contract
    Permanent employment
    Full time
    Temporary work
    Direct hire
    Immediate start
    Monday to friday
    Shift work
    Afternoon shift
    Weekday work

    Randstad Canada

    Winnipeg, MB
    10 days ago
  • A leading technology company in Markham, Canada, seeks a Principal Software Development Engineer focused on generative AI training and inference. You will collaborate with a talented team to innovate efficient techniques for model scaling. Required qualifications include a relevant... 
    Training

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    40 minutes ago
  • $80k - $95k per year

     ...Job Description Gather and document business requirements for systems used across manufacturing operations. Work directly with business...  ...your experience, we encourage you to apply. This role may use AI‑assisted tools to support initial screening. All assessments and decisions... 
    Permanent employment

    Michael Page

    Winnipeg, MB
    2 days ago
  •  ...helping you reach your potential through training and education. Community Involvement -...  ...’re invited to be a part of that. Lab Systems Software Developer We are looking for...  ...you will work directly with laboratory and engineering teams to build and maintain software... 
    Training

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  • usd112k per year

     ...Properties is recruiting ambitious real estate agents to build a Dubai-based career. The role includes relocation support, comprehensive training, and RERA licensing assistance. You will be trained from zero and work on commission with the potential to earn substantial... 
    Training
    Relocation
    Relocation package

    McCone Properties

    Winnipeg, MB
    10 days ago
  •  ...together across manufacturing, engineering, customer care, service,...  ...highly visible Finance Business Systems team that sits at the intersection...  ..., Tax, Technology, Analytics, AI, and Business Transformation....  ...balance. Access on-the-job training in a continuous learning environment... 
    Training
    Permanent employment
    Full time
    Work at office
    Immediate start
    Monday to friday

    NFI Group Inc.

    Winnipeg, MB
    a month ago
  • Flexspring, Inc. is seeking a skilled AI Model Training and Deployment Developer to join our engineering team, building the next generation of our AI tools and services. You will contribute to designing, training, and deploying AI models using low-code platforms and integrate... 
    Training

    Flexspring

    Winnipeg, MB
    44 minutes ago
  •  ...helping you reach your potential through training and education. Community Involvement -...  ...Coffee. Test Automation Lead Enterprise Systems • IFS ERP • Multi-site Manufacturing...  ...Bachelor's degree in Computer Science, Software Engineering, Information Technology, Computer... 
    Training

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto, CAEmployment type : Full-timeSalary : $250k - $350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference... 

    Brix

    Winnipeg, MB
    39 minutes ago
  •  ...Our Winnipeg Branch office is currently recruiting for a Fire System Sales Representative to be responsible for acquiring and maintaining...  ...with multiple trades Experience dealing with Contractors, Engineers & Distribution Experience within the construction market Proven... 
    Full time
    For contractors
    Work at office

    Chubb

    Winnipeg, MB
    4 days ago
  • Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong... 
    Work at office

    Best AI Tools Wiki

    Winnipeg, MB
    35 minutes ago
  •  ...The individual needs to have strong Accounting and Information System backgrounds and be able to work seamlessly with both Accounting and...  ...for more flexibility in the way we work, we offer a hybrid work model and flexible dress code for our eligible office-based workforce in... 
    Work at office
    Flexible hours

    TransCanada PipeLines

    Winnipeg, MB
    10 days ago
  •  ...includes Fitness related App’s. Personal and Professional Development - We are committed to helping you reach your potential through training and education. Community Involvement - Generously supporting health, charities, youth, and education opportunities is our passion,... 
    Training

    Price Industries Limited

    Winnipeg, MB
    10 days ago
  •  ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver... 

    Cerebras

    Winnipeg, MB
    41 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Systems Engineer - Ai Model (Training & Inference). Be the first to apply!