Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Ai Systems Engineer - Ai Model (Training & Inference)

Advanced Micro Devices, Inc.

ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
ADVANCE YOUR CAREER. ADVANCE THE WORLD.
At AMD, we believe technology can change lives for the better. It can heal us, entertain us, and make us more connected, productive, and understanding of the world around us. And we’re looking for talent who feel the same: people who want to leave the planet better than they found it, those who don’t shy away from humanity’s challenges but are determined to help solve them.
AMD is powering the next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI breakthroughs, or creating go-to-market plans, every role at AMD contributes to something bigger — technology that moves the world forward.
The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving.
The PersonThis role demands someone who has shipped LLMs on real hardware, written GPU kernels that moved production metrics, and built the systems infrastructure (orchestration, storage, monitoring) that keeps thousands of GPUs productive. You will be instrumental in ensuring AMD GPUs are first-class citizens for frontier model training and inference across current and next-generation Instinct accelerators.
Key ResponsibilitiesTraining Infrastructure & Enablement
Enable and optimize large-scale model training (LLMs, VLMs, MoE architectures) on AMD Instinct GPU clusters, ensuring correctness, reproducibility, and competitive throughput.
Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
Develop monitoring, alerting, and compliance infrastructure to ensure training cluster health, data security, and SLA adherence at scale.
Design and build end-to-end validation and testing infrastructure using proxy workloads, synthetic benchmarks, and configurable workload generators to systematically validate platform readiness across AMD Instinct GPU generations.
Inference Optimization & Serving
Write and optimize high-performance GPU kernels (GEMM, attention, quantized matmul, GPTQ/AWQ) in HIP, Triton, and MLIR targeting AMD Instinct architectures, with demonstrated ability to outperform open-source baselines.
Drive end-to-end inference enablement on new AMD GPU silicon - be among the first to get frontier models running on each new Instinct generation, creating reproducible guides and reference implementations.
Optimize inference serving frameworks (vLLM, SGLang, TorchServe) for AMD GPUs: batching strategies, KV-cache management, speculative decoding, and continuous batching for production throughput/latency targets.
Develop novel approaches to inference acceleration, including bio-inspired algorithms, SLM-assisted batching, and custom scheduling strategies that exploit AMD hardware characteristics.
Build quantization pipelines (FP8, FP6, FP4, GPTQ, AWQ) for production model deployment, ensuring quality-performance tradeoffs are well-characterized across AMD GPU generations.
Cross-Cutting
Collaborate with AMD silicon architecture and pre-silicon teams to provide software feedback and validate software stack integration on next-generation Instinct GPU designs for both training and inference workloads.
Build observability and automated analysis tooling: log analysis pipelines, anomaly detection, performance baselining, regression detection, and diagnostic workflows for large-scale GPU clusters.
Contribute to the open ROCm ecosystem and AMD's developer experience — SDKs, CI dashboards, documentation, and developer cloud enablement.
Preferred Experience
Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
Background in building anomaly detection, log analysis, or observability systems for large-scale distributed GPU infrastructure.
Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.
Experience with pre-silicon software validation or hardware-software co-verification workflows.
Publications or patents in HPC, ML systems, or GPU kernel optimization.
Preferred Academic Credentials
Bachelor’s or Master’s degree or Ph.D in Computer/Software Engineering, Computer Science, or related technical discipline
LOCATIONMarkham, Canada
This role is not eligible for visa sponsorship.
Benefits offered are described: AMD benefits at a glance.
AMD does not accept unsolicited resumes from headhunters, recruitment agencies, or fee-based recruitment services. AMD and its subsidiaries are equal opportunity, inclusive employers and will consider all applicants without regard to age, ancestry, color, marital status, medical condition, mental or physical disability, national origin, race, religion, political and/or third-party affiliation, sex, pregnancy, sexual orientation, gender identity, military or veteran status, or any other characteristic protected by law. We encourage applications from all qualified candidates and will accommodate applicants’ needs under the respective laws throughout all stages of the recruitment and selection process.
AMD may use Artificial Intelligence to help screen, assess or select applicants for this position. AMD’s “Responsible AI Policy” is available here.
This posting is for an existing vacancy.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Ai Systems Engineer - Ai Model (Training & Inference) in Winnipeg, MB vacancy
  • AMD is seeking a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs, covering training infrastructure at scale and high-performance inference serving. You will ship LLMs on real hardware, optimize GPU kernels, and ensure frontier... 
    Training

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    1 hour ago
  • A leading technology company in Markham, Canada, seeks a Principal Software Development Engineer focused on generative AI training and inference. You will collaborate with a talented team to innovate efficient techniques for model scaling. Required qualifications include a relevant... 
    Training

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    1 hour ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto, CAEmployment type : Full-timeSalary : $250k - $350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference... 
    Suggested

    Brix

    Winnipeg, MB
    1 hour ago
  • Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong... 
    Suggested
    Work at office

    Best AI Tools Wiki

    Winnipeg, MB
    1 hour ago
  •  ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver... 
    Suggested

    Cerebras

    Winnipeg, MB
    1 hour ago
  • Flexspring, Inc. is seeking a skilled AI Model Training and Deployment Developer to join our engineering team, building the next generation of our AI tools and services. You will contribute to designing, training, and deploying AI models using low-code platforms and integrate... 
    Training

    Flexspring

    Winnipeg, MB
    1 hour ago
  •  ...seeking a Member of Technical Staff (Post training team) to help advance model training technologies....  ...Ideal candidates possess strong software engineering skills and should be proficient in Python...  ...diverse team pushing the boundaries of AI research while enjoying a supportive... 
    Training

    Cohere

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...of AI to bring cutting-edge models into production. We're growing quickly...  ...Join us and help build the platform engineers turn to ship AI products.THE ROLE... 
    Internship
    Flexible hours

    Urban Ridge Supplies

    Winnipeg, MB
    1 hour ago
  • $127k - $225k per year

     ...permanent opening for a Senior Engineer. About the team: The...  ...enhance algorithm performance and training efficiency across industries,...  ...About the job: As a Senior System Engineer, you will drive core...  ...performance across foundation model pre-training and post-training... 
    Training
    Long term contract
    Permanent employment
    Internship
    Local area
    Immediate start

    Huawei Technologies Co.

    Winnipeg, MB
    1 hour ago
  • $100k - $145k per year

    Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for...  ...Architecture, and Enterprise AI teams to onboard new research models into production. About The Role Within Platform Engineering... 
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered... 

    Sarsfield Group

    Winnipeg, MB
    1 hour ago
  • $114.4k - $164.4k per year

    Company:Qualcomm Canada ULC Job Area:Engineering Group, Engineering Group...  ...Summary:As a member of the Low Power AI Solution team, you will conduct advanced research on model efficiency, model compression techniques, and ML system optimization to push the boundaries... 
    Training
    Work from home

    Blumberg Capital Company

    Winnipeg, MB
    1 hour ago
  • A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong... 
    Flexible hours

    Cohere

    Winnipeg, MB
    1 hour ago
  • $120k - $140k per year

     ...Magnetized Target Fusion (“MTF”) technology, an engineering-driven approach to fusion energy....  ...’s No. 1 GreenTech Company of 2026.The Systems Modeling Engineer works with a team of subject matter...  ...registration,Experience applying AI to accelerate systems modeling and requirements... 

    General Fusion Inc

    Winnipeg, MB
    1 hour ago
  • Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  • We are seeking a Model-Based Systems Engineer with hands-on experience in MBSE, SysML, and UML to support vehicle feature modeling, system architecture...  ...code generation and integration. Familiarity with AI/LLMs and system behavior testing. The Company offers a total... 
    Training
    For contractors
    Local area

    Collabera

    Winnipeg, MB
    1 hour ago
  •  ...experiences they love. Our Vector Gamer AI team sits at the heart of that...  ...scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the distributed systems that power billions of daily... 
    Training
    Work at office
    Worldwide

    Unity Technologies

    Winnipeg, MB
    1 hour ago
  • Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...An opportunity exists for a Bridge Engineer-in-Training to become part of our dynamic Transportation...  ..., specifying, and engineering bridge systems and products for a variety of transportation...  ....  Experience with structural modeling and design software such as SAP2000 or... 
    Training
    Full time
    Contract work
    For contractors
    Summer work
    Work at office
    Local area

    Stantec

    Winnipeg, MB
    8 days ago
  • NVIDIA is seeking a Senior Engineer to drive performance modeling, evaluation, and post-training of large language models specialized in code generation, software engineering...  ...work at the intersection of model training, inference optimization, and empirical analysis to improve... 
    Training

    2100 NVIDIA USA

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion,...  ...frontier of AI to bring cutting-edge models into production. We’re growing quickly...  ...Join us and help build the platform engineers turn to ship AI products. About... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...of AI to bring cutting-edge models into production. We're growing quickly...  ...Join us and help build the platform engineers turn to ship AI products. Baseten... 
    Training
    Long term contract
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...teams. In this role, you will leverage your engineering expertise to contribute to various key...  ...Responsibilities Architecture Definition: Design the train architecture, operating modes, and...  ...throughout the train's lifecycle. System Sizing: Size systems and equipment to... 

    3M Consultancy

    Winnipeg, MB
    1 hour ago
  • $119k - $148k per year

    Engineering Service Business Unit focuses on power system software development, power system and substation consulting studies...  ...and solar renewables, and load model development or validation via field...  ...troubleshooting, safety training and awareness, considered as an assetMust... 
    Training
    Full time

    Powertech Labs Inc.

    Winnipeg, MB
    1 hour ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude... 
    Training

    FDE Times

    Winnipeg, MB
    1 hour ago
  • Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional teams to...  ...in GPU programming and CUDA • Experience deploying models on Kubernetes • Familiarity with deep learning runtimes... 

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  • $120k - $180k per year

    System Software Engineer - AIAbout us:We are a startup building foundational technology to address performance...  ...resiliency challenges in large-scale AI data center clusters. We are backed by...  ...execution primitives that allow large-scale AI models to run efficiently across thousands of... 
    Training
    Internship
    Remote work

    Delos Data

    Winnipeg, MB
    1 hour ago
  • $111k - $160k per year

     ...greatest potential.Title and Summary Senior Software Engineer (Sanctions Service & AI Inference)Who is Mastercard? Mastercard is a global technology company...  ...design, develop and support business-critical software systems that operate at global scale. You will work closely with... 
    Internship
    Worldwide

    Mastercard Inc.

    Winnipeg, MB
    1 hour ago
  • Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise environments. You will own the architecture for complex inference challenges, enable low latency and high... 

    Fdetimes

    Winnipeg, MB
    1 hour ago
  •  ...write could directly shape how the next generation of AI understands and generates software? We're looking for Software Engineers in Calgary to build, evaluate, and improve AI-generated code — helping train AI systems to think like real developers. About The RoleWhat if... 
    Training
    Hourly pay
    Ongoing contract
    Contract work
    Freelance
    Manual labor
    Remote work
    Flexible hours

    Alignerr Corp.

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Ai Systems Engineer - Ai Model (Training & Inference). Be the first to apply!