Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Machine Learning Systems Engineer, LLM Inference Performance on AWS Trainium

$72.06k - $138.94k per year
Full-time

Capgemini

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.

Location

Remote anywhere in Canada

About the job you’re considering

We are seeking a hands-on machine learning systems engineer to optimize production-grade large language model inference across current and next-generation AWS Trainium platforms, including Trainium2 and Trainium3. The work focuses on decode latency, throughput under representative load, price-performance, long-context and multi-chip scaling, and reproducible benchmarking against leading GPU platforms.

Your role

  • Improve decode latency, throughput, and cost on AWS Trainium platforms, validating correctness at every step. Initial priorities include speculative decoding and native multi-token prediction (MTP) for Qwen-family models in vLLM on AWS Neuron.
  • Design and run matched, reproducible tests against leading GPU platforms, controlling prompts, concurrency, cache state, and warm-up. Deliver latency-throughput Pareto frontiers and price-performance comparisons aligned with customer service-level objectives.
  • Benchmark and migrate workloads across Trainium generations, including Trainium2 and Trainium3. Scale serving on multi-chip Trainium systems for long-context workloads, including contexts of 100K tokens or more, and apply architecture-specific optimizations.
  • Extend model coverage. Onboard additional architectures, including hybrid state-space and mixture-of-experts models, reusing and generalizing existing implementations where practical.
  • Create runbooks, implementation guides, and benchmark documentation, and support hands-on workshops so customer engineers can operate, reproduce, and tune the stack independently.

Your skills and experience

  • 5+ years of experience in machine learning or systems engineering, including 2+ years focused on production model inference or serving.
  • Strong proficiency in Python and PyTorch, with the ability to read and modify model implementations involving attention, mixture-of-experts routing, and KV-cache management.
  • Hands-on experience with an LLM serving framework such as vLLM, TensorRT-LLM, SGLang, or Triton Inference Server.
  • Deep understanding of LLM inference performance, including prefill and decode, continuous batching, tensor and expert parallelism, and their impact on latency, throughput, and cost.
  • Experience profiling and optimizing accelerator workloads at the framework, compiler, or kernel level, and designing rigorous performance experiments.
  • Strong written and verbal communication skills, with the ability to explain engineering trade-offs to technical audiences and business impact to senior stakeholders .
  • Preferred qualifications include experience with AWS Trainium/Inferentia, the AWS Neuron SDK, and optimizing AI inference workloads, along with expertise in accelerator migrations, speculative decoding techniques, and kernel development using NKI, Triton, or CUDA.

The base compensation range for this role in the posted location is: $72,056 - $138,940/year

Capgemini provides compensation range information in accordance with applicable national, state, provincial, and local pay transparency laws. The base compensation range listed for this position reflects the minimum and maximum target compensation Capgemini, in good faith, believes it may pay for the role at the time of this posting. This range may be subject to change as permitted by law.

The actual compensation offered to any candidate may fall outside of the posted range and will be determined based on multiple factors legally permitted in the applicable jurisdiction.

These may include, but are not limited to: Geographic location, Education and qualifications, Certifications and licenses, Relevant experience and skills, Seniority and performance, Market and business consideration, Internal pay equity.

It is not typical for candidates to be hired at or near the top of the posted compensation range.

In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.

Capgemini offers a comprehensive, non-negotiable benefits package to all regular, full-time employees. In the U.S. and Canada, available benefits are determined by local policy and eligibility and may include:

· Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave

· Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)

· Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)

· Life and disability insurance

· Employee assistance programs

· Other benefits as provided by local policy and eligibility

Important Notice: Compensation (including bonuses, commissions, or other forms of incentive pay) is not considered earned, vested, or payable until it becomes due under the terms of applicable plans or agreements and is subject to Capgemini’s discretion, consistent with applicable laws. The Company reserves the right to amend or withdraw compensation programs at any time, within the limits of applicable legislation.

Disclaimers

Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. Capgemini also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness, accessibility, inclusion and respect. We value the rich cultural heritage and contributions of Indigenous Peoples and actively work to create a welcoming and respectful environment. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or environmental demands may be referenced in an attempt to communicate the manner in which this position traditionally is performed. Whenever necessary to provide individuals with disabilities an equal employment opportunity, Capgemini will consider reasonable accommodations that might involve varying job requirements and/or changing the way this job is performed, provided that such accommodation does not pose an undue hardship. Capgemini is committed to providing reasonable accommodation during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.

Please be aware that Capgemini may capture your image (video or screenshot) during the interview process and that image may be used for verification, including during the hiring and onboarding process.

Click the following link for more information on your rights as an Applicant in the United States.

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, generative AI, cloud and data, combined with its deep industry expertise and partner ecosystem.

Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Senior Machine Learning Systems Engineer, LLM Inference Performance on AWS Trainium in Toronto, ON vacancy
  • $100k - $145k per year

     ...Job Description As a Machine Learning Engineer, you will build and deploy production machine learning and large language model (LLM) systems that extract actionable insights from complex legal documents and data. You will work on challenging natural language processing problems... 
    Senior
    Performance
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Thomson Reuters

    Toronto, ON
    15 days ago
  • $160k - $200k per year

     ...Description Wiser Solutions is hiring a Senior ML Engineer to help build our customer-facing AI...  ...than a slide deck. You'll own ML systems end to end, from idea to experiment to production...  ...systems, embedding-based retrieval, and LLM-powered features on AWS  ~ Own the... 
    Amazon Web Service
    Senior
    Performance
    Work at office
    Local area
    Worldwide

    Wiser Solutions

    Toronto, ON
    15 days ago
  • $180k per year

     ...want to help shape how Canadians buy, sell, and own cars. Learn more at clutch.ca . About the role: Every car Clutch...  ...it’s one of the first things they compare. We’re hiring a Senior Machine Learning Engineer to help build the framework behind those decisions, from what... 
    Senior
    Performance
    Permanent employment
    Full time
    Internship
    Work at office
    3 days per week

    Clutch Technologies Inc.

    Toronto, ON
    4 days ago
  • $170k - $250k per year

     ...for TD Bank Group. We develop and deploy industry-leading machine learning systems that impact the lives of over 27 million customers, helping...  ...to be at the cutting edge of machine learning in research, engineering, and impactful applications. We are looking for world-class... 
    Senior
    Performance
    Full time
    Temporary work
    Work from home

    TD

    Toronto, ON
    3 days ago
  • $187.5k - $261k per year

     ...Lifecycle (PDLC). Enable software engineers, quality engineers,...  ...and/or infrastructure areas, senior technical leadership in support...  ...agentic workflows and multi-agent systems; design tool-calling and MCP...  ...continuous process / performance improvements where opportunities... 
    Senior
    Performance
    Long term contract
    Permanent employment
    Full time
    Temporary work
    Work from home

    TD Bank

    Toronto, ON
    7 days ago
  • $149.6k - $187k per year

     ...modern ML utilizing peta-byte scale data. Our highly motivated Machine Learning Engineers work on these challenging problems and define solutions to...  ...environment, we are searching for you. We are seeking a Senior Machine Learning Engineer to join the Rider Applied AI team... 
    Senior
    Performance
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft

    Toronto, ON
    6 days ago
  • $186.1k - $265.8k per year

     ...About the Role: The Machine Learning team at Tubi drives the innovation behind personalized user experiences.  With the largest...  ...of streaming. We are seeking a highly skilled Senior Machine Learning Engineer to contribute to transformative projects in video personalization... 
    Senior
    Performance
    Remplacement
    Long term contract
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Flexible hours

    Tubi - Canada

    Toronto, ON
    6 days ago
  • $94.43k - $144.43k per year

     ...capabilities. We are seeking an innovative and experienced Machine Learning Engineer to join our AI + Data team, a cross-functional group...  ...insurance claims, digital transactions, and more, building systems that enhance the end-to-end customer experience. This is... 
    Performance
    Long term contract
    Temporary work
    Internship
    Local area
    Flexible hours

    Manulife

    Toronto, ON
    12 days ago
  • $400k per year

     ...Job Description: Position: Machine Learning Engineer Location: Remote / Hybrid Employment Type: Full-time Responsibilities Design, train...  ..., and optimization. Work with large-scale datasets, perform feature engineering, data cleaning, and model tuning. Develop... 
    Amazon Web Service
    Performance
    Full time
    Remote work
    Relocation

    MS Systems

    Toronto, ON
    2 days ago
  •  ...The Senior Machine Learning Engineer will deploy, integrate, monitor, and operationalize AI and machine-learning solutions using modern MLOps practices. The role will establish reusable deployment patterns, tooling, monitoring, and automation that enable AI solutions to move... 
    Senior
    Performance

    P@thlion Staffing Careers

    Toronto, ON
    18 days ago
  • $140k - $250k per year

     ...individuals for a variety of positions, ranging from junior to senior levels, and will evaluate your application in its entirety....  ...for TD Bank Group. We develop and deploy industry-leading machine learning systems that impact the lives of over 27 million customers, helping... 
    Amazon Web Service
    Senior
    Performance
    Full time
    Temporary work
    Work from home

    TD

    Toronto, ON
    3 days ago
  •  ...smarter marketing through AI-powered automation, intelligent systems, and advanced optimization. We've pioneered cutting-edge...  ...enterprise-scale ML operations. We are looking for a Staff Machine Learning & AI Engineer to lead the engineering architecture of our multi-agent AI... 
    Amazon Web Service
    Senior
    Work at office
    Remote work
    Work from home
    Flexible hours
    2 days per week
    3 days per week

    HelloFresh

    Toronto, ON
    6 days ago
  • $100k - $145k per year

     ...support our evolving business needs. Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to...  ...responsible for productionizing, optimizing, and scaling AI and LLM workloads that power TR’s AI driven products. This role... 
    Amazon Web Service
    Senior
    Performance
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Toronto, ON
    15 days ago
  • $140k - $175k per year

     ...We bring together scientists, engineers, and domain experts to explore...  ...fiduciary-grade AI. The Thomson LLM model family was developed by...  ..., Thomson Reuters' custom inference platform. Mariner serves every...  ...rather than inheriting a fixed system. Collaborate with research... 
    Senior
    Performance
    Full time
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    1 day ago
  •  ...to democratize AI. Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI Enterprise Transformation...  ...Type: Remote, Full-time Role Overview We’re hiring a Senior Machine Learning Engineer to architect, build, and deploy high-performance... 
    Senior
    Performance
    Full time
    Contract work
    Local area
    Remote work
    Worldwide

    Fusemachines

    Toronto, ON
    23 days ago
  •  ...We are looking for a Machine Learning Engineer to join our Toronto team and help us take our products to the next level in terms of visual intelligence...  ...record of building, shipping, and maintaining production ML systems. The position includes working on projects that expand... 
    Performance
    Full time
    Internship
    Manual labor
    Work at office
    3 days per week

    Invision AI

    Toronto, ON
    more than 2 months ago
  • $135k - $185k per year

     ...We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop algorithms and optimizations for our LPX inference and compiler stack. You will work at the intersection of large-scale systems, compilers, and deep learning... 
    Senior
    Performance
    Full time

    Nvidia

    Toronto, ON
    14 days ago
  • $45 - $70 per hour

     ...collaborate with top researchers and engineers in the field. We provide...  ...Lead initiatives to scale AI systems for production environments, ensuring performance and reliability across use cases....  ...Science, Artificial Intelligence, Machine Learning, or a related technical... 
    Performance
    Hourly pay
    Internship
    Work at office
    Local area

    Cresta

    Toronto, ON
    6 days ago
  • $168k - $231k per year

     ...to life. We collaborate closely with the Machine Learning team and various product teams to ensure...  ...:  As a Staff Machine Learning Engineer on the Generative AI team, you will help...  ...implementation of production-ready AI/ML systems at scale: ranging from LLM-powered features... 
    Amazon Web Service
    Performance
    Local area
    Worldwide

    Okta

    Toronto, ON
    10 hours ago
  •  ...you belong on #TeamBell. Summary We are looking for a Machine Learning Engineer, Marketing to join our team. In this role, you will be responsible...  ...working in secure corporate cloud environments (eg. GCP, AWS, Azure) Experience with constrained optimization models and... 
    Amazon Web Service
    Full time
    Work at office
    3 days per week

    Bell

    Toronto, ON
    12 days ago
  •  ...and work with algorithms that learn and analyze data, just like the...  ...brain. By leveraging AI and machine learning technologies, you'll...  ...experienced Machine Learning Engineering Developer II to join our team....  ...specify preferred platforms, e.g., AWS, Azure, GCP).  Design,... 
    Amazon Web Service
    Performance
    Full time
    Work at office
    3 days per week

    Bell

    Toronto, ON
    12 days ago
  • $170.84k - $220.84k per year

     ...users around the world and 300 billion ideas saved, Pinterest Machine Learning engineers build personalized experiences to help Pinners create a life...  ...vault of data and contribute large-scale recommendation systems in ways you won’t find anywhere else.   What you’ll do:... 
    Work at office
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Toronto, ON
    13 days ago
  •  ...Expectations: Design and implement deep learning architectures for 3D volumetric medical...  ...Qualifications: 7+ years of experience in machine learning, with substantial work in...  ...impactful research (publications, deployed systems, or equivalent demonstrations of technical... 
    Senior

    Altis Labs, Inc.

    Toronto, ON
    12 days ago
  • $156.5k - $190k per year

     ...opportunities to improve how work is performed, decisions are supported,...  ..., patterns, methods and learning that increase Risk's ability to...  ...sustainable and reusable. This senior individual contributor leads technical...  ...player-coach to other Applied Machine Learning Scientists and... 
    Senior
    Performance
    Full time
    Work from home

    TD

    Toronto, ON
    11 hours ago
  •  ..., and Payments organizations are excited to offer Master's machine learning engineering internships for the summer of 2027. This is an exceptional...  ...Responsibilities Develop and deploy large-scale machine learning systems that drive significant business value across various... 
    Summer work
    Internship
    Summer internship

    Stripe

    Toronto, ON
    6 days ago
  •  ...About Thri5 Thri5 is the AI-powered System of Actions for the modern retailer....  ...closing the gap between plan and real-world performance. Our vision is to become the trusted...  ...investors. Your Role As an AI / Machine Learning Engineer at Thri5, you'll help build... 
    Performance
    Full time

    Thri5 Inc.

    Toronto, ON
    21 days ago
  •  ...users around the world and 400 billion ideas saved, Pinterest Machine Learning engineers build personalized experiences to help Pinners create a life...  ...vault of data and contribute large-scale recommendation systems in ways you won’t find anywhere else. What you’ll do:... 
    Senior
    Local area
    Remote work
    Relocation
    Relocation package

    Pinterest

    Toronto, ON
    13 days ago
  • $125.5k - $154k per year

     ...looking for a highly motivated Applied Machine Learning Scientist to join our AI2 team. In this...  ...models for use cases such as: Agentic AI, LLM-based models, Pricing, Anomaly Detection...  ...testing, and monitoring to ensure model performance, fairness, and stability in production... 
    Performance
    Full time
    Work from home

    TD

    Toronto, ON
    11 hours ago
  •  ...applying Agentic AI, Generative AI, and Machine Learning to solve complex problems across retail media...  ..., and optimization, we're building AI systems that deliver meaningful business impact at scale. We're looking for an Engineering Manager, Agentic AI & Machine Learning to... 
    Long term contract
    Permanent employment
    Full time
    Temporary work
    Internship

    Loblaw Companies Limited

    Toronto, ON
    8 days ago
  • $118.8k - $148.5k per year

     ...end AI agents for safety case management, systems that reason over complex, high-stakes...  ...together ML, data, backend, and product engineers alongside data scientists and operations...  ...partners to transform these systems. As a Machine Learning Engineer on the SCC team, you will fine-... 
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft

    Toronto, ON
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Machine Learning Systems Engineer, LLM Inference Performance on AWS Trainium. Be the first to apply!