Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Systems Engineer Serverless Distributed Computing

$127k - $225k per year
Full-time

Huawei Technologies Canada Co.,

Job description

Huawei Canada has an immediate permanent opening for a Software Engineer.

About the team: 

The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.


About the job:

  • Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).

  • Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.

  • Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.

  • Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.

  • Contribute thought leadership through innovation, technical presentations, and patent generation.

  • Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.

The total target annual compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.

Job requirements

About the ideal candidate:

  • PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.

  • Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.

  • Proven expertise in one or more of the following areas:

    o AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.

    o Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.

  • Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.

  • Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.

  • Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.

  • Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.

Additional Information:

Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.

All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.

All done!

Your application has been successfully submitted!

You've already applied for this job

We appreciate your interest in this position. Unfortunately, you have already applied for this job.

Vacancy posted 11 hours ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer Serverless Distributed Computing in Markham, ON vacancy
  • $106k - $156k per year

     ...Researcher. About the team:  The Distributed Data Storage and Management Lab...  ...research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure...  ...technologies for Huawei's global AI infrastructure. About the... 
    Suggested
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    23 days ago
  • $106k - $156k per year

     ...Researcher. About the team:  The Distributed Data Storage and Management Lab...  ...research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure...  ...technologies for Huawei's global AI infrastructure. About the... 
    Suggested
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    more than 2 months ago
  • $58k - $104k per year

     ...internship opening for a Research Engineer. About the Team: The...  ...implement high-scalability AI Agent pipelines, transforming...  ...Master’s or Bachelor’s Degree in Computer Science or a highly...  ...focus on AI, Software Engineering Systems, or Distributed Systems. Proficient... 
    Suggested
    Long term contract
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    11 hours ago
  •  ...Canada has a 12/16-month Co-op opening for a Software Engineer. About the team: The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and... 
    Suggested
    Internship

    Huawei Technologies Canada Co.

    Markham, ON
    11 hours ago
  • $124.2k - $174.2k per year

     ...Company: Qualcomm Canada ULC Job Area: Engineering Group, Engineering Group ASICS Engineering General Summary:...  ...leadership in wireless connectivity, high-performance, low-power computing, and on-device AI, we’re powering the connected intelligent edge. We are... 
    Suggested
    Full time
    Work from home

    Qualcomm

    Markham, ON
    11 hours ago
  • Support dependent system, design, and software teams implementing Edge AI platform solutions. Leverage experience in DSP,...  ...learning algorithms, SoC hardware and computer architecture concepts to develop...  ...support and customer engineering documentation Defining and patenting... 
    Full time

    Qualcomm

    Markham, ON
    11 hours ago
  • $124.2k - $174.2k per year

     ...Company: Qualcomm Canada ULC Job Area: Engineering Group, Engineering Group ASICS...  ...with the other NPU components to accelerate AI machine learning, video and other dsp applications...  ...New Grad Bachelors - Engineering, Computer Engineering Understanding of digital... 
    Full time
    Work from home

    Qualcomm

    Markham, ON
    11 hours ago
  •  ...VP. About the team: The Computing Data Application Acceleration...  ...interconnection protocols for AI/general computing scenarios, in...  ...software framework. Implement system-level innovative solutions centered...  ..., big data, search and push, distributed database, and other... 
    Long term contract
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    a month ago
  • $58k - $104k per year

     ...has an immediate co-op opening for an Engineer. About the team: Founded in 2012...  ...and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving. About...  ...role, you will not only build robust systems but also pioneer the use of AI agents... 
    Long term contract
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    11 hours ago
  • $165k - $210k per year

     ...Senior Systems Engineer – Avionics Location: Lindsay, Ontario, Canada (Hybrid) Employment Type: Full-time Salary Range: CAD...  ...system integration of avionics systems, including flight control computers, communication and navigation equipment, displays, sensors,... 
    Full time

    Essence Coaching Group

    Markham, ON
    11 hours ago
  • $165k - $210k per year

     ...Senior Systems Engineer Location: Lindsay, Ontario, Canada (Hybrid) Employment Type: Full-time Salary Range: CAD 165,000 – 210,000 gross/year About the Role A senior-level Systems Engineer is sought to lead aircraft- and system-level engineering... 
    Long term contract
    Full time

    Essence Coaching Group

    Markham, ON
    11 hours ago
  •  ...Description Your role at GEI.   GEI is seeking an AI Engineer Intern/Co-op to support the growth of GEI’s AI Center of Excellence...  ...Minimum Qualifications Currently pursuing a Bachelor’s degree in Computer Science, Software Engineering, Computer Engineering, Machine... 
    Part time
    Internship
    Summer holiday
    Work at office
    10 hours per week
    Flexible hours

    Gei Consultants, Inc.

    Markham, ON
    11 hours ago
  •  ...permanent opening for a Principal Engineer. About the team: Established in 2014, the Distributed Scheduling and Data Engine Lab...  ...About the job: Integrate AI frameworks with cloud infrastructure...  ...inference framework and storage system. ~ Proficient in Kubernetes or... 
    Permanent employment
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    11 hours ago
  •  ...non-university certificate or diploma from a program of 1 year to 2 years ~ Tasks ~ Evaluate and install computer hardware, networking software and operating system software ~ Provide problem-solving services to network users ~ Implement data, software and hardware... 
    Permanent employment
    Part time
    Local area
    Relocation

    Accusonic Corporation

    Markham, ON
    14 hours ago
  • $165k - $210k per year

     ...Senior Systems Engineer – Electric Propulsion Location: Lindsay, Ontario, Canada (Hybrid) Employment Type: Full-time Salary...  ...systems, including motors, inverters, motor controllers, and power distribution units. You will be a key driver in defining system-level... 
    Full time

    Essence Coaching Group

    Markham, ON
    11 hours ago
  •  ...NETINT Technologies is a pioneer of computational storage and video processing SoC solutions...  ...opportunities. Job Scope As a System Engineer, you are responsible for the...  ...Qualifications MS or BS in Electrical/Computer Engineering or equivalent Years of experiences... 
    Permanent employment
    Full time

    Netint Technologies Inc.

    Markham, ON
    11 hours ago
  •  ...great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and...  ...is looking for a specialized Principal level engineer who is passionate about enabling innovative and... 
    Full time
    Internship

    AMD

    Markham, ON
    7 days ago
  • $127k - $225k per year

     ...contract opening for a Research Engineer. About the team: The...  ...consumer, embedded and enterprise computing platforms by building security...  ...the most challenging system and data security problems, analyzing...  ...hardware security, data security, ai agent security, advancement of... 
    Contract work
    Internship
    Immediate start
    Worldwide
    Shift work

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    10 days ago
  • $114.4k - $164.4k per year

     ...Qualcomm Canada ULC Job Area: Engineering Group, Engineering Group...  ...As a member of Low Power AI solution team, you will play...  ...offs. Develop and optimize computational graphs, including operator fusion...  ...working across modeling, systems, and low-level execution layers... 
    Full time
    Work from home

    Qualcomm

    Markham, ON
    11 hours ago
  •  ...opening for a Principal Software Engineer. About the team: Established in 2014, the Distributed Scheduling and Data Engine Lab...  ...areas include cloud multi-agent system, cloud native databases, infrastructure...  ..., and scale next-generation AI Multi-Agent systems to enable... 
    Permanent employment
    Immediate start
    Overseas

    Huawei Technologies Canada Co.,

    Markham, ON
    11 hours ago
  • $131.2k - $181.2k per year

     ...Qualcomm Canada ULC Job Area Engineering Group, Engineering Group Machine...  ...Qualifications ~ Bachelor's degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of...  ...hardware and software. AI’s ability to solve complex problems... 
    Full time
    Work from home

    Qualcomm

    Markham, ON
    28 days ago
  • $125k - $174.5k per year

     ...applications. (New Head Count) AI Disclosure: As part of...  .... As a Senior AI/ML Engineer in the Embodied AI Data Foundations...  ..., long-tail and out-of-distribution scenario discovery - to raise...  ...bring models into onboard driving systems, and document learnings and best... 
    Full time
    Local area
    Work from home

    General Motors

    Markham, ON
    4 days ago
  •  ...the lab strives to advance human-computer interaction research. Our team includes researchers, engineers, and designers collaborating...  ...disciplines to develop novel interactive systems, sensing technologies, wearable...  ...-end vision for next-generation AI agent–native multimodal... 
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    4 days ago
  • $127k - $225k per year

     ...permanent opening for a Research Engineer. About the team: The Intelligent Complex Systems Team, currently a part of the Waterloo...  ...in artificial intelligence (AI) and robotics to determine its potential...  ...candidate: A PhD degree in Computer Science, Software Engineering,... 
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    27 days ago
  • $127k - $225k per year

     ...Lab unites global researchers, engineers, and designers to redefine...  ...research. We focus on agentic AI and multimodal interaction (voice...  ...integrating sensing, algorithms, and systems, our prototype driven work...  ...AI, and next-generation computing platforms. Research the evolution... 
    Long term contract
    Contract work
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    19 days ago
  •  ...become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction...  ...currently seeking a  Telecommunications and Electronic Security Systems Engineering Intern  for a new position based in our  Markham /... 
    Internship
    Work at office
    Local area
    Worldwide
    Relocation package
    Flexible hours

    AECOM

    Markham, ON
    18 days ago
  •  ...Qualcomm Canada ULC Job Area: Engineering Group, Engineering Group...  ...Shape the future of low power AI subsystems. Push the boundaries...  ...premium tiers of the mobile, compute, automotive, and IoT markets,...  ...Implement modules and sub-systems and integrate IP from other teams... 
    Full time

    Qualcomm

    Markham, ON
    11 hours ago
  •  ...company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving. About the job:...  ...solutions into the broader autonomous driving system. Mentor and guide junior engineers and interns, fostering a collaborative and innovative... 
    Long term contract
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    4 days ago
  • $67 - $77 per hour

     ...Senior Insurance Test Engineer (Regulatory Systems) Take part in insurance technology initiatives focused on regulatory compliance software testing automation and quality assurance. Collaborate with Agile teams on business-critical projects involving SQL validation and... 
    Hourly pay
    Full time
    Contract work

    Recrute Action

    Markham, ON
    11 days ago
  • $90.1k - $186.2k per year

     ...nCompany:\n\nQualcomm Canada ULC\n\n## Job Area:\n\nEngineering Group, Engineering Group \u003e ASICS Engineering\n\nGeneral Summary:\n\nWhat we are doing has not been done. \n\nShape the future of low power AI subsystems.\n\nPush the boundaries on features and performance.\n\... 
    Full time
    Internship
    Work from home

    Qualcomm

    Markham, ON
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Systems Engineer Serverless Distributed Computing. Be the first to apply!