Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Systems Engineer Serverless Distributed Computing

$127k - $225k per year
Full-time

Huawei Technologies Canada Co.,

Job description

Huawei Canada has an immediate permanent opening for a Software Engineer.

About the team: 

The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.


About the job:

  • Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).

  • Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.

  • Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.

  • Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.

  • Contribute thought leadership through innovation, technical presentations, and patent generation.

  • Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.

The total target annual compensation for this position ranges from $127,000 to $225,000 depending on education, experience, and demonstrated expertise.

Job requirements

About the ideal candidate:

  • PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.

  • Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.

  • Proven expertise in one or more of the following areas:

    o AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.

    o Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.

  • Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.

  • Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.

  • Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.

  • Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.

Additional Information:

Huawei Canada is committed to a fair, inclusive, and accessible recruitment process. If you require accommodation during any stage of the hiring process, please let us know and we will work with you to meet your needs.

All applications for this position are reviewed directly by our hiring team, we do not use artificial intelligence tools to screen or select candidates.

All done!

Your application has been successfully submitted!

You've already applied for this job

We appreciate your interest in this position. Unfortunately, you have already applied for this job.

Vacancy posted more than 2 months ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer Serverless Distributed Computing in Markham, ON vacancy
  • $58k - $104k per year

     ...internship opening for a Research Engineer. About the Team: The...  ...implement high-scalability AI Agent pipelines, transforming...  ...Master’s or Bachelor’s Degree in Computer Science or a highly...  ...focus on AI, Software Engineering Systems, or Distributed Systems. Proficient... 
    Suggested
    Long term contract
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    more than 2 months ago
  • $127k - $225k per year

     .... About the team: The Computing Data Application Acceleration...  ...About the job: Frontier AI Technology Research Track the...  ...algorithmic and hardware innovations on system performance and provide...  ...D. in Artificial Intelligence Computer Architecture Computer Systems... 
    Suggested
    Long term contract
    Contract work
    Internship
    Immediate start

    Huawei Technologies Canada Co.

    Markham, ON
    1 day ago
  •  ...performance of information and communication system networks Research, design and develop...  ...components Lead and co-ordinate teams of engineers, technologists, technicians and drafters in the design and development of computer and telecommunications hardware Research... 
    Suggested
    Permanent employment

    ESKADO TECHNOLOGIES

    Markham, ON
    8 days ago
  • $127k - $225k per year

     ...Lab unites global researchers engineers and designers to redefine human...  ...research. We focus on agentic AI and multimodal interaction (...  ...integrating sensing algorithms and systems our prototype driven work...  ...advance research directions in computer vision spatial perception and... 
    Suggested
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co.

    Markham, ON
    1 day ago
  • $124.2k - $174.2k per year

     ...Company: Qualcomm Canada ULC Job Area: Engineering Group, Engineering Group ASICS...  ...with the other NPU components to accelerate AI machine learning, video and other dsp applications...  ...New Grad Bachelors - Engineering, Computer Engineering Understanding of digital... 
    Suggested
    Full time
    Work from home

    Qualcomm

    Markham, ON
    19 days ago
  •  ...VP. About the team: The Computing Data Application Acceleration...  ...interconnection protocols for AI/general computing scenarios, in...  ...software framework. Implement system-level innovative solutions centered...  ..., big data, search and push, distributed database, and other... 
    Long term contract
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    a month ago
  •  ...next generation of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling...  ...forward. The Role AMD is seeking a Server Systems Assembly Manufacturing Engineer to drive manufacturing excellence for our growing Data... 
    Contract work
    Internship

    AMD

    Markham, ON
    14 hours ago
  • $106k - $156k per year

     ...Lab unites global researchers, engineers, and designers to redefine...  ...research. We focus on agentic AI and multimodal interaction (voice...  ...integrating sensing, algorithms, and systems, our prototype driven work...  ...Conduct advanced research in computer vision focusing on 2D/3D scene... 
    Contract work
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    9 days ago
  • $58k - $104k per year

     ...has an immediate co-op opening for an Engineer. About the team: Founded in 2012...  ...and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving. About...  ...role, you will not only build robust systems but also pioneer the use of AI agents... 
    Long term contract
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    more than 2 months ago
  •  ...permanent opening for a Principal Engineer. About the team: Established in 2014, the Distributed Scheduling and Data Engine Lab...  ...About the job: Integrate AI frameworks with cloud infrastructure...  ...inference framework and storage system. ~ Proficient in Kubernetes or... 
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    more than 2 months ago
  • $106k - $156k per year

     ...Lab unites global researchers engineers and designers to redefine human...  ...research. We focus on agentic AI and multimodal interaction (...  ...integrating sensing algorithms and systems our prototype driven work...  ...Masters or PhD degree in Human-Computer Interaction Cognitive Science... 
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co.

    Markham, ON
    1 day ago
  • $99.5k - $149.3k per year

     ...Qualcomm Canada ULC Job Area: Engineering Group, Engineering Group...  ...models or train models AI’s ability to solve complex problems...  ...C++17 code for an embedded system Development of model...  ...Qualifications: • Bachelor's degree in Computer Science, Engineering,... 
    Full time
    Work from home

    Qualcomm

    Markham, ON
    19 days ago
  • $58k - $104k per year

     ...immediate co-op opening for an Engineer. About the team:...  ...an international open source AI Agent community building infrastructure...  ..., Evaluation, and Multi-Agent systems. The total target annual...  ...Master's, or Ph.D. degree in Computer Science or a related field.... 
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    19 days ago
  •  ...Job Description Summary The DCS Engineer is a key technical resource directly supporting...  ...but not limited to Digital Control Systems (DCS) Distribution Automation Process Bus Digital...  ...controller units auxiliary relays industrial computers synchronizing clocks telecom equipment... 
    Full time
    Work at office
    Remote work
    Relocation package

    GE Vernova

    Markham, ON
    22 days ago
  • $120k - $130k per year

    Job Description: Senior Software Engineer (AI Integration & Modernization) Jonas Software...  ...capabilities into legacy and cloud systems, and turn complex problems into reliable...  ...working with databases, and developing distributed systems. ~Exposure to AI/LLM-based systems... 
    Worldwide

    Urban Ridge Supplies

    Markham, ON
    1 day ago
  •  ...connectivity, server colocation, cloud computing, telephony and outsourced IT...  ...workloads. • Monitor system performance, troubleshoot...  ...related to infrastructure systems engineering. • Identify opportunities...  ...: • Bachelor’s degree in computer science, Information Technology... 
    Permanent employment
    Full time
    Remote work

    Pathway Communications

    Markham, ON
    a month ago
  •  ...opening for a Principal Software Engineer. About the team: Established in 2014, the Distributed Scheduling and Data Engine Lab...  ...areas include cloud multi-agent system, cloud native databases, infrastructure...  ..., and scale next-generation AI Multi-Agent systems to enable... 
    Permanent employment
    Full time
    Immediate start
    Overseas

    Huawei Technologies Canada Co.,

    Markham, ON
    more than 2 months ago
  • $58k - $104k per year

     ...Canada has an immediate internship opening for an Engineer. About the team:  The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases... 
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    a month ago
  •  ...Job Responsibility: Distribution Team Lead at Pacific Smoke International Inc. On-Site (Daily) Do you believe that a company's success...  ...volume, productivity, and KPIs. Document user errors in the system to address and prevent future occurrences. Collaborate with... 
    Work visa
    Monday to friday
    Shift work
    Day shift

    Pacific Smoke International Inc

    Markham, ON
    8 days ago
  •  ...Job Description Job Description L3 Network/ Linux Systems Engineer Responsibilities Being escalation point for a variety of change requests...  ...for use in lab environment *Experience using agentic AI tools, deploying self-hosted LLM to improve workflows/increase... 
    Internship
    Worldwide

    Nextologies Limited

    Markham, ON
    more than 2 months ago
  • $108k - $158k per year

     ...Qualcomm Canada ULC Job Area Engineering Group, Engineering Group...  ...Shape the future of low power AI subsystems. Push the boundaries...  ...premium tiers of the mobile, compute, automotive, and IoT markets,...  ...Implement modules and sub-systems and integrate IP from other teams... 
    Work from home

    Qualcomm

    Markham, ON
    9 days ago
  • $106k - $156k per year

     ...Canada has an immediate permanent opening for an Engineer. About the team:  The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases... 
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    27 days ago
  • $127k - $225k per year

     ...permanent opening for a Research Engineer. About the team: The Intelligent Complex Systems Team, currently a part of the Waterloo...  ...in artificial intelligence (AI) and robotics to determine its potential...  ...candidate: A PhD degree in Computer Science, Software Engineering,... 
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    14 days ago
  • $90.1k - $186.2k per year

     ...nCompany:\n\nQualcomm Canada ULC\n\n## Job Area:\n\nEngineering Group, Engineering Group \u003e ASICS Engineering\n\nGeneral Summary:\n\nWhat we are doing has not been done. \n\nShape the future of low power AI subsystems.\n\nPush the boundaries on features and performance.\n\... 
    Full time
    Internship
    Work from home

    Qualcomm

    Markham, ON
    more than 2 months ago
  • $127k - $225k per year

     ...contract opening for a Research Engineer. About the team: The...  ...consumer, embedded and enterprise computing platforms by building security...  ...the most challenging system and data security problems, analyzing...  ...hardware security, data security, ai agent security, advancement of... 
    Contract work
    Internship
    Immediate start
    Worldwide
    Shift work

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    a month ago
  •  ...description Huawei Canada has an immediate permanent opening for a Distinguished Software IDE Engineer. About the team: Software IDE innovation Lab is building an AI Native IDE for efficient work, we have our own IDE and a series of enterprise-level intelligent tools... 
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    more than 2 months ago
  •  ...the lab strives to advance human-computer interaction research. Our team includes researchers, engineers, and designers collaborating...  ...disciplines to develop novel interactive systems, sensing technologies, wearable...  ...-end vision for next-generation AI agent–native multimodal... 
    Permanent employment
    Full time
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    20 days ago
  •  ...company's products and services, including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving. About the job:...  ...solutions into the broader autonomous driving system. Mentor and guide junior engineers and interns, fostering a collaborative and innovative... 
    Long term contract
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Markham, ON
    21 days ago
  • $93k - $104k per year

     ...month internship opening for an AI Agent Intern Researcher....  ...foundation models, and intelligent systems, combining technology insight,...  ...: Pursuing a Ph.D. in Computer Science, Artificial Intelligence...  ...Understanding of AI systems, distributed infrastructure, robotics, or embodied... 
    Long term contract
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Markham, ON
    more than 2 months ago
  •  ...creating the world's leading AI-powered, -native solutions for...  ...Businesses more scalable, and Systems more resilient. We combine human...  ...include other Software Engineers and are held to ensure a high...  ...interfaces. Experience with cloud computing platforms (AWS/Azure/Google/IBM... 
    Full time
    Flexible hours

    IBM

    Markham, ON
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Systems Engineer Serverless Distributed Computing. Be the first to apply!