Gpu Cloud Platform Engineer
Yotta Labs
Join to apply for the
GPU Cloud Platform Engineer
role at
Yotta Labs .
About Yotta LabsYotta Labs is pioneering the development of a Decentralized Operating System (DeOS) for AI workload orchestration at a planetary scale. Our mission is to democratize access to AI resources by aggregating geo-distributed GPUs, enabling high-performance computing for AI training and inference on a wide spectrum of hardware—from commodity to high-end GPUs. Our platform supports major large language models (LLMs) and offers customizable solutions for new models, facilitating elastic and efficient AI development.
Role OverviewWe are seeking a GPU Cloud Platform Engineer to join our core infrastructure team and help build the next-generation AI compute cloud. In this role, you will design, deploy, and operate large-scale, multi-cluster GPU infrastructure across data centers and cloud environments. You will be responsible for ensuring high availability, performance, and efficiency of containerized AI workloads—ranging from LLMs to generative models—deployed in Kubernetes-based GPU clusters.
Responsibilities
Build and operate large-scale, high-performance GPU clusters;
ensure stable operationof compute, network, and storage systems;
monitor and troubleshoot online issues.
Conduct performance testing and evaluation of multi-node GPU clusters using standard benchmarking tools to identify and resolve performance bottlenecks.
Deploy and orchestrate large models (e.G., LLMs, video generation models) across multi-cluster environments using Kubernetes;
implement elastic scaling and cross-cluster load balancing to ensure efficient service response under high concurrency for global users.
Participate in the design, development, and iteration of GPU cluster scheduling and optimization systems. Define and lead Kubernetes multi-cluster configuration standards;
optimize scheduling strategies (e.G., node affinity, taints/tolerations) to improve GPU resource utilization.
Build a unified multi-cluster management and monitoring system to support cross-region resource monitoring, traffic scheduling, and fault failover. Collect key metrics such as GPU memory usage, QPS, and response latency in real time;
configure alert mechanisms.
Coordinate with IDC providers for planning and deploying large-scale GPU clusters, networks, and storage infrastructure to support internal cloud platforms and external customer needs.
Qualifications
Bachelor's degree or higher in Computer Science, Software Engineering, Electronic Engineering, or related fields;
3+ years of experience in system engineering or DevOps.
5+ years of experience in cloud-native development or AI engineering, with at least 2 years of hands-on experience in Kubernetes multi-cluster management and orchestration.
Familiarity with the Kubernetes ecosystem;
hands-on experience with tools such as kubectl, Helm, and expertise in multi-cluster deployment, upgrade, scaling, and disaster recovery.
Proficient in Docker and containerization technologies;
knowledge of image management and cross-cluster distribution.
Experience with monitoring tools such as Prometheus and Grafana;
has practical experience in GPU fault monitoring and alerting.
Hands-on experience with cloud platforms such as AWS, GCP, or Azure;
understanding of cloud-native multi-cluster architecture.
Experience with cluster management tools such as Ray, Slurm, KubeSphere, Rancher, Karmada is a plus.
Familiarity with distributed file systems such as NFS, JuiceFS, CephFS, or Lustre;
ability to diagnose andresolve performance bottlenecks.
Understanding of high-performance communication protocols such as IB, RoCE, NVLink, and PCIe.
Strong communication skills, self-motivation, and team collaboration.
Preferred Experience
Experience in developing and operating MaaS platforms or large-scale model inference clusters. Proven track record of leading multi-cluster system development or performance optimization projects.
Proficiency in CUDA programming and the NCCL communication library;
understanding of high-performance GPUs like H100.
Ability to develop standardized inference APIs (RESTful/gRPC) and automation tools using Golang or Python.
Hands-on experience with optimization techniques such as model quantization, static compilation, and multi-GPU parallelism;
capable of profiling inference processes in multi-cluster setups and identifying bottlenecks like memory fragmentation and low compute efficiency.
Active engagement with open-source communities such as Hugging Face and GitHub;
deep understanding of the design principles of inference frameworks like Triton, vLLM, and SGLang;
ability to perform secondary development and optimization based on open-source projects and quickly translate cutting-edge techniques into production-ready multi-cluster solutions.
Why Join Yotta Labs?
Be part of a visionary team aiming to redefine AI infrastructure.
Work on cutting-edge technologies that bridge AI and decentralized computing.
Collaborate with experts from leading institutions and tech companies.
Enjoy a flexible, remote work environment that values innovation and autonomy.
How to ApplyInterested candidates should apply directly or send their resume and a brief cover letter to View email address on ca.hrm.tc. Please include links to any relevant projects or contributions.
Apply: View email address on ca.hrm.tc
Location: Remote (Global)
Type: Full-time
#J-18808-Ljbffr
GPU Cloud Platform Engineer
role at
Yotta Labs .
About Yotta LabsYotta Labs is pioneering the development of a Decentralized Operating System (DeOS) for AI workload orchestration at a planetary scale. Our mission is to democratize access to AI resources by aggregating geo-distributed GPUs, enabling high-performance computing for AI training and inference on a wide spectrum of hardware—from commodity to high-end GPUs. Our platform supports major large language models (LLMs) and offers customizable solutions for new models, facilitating elastic and efficient AI development.
Role OverviewWe are seeking a GPU Cloud Platform Engineer to join our core infrastructure team and help build the next-generation AI compute cloud. In this role, you will design, deploy, and operate large-scale, multi-cluster GPU infrastructure across data centers and cloud environments. You will be responsible for ensuring high availability, performance, and efficiency of containerized AI workloads—ranging from LLMs to generative models—deployed in Kubernetes-based GPU clusters.
Responsibilities
Build and operate large-scale, high-performance GPU clusters;
ensure stable operationof compute, network, and storage systems;
monitor and troubleshoot online issues.
Conduct performance testing and evaluation of multi-node GPU clusters using standard benchmarking tools to identify and resolve performance bottlenecks.
Deploy and orchestrate large models (e.G., LLMs, video generation models) across multi-cluster environments using Kubernetes;
implement elastic scaling and cross-cluster load balancing to ensure efficient service response under high concurrency for global users.
Participate in the design, development, and iteration of GPU cluster scheduling and optimization systems. Define and lead Kubernetes multi-cluster configuration standards;
optimize scheduling strategies (e.G., node affinity, taints/tolerations) to improve GPU resource utilization.
Build a unified multi-cluster management and monitoring system to support cross-region resource monitoring, traffic scheduling, and fault failover. Collect key metrics such as GPU memory usage, QPS, and response latency in real time;
configure alert mechanisms.
Coordinate with IDC providers for planning and deploying large-scale GPU clusters, networks, and storage infrastructure to support internal cloud platforms and external customer needs.
Qualifications
Bachelor's degree or higher in Computer Science, Software Engineering, Electronic Engineering, or related fields;
3+ years of experience in system engineering or DevOps.
5+ years of experience in cloud-native development or AI engineering, with at least 2 years of hands-on experience in Kubernetes multi-cluster management and orchestration.
Familiarity with the Kubernetes ecosystem;
hands-on experience with tools such as kubectl, Helm, and expertise in multi-cluster deployment, upgrade, scaling, and disaster recovery.
Proficient in Docker and containerization technologies;
knowledge of image management and cross-cluster distribution.
Experience with monitoring tools such as Prometheus and Grafana;
has practical experience in GPU fault monitoring and alerting.
Hands-on experience with cloud platforms such as AWS, GCP, or Azure;
understanding of cloud-native multi-cluster architecture.
Experience with cluster management tools such as Ray, Slurm, KubeSphere, Rancher, Karmada is a plus.
Familiarity with distributed file systems such as NFS, JuiceFS, CephFS, or Lustre;
ability to diagnose andresolve performance bottlenecks.
Understanding of high-performance communication protocols such as IB, RoCE, NVLink, and PCIe.
Strong communication skills, self-motivation, and team collaboration.
Preferred Experience
Experience in developing and operating MaaS platforms or large-scale model inference clusters. Proven track record of leading multi-cluster system development or performance optimization projects.
Proficiency in CUDA programming and the NCCL communication library;
understanding of high-performance GPUs like H100.
Ability to develop standardized inference APIs (RESTful/gRPC) and automation tools using Golang or Python.
Hands-on experience with optimization techniques such as model quantization, static compilation, and multi-GPU parallelism;
capable of profiling inference processes in multi-cluster setups and identifying bottlenecks like memory fragmentation and low compute efficiency.
Active engagement with open-source communities such as Hugging Face and GitHub;
deep understanding of the design principles of inference frameworks like Triton, vLLM, and SGLang;
ability to perform secondary development and optimization based on open-source projects and quickly translate cutting-edge techniques into production-ready multi-cluster solutions.
Why Join Yotta Labs?
Be part of a visionary team aiming to redefine AI infrastructure.
Work on cutting-edge technologies that bridge AI and decentralized computing.
Collaborate with experts from leading institutions and tech companies.
Enjoy a flexible, remote work environment that values innovation and autonomy.
How to ApplyInterested candidates should apply directly or send their resume and a brief cover letter to View email address on ca.hrm.tc. Please include links to any relevant projects or contributions.
Apply: View email address on ca.hrm.tc
Location: Remote (Global)
Type: Full-time
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Gpu Cloud Platform Engineer in Winnipeg, MB vacancy
- ...ThinkOn Inc. is seeking a Cloud Platform Engineer to deploy, manage VMware VCF 9.x environments with GPU-enabled clusters and multi-tenant Gov workloads at Protected B level. You will ensure secure operations, IaC automation, and robust observability across core and edge...SuggestedRemote work
- Build security platforms for NVIDIA DGX Cloud’s massive GPU clusters through API-driven services, policy automation, and Kubernetes expertise. Shape scalable controls for AI infrastructure.This Senior Security Engineer develops security products into seamless components of...Suggested
- A pioneering tech company is seeking a GPU Cloud Platform Engineer to join their team. This full-time role involves designing and operating extensive GPU infrastructure for AI workloads in cloud environments. The ideal candidate has a Bachelor's degree in Computer Science and...SuggestedFull timeRemote workFlexible hours
$110k - $125k per year
...000.00 Annually ThinkOn is seeking a skilled and motivated Cloud Platform Engineer to support the deployment, management, and ongoing... ...multi-tenant VMware Cloud Foundation (VCF) 9.x environments with GPU integration and edge deployments. This platform supports government...SuggestedPermanent employmentRemote workFlexible hours$165k - $330k per year
...Spark Capital. Join us and help build the platform engineers turn to ship AI products.About Baseten... ...turn to ship AI products.THE ROLE Join Cloud Platform Engineering to own the Kubernetes... ...operate, reduce configuration drift, and bring GPU capacity online seamlessly to power the...SuggestedInternshipFlexible hours- ...Electronic Arts is seeking a Lead Infrastructure Engineer to own the GPU fleet our researchers train on, including capacity, scheduling, diagnostics, and support. You will set technical direction for GPU operations and infrastructure architecture, and lead Infrastructure as...3 days per week
- ...will have an impactAs an Embedded Kernel Engineer within our dynamic team, you'll be instrumental... ...for efficient inferencing on embedded GPU environments. Through close collaboration... ...hardware capabilities of various deployment platforms. Your deep understanding of GPU...Hourly payFull timeWork at officeWork from home
$165k - $330k per year
...Series F, led by Altimeter Capital, Conviction Partners, and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEAs a Cloud Platform Engineer, you'll envision and build robust systems and processes that ensure our infrastructure...Flexible hours- ...businesses that power our economy, this could be your next big opportunity.We can’t wait to get to know you!The Work The Cloud Platform Engineer is responsible for all aspects of our Kubernetes and Docker containers. He/she will be responsible for production support, administration...Hourly payPermanent employmentFull timeInternshipWork at office
- ...businesses that power our economy, this could be your next big opportunity. We can't wait to get to know you! The WorkThe Cloud Platform Engineer is responsible for all aspects of our Kubernetes and Docker containers. He/she will be responsible for production support, administration...Hourly payPermanent employmentFull timeInternshipWork at office
$125k - $140k per year
Requisition Number: 106441Cloud Platform Engineer You will have the flexibility to work fully remotely.Insight at a Glance 14,000+ engaged... ...in 2024 by Insight globallyAbout the Role As a Cloud Platform Engineer, you will focus on project delivery across Azure...Local areaRemote work$169.5k - $242.6k per year
...and connect. And increasingly, the biggest entertainment platforms aren't just places to consume content — they're places where... ..., safer, and more rewarding. As Lead Infrastructure Engineer, you will own the GPU fleet our researchers train on including capacity, scheduling...RemplacementFull timeWork at officeLocal area3 days per week$140.6k - $190.6k per year
About the role You'll own the Azure platform that Thomson Reuters product engineering teams build on: the infrastructure... ...in Key Vault, drive Defender for Cloud and Defender for Containers... ...experienceInfrastructure for AI/ML workloads — GPU capacity planning, Azure OpenAI,...Work at officeLocal areaFlexible hours- ThinkOn is seeking a Cloud Platform / Site Reliability Engineer to operate, automate, monitor, and improve our private cloud and Kubernetes platforms.The... ...object storage, and logging and observability platforms.GPU & AI Infrastructure Support GPU-enabled infrastructure...Long term contractPermanent employmentRemote workFlexible hours
- Shape BMO Financial's cloud platform engineering from Toronto in a hybrid, full-time position requiring AWS expertise and technical leadership.This Lead DevOps Engineer role focuses on evolving enterprise platforms, toolchains, and engineering standards. You will design AWS...Full time
- Join our Observability team as a motivated Platform Engineer focused on optimizing cloud-native and hybrid applications. Utilize your expertise in observability tools and strategies to enhance application reliability in public and private cloud environments. This role requires...
- ...1984, we started out as a team of three engineers. Today, we have grown to become a global... ...who manage them. Our powerful, AI infused platform provides full transparency and visibility... ...Orchestration, Declarative Automation - The Cloud Platform Engineering Team is responsible...Work at officeRemote work
- Cloud Platform Engineer – KubernetesLocation: Toronto, ON Position OverviewMyticas Consulting is seeking an experienced Cloud Platform Engineer – Kubernetes to support enterprise cloud infrastructure, container platforms, and application engineering teams. This...
- ...Data Warehouse SE to evolve our data platform from Hadoop to a cloud-native Lakehouse built on Apache Iceberg. You will focus on platform engineering, running large-scale data infrastructure... ..., metadata governance, and multi-engine data access. Join a team delivering PB...
- Own assigned data assets and improve platform reliability at 360insights through cloud data engineering, pipeline operations, and AI-supported development practices. Work from Whitby, Canada.The hands-on, mid-level Data Platform Engineer builds, maintains, and enhances 360insights...
- AWS Cloud Platform Engineer – Azure & AutomationJob#: 3012787 Client: Big Five Bank.Terms: Contract through October 2026.Location: Hybrid twice a month is preferred with an office in Downtown Toronto; however, open to remotefor the right candidate with EST working hours...Contract workWork at office
- Drive cloud platform releases in Toronto using Azure, Helm, and Terraform. Coordinate deployment windows while strengthening secure operational delivery.TD is seeking a DevOps Engineer within Technology Solutions to support release engineering across non-production and production...
- ...inference, automating deployments and strengthening reliability. Work closely with users operationalizing machine learning.As a Cloud Platform Engineer, you will design and maintain systems supporting machine learning model deployment and operation. You will establish...
- Join Bally’s Intralot as a Data Cloud Platform Engineer (DBA) - AWS InfrastructureAt Bally’s Intralot, we shape the future of gaming through innovation... ...Aurora (MySQL/PostgreSQL), self-managed DBs on EC2.Database Engines: MySQL, PostgreSQL, Oracle, SQL Server (one or more)....Worldwide
- Diseña plataformas cloud fiables con Kubernetes y Terraform como Platform Engineer híbrido en Manulife, con sede referenciada en Waterloo, Ontario. Automatiza infraestructura para aplicaciones modernas.Como Platform Engineer, trabajarás con infraestructura cloud, orquestaci...
- ...Description and RequirementsRole OverviewIn this role, you will join Lenovo’s UDS Cloud platform team and help build scalable cloud services and applications. You will work with engineers to develop APIs, microservices, event-driven systems, and automation that support Lenovo...InternshipLocal area
- ...are certified to ISO/IEC 27001:2022, reflecting our commitment to protecting data and managing risk.The Role The Head of Cloud Platform Engineering owns the operations and component-level architecture of Flui's AWS cloud estate - the infrastructure that underpins software...Hourly pay
$180k per year
...DescriptionWe are seeking an experienced and motivated engineer to join the Observability fleet which... ...on delivering tools in private and public cloud environments. The role focuses on developing and modernizing Observability platforms for cloud-native and hybrid applications,...16 hoursContract workWork at office$103k - $153k per year
...workersJob summary: The IT Enterprise Architecture, Network, Cloud and Data Platform Group at HOOPP is committed to delivering meaningful... ...to the Sr. Manager, Cloud Platform, the Sr. Cloud Platform Engineer will be responsible for designing, maintaining and supporting...Long term contractPermanent employmentImmediate start- ...NVIDIA Corporation is hiring a Senior Security Engineer for Infrastructure Security Engineering focused on DGX Cloud. You will design and build security primitives for massive GPU clusters, automate policy enforcement, and implement guardrails across a distributed, hybrid cloud...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gpu Cloud Platform Engineer. Be the first to apply!
Related searches
- cloud operations engineer Winnipeg, MB
- junior cloud engineer Winnipeg, MB
- cloud network engineer Winnipeg, MB
- cloud engineer Winnipeg, MB
- associate cloud engineer Winnipeg, MB
- entry level cloud engineer Winnipeg, MB
- cloud engineer remote Winnipeg, MB
- cloud security engineer
- cloud operations engineer
- google cloud architect

