Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AIDC GPU Server Cluster Operations Engineer

GLOBAL INNOVATIVE SOLUTIONS INC.

Job Description

Job Description

1. Job Overview

 

We are looking for an experienced GPU Data Center Operations Engineer to manage and maintain our AI computing infrastructure deployed in a third-party colocation data center in Canada.

 

The successful candidate will be responsible for the daily operation, monitoring, maintenance, and troubleshooting of approximately 72 GPU servers, ensuring high availability and stable performance of our GPU computing infrastructure.

 

This role focuses on server-level hardware and software operations, GPU cluster maintenance, and coordination with the third-party data center operator. The candidate will work closely with our overseas operations team and internal technical team.

 

2. Key Responsibilities

 

A. GPU Server Operations & Maintenance

 

l Perform daily inspections and routine maintenance of 72 GPU servers.

 

l Monitor GPU health, utilization, temperature, power consumption, memory, CPU, storage, and network status.

 

l Maintain server hardware, including GPUs, CPUs, memory, storage, power supplies, and network components.

 

l Coordinate server installation, rack deployment, cabling, and hardware replacement with the data center operator.

 

l Maintain accurate hardware inventory, serial numbers, and equipment records.

 

B. Hardware Troubleshooting & Incident Management

 

l Diagnose and troubleshoot GPU server hardware failures and system abnormalities.

 

l Identify and resolve common issues involving GPUs, memory, storage, power supplies, and network connectivity.

 

l Coordinate hardware repairs, RMA processes, and warranty claims with hardware vendors.

 

l Maintain incident logs, troubleshooting records, and maintenance reports.

 

l Respond to critical incidents and coordinate timely resolution with relevant technical teams.

 

C. Linux & GPU Infrastructure Management

 

l Perform Linux server administration, system configuration, and routine maintenance.

 

l Install, configure, and maintain NVIDIA GPU drivers, CUDA, and related software environments.

 

l Use NVIDIA-SMI and other monitoring tools to monitor GPU health and performance.

 

l Assist with GPU cluster deployment, validation, and performance troubleshooting.

 

l Support software updates, system upgrades, and infrastructure optimization.

 

D. Data Center Coordination

 

l Act as the technical point of contact with the third-party colocation data center.

 

l Coordinate remote hands services, on-site technical assistance, server access, and maintenance activities.

 

l Monitor and report issues related to rack power, PDU, cooling, temperature, and network connectivity.

 

l Ensure all maintenance activities comply with data center security and operational procedures.

 

l Coordinate service requests and escalate infrastructure-related issues to the data center operator.

 

E. Reporting & Cross-functional Collaboration

 

l Prepare regular infrastructure health reports and GPU utilization reports.

 

l Maintain documentation of hardware status, incidents, repairs, and maintenance activities.

 

l Work closely with the company's overseas operations and internal engineering teams.

 

l Support new hardware deployment, infrastructure expansion, and equipment acceptance.

 

3. Qualifications

 

l 3+ years of experience in server operations, data center operations, or IT infrastructure support.

 

l Strong knowledge of Linux system administration and troubleshooting.

 

l Hands-on experience with GPU servers and enterprise server hardware.

 

l Familiarity with NVIDIA GPU architecture, GPU drivers, CUDA, and NVIDIA-SMI.

 

l Experience diagnosing hardware issues involving GPUs, memory, storage, CPUs, and power supplies.

 

l Understanding of data center infrastructure, including rack systems, PDU, power distribution, cooling, and networking.

 

l Good English communication skills and ability to coordinate with local data center operators and hardware vendors.

 

l Strong troubleshooting, communication, and problem-solving skills.

 

l Ability to work independently and handle urgent operational incidents.

 

4. Preferred Qualifications

 

l Experience maintaining NVIDIA H100, H200, or other high-performance GPU servers.

 

l Experience with large-scale AI computing infrastructure or GPU clusters.

 

l Knowledge of InfiniBand, RoCE, Mellanox/NVIDIA ConnectX networking.

 

l Familiarity with Kubernetes, Docker, or Slurm.

 

l Experience with GIGABYTE, Supermicro, Dell, or HPE enterprise servers.

 

l Previous experience working in a colocation data center environment in Canada.

 

l Availability for occasional after-hours maintenance and emergency incident response.

Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the AIDC GPU Server Cluster Operations Engineer in Mississauga, ON vacancy
  • $17.95 per hour

     ...Server Servers lead the Guest Experience at the table and ensure our Guests have everything they need from appitizers to desserts.  Masters of situational service, they tailor their style to meet the needs of our Guests . Servers are responsible for the accuracy of the... 
    Suggested
    Hourly pay
    Work at office
    Local area
    Flexible hours
    Mississauga, ON
    2 days ago
  •  ...let's create a future of financial empowerment. The Data Operations Engineer is responsible for supporting, maintaining, and continuously...  ...services across Azure Databricks, Azure Data Factory (ADF), SQL Server, Enterprise Data Warehouse (EDW), and Managed File Transfer (SFTP... 
    Suggested
    Work at office
    Flexible hours
    3 days per week

    goeasy

    Mississauga, ON
    19 days ago
  •  ...Job Description Job Description Lago Restaurant and Bar is hiring a highly skilled Cocktail Server and Food Waiter Are you passionate about delivering exceptional service and creating memorable dining experiences? Join Lago Restaurant and Bar, a premier destination known... 
    Suggested
    Full time
    Part time
    Monday to friday
    Night shift
    Day shift

    Lago Restaurant and Bar

    Mississauga, ON
    3 days ago
  •  ...Are you passionate about hospitality and providing memorable dining experiences? As a Server at Chartwell, you’ll play a key role in creating a warm, welcoming atmosphere where residents and guests enjoy high-quality food and service. Your attention to detail, friendly demeanor... 
    Suggested

    Chartwell Retirement Residences

    Mississauga, ON
    11 days ago
  •  ...Staffmax is helping our client hire multiple Banquet Servers for a 2-week event-based contract. If you enjoy working in hospitality and want to be part of special events, this short-term opportunity could be perfect for you. Contract Length: 2 Weeks  Location: Mississauga... 
    Suggested
    Contract work
    Temporary work
    Part time
    Flexible hours
    Shift work
    Weekend work
    Afternoon shift

    Staffmax Staffing & Recruiting

    Mississauga, ON
    17 days ago
  •  ...put Culture first because we believe it produces results and, more importantly, changes lives.   Compass is recruiting for an Operations Engineer, an individual contributor and resident technical expert supporting facility engineering, commissioning, troubleshooting, and... 
    Remplacement
    Full time
    For contractors
    Work visa

    Compass Datacenters

    Mississauga, ON
    20 days ago
  •  ...Job Description Job Description We are seeking a Server Cashier to become an integral part of our team! You will be responsible for selling products, merchandise, and services in a retail setting in order to drive company revenue. Responsibilities: Welcome and identify... 

    Lauraj Holdings Inc

    Mississauga, ON
    5 days ago
  •  ...Job Description Job Description Job Description: As a CNC Laser Operator, you will be responsible for operating CNC laser cutting machines to produce high-quality parts according to specifications. The role also requires able to read blue prints and drawing. Key Responsibilities... 

    Unity Recruitments Inc.

    Mississauga, ON
    16 days ago
  •  ...can show this not only produces results, but more importantly, can change lives.     Compass is recruiting for a Principal, Operations Engineer, an individual contributor and senior technical expert supporting high-level facility engineering, commissioning, troubleshooting... 
    Remplacement
    Full time
    For contractors
    Live out
    Work visa

    Compass Datacenters

    Mississauga, ON
    20 days ago
  • $29.57 per hour

     ...Mississauga Campus (UTM) invites qualified candidates to apply for an Operating Engineer Trainee I position in the Facilities Management and Planning...  ...afforded the opportunity to gain valuable experience in the operation and maintenance of our boiler plant and the HVAC systems in... 
    Hourly pay
    Full time
    Traineeship
    Local area

    University of Toronto

    Mississauga, ON
    11 days ago
  • $19.25 per hour

    Job Description: DINING ROOM SERVER Amica City Centre Casual $19.25 Established in 1996, Amica Senior Lifestyles operates over 30 senior living residences in British Columbia and Ontario, while continuing to grow in select markets. We offer Independent Living (IL)... 
    Long term contract
    Casual work
    Internship
    Shift work

    Amica Senior Lifestyles

    Mississauga, ON
    a month ago
  •  ...in the country. Our customers operate in some of Canada's most critical...  ...workflows. As a Technical Engineer your role will focus on designing...  ...working with Windows, MS SQL Server, SQL Server AlwaysOn, networks, Active Directory, server clustering, scripting tools, Microsoft... 
    Remplacement
    Full time

    Sectra AB

    Mississauga, ON
    5 days ago
  •  ...What you will do: The Server or Server Assistant will be responsible for providing high-levels of guest service to all restaurant patrons by providing prompt service, taking accurate orders, and maintaining a strong working knowledge of all menu items and daily specials.... 
    Hourly pay
    Remplacement
    Internship
    Seasonal work
    Flexible hours

    Cineplex Entertainment LP

    Mississauga, ON
    11 days ago
  •  ...cloud-based solutions mobile apps for Android or iOS middle tier server software or backend database components. Our fundamental...  ...the world depend on us to secure manage and support their mobile operations with millions of devices managed worldwide. SOTIs two decades of... 
    Full time
    Temporary work
    Internship
    Worldwide
    Night shift

    SOTI

    Mississauga, ON
    7 days ago
  •  ...experienced, detail-oriented Sr Data Engineer to join their platform...  ...re-implementing existing SQL Server stored procedure logic into PySpark...  ...types, skew handling, and cluster compute parameters. Idempotency...  ..., including MERGE/upsert operations, incremental loads, schema evolution... 
    Contract work
    Internship
    Remote work

    Randstad Canada

    Mississauga, ON
    11 days ago
  •  ...Why Valvoline Global Operations?   At Valvoline Global Operations , we’re proud to be The Original Motor Oil , but we’ve never...  ...s degree in science, environmental health and safety, quality, engineering technology, operations, or a related discipline preferred; equivalent... 
    For contractors
    Internship
    Work at office
    Immediate start

    Valvoline Global

    Mississauga, ON
    11 days ago
  •  ...Position Purpose Ensure the safe and efficient operation, monitoring, and maintenance of refrigeration systems, warehouse equipment, and...  ...related duties as assigned. Desired Profile ~ Stationary Engineer “A” - Refrigeration Licence Class A or Class B. ~ Experience... 
    Shift work
    Weekend work

    Congebec

    Mississauga, ON
    11 hours ago
  •  ...About the Role As a Machine Operator you will work within our Production and Maintenance...  ...at our facilities, and work to ensure operation downtime is kept to a minimum along with...  ...Education in Mechanical or Electro-Mechanical Engineering Diploma or equivalent, or relevant... 
    Shift work
    Night shift
    Afternoon shift

    HelloFresh

    Mississauga, ON
    5 days ago
  • $120k per year

     ...technical skills and careers paths. Job Description Lead Operations. Drive Innovation. Deliver Life-Changing Therapies. Are you...  ...? We are seeking a Manager, Drug Product Operations & Engineering to lead our Drug Product Operations team and play a critical role... 
    Full time
    Contract work
    Internship
    Immediate start

    Eurofins Canada BioPharma

    Mississauga, ON
    1 day ago
  •  ...market and consumer research; full concept development; design and engineering capabilities; testing, validation and world-class manufacturing...  ...are developed from consumer research, finding the ease of operation to be comfortable, convenient and connected. Job Responsibilities... 
    Full time
    Local area

    Magna International

    Mississauga, ON
    11 days ago
  • $120k per year

     ...Eurofins CDMO Alphora seeks an experienced pharmaceutical operations manager to lead drug product manufacturing and engineering teams. The role encompasses operational oversight, technical leadership, process optimization, and client partnership across cGMP clinical supply... 

    Eurofins

    Mississauga, ON
    1 day ago
  • $128.85k - $171.8k per year

     ...globally recognized technology group and investor/operator focused on AI, robotics, and next-generation computing...  ...a local unit(s), encompassing the full scope of operations, including project management and control, engineering, production, order administration, procurement,... 
    Local area

    CARBT ABB Robotics Canada Inc.

    Mississauga, ON
    11 days ago
  • $25.36 - $29.8 per hour

     ...: Cosma provides a comprehensive range of body, chassis and engineering solutions to global customers. Through our robust product engineering...  ...up equipment and machinery as required. Responsible for the operation of presses. Perform and document Quality Assurance first-off... 
    Hourly pay
    Permanent employment
    Full time
    Work at office
    Local area
    Immediate start

    Magna International

    Mississauga, ON
    11 days ago
  • $81.6k - $115.2k per year

     ...activities.  Follow documented operational procedures and processes with...  ...tools such as VMware Aria Operations, Dynatrace, and Intersight to...  ..., UCS C-Series and B-Series servers, and blade chassis.  Expert...  ...DRS, vMotion, vSphere HA, host clusters, datastore clusters, and... 
    Work from home

    TD Bank

    Mississauga, ON
    11 days ago
  • $19.5 per hour

     ...Intersection: Derry & Airport * half hour lunch deducted / 7.5 hours a day* Required experience - At least two year of experience operating a forklift - Possess a valid Counterbalance operator license - Able to understand and follow instructions. - Desire to work... 
    Permanent employment
    Shift work

    the Staffing Guys

    Mississauga, ON
    1 day ago
  • $80k - $90k per year

     ...sustainability. What Makes This Role Great: Front Lines of Energy Operations: Operate distributed energy resources (DERs), Battery Energy...  ...generation operations. ~ Degree or diploma in Electrical Engineering, Power Engineering, or a related technical field. Work... 
    Long term contract
    Full time
    Work at office
    Local area
    Shift work
    Night shift
    Rotating shift

    Rodan Energy Solutions Inc.

    Mississauga, ON
    2 days ago
  •  ...for cancer. How will you make an impact? Manage the Process Engineering team and provides leadership and technical direction and...  ...commercial batches, assistance in the pre-commercial lots run by Operations and technical support for the execution of Pharmaceutical Development... 
    Contract work
    Internship
    Work at office
    Shift work

    Thermo Fisher Scientific

    Mississauga, ON
    5 days ago
  • $92.2k - $115.25k per year

     ...matters. With over 6,500 employees, we operate more than 80 manufacturing and distribution...  ...continuous improvement across our operations building a culture where efficiency, quality...  ...Are Looking For ~ Bachelor’s degree in Engineering, Business, Operations Management, or a... 
    Long term contract

    Oldcastle BuildingEnvelope

    Mississauga, ON
    1 day ago
  •  ...Job Description Job Description Leading Edge National Staffing is currently hiring Forklift Operators for a full time opportunity in Mississauga. Afternoon Shift - 3:00pm - 12:00am Mon-Fri 40 hours a week full time Starting ASAP If you are interested, please... 
    Full time
    Immediate start
    Monday to friday
    Afternoon shift

    Leading Edge National Staffing

    Mississauga, ON
    18 days ago
  • $96k - $141k per year

     ...with approximately 10,000 team members. We operate sites in 20+ locations across Canada. We...  ...The Opportunity: As the Manager, Operations Learning, you will build the learning strategy...  ...Excellence, FSQA, Supply Chain, Engineering and Asset Reliability, translating enterprise... 
    Full time
    Temporary work
    Part time

    Maple Leaf Foods Inc.

    Mississauga, ON
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AIDC GPU Server Cluster Operations Engineer. Be the first to apply!