Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Gpu Infrastructure

$175k - $325k per year

Vector Institute

Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this team?Internal Infrastructure builds the infrastructure and tools used to train, evaluate, and serve Cohere's foundation models. You will work with AI researchers and ML engineers on stability, scalability, and observability. The work accelerates the models behind Cohere's platform, North.
You will run the shared Kubernetes fleets those workloads land on: multi-cloud GPU and TPU clusters, node health, performance, and the partnership with cloud providers and hardware vendors. The role includes a compensated 24x7 on-call rotation.
What you will do
Deploy and operate GPU Kubernetes clusters across clouds, and bring up new hardware generations and providers.
Work with cloud providers and hardware partners on reliability, performance, and cost, including RDMA and high-speed interconnects.
Automate node, GPU, and fabric fault detection and remediation so most faults are fixed without a human.
Improve fleet utilization, track cost, and cut the time it takes to get a faulty node back into service.
Troubleshoot production failures and performance problems, and leave the system easier to operate than you found it.
We hire at more than one level. We set level based on the scope you’ve owned and how independently you drive work.
You may be a good fit if you have
Run GPU Kubernetes clusters with thousands of GPUs for ML or HPC workloads.
Debugged Linux, networking, and performance problems. Familiarity with RDMA, NCCL, or accelerator health is a plus.
Written software in Python or Go. You would rather extend a solid open-source project than rebuild it.
Worked with researchers, ML engineers, or another team whose goals were not identical to yours.
Found a bottleneck, proposed a fix, and driven it in a fast-moving environment.
If this does not line up exactly with your experience, we still encourage you to apply.
Full-Time Employees at Cohere enjoy these Perks:
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work:
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all;
we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn’t limit the applications our recruiters may review or consider.
Compensation Range: $175K - $325K
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Software Engineer, Gpu Infrastructure in Winnipeg, MB vacancy
  • $94.5k - $227.2k per year

     ...unique platform requires expertise across a range of fields: software engineering, data science, biology, chemistry, protein engineering, circuit...  ...parallel DNA sequencing, we need you! Responsibilities Develop GPU-accelerated software targeted for real-time primary analysis... 
    Suggested
    Relocation package

    Roche

    Winnipeg, MB
    1 hour ago
  • Develop GPU compiler software for Intel AI platforms in Toronto, combining systems programming with modern compiler infrastructure under a hybrid work model. Contribute to technologies enabling...  ...execution.As an Experienced Hire Compiler Engineer, you will build software for Triton... 
    Suggested

    Intel Corporation

    Winnipeg, MB
    1 hour ago
  • $180k - $360k per year

     ...Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable...  ...Spark Capital. Join us and help build the platform engineers turn to ship AI products. The RoleWe’re seeking a GPU Kernel Engineer to join our team at the... 
    Suggested
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...speeds; over 10 times faster than GPU-based hyperscale cloud inference...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and optimize...  ...software stack, and rack-scale AMD GPU infrastructure, to make this new serving path... 
    Suggested

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...inference. Customers bring their own models, and we run them as fast, reliable production endpoints on GPU servers across many sites. We are a small team of about five engineers. The role You will own how new GPU servers become ready for customers: from racks at a... 
    Suggested
    Internship
    Remote work

    PolarGrid

    Winnipeg, MB
    1 hour ago
  • Own GPU fleet readiness at PolarGrid, using bare-metal automation and hardware diagnostics to deliver reliable production nodes across multiple datacenters.As a senior infrastructure engineer, you will prepare multi-GPU servers for customer workloads and maintain their health... 
    Remote work

    PolarGrid

    Winnipeg, MB
    1 hour ago
  • Build machine learning software in Markham, Ontario, using C++ and Python to optimize GPU kernels, workloads, and next-generation computing platforms onsite.Sapphire...  ...Stream Technology seeks a Machine Learning Software Engineer focused on GPU and AI optimization. You will... 

    Sapphire Stream Technology

    Winnipeg, MB
    1 hour ago
  • Lead the forefront of DNA sequencing technology as a Senior GPU Software Engineer with Roche. Collaborate on pioneering software solutions for real-time data analysis. Roche invites applications for a Senior GPU Software Engineer to elevate our unique nanopore platform.... 

    Roche

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...applied AI research, flexible infrastructure, and seamless developer...  ...and help build the platform engineers turn to ship AI products.About...  ...foundational engineers to lead our GPU Networking efforts, making...  ...configuration to architect the software fabric that unifies thousands... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  •  ...Electronic Arts is seeking a Lead Infrastructure Engineer to own the GPU fleet our researchers train on, including capacity, scheduling, diagnostics, and support. You will set technical direction for GPU operations and infrastructure architecture, and lead Infrastructure as... 
    3 days per week

    Electronic Arts

    Winnipeg, MB
    1 hour ago
  • Where you will have an impactAs an Embedded Kernel Engineer within our dynamic team, you'll be instrumental in deploying Wayve's autonomous...  ...crafting high-performance kernels for efficient inferencing on embedded GPU environments. Through close collaboration with machine learning... 
    Hourly pay
    Full time
    Work at office
    Work from home

    Wayve

    Winnipeg, MB
    1 hour ago
  • $169.5k - $242.6k per year

     ...more players to participate in creative expression by making creation easier, safer, and more rewarding. As Lead Infrastructure Engineer, you will own the GPU fleet our researchers train on including capacity, scheduling, diagnostics, and support. You will set technical... 
    Remplacement
    Full time
    Work at office
    Local area
    3 days per week

    Electronic Arts

    Winnipeg, MB
    1 hour ago
  • A leading semiconductor company in Markham is seeking a Software Development Engineer to focus on innovative AI software features. The role involves validating and releasing software, contributing to open-source AI projects, and creating technical resources for developers.... 
    Full time

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    1 hour ago
  • $169k - $396.36k per year

     ...office Flexible PTO Quarterly team offsites What We're Looking ForWe’re looking for an experienced backend engineer to build out the infrastructure required to rapidly scale up our engineering organization. Built self-hosted Elasticsearch infrastructure on Kubernetes... 
    Internship
    Work at office
    Flexible hours

    Wilco

    Winnipeg, MB
    1 hour ago
  •  ...of the greatest threats AI presents: mass‑manufactured social engineering. Countless scams, deepfakes, and other social engineering attacks...  ...looking for an experienced backend engineer to build out the infrastructure required to rapidly scale up our engineering organization. A... 
    Internship
    Work at office
    Flexible hours

    Wilco

    Winnipeg, MB
    1 hour ago
  •  ...KeycardAt Keycard, we're building identity and access infrastructure for the agent-native era, where software isn't static but a dynamic, constantly changing...  ...Heroku. The RoleWe're hiring two staff-level Software Engineers, Infrastructure to own how Keycard is built, shipped... 
    Internship
    Remote work

    KeyCard

    Winnipeg, MB
    1 hour ago
  • $165k - $330k per year

     ...Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable...  ...Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEAs an Infrastructure Software Engineer at Baseten, you'll build and... 
    Flexible hours

    Baseten

    Winnipeg, MB
    1 hour ago
  • $153.91k - $217.28k per year

     ...are seeking a skilled and experienced GPU Validation Engineer to join our dynamic team. This role...  ...You will apply various hardware and software tools and techniques to ensure comprehensive...  ...GPU features using validation infrastructure.Develop post-silicon validation infrastructure... 
    Local area
    Immediate start
    Shift work

    Intel Corporation

    Winnipeg, MB
    1 hour ago
  •  ...Canada or United StatesFocus: GPU Compilers, Graphics,...  ...OptimizationTalentLab is recruiting GPU Compiler Engineers at multiple levels to join a team developing the software and compiler technology behind...  ...:LLVM or similar compiler infrastructure.GPU architecture and... 

    Talentlab

    Winnipeg, MB
    1 hour ago
  •  ...customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate...  ...experience running production infrastructure at a large scale ~ Experience designing...  ...distributed systems with Kubernetes, and GPU workloads on those clusters ~ Experience... 
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    Winnipeg, MB
    1 hour ago
  •  ...over 10 times faster than GPU-based hyperscale cloud inference...  ...monitor, and optimize cloud infrastructure to support CI workloads, balancing...  ...developer velocity and engineering productivity. Contribute to...  ...a DevOps, infrastructure, or software engineering role. Familiarity... 

    Cerebras

    Winnipeg, MB
    1 hour ago
  •  ...Mozilla in Toronto is seeking aGraphics Engineer to maintain and advance Firefox’s Graphics area, including rendering, compositing, images, canvas, and WebGL. You will help keep the graphics code healthy and scalable in a large, mature codebase. You will diagnose cross‑platform... 
    Contract work

    Mozilla

    Winnipeg, MB
    1 hour ago
  • Software Engineer: Agent Infrastructure Backend / Distributed Systems · Toronto, Canada · Full-timeDesign and build the execution fabric, scheduling,...  ...distributed compute: job schedulers and workflow orchestration engines; on-prem cluster management and deployment;... 

    AgentField.ai

    Winnipeg, MB
    1 hour ago
  • Why this role? We’re building the data infrastructure behind some of the most demanding AI training workloads in the world, and we want...  ...teams rely on for training and evaluation jobs.As a Software Engineer, Data Infrastructure, you will Work directly on petabyte‑... 
    Full time
    Work at office
    Flexible hours

    Cohere

    Winnipeg, MB
    1 hour ago
  • Build robust orchestration systems and developer tooling for Auth0’s platform infrastructure in a hybrid work model serving global identity operations.As a Software Engineer II, you will help develop the Control Server, APIs, and CLI tools managing environments on AWS and Azure... 

    Okta Inc.

    Winnipeg, MB
    1 hour ago
  • Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud... 

    Databricks Inc.

    Winnipeg, MB
    1 hour ago
  • Strengthen scalable applications and processing infrastructure as an Associate Software Engineer using server-side development, SQL, and AWS.This Associate Software Engineer role focuses on outcomes, customer impact, and reliable technology. You will independently own large-... 

    Justworks, Inc.

    Winnipeg, MB
    1 hour ago
  •  ...regulators around the world. About the Role As a Senior Software Engineer, you will play a key role in driving projects from implementation...  ...design, deploy, and manage distributed systems using cloud infrastructure. Expertise in troubleshooting and debugging large codebases... 
    Flexible hours

    d1g1t Inc.

    Winnipeg, MB
    1 hour ago
  • $135.2k - $258k per year

    About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies...  ...customer churn.What you'll do As an engineer on the team, you'll be responsible for...  ...2+ years of experience in backend software developmentAbility to write high-quality... 
    Contract work
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Relocation

    Stripe, Inc.

    Winnipeg, MB
    1 hour ago
  • $140k - $180k per year

     ...evidence-based platform. We are well-funded and have engineering offices in New York City, Toronto, and Vancouver.We are looking for an experienced Software Engineer to design, implement, and maintain our infrastructure solutions. The ideal candidate will have a strong background... 
    Work at office
    Local area

    Owl.co

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Gpu Infrastructure. Be the first to apply!