Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Fleet Platform Software Engineer

Cerebras

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

The Role

Cerebras operates AI clusters across a growing number of data centers. As the fleet expands, the software used to monitor and manage it must scale with it. We are seeking a senior software engineer to build the platforms and tools that help our teams understand fleet health, respond to issues, and keep compute capacity available.

You will own substantial engineering work across backend services, operational tools, and user-facing applications. You will partner with Cluster Operations, infrastructure, inference, security, and data center teams to turn real operational challenges into software that works reliably at scale.

Responsibilities

  • Build and operate software for managing large fleets of AI clusters
  • Give operators clear, actionable views of cluster health, capacity, performance, and ongoing issues.
  • Develop services and integrations that bring together data and workflows from multiple infrastructure systems.
  • Automate repetitive work and improve the tools teams use to investigate incidents and restore service.
  • Design systems that remain reliable as the fleet grows and continue to function through component and site failures.
  • Work closely with users of the platform to understand their needs and make practical product and engineering decisions.
  • Lead projects from initial design to production, measure their impact, and use operational feedback to guide improvements.

Skills And Requirements

  • 12+ years of industry experience building and operating production distributed systems or large-scale infrastructure software.
  • Strong Go skills. You will work with Go, Protocol Buffers, and SQL regularly. Python experience is an added benefit.
  • Experience building control planes, fleet management systems, or operational platforms.
  • Experience designing APIs and data models that serve multiple consumers, with a considered approach to versioning and compatibility.
  • Experience building asynchronous systems that support idempotency, concurrency, and reconciliation while preventing unintended state drift.
  • A strong testing practice, especially for software that can change the state of running production clusters.
  • Experience with Linux, containers, and Kubernetes.
  • Experience with durable workflow execution, event streaming, or time-series telemetry at high cardinality.
  • Sound judgment about reliability, security, and observability, including how a system behaves when its dependencies are unavailable.
  • Ability to take an ambiguous problem from design through production and improve the solution using operational feedback.

Preferred Experience

  • Building infrastructure software for thousands of hosts across multiple sites.
  • Developing software for incident response, hardware health, or capacity management.
  • Deploying and operating services on AWS.
  • Working with AI or HPC clusters and their compute, networking, and hardware systems.
  • Developing dashboards or applications for infrastructure operators.

Location

  • SF Bay Area.
  • Toronto, Canada.

Why Join Cerebras

About

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

  • Build a breakthrough AI platform beyond the constraints of the GPU.
  • Publish and open source their cutting-edge AI research.
  • Work on one of the fastest AI supercomputers in the world.
  • Enjoy job stability with startup vitality.
  • Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here !

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Fleet Platform Software Engineer in Toronto, ON vacancy
  • Join Cerebras Systems as a Senior Software Engineer specializing in AI fleet platform development. This role focuses on managing AI clusters and enhancing operational efficiency across platforms. As a senior engineer at Cerebras, you'll drive innovation in fleet management... 
    Software
    Fleet

    Cerebras

    Toronto, ON
    2 days ago
  • Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+ years... 
    Software

    Cerebras

    Toronto, ON
    1 day ago
  • $140k - $175k per year

     ...Thomson Reuters is building the AI platform that will power the next decade of tax, accounting and audit products, including CoCounsel...  ...used by accountants on real client work every day. As a Lead Software Engineer (Staff Engineer), you will own core backend and AI... 
    Software
    Long term contract
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    22 hours ago
  • $163k - $200k per year

     ...About Sentry Software runs the world and the pace is faster than ever...  ...standard and our team is building its AI-native future. About the role The Streaming Platform team at Sentry is building the...  ...that makes it easy for Sentry engineers to deploy and run Streaming... 
    Software
    Fleet
    Full time
    Work at office
    3 days per week

    Sentry

    Toronto, ON
    2 days ago
  •  ...will work directly with the Co-Founder & CEO, translating product strategy into robust engineering practice and scalable systems. You will partner with clinical leadership to build AI-powered infrastructure, solutioning for multiple lines and jurisdictions, and shape the... 
    Software
    Internship

    TekRek

    Toronto, ON
    1 day ago
  •  ...Design, build, and operate Streaming Platform components including Kafka, the...  ...and control-plane systems for Kafka fleet management. Partner with product engineers to improve the reliability and...  ...Requirements At least 2–3 years of software engineering experience with a... 
    Software
    Fleet
    Work at office
    3 days per week

    Sentry

    Toronto, ON
    5 days ago
  •  ...Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows...  ...inference. About the Role We're hiring a Software Engineer to help contribute to projects on our Inference Platform team. Our team primarily owns the orchestration... 
    Software

    Cerebras

    Toronto, ON
    1 day ago
  • $150k per year

     ...recognized externally. Enabled by modern platforms and AI, you’ll do the most meaningful work of...  ...of records. As a Principal AI Platform Engineer, you will design and build the platform...  ...experience. ~7+ years building production software, with a track record of owning systems... 
    Software
    Long term contract
    Local area
    Worldwide

    1135 Epiq Systems Canada LLC

    Toronto, ON
    2 days ago
  •  ...They rely on multiple outdated platforms and error-prone manual work to...  ...-ownership Senior Platform Engineer to build and scale the infrastructure...  ...infrastructure patterns, AI-powered developer workflows, and...  ...field ~5+ years of software engineering experience with a... 
    Software
    Remote work
    Flexible hours

    ExaCare, Inc.

    Toronto, ON
    22 hours ago
  •  ...PagerDuty, ROSS Intelligence & Lazer. We have top AI staff, including from programs such as MScAC...  ...Role & responsibilities As an AI-focused software engineer on the Mash team, you will: Ship core AI features within the Mash platform. Architect LLM-powered solutions and... 
    Software

    Mash

    Toronto, ON
    1 day ago
  •  .... To usher in this new era, we seek AI-native thinkers across every function...  ...part of that mission. Our AI/ML engineering teams are delivering the intelligence...  ...powered experiences on the Snowflake platform. We're looking for a Software Engineer — AI to join our growing Toronto... 
    Software
    Work at office
    Local area
    Worldwide

    Snowflake

    Toronto, ON
    2 days ago
  •  ...inform, inspire, and empower audiences across all platforms. With significant reach and influence, SJC has...  ...About the Role SJC Media is building the AI layer for its Digital Operations. As the founding Software Engineer, Applied AI, you own that layer end-to-end: from... 
    Software
    Full time
    Flexible hours

    Urban Ridge Supplies

    Toronto, ON
    17 days ago
  •  ...Our Toronto Financial Client is seeking two AI Platform Engineers to support a large enterprise AI transformation program. The successful candidates will design, build, and operate AI platform infrastructure that enables enterprise AI, Generative AI, and Agentic AI solutions... 

    Myticas Consulting Inc.

    Toronto, ON
    4 days ago
  • $200k - $235k per year

     ...the rewards. The Backend Platform team's mission is to enable fast...  ...that support hundreds of engineers working across backend services...  ...rely on every day! As a Staff Software Developer , you will set...  ...a specific accommodation. AI Usage Disclosure: the company... 
    Software
    Long term contract
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Robinhood

    Toronto, ON
    22 hours ago
  •  ...sector expertise with modern SaaS practices, AI-enabled workflows, and a relentless focus...  ..., and the talented teams that bring our platform to life. Our solutions support the entire...  ...grow a small team of AI/ML and platform engineers. Own delivery— turn the AI strategy into... 
    Full time
    Remote work

    NEOGOV

    Toronto, ON
    4 days ago
  • $118k - $162k per year

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential...  ...Okta is seeking an experienced Senior Software Engineer in Test for our UI Engineering team. As...  ...quality strategy for our frontend and platform surfaces, ensuring every UI release... 
    Software
    Local area
    Worldwide

    Okta

    Toronto, ON
    10 days ago
  •  ...investment and pension organization to engage an experienced Senior AI Platform Engineer (MLOps) to support the ongoing growth and operationalization...  ...of MLOps best practices, CI/CD, automation, testing, and software engineering principles ~ Experience with Databricks, MLflow... 
    Software
    Contract work
    Work at office

    Akkodis

    Toronto, ON
    1 day ago
  • $136k - $187k per year

     ...Secure Every Identity, from AI to Human Identity is the key to...  ...too, let's talk. The Data Platform team is responsible for the foundational...  ...expect great things from our engineers and reward them with...  ...an opportunity for experienced Software Engineers to join our fast growing... 
    Software
    Local area
    Worldwide
    Flexible hours

    Okta

    Toronto, ON
    1 day ago
  • $70k - $150k per year

     ...Hybrid Work Model BMO is building the platform capabilities that make enterprise AI safe, governed, and scalable. We are seeking experienced Senior Engineers to help build and operate the core...  ...'s degree in Computer Science, Software Engineering, or a related technical... 
    Software
    Part time
    Internship

    BMO Financial Group

    Toronto, ON
    1 day ago
  • Be a key player at Epiq as a Senior AI Platform Engineer, focusing on advanced AI solutions in a flexible and innovative environment. You will...  ...in computer science or related field • 7+ years of production software experience • Strong Python skills; TypeScript proficiency • Familiarity... 
    Software
    Worldwide
    Flexible hours

    Legaltech Hub, Inc.

    Toronto, ON
    2 days ago
  • Drive innovation as a Senior Backend Engineer with a remote-first AI-native platform team focused on marketing and creative insights. You will leverage your...  ...API contracts Requirements: • 6+ years in large-scale software development • Proven experience in building from zero... 
    Software
    Remote work

    Acquird.io

    Toronto, ON
    2 days ago
  •  ...generation of insurance products, financial services and fleet software for trucking use our Universal API to access GPS...  ...About the role We're looking for an engineer who thrives on building scalable platforms and enjoys tackling hard data and backend challenges... 
    Software
    Fleet
    Full time
    Work at office
    Flexible hours

    Terminal

    Toronto, ON
    more than 2 months ago
  • $110k - $130k per year

     ...About the job As a Site Reliability Engineer II on the Serving Platforms team within Infrastructure...  ...Experience operating, scaling, and monitoring AI/ML or LLM-powered services and workloads...  ...developing and maintaining OS-level software packaging (RPM/DEB) and participating... 
    Software
    Full time
    Work at office
    Local area
    Worldwide
    Flexible hours
    2 days per week

    Opentable

    Toronto, ON
    12 days ago
  • $160k - $220k per year

    Secure Every Identity, from AI to HumanIdentity is the key to unlocking...  ...s talk.About the TeamThe Data Platform team is responsible for the...  ...expect great things from our engineers and reward them with...  ...an opportunity for experienced Software Engineers to join our fast growing... 
    Software
    Local area
    Worldwide
    Flexible hours

    Okta Inc.

    Toronto, ON
    4 days ago
  •  ...most trusted and innovative retail trading platforms, serving over 24 million active users...  ...are looking for an experienced Senior Software Engineer to join our engineering team in Toronto...  ...engineering problems, and deeply leverage AI to improve software development... 
    Software
    Long term contract
    Full time
    Internship
    Work at office
    Local area
    Worldwide

    Moomoo

    Toronto, ON
    a month ago
  • $137.2k - $196k per year

     ...Senior Software Engineer - Platforms & Infrastructure About the Role: The Infrastructure team at Tubi builds and operates the core platforms that...  ...practices. Mentor junior engineers, including on effective AI-assisted workflows, and take part in interviewing and onboarding... 
    Software
    Long term contract
    Remplacement
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours
    2 days per week

    Tubi, Inc.

    Toronto, ON
    4 days ago
  • $136k - $187k per year

     ...Secure Every Identity, from AI to Human Identity is the key to unlocking the potential...  ...use any technology, and within Okta Platform R&D, we're specifically focused on...  ...looking for an experienced full stack Staff Software Engineer (with a focus on UI) who is passionate... 
    Software
    Long term contract
    Local area
    Worldwide

    Okta

    Toronto, ON
    3 days ago
  •  ...growing, venture-backed B2B SaaS company building an AI-powered competitive intelligence platform that helps revenue teams win more competitive deals....  ...open web. About the role: We're hiring a Senior Software Engineer to build and optimize state-of-the-art LLM-powered agents... 
    Software
    Permanent employment
    Full time

    GuruLink

    Toronto, ON
    2 days ago
  • $150k - $200k per year

     ...Stikeman Elliott is building its own agentic AI platform, with production agents working...  ...continues to expand. This is the senior engineering role responsible for advancing its development...  ...that spans application architecture, software development and production delivery. You... 
    Software

    Stikeman Elliott LLP

    Toronto, ON
    1 day ago
  • Elevate customer experience through AI as a Software Engineer at Sierra, a leader in customer-facing AI agents in San Francisco. Drive the development...  ...and large enterprises • Prototype new tools and shape the platform's future • Solve complex customer interactions using AI... 
    Software

    Sierra

    Toronto, ON
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Fleet Platform Software Engineer. Be the first to apply!