Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Software Engineer, Data Infrastructure

Full-time

Cohere

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Why this role?

The Data Infrastructure team at Cohere is responsible for the storage and data movement layer underlying every model training run. We’re building the unified storage layer that feeds our training workloads at petabyte scale. In this role, you would have the opportunity to architect and lead the design of this system from the ground up, serving petabytes of training data and model checkpoints fast enough to keep thousands of GPUs busy across several training clusters. You’d be a key contributor, leading the effort to solve a problem few teams have tackled at this scale.

In this role, you will:

  • Design, architect, and operate the distributed storage system that feeds model training and evaluation, driving the technical vision from concept through production.

  • Lead and own the deployment of this system across multiple Kubernetes clusters at petabyte scale, setting standards and best practices for the organization.

  • Collaborate with researchers and training-infra teams to define how jobs read and write data, translating those patterns into throughput, latency, and durability requirements that shape the platform’s roadmap.

  • Navigate the networking, I/O, and consistency challenges of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the key metrics of success — and drive the solutions that improve them.

You may be a good fit if you have:

  • Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management, with demonstrated architecture and design experience.

  • Strong coding ability in Python and Go, with the ability to lead implementations and mentor others in either language, and the willingness to contribute to the other.

  • Proven experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets, with the capacity to design and execute operational strategies.

  • Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.

It’s a bonus if you have:

  • Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre, and a track record of applying them at scale.

  • Familiarity with the data-loading and checkpointing patterns used in large-scale model training, with the ability to innovate on them.

  • An interest in how large models are trained and evaluated, including the trajectory and eval data those runs generate, and a desire to understand the workloads the platform is serving — with the capacity to guide others in that understanding.

Full-Time Employees at Cohere enjoy these Perks:

  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:

  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.

We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form , and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn’t limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Staff Software Engineer, Data Infrastructure in Remote vacancy
  • usd181k - usd241k per year

     ..., no surprises, and no tradeoffs on what matters most. App Infrastructure is the team behind Affirm's shared mobile app infrastructure —...  ...you have mastered gathering and iterating on feedback from your engineering and cross-functional peers. You have strong verbal and... 
    Suggested
    Work at office
    Remote work
    Flexible hours

    Affirm

    Remote
    11 days ago
  • $229k - $241.5k per year

     ...person events. Learn more about our flexible approach to where we work. Overview As a Staff Software Engineer, you will play a key role in shaping and advancing a robust data platform that addresses strategic challenges within Ads and across Instacart. You will design... 
    Suggested
    Long term contract
    Permanent employment
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Remote
    10 days ago
  •  ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft...  ...the role. We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems, distributed... 
    Suggested
    Full time
    Manual labor
    Local area
    Remote work

    Cohere

    Remote
    23 days ago
  • $154.8k - $212.85k per year

     ...harness Internet of Things (IoT) data to develop actionable...  ...GDP, these industries are the infrastructure of our planet, including agriculture...  ...1B ARR is that we need great engineers everywhere, and we have the...  ...at the center of hardware, software, AI, and the physical world.... 
    Suggested
    Long term contract
    Full time
    Internship
    Remote work
    Relocation package
    Flexible hours

    Samsara

    Remote
    11 days ago
  •  ...and act on all their disparate data, wherever it lives, and move...  ...open source observability software – including Prometheus, Mimir...  ...performance of their applications and infrastructure in any environment by...  ...software. We are looking for Engineers that are passionate about communicating... 
    Suggested
    Full time
    Local area
    Remote work

    Grafana Labs

    Remote
    12 days ago
  • $134.3k - $227.7k per year

     ...Team Description The Dropbox Engineering Team builds the technology that...  ...opportunity for impact. Our software engineering team uses a range...  ...Machine Learning Engineers, Infrastructure Engineer, Product SWE Frontend...  ...), Engineering Manager, Data Engineer, Software Development... 
    Worldwide
    Flexible hours

    Dropbox

    Remote
    8 days ago
  •  ...As the most trusted global leader in data-first contract lifecycle management (CLM) software, Agiloft helps organizations manage the end-to-end process of...  ...Position Overview We are looking for an experienced Staff Data Engineer to lead the next generation of our contract data... 
    Full time
    Contract work
    Flexible hours

    Agiloft

    Remote
    8 days ago
  •  ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...Role We’re seeking a Senior/Staff Engineer to build and maintain the automation infrastructure that powers the development cycles...  ...feature flags and realistic customer data profiles Create intelligent... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Remote
    16 hours ago
  • $145k - $170k per year

     ...and distribute open-source software that enables people to enjoy...  ...seeking experienced browser engineers to join a small team exploring...  ...subsystems. Investigate how internal data structures and execution...  ...with accessibility infrastructure, browser security, profiling,... 
    Full time
    Immediate start
    Remote work
    Home office

    Mozilla

    Remote
    8 days ago
  • $192.89k - $231.47k per year

     ...understand, and act on all their disparate data, wherever it lives, and move at the...  ...truly career-defining opportunity. Staff Backend Engineer - Adaptive Telemetry, Databases  This...  ...leverage the best open source observability software – including Prometheus, Mimir, Loki,... 
    Long term contract
    Full time
    Local area
    Remote work

    Grafana Labs

    Remote
    12 days ago
  •  ...Responsibilities Design and implement experiments within browser engine subsystems. Investigate browser data structures, execution behavior, document structure,...  ...leadership; and experience with accessibility infrastructure, browser security, profiling, or automated agent-... 
    Full time
    Immediate start
    Home office

    Mozilla

    Remote
    11 days ago
  • $154.8k - $212.85k per year

     ...harness Internet of Things (IoT) data to develop actionable...  ...GDP, these industries are the infrastructure of our planet, including agriculture...  ...About the role The way software gets built is changing fast....  ...review, and ship code alongside engineers — and our Developer... 
    Long term contract
    Full time
    Internship
    Live out
    Remote work
    Flexible hours

    Samsara

    Remote
    11 days ago
  • $195k - $265k per year

     ...About CircleCI Engineering CI/CD has been solved. Now it's being reinvented...  ...everything inside their own infrastructure: regulated industries, air-...  ..., and teams with strict data residency and compliance requirements...  ...and keep them current. As a Staff Engineer here, you'll care as... 
    Internship
    Local area
    Remote work

    CircleCI

    Remote
    11 days ago
  • Job Responsibility: Overview: Quest Software is looking for an experienced SaaS Software Developer...  ...databases such as SQL or Azure Data Explorer Development experience with AI...  ...monitor, protect, and analyze information and infrastructure to help fuel innovation and drive their... 
    Full time
    Remote work

    Quest Software

    Remote
    10 days ago
  •  ...future at Cresta. About the Role:    We're seeking a Staff Software Engineer to lead the design and evolution of our backend systems that...  ...to operationalize AI capabilities, building the runtime infrastructure and orchestration systems that power AI agents at scale... 
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Home office

    Cresta

    Remote
    11 days ago
  • $176k - $226k per year

     ...at Coalition. About the role This is a Staff-level individual contributor role and the technical lead for the Security Engineering team behind Coalition Control, the platform...  ...regarding access, correction, and deletion of your data where applicable. Information submitted,... 
    Full time
    Fixed term contract
    Work at office
    Remote work
    Home office
    Flexible hours

    Coalition, Inc.

    Remote
    5 days ago
  •  ...all applications and next steps. Our partner is looking for a Staff Infrastructure Engineer, Cost Optimization based in Canada. In this high-impact...  ...infrastructure cost forecasts, financial models, and reliable data inputs supporting budgeting, capacity planning, and long-term... 
    Long term contract
    Full time
    Contract work

    Jobgether

    Remote
    11 days ago
  •  ...What the Role Is We’re hiring a Staff Software Engineer who’ll be the technical lead for a new Search team at Babylist. This new team will be focused...  ...wrong before it ships. - Partner with product, design and data as a peer, shaping what’s worth building from the start. - Coach... 
    Full time

    Babylist

    Remote
    12 days ago
  •  ...applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design...  ...fabrics for large-scale AI workloads. You will develop software-driven solutions that configure network switches,... 
    Full time

    Jobgether

    Remote
    17 days ago
  •  ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Software Engineer (Interfaces) based in Canada . As a Staff Software Engineer, you will shape the technical direction and evolution of a developer... 
    Immediate start
    Remote work
    Worldwide

    Jobgether

    Remote
    2 days ago
  • $116.7k - $145.9k per year

     ...sectors. We are both a space company and data company all rolled into one....  ...design, manufacturing, data processing, and software engineering, our office is a truly inspiring mix of...  ...platform that underpins the company's data infrastructure. The platform provides a horizontally scalable... 
    Ongoing contract
    Long term contract
    Full time
    Temporary work
    Internship
    Work at office
    Local area
    Remote work
    Home office
    3 days per week

    Planet Labs

    Remote
    11 days ago
  • usd181k - usd241k per year

     ...tradeoffs on what matters most. Engineering owns cost visibility and...  ...across Affirm's cloud and AI infrastructure. We're the team that tells...  ...never gets diffuse. As a Staff Cost Engineer, you'll operate...  ...finance, infrastructure, and data engineering — designing the tooling... 
    Work at office
    Remote work
    Flexible hours

    Affirm

    Remote
    11 days ago
  • usd181k - usd241k per year

     ...Observability team builds the platform every Affirm engineer relies on to understand the behavior and...  ..., and when a user's checkout fails, our data is how engineers find out why. Over the...  ...by default. We’re looking for a Staff Software Engineer to be the technical lead for... 
    Work at office
    Remote work
    Flexible hours

    Affirm

    Remote
    11 days ago
  •  ...About the team We build the products and infrastructure that millions of Canadians trust with their financial lives. Data & Engineering at Wealthsimple spans everything from the...  ...Wealthsimple — and it’s a meaningful one. As a Staff Software Developer on Production... 
    Long term contract
    Full time
    Immediate start

    Wealthsimple

    Remote
    11 days ago
  • $128k - $171k per year

     ...and distribute open-source software that enables people to enjoy...  ...experienced and versatile software engineer to work on the tools and...  ...workflow automation, and the infrastructure required to operate them. We...  ...Use telemetry, metrics, and data analysis to investigate problems... 
    Long term contract
    Immediate start
    Remote work
    Home office

    Mozilla

    Remote
    11 days ago
  • usd181k - usd241k per year

     ...matters most. We are seeking a seasoned Staff Engineer to help drive our Resilience Engineering...  ...experimentation. Partner with infrastructure, product, and security leadership to embed resilience validation into the software development lifecycle. Establish best... 
    Long term contract
    Work at office
    Immediate start
    Remote work
    Flexible hours

    Affirm

    Remote
    4 hours ago
  •  ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies...  ...Revenue Suite’s rapid growth and help engineers build and ship faster through...  ...infrastructure. What you'll do As a Software Engineer on the Metronome Infrastructure... 
    Contract work
    Internship

    Stripe

    Remote
    11 days ago
  • $128.1k - $170.8k per year

     ...Mozillians design, build and distribute open-source software that enables people to enjoy the internet on their...  ...environments especially implementation of Data Loss Prevention (DLP) features. As a Staff Software Engineer, you’re a clear communicator and expert in your domain... 
    Full time
    Immediate start
    Remote work
    Home office

    Mozilla

    Remote
    16 hours ago
  •  ...resolution. Develop Windows-focused enterprise features, especially Data Loss Prevention functionality. Lead multi-month projects...  ...technical direction. Conduct code reviews and mentor software engineers. Collaborate with geographically distributed teams and stakeholders... 
    Full time
    Immediate start
    Remote work
    Home office

    Mozilla

    Remote
    16 hours ago
  •  ...applications and next steps. Our partner is looking for a Staff Software Engineer – Builder Platform based in Canada. As a Staff Software Engineer...  ..., development, and operation of agent platforms and AI infrastructure, ensuring reliability, security, and scalability across the... 
    Full time

    Jobgether

    Remote
    17 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Software Engineer, Data Infrastructure. Be the first to apply!