Staff Software Engineer, Data Infrastructure
Cohere
Who are we?
Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this role?
The Data Infrastructure team at Cohere is responsible for the storage and data movement layer underlying every model training run. We’re building the unified storage layer that feeds our training workloads at petabyte scale. In this role, you would have the opportunity to architect and lead the design of this system from the ground up, serving petabytes of training data and model checkpoints fast enough to keep thousands of GPUs busy across several training clusters. You’d be a key contributor, leading the effort to solve a problem few teams have tackled at this scale.
In this role, you will:
Design, architect, and operate the distributed storage system that feeds model training and evaluation, driving the technical vision from concept through production.
Lead and own the deployment of this system across multiple Kubernetes clusters at petabyte scale, setting standards and best practices for the organization.
Collaborate with researchers and training-infra teams to define how jobs read and write data, translating those patterns into throughput, latency, and durability requirements that shape the platform’s roadmap.
Navigate the networking, I/O, and consistency challenges of moving large datasets and checkpoints across regions and backends, with GPU idle time and time-to-insight as the key metrics of success — and drive the solutions that improve them.
You may be a good fit if you have:
Strong storage fundamentals, including replication, consistency, caching, and data lifecycle management, with demonstrated architecture and design experience.
Strong coding ability in Python and Go, with the ability to lead implementations and mentor others in either language, and the willingness to contribute to the other.
Proven experience running stateful systems on Kubernetes, including Persistent Volumes, CSI drivers, and StatefulSets, with the capacity to design and execute operational strategies.
Hands-on experience with cloud object storage such as S3 as well as POSIX-style filesystems.
It’s a bonus if you have:
Experience with parallel or HPC filesystems such as Weka, VAST, or Lustre, and a track record of applying them at scale.
Familiarity with the data-loading and checkpointing patterns used in large-scale model training, with the ability to innovate on them.
An interest in how large models are trained and evaluated, including the trajectory and eval data those runs generate, and a desire to understand the workloads the platform is serving — with the capacity to guide others in that understanding.
Full-Time Employees at Cohere enjoy these Perks:
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits:
Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.
Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work:
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.
We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form , and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn’t limit the applications our recruiters may review or consider.
Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.
usd181k - usd241k per year
..., no surprises, and no tradeoffs on what matters most. App Infrastructure is the team behind Affirm's shared mobile app infrastructure —... ...you have mastered gathering and iterating on feedback from your engineering and cross-functional peers. You have strong verbal and...SuggestedWork at officeRemote workFlexible hours$229k - $241.5k per year
...person events. Learn more about our flexible approach to where we work. Overview As a Staff Software Engineer, you will play a key role in shaping and advancing a robust data platform that addresses strategic challenges within Ads and across Instacart. You will design...SuggestedLong term contractPermanent employmentWork at officeRemote workWork from homeFlexible hours- ...they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft... ...the role. We’re building the next generation of agentic AI infrastructure at Cohere. This team sits at the intersection of ML systems, distributed...SuggestedFull timeManual laborLocal areaRemote work
$154.8k - $212.85k per year
...harness Internet of Things (IoT) data to develop actionable... ...GDP, these industries are the infrastructure of our planet, including agriculture... ...1B ARR is that we need great engineers everywhere, and we have the... ...at the center of hardware, software, AI, and the physical world....SuggestedLong term contractFull timeInternshipRemote workRelocation packageFlexible hours- ...and act on all their disparate data, wherever it lives, and move... ...open source observability software – including Prometheus, Mimir... ...performance of their applications and infrastructure in any environment by... ...software. We are looking for Engineers that are passionate about communicating...SuggestedFull timeLocal areaRemote work
$134.3k - $227.7k per year
...Team Description The Dropbox Engineering Team builds the technology that... ...opportunity for impact. Our software engineering team uses a range... ...Machine Learning Engineers, Infrastructure Engineer, Product SWE Frontend... ...), Engineering Manager, Data Engineer, Software Development...WorldwideFlexible hours- ...As the most trusted global leader in data-first contract lifecycle management (CLM) software, Agiloft helps organizations manage the end-to-end process of... ...Position Overview We are looking for an experienced Staff Data Engineer to lead the next generation of our contract data...Full timeContract workFlexible hours
- ...Cohere is a team of researchers, engineers, designers, and more, who are... ...Role We’re seeking a Senior/Staff Engineer to build and maintain the automation infrastructure that powers the development cycles... ...feature flags and realistic customer data profiles Create intelligent...Full timeWork at officeLocal areaRemote workHome office
$145k - $170k per year
...and distribute open-source software that enables people to enjoy... ...seeking experienced browser engineers to join a small team exploring... ...subsystems. Investigate how internal data structures and execution... ...with accessibility infrastructure, browser security, profiling,...Full timeImmediate startRemote workHome office$192.89k - $231.47k per year
...understand, and act on all their disparate data, wherever it lives, and move at the... ...truly career-defining opportunity. Staff Backend Engineer - Adaptive Telemetry, Databases This... ...leverage the best open source observability software – including Prometheus, Mimir, Loki,...Long term contractFull timeLocal areaRemote work- ...Responsibilities Design and implement experiments within browser engine subsystems. Investigate browser data structures, execution behavior, document structure,... ...leadership; and experience with accessibility infrastructure, browser security, profiling, or automated agent-...Full timeImmediate startHome office
$154.8k - $212.85k per year
...harness Internet of Things (IoT) data to develop actionable... ...GDP, these industries are the infrastructure of our planet, including agriculture... ...About the role The way software gets built is changing fast.... ...review, and ship code alongside engineers — and our Developer...Long term contractFull timeInternshipLive outRemote workFlexible hours$195k - $265k per year
...About CircleCI Engineering CI/CD has been solved. Now it's being reinvented... ...everything inside their own infrastructure: regulated industries, air-... ..., and teams with strict data residency and compliance requirements... ...and keep them current. As a Staff Engineer here, you'll care as...InternshipLocal areaRemote work- Job Responsibility: Overview: Quest Software is looking for an experienced SaaS Software Developer... ...databases such as SQL or Azure Data Explorer Development experience with AI... ...monitor, protect, and analyze information and infrastructure to help fuel innovation and drive their...Full timeRemote work
- ...future at Cresta. About the Role: We're seeking a Staff Software Engineer to lead the design and evolution of our backend systems that... ...to operationalize AI capabilities, building the runtime infrastructure and orchestration systems that power AI agents at scale...InternshipWork at officeLocal areaRemote workWork from homeHome office
$176k - $226k per year
...at Coalition. About the role This is a Staff-level individual contributor role and the technical lead for the Security Engineering team behind Coalition Control, the platform... ...regarding access, correction, and deletion of your data where applicable. Information submitted,...Full timeFixed term contractWork at officeRemote workHome officeFlexible hours- ...all applications and next steps. Our partner is looking for a Staff Infrastructure Engineer, Cost Optimization based in Canada. In this high-impact... ...infrastructure cost forecasts, financial models, and reliable data inputs supporting budgeting, capacity planning, and long-term...Long term contractFull timeContract work
- ...What the Role Is We’re hiring a Staff Software Engineer who’ll be the technical lead for a new Search team at Babylist. This new team will be focused... ...wrong before it ships. - Partner with product, design and data as a peer, shaping what’s worth building from the start. - Coach...Full time
- ...applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design... ...fabrics for large-scale AI workloads. You will develop software-driven solutions that configure network switches,...Full time
- ...position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Software Engineer (Interfaces) based in Canada . As a Staff Software Engineer, you will shape the technical direction and evolution of a developer...Immediate startRemote workWorldwide
$116.7k - $145.9k per year
...sectors. We are both a space company and data company all rolled into one.... ...design, manufacturing, data processing, and software engineering, our office is a truly inspiring mix of... ...platform that underpins the company's data infrastructure. The platform provides a horizontally scalable...Ongoing contractLong term contractFull timeTemporary workInternshipWork at officeLocal areaRemote workHome office3 days per weekusd181k - usd241k per year
...tradeoffs on what matters most. Engineering owns cost visibility and... ...across Affirm's cloud and AI infrastructure. We're the team that tells... ...never gets diffuse. As a Staff Cost Engineer, you'll operate... ...finance, infrastructure, and data engineering — designing the tooling...Work at officeRemote workFlexible hoursusd181k - usd241k per year
...Observability team builds the platform every Affirm engineer relies on to understand the behavior and... ..., and when a user's checkout fails, our data is how engineers find out why. Over the... ...by default. We’re looking for a Staff Software Engineer to be the technical lead for...Work at officeRemote workFlexible hours- ...About the team We build the products and infrastructure that millions of Canadians trust with their financial lives. Data & Engineering at Wealthsimple spans everything from the... ...Wealthsimple — and it’s a meaningful one. As a Staff Software Developer on Production...Long term contractFull timeImmediate start
$128k - $171k per year
...and distribute open-source software that enables people to enjoy... ...experienced and versatile software engineer to work on the tools and... ...workflow automation, and the infrastructure required to operate them. We... ...Use telemetry, metrics, and data analysis to investigate problems...Long term contractImmediate startRemote workHome officeusd181k - usd241k per year
...matters most. We are seeking a seasoned Staff Engineer to help drive our Resilience Engineering... ...experimentation. Partner with infrastructure, product, and security leadership to embed resilience validation into the software development lifecycle. Establish best...Long term contractWork at officeImmediate startRemote workFlexible hours- ...About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies... ...Revenue Suite’s rapid growth and help engineers build and ship faster through... ...infrastructure. What you'll do As a Software Engineer on the Metronome Infrastructure...Contract workInternship
$128.1k - $170.8k per year
...Mozillians design, build and distribute open-source software that enables people to enjoy the internet on their... ...environments especially implementation of Data Loss Prevention (DLP) features. As a Staff Software Engineer, you’re a clear communicator and expert in your domain...Full timeImmediate startRemote workHome office- ...resolution. Develop Windows-focused enterprise features, especially Data Loss Prevention functionality. Lead multi-month projects... ...technical direction. Conduct code reviews and mentor software engineers. Collaborate with geographically distributed teams and stakeholders...Full timeImmediate startRemote workHome office
- ...applications and next steps. Our partner is looking for a Staff Software Engineer – Builder Platform based in Canada. As a Staff Software Engineer... ..., development, and operation of agent platforms and AI infrastructure, ensuring reliability, security, and scalability across the...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Software Engineer, Data Infrastructure. Be the first to apply!
