Senior/Staff Backend Software Engineer (Inference)
Cohere
This role is for a highly experienced Back-End Software Engineer who wants to work on core systems that shape how the platform (Model Vault) operatesYou will help define the architecture of the platform where reliability, security, performance, and simplicity all matter, and where many of the problems do not have off-the-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating models securely at enterprise scale. The team owns the systems between a customer and the underlying AI infrastructure, including identity, deployments, metering, billing, security, privacy, and confidential computingWe are strengthening these systems as Model Vault grows, with the goal of scaling to millions of users and supporting some of the world’s most demanding enterprise workloadsEvolve and scale the backend systems that power Model Vault, including authentication and authorization, deployment management, billing, metering, and customer lifecycleLead major architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundationsBuild highly reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platformsDesign APIs and distributed systems with strong guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observabilityBuild security and privacy into the platform architecture, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundariesSolve complex problems that span backend systems, cloud infrastructure, security, and AI inference, where conventional SaaS patterns are often not enoughDrive projects end-to-end, from architecture and threat modeling through implementation, rollout, production operations, and iteration based on real customer workloadsBenefits
Six weeks’ paid vacationEquity / stock optionsRRSP, 401(k), and Pension Scheme contributionsCoverage for 100% of your insurance premiums across health, dental, vision, and travelAdditional coverage for accessing mental health providers/servicesSix months of fully paid parental leave, including adoption and surrogacyFinancial support for egg freezing and IVF in Canada and the UKA monthly fitness and wellness allowanceGlobally dispersed company that supports a remote work cultureA $2,000 annual education benefit for professional developmentA weekly stipend for meals when working remotely and catered lunch when working from one of our global officesA monthly arts and culture allowanceA monthly quality time allowanceYou think deeply about security boundaries and understand authentication, authorization, identity, cryptography, secrets, tenant isolation, and how small implementation choices can create significant security risksYou are a strong backend engineer with excellent fundamentals in distributed systems, databases, networking, operating systems, and securityYou have a track record of taking technically difficult projects from an unclear starting point to systems that other engineers and customers depend onYou have strong systems-design instincts and understand concepts such as concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradationYou have strong programming fundamentals and experience building production systems in languages such as Go, Python, Java, C++, Rust, or similar. You write clean, maintainable, well-tested code and make thoughtful tradeoffs between simplicity, performance, and correctnessYou can take ambiguous, high-impact technical problems, define the right architecture, and drive them through to reliable production systemsYou have designed and operated production systems where correctness, availability, security, and performance mattered at significant scaleYou are comfortable reasoning across backend services, APIs, databases, distributed systems, and the cloud infrastructure they run onYou are comfortable diving into unfamiliar codebases and debugging complex problems that cross service or system boundariesYou are comfortable challenging existing architecture and evolving foundational components when the system’s needs changeYou care about the details of production engineering, including instrumentation, capacity planning, migrations, backwards compatibility, incident response, and safe rolloutsIf any of the above doesn’t line up exactly with your experience, we still encourage you to apply
#J-18808-Ljbffr
Six weeks’ paid vacationEquity / stock optionsRRSP, 401(k), and Pension Scheme contributionsCoverage for 100% of your insurance premiums across health, dental, vision, and travelAdditional coverage for accessing mental health providers/servicesSix months of fully paid parental leave, including adoption and surrogacyFinancial support for egg freezing and IVF in Canada and the UKA monthly fitness and wellness allowanceGlobally dispersed company that supports a remote work cultureA $2,000 annual education benefit for professional developmentA weekly stipend for meals when working remotely and catered lunch when working from one of our global officesA monthly arts and culture allowanceA monthly quality time allowanceYou think deeply about security boundaries and understand authentication, authorization, identity, cryptography, secrets, tenant isolation, and how small implementation choices can create significant security risksYou are a strong backend engineer with excellent fundamentals in distributed systems, databases, networking, operating systems, and securityYou have a track record of taking technically difficult projects from an unclear starting point to systems that other engineers and customers depend onYou have strong systems-design instincts and understand concepts such as concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradationYou have strong programming fundamentals and experience building production systems in languages such as Go, Python, Java, C++, Rust, or similar. You write clean, maintainable, well-tested code and make thoughtful tradeoffs between simplicity, performance, and correctnessYou can take ambiguous, high-impact technical problems, define the right architecture, and drive them through to reliable production systemsYou have designed and operated production systems where correctness, availability, security, and performance mattered at significant scaleYou are comfortable reasoning across backend services, APIs, databases, distributed systems, and the cloud infrastructure they run onYou are comfortable diving into unfamiliar codebases and debugging complex problems that cross service or system boundariesYou are comfortable challenging existing architecture and evolving foundational components when the system’s needs changeYou care about the details of production engineering, including instrumentation, capacity planning, migrations, backwards compatibility, incident response, and safe rolloutsIf any of the above doesn’t line up exactly with your experience, we still encourage you to apply
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior/Staff Backend Software Engineer (Inference) in Winnipeg, MB vacancy
- ...group of committed researchers, engineers, policy experts, and business... ...systems. About the roleOur Inference team is responsible for... ...qualifications Significant software engineering experience, particularly... ...policy: Currently, we expect all staff to be in one of our offices at...SeniorLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU... .... About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute to projects... ...develop, test, and maintain production software, with responsibilities spanning testing,...Senior
- ...deliver industry-leading training and inference speeds; over 10 times faster than... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML... ...experience across models and accelerator backends. This role sits at the...Suggested
- ...ingestion platform underneath it all. It is a mix of product and backend engineering, shaping the APIs and deeper backend components our customers... ..., SQS, Kafka, EventBridge). Orchestration and workflow engines (Step Functions, Temporal). JVM languages for cross-team...Senior
- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...We are looking for Members of Technical Staff to join the Model Serving team at Cohere.... ...they influence latency and throughput of inference. ~ Strong understanding or working...SuggestedFull timeWork at officeRemote workFlexible hours
- ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud... ...with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and optimize our GPU serving stack...
- ...the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs,... ...consistent experience across models and accelerator backends. This hands-on role touches streaming, tool...
$167.55k - $209.44k per year
...their warehouses, canonical and ready to query, with no engineering or maintenance required. We’re proud that more organizations... ..., and career sites. About the RoleWe’re looking for a Staff Software Engineer, Backend to join our Reverse ETL product engineering team....SeniorFull timeInternshipWork at officeRemote workFlexible hours2 days per week$196.8k - $270.6k per year
...Harvey, the future of professional services is being written today — and we’re just getting started.Role Overview As a Staff Backend Software Engineer at Harvey, you’ll play a pivotal role in shaping the foundation of our product platform while directly building user-...Work at officeRelocation packageFlexible hours- Build backend applications and data pipelines as a Staff Software Engineer at Marqeta, working remotely from Ontario or British Columbia.The Program Experience team is scaling Marqeta’s Customer Migration Platform. This experienced engineering role focuses on Java and Python...Remote work
$171k - $200k per year
...beverage, retail, and the public sector.Visit gomotive.Com to learn more.About the Role: As a Staff Software Engineer on the Equipment Monitoring team, you will build the backend systems that give fleets unmatched visibility into the location, utilization, and health of...Long term contractTemporary workWork at office$170k - $227k per year
...world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing...Summer workWorldwide$181k - $241k per year
...have 8+ years of experience designing, developing and launching backend systems at scale using languages like Python or Kotlin. You have... ...years of experience working in search or related recommendation engines You have experience delivering major features, system...Work at officeRemote workFlexible hours$200k - $235k per year
...high, and so are the rewards. The Backend Platform team's mission is to enable... ...libraries, and tooling that support hundreds of engineers working across backend services. By... ...engineers rely on every day! As a Staff Software Developer, you will set technical...Long term contractWork at officeFlexible hoursShift work3 days per week$160k - $240k per year
...time / Long-term projectCompensation: $160K–$240K annually+ meaningful equitySeniority: Senior / Staff About the ProjectWe are looking for a Senior/Staff Software Engineer to join a rapidly growing technology company building infrastructure for AI-powered...SeniorLong term contractFull timeRemote work- Shape backend architecture with Go, secure APIs, and distributed systems at Rivian and Volkswagen Group Technologies. Lead through influence across platform initiatives.As a Staff Backend Software Engineer, you will build and operate services powering customer-facing digital...
- Excel as a Staff Backend Software Engineer at Motion, focusing on API design and backend services. Use your skills in Node, TypeScript, and MongoDB to influence company-wide operations. Join Motion's Platform team to develop and enhance high-quality backend solutions that...
$181k - $241k per year
...Observability team builds the platform every Affrim engineer relies on to understand the behavior and... ...by default. We’re looking for a Staff Software Engineer to be the technical lead for... ...designing, developing and launching backend systems at scale using languages like Python...Work at officeRemote workFlexible hours$209k - $269k per year
...surprises, and no tradeoffs on what matters most. Affirm's engineering team is building a large-scale, highly-available, and global infrastructure... ...and adapt them to affirm's needs Qualifications10+ years in software or infrastructure engineering with proven delivery of complex...SeniorWork at officeRemote workFlexible hours$211.5k per year
...team. We’re stronger together, and you’re a person who embraces being pushed out of your comfort zone.We’re looking to hire Staff Software Engineers to join our Platform Product Group. The Platform Product Group’s mission is to build a trusted, scalable, and compliant platform...Full timeLocal areaImmediate startRemote work- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...Work at office
- Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services. Candidates for this position must have over five years of backend engineering...Remote work
- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered...
- ...Affirm, Inc. is seeking an experienced Capacity Modeling Engineer to own quarterly goals for the team and lead engineers through ambiguity while delivering capacity plans for peak sales events. You will translate demand forecasts into resource settings across regions and environments...Senior
$181k - $241k per year
Staff Software Engineer, Backend (Fraud Decisioning) Remote CanadaAt Affine, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most.We are looking for a Staff Engineer...Work at officeRemote workFlexible hours$181k - $241k per year
Staff Software Engineer, Backend (Identity Decisioning)Remote Canada At Affim, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. Affirm’s Identity team...Work at officeRemote workFlexible hours$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...operating distributed systems, backend infrastructure, or large-scale... ...contributions to LLM inference engines and frameworks such as vLLM,...Flexible hours$144.9k - $189.18k per year
...code reviews Partner across engineering teams to tackle company-wide... ...building and developing backend applications Bachelor's or... ...for Computer Science degree Senior-level experience with one or... ...Practical knowledge of agile software development methodologies (e....SeniorInternshipWork at officeLocal areaRemote work- ...financial products. The entire platform is engineered from the ground up to defend against... ...compliance systems a bank actually runs on. As a Senior Staff Engineer, you would help to shape... ...Have A long track record shipping backend systems in statically typed languages, including...Senior
- Build backend systems for Index Exchange’s programmatic advertising platform in Toronto or Kitchener, using strong software engineering and service design skills.Index Exchange seeks Senior-level software engineers for product and platform teams supporting backend, frontend...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior/Staff Backend Software Engineer (Inference). Be the first to apply!
Related searches
- backend developer Winnipeg, MB
- backend software developer Winnipeg, MB
- senior financial accountant Winnipeg, MB
- senior sales consultant Winnipeg, MB
- senior communications specialist Winnipeg, MB
- senior bookkeeper Winnipeg, MB
- senior system administrator Winnipeg, MB
- senior technical recruiter Winnipeg, MB
- senior director Winnipeg, MB
- senior technical specialist Winnipeg, MB

