Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior/Staff Backend Software Engineer (Inference)

Cohere

This role is for a highly experienced Back-End Software Engineer who wants to work on core systems that shape how the platform (Model Vault) operatesYou will help define the architecture of the platform where reliability, security, performance, and simplicity all matter, and where many of the problems do not have off-the-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating models securely at enterprise scale. The team owns the systems between a customer and the underlying AI infrastructure, including identity, deployments, metering, billing, security, privacy, and confidential computingWe are strengthening these systems as Model Vault grows, with the goal of scaling to millions of users and supporting some of the world’s most demanding enterprise workloadsEvolve and scale the backend systems that power Model Vault, including authentication and authorization, deployment management, billing, metering, and customer lifecycleLead major architectural initiatives across identity, payments, usage systems, platform scalability, and other core product foundationsBuild highly reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware platformsDesign APIs and distributed systems with strong guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observabilityBuild security and privacy into the platform architecture, including tenant isolation, least-privilege access, auditability, secrets management, encryption, and confidential computing boundariesSolve complex problems that span backend systems, cloud infrastructure, security, and AI inference, where conventional SaaS patterns are often not enoughDrive projects end-to-end, from architecture and threat modeling through implementation, rollout, production operations, and iteration based on real customer workloadsBenefits
Six weeks’ paid vacationEquity / stock optionsRRSP, 401(k), and Pension Scheme contributionsCoverage for 100% of your insurance premiums across health, dental, vision, and travelAdditional coverage for accessing mental health providers/servicesSix months of fully paid parental leave, including adoption and surrogacyFinancial support for egg freezing and IVF in Canada and the UKA monthly fitness and wellness allowanceGlobally dispersed company that supports a remote work cultureA $2,000 annual education benefit for professional developmentA weekly stipend for meals when working remotely and catered lunch when working from one of our global officesA monthly arts and culture allowanceA monthly quality time allowanceYou think deeply about security boundaries and understand authentication, authorization, identity, cryptography, secrets, tenant isolation, and how small implementation choices can create significant security risksYou are a strong backend engineer with excellent fundamentals in distributed systems, databases, networking, operating systems, and securityYou have a track record of taking technically difficult projects from an unclear starting point to systems that other engineers and customers depend onYou have strong systems-design instincts and understand concepts such as concurrency, consistency, caching, queues, rate limiting, backpressure, failure domains, idempotency, and graceful degradationYou have strong programming fundamentals and experience building production systems in languages such as Go, Python, Java, C++, Rust, or similar. You write clean, maintainable, well-tested code and make thoughtful tradeoffs between simplicity, performance, and correctnessYou can take ambiguous, high-impact technical problems, define the right architecture, and drive them through to reliable production systemsYou have designed and operated production systems where correctness, availability, security, and performance mattered at significant scaleYou are comfortable reasoning across backend services, APIs, databases, distributed systems, and the cloud infrastructure they run onYou are comfortable diving into unfamiliar codebases and debugging complex problems that cross service or system boundariesYou are comfortable challenging existing architecture and evolving foundational components when the system’s needs changeYou care about the details of production engineering, including instrumentation, capacity planning, migrations, backwards compatibility, incident response, and safe rolloutsIf any of the above doesn’t line up exactly with your experience, we still encourage you to apply
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior/Staff Backend Software Engineer (Inference) in Winnipeg, MB vacancy
  • Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers... 
    Senior
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    Winnipeg, MB
    54 minutes ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU...  .... About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute to projects...  ...develop, test, and maintain production software, with responsibilities spanning testing,... 
    Senior

    Cerebras

    Winnipeg, MB
    57 minutes ago
  •  ...deliver industry-leading training and inference speeds; over 10 times faster than...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML...  ...experience across models and accelerator backends. This role sits at the... 
    Suggested

    Cerebras

    Winnipeg, MB
    56 minutes ago
  •  ...ingestion platform underneath it all. It is a mix of product and backend engineering, shaping the APIs and deeper backend components our customers...  ..., SQS, Kafka, EventBridge). Orchestration and workflow engines (Step Functions, Temporal). JVM languages for cross-team... 
    Senior

    SearchLabs

    Winnipeg, MB
    54 minutes ago
  •  ...and real-world impact converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend...  ...a focus on the performance, reliability, and scalability of inference systems. Join us and help influence how billions of gaming... 
    Suggested
    Work at office
    Worldwide

    Unity Technologies

    Winnipeg, MB
    59 minutes ago
  •  ...allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale...  ...prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and optimize our GPU serving... 

    Cerebras

    Winnipeg, MB
    55 minutes ago
  • $167.55k - $209.44k per year

     ...their warehouses, canonical and ready to query, with no engineering or maintenance required. We’re proud that more organizations...  ..., and career sites. About the RoleWe’re looking for a Staff Software Engineer, Backend to join our Reverse ETL product engineering team.... 
    Senior
    Full time
    Internship
    Work at office
    Remote work
    Flexible hours
    2 days per week

    Fivetran

    Winnipeg, MB
    1 hour ago
  • $170k - $190k per year

     ...million.Copper is looking for a positive, customer-oriented Staff Software Engineer to join one of our product development teams. You will...  ...influence the roadmapWhat you’ll bring ...8+ years of experience in backend engineering, with 2+ years in a Staff or Senior Staff role.... 
    Senior
    Internship
    Remote work

    Copper

    Winnipeg, MB
    1 hour ago
  • $171k - $200k per year

     ...beverage, retail, and the public sector.Visit gomotive.Com to learn more.About the Role: As a Staff Software Engineer on the Equipment Monitoring team, you will build the backend systems that give fleets unmatched visibility into the location, utilization, and health of... 
    Long term contract
    Temporary work
    Work at office

    ProducePay

    Winnipeg, MB
    55 minutes ago
  •  ...the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs,...  ...consistent experience across models and accelerator backends. This hands-on role touches streaming, tool... 

    Cerebras

    Winnipeg, MB
    54 minutes ago
  •  ...tools that transform how semiconductor engineers create, verify, and optimize chips. Our...  ...engineering disciplines. Job TitleStaff Backend Software Engineer About CognichipAt Cognichip,...  .... About The RoleWe are seeking a Staff Backend Software Engineer to spearhead the... 
    Senior
    Work at office
    Remote work
    Work from home
    1 day per week

    Cognichip

    Winnipeg, MB
    54 minutes ago
  • Shape backend systems with Python, Kotlin, AWS, MySQL, and Kubernetes as a Staff Software Engineer at Affim, working remotely across Canada. Build secure account experiences that protect customers and reduce friction.As part of Trust & Safety within Affim’s Checkout organization... 
    Remote work

    Affirm, Inc.

    Winnipeg, MB
    58 minutes ago
  • $170k - $227k per year

     ...world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business. Founded by engineers — and customer obsessed — we leap at every opportunity to solve technical challenges, from designing next-gen UI/UX for interfacing... 
    Summer work
    Worldwide

    Neon

    Winnipeg, MB
    57 minutes ago
  • $196.8k - $270.6k per year

     ...Harvey, the future of professional services is being written today — and we’re just getting started.Role Overview As a Staff Backend Software Engineer at Harvey, you’ll play a pivotal role in shaping the foundation of our product platform while directly building user-... 
    Work at office
    Relocation package
    Flexible hours

    Harvey

    Winnipeg, MB
    57 minutes ago
  • Build backend applications and data pipelines as a Staff Software Engineer at Marqeta, working remotely from Ontario or British Columbia.The Program Experience team is scaling Marqeta’s Customer Migration Platform. This experienced engineering role focuses on Java and Python... 
    Remote work

    Marqeta, Inc.

    Winnipeg, MB
    53 minutes ago
  • $209k - $269k per year

     ...surprises, and no tradeoffs on what matters most. Affirm's engineering team is building a large-scale, highly-available, and global infrastructure...  ...and adapt them to affirm's needs Qualifications10+ years in software or infrastructure engineering with proven delivery of complex... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Winnipeg, MB
    1 hour ago
  • Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model... 
    Senior

    Cerebras

    Winnipeg, MB
    1 hour ago
  • $181k - $241k per year

     ...surprises, and no tradeoffs on what matters most.Engineering owns cost visibility and optimization...  ...accountability never gets diffuse.As a Staff Cost Engineer, you'll operate at the...  ...experience designing, developing and launching backend systems at scale using languages like... 
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Winnipeg, MB
    53 minutes ago
  • $211.5k per year

     ...team. We’re stronger together, and you’re a person who embraces being pushed out of your comfort zone.We’re looking to hire Staff Software Engineers to join our Platform Product Group. The Platform Product Group’s mission is to build a trusted, scalable, and compliant platform... 
    Full time
    Local area
    Immediate start
    Remote work

    Coinbase, Inc.

    Winnipeg, MB
    55 minutes ago
  • Excel as a Staff Backend Software Engineer at Motion, focusing on API design and backend services. Use your skills in Node, TypeScript, and MongoDB to influence company-wide operations. Join Motion's Platform team to develop and enhance high-quality backend solutions that... 

    HRB

    Winnipeg, MB
    52 minutes ago
  • $200k - $235k per year

     ...Expectations are high, and so are the rewards.The Backend Platform team’s mission is to enable...  ..., and tooling that support hundreds of engineers working across backend services. By...  ...backend engineers rely on every day!As a Staff Software Developer, you will set technical... 
    Long term contract
    Work at office
    Flexible hours
    Shift work
    3 days per week

    Candidate

    Winnipeg, MB
    57 minutes ago
  • $181k - $241k per year

    Staff Software Engineer, Backend (Observability)Remote Canada At affirm, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most. The Observability team builds... 
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Winnipeg, MB
    56 minutes ago
  • Shape enterprise backend experiences at Harvey in Toronto, combining secure systems expertise with hands-on product development. Work onsite three days weekly.This Staff Backend Software Engineer role focuses on platform infrastructure and enterprise-facing features for law... 

    Harvey

    Winnipeg, MB
    57 minutes ago
  • Explore the role of Staff Software Engineer with a focus on backend architecture and document analysis in a hybrid workplace. Bring your skills to a company committed to transparency and justice. This role targets seasoned developers with a strong backend emphasis to advance... 

    Thomson Reuters

    Winnipeg, MB
    52 minutes ago
  • Shape backend architecture with Go, secure APIs, and distributed systems at Rivian and Volkswagen Group Technologies. Lead through influence across platform initiatives.As a Staff Backend Software Engineer, you will build and operate services powering customer-facing digital... 

    Rivian and Volkswagen Group Technologies

    Winnipeg, MB
    1 hour ago
  • $160k - $240k per year

     ...time / Long-term projectCompensation: $160K–$240K annually+ meaningful equitySeniority: Senior / Staff About the ProjectWe are looking for a Senior/Staff Software Engineer to join a rapidly growing technology company building infrastructure for AI-powered... 
    Senior
    Long term contract
    Full time
    Remote work

    AIDA Recruitment

    Winnipeg, MB
    52 minutes ago
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered... 

    Sarsfield Group

    Winnipeg, MB
    55 minutes ago
  • Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong... 
    Work at office

    Best AI Tools Wiki

    Winnipeg, MB
    54 minutes ago
  • Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services. Candidates for this position must have over five years of backend engineering... 
    Remote work

    Best AI Tools Wiki

    Winnipeg, MB
    59 minutes ago
  • $181k - $241k per year

    Staff Software Engineer, Backend (Fraud Decisioning) Remote CanadaAt Affine, we exist for the moments that matter—giving people a clear, predictable way to pay over time, with no hidden fees, no surprises, and no tradeoffs on what matters most.We are looking for a Staff Engineer... 
    Work at office
    Remote work
    Flexible hours

    Affirm, Inc.

    Winnipeg, MB
    56 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior/Staff Backend Software Engineer (Inference). Be the first to apply!