Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Forward Deployed Engineer, Inference

FDE Times

Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this role?Are you energized by bridging the gap between frontier AI capability and complex customer reality? Do you want to architect high-performance, resilient machine learning systems directly inside strategic enterprise environments? We are looking for a Staff Forward Deployed Engineer (FDE) to join our team. The team is responsible for taking our large language models and making them work reliably, securely, and at peak performance within our customers' custom infrastructure and data perimeters.
In this role, you will act as the principal technical translation layer between our core engineering teams and our strategic partners. You will own the architecture for highly ambiguous, customer-specific inference challenges—ranging from multi-tenant model serving to multi-datacenter disaster recovery and custom hardware validation. You will lead technical adoption end-to-end, ensuring our models achieve exceptionally low latency, high throughput, and seamless resilience in the field.
As a Forward Deployed Engineer, you will
Embed directly with customer engineering teams to architect the "connective tissue" between our AI models and their live, complex production environments.
Design advanced model serving topologies, implementing multi-tenant architectures, intelligent model routing, and cross-datacenter failover strategies for multi-cluster environments.
Optimize "AI-in-a-box" and private deployments, balancing localized SRE constraints like Kubernetes multi-cluster scale with raw model performance.
Conduct rigorous benchmarking and profiling of customer LLM workloads, root-causing performance degradation (e.G., slow generation) via metrics, dashboards, and distributed logs.
Accelerate hardware validation, collaborating with clients to run and support Cohere models on next-generation accelerators (GPUs, TPUs, AMD, and custom ASICs).
Translate complex field friction into platform upgrades, delivering prescriptive feedback and contributing directly back to core product features.
Ensure Day-1 production reliability, assisting customers in establishing sound deployment patterns, SLOs, and observability frameworks.
You may be a good fit if you have
8+ years of engineering experience running production infrastructure, designing large-scale distributed systems, or deploying enterprise software in complex environments.
Deep technical depth in production Kubernetes, including orchestration across multi-cluster and hybrid/multi-cloud ecosystems (GCP, Azure, AWS, OCI).
Strong understanding of LLM architecture and inference dynamics, specifically how attention mechanisms, compute-bound prefill, and memory-bound decode phases dictate live performance.
Hands-on experience with modern inference engines and optimization stacks (e.G., vLLM, TensorRT-LLM, lmd, or Dynamo).
Familiarity with distributed serving techniques, such as prefill/decode disaggregated serving, distributed KV caching, and multi-GPU workloads.
Exceptional customer-facing technical leadership, with a proven track record of scoping highly ambiguous problems and steering executive technical stakeholders.
The high agency, grit, and adaptability to write same-day production code while managing client-side deployment politics or blockers.
Strong programming foundations in Python, Go, or C++, comfortable moving fluidly between backend data pipelines and infrastructure layer tuning.
Full-Time Employees at Cohere enjoy these Perks
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
We strive to create an inclusive work environment for all;
we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
#J-18808-Ljbffr
Vacancy posted 30 minutes ago
Similar jobs that could be interesting for youBased on the Forward Deployed Engineer, Inference in Winnipeg, MB vacancy
  •  ...leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside...  ...environments. You will own the architecture for complex inference challenges, enable low latency and high throughput, and... 
    Suggested

    Fdetimes

    Winnipeg, MB
    30 minutes ago
  •  ...a world-class digital product studio composed of 180+ senior engineers and designers with backgrounds from companies like Apple,...  ...data, or AI practice at an MBB, Big Four, or equivalent firm. Forward-deployed or AI startup experience is a strong plus. Hands‑on AI power... 
    Suggested
    Contract work
    Internship
    Work at office
    Remote work
    Worldwide

    Lazer Technologies

    Winnipeg, MB
    5 days ago
  • $165k - $330k per year

    About BasetenBaseten powers mission‑critical inference for the world’s most dynamic AI companies, such as...  ...Capital. Join us and help build the platform engineers turn to for shipping AI products. The RoleAs a Forward Deployed Engineer at Baseten, you will partner directly... 
    Suggested
    Internship
    Flexible hours

    Baseten

    Winnipeg, MB
    25 minutes ago
  •  ...time-intensive workflows with AI agents, deploying cutting-edge technology into one of...  ...About the Role We are looking for a Forward Deployed Engineer to join our team. This role is ideal...  ...solutions, and build the systems needed to deploy Didero successfully.You will work... 
    Suggested
    Long term contract
    Casual work
    Work at office

    Didero, Inc.

    Winnipeg, MB
    26 minutes ago
  •  ...DoppelDoppel is building the future of social engineering defense. Our AI-native platform uses...  ...requirements and drive successful deployments. Build and maintain integrations with...  ...scan over 150 billion entities daily and deploy continuously adaptive AI SOC agents, paired... 
    Suggested
    Work at office
    Flexible hours

    Wilco

    Winnipeg, MB
    31 minutes ago
  •  ...AI Transformation team to help its businesses adopt AI-first engineering practices, modernise their technology and significantly improve...  ...improve how they operate. You'll operate in a forward‑deployed capacity, embedding yourself within different software businesses... 
    Long term contract

    Grove Talent

    Winnipeg, MB
    26 minutes ago
  •  ...professional growth.Your Opportunity BDO Canada is looking to onboard a Forward Deployment Engineer who is responsible for partnering directly with business and technology stakeholders to design, develop, and deploy technology solutions that address complex business challenges.... 
    Long term contract

    BDO Canada

    Winnipeg, MB
    26 minutes ago
  • $85.5k - $114k per year

    Position Title: Forward Deployment EngineerPosition Type: Regular - Full-TimeRequisition ID: 44875In every role, McCainers are ambitious...  ...with McCain easy.About The Role. The Forward Deployment Engineer is accountable for owning high-value AI use cases from... 
    Permanent employment
    Work at office
    Remote work
    Work from home
    2 days per week

    McCain Foods Limited

    Winnipeg, MB
    27 minutes ago
  •  ...offering meaningful virtual support to patients across an expansive array of specialties, in all 50 states.About the Role Forward Deployed Engineering is how we build that platform with real clients instead of guessing. An FDE embeds with a client, works in the client\ 's... 
    Remote work
    Flexible hours

    Health Data Innovations, Inc.

    Winnipeg, MB
    28 minutes ago
  • $176.61k - $243.68k per year

    We're looking for a Staff Forward Deployed AI Engineer to lead the design, delivery, and adoption of AI/ML systems directly within client environments...  ...makes it land. You'll raise the bar on how we build and deploy AI systems, and help clients actually adopt and scale what... 
    Long term contract

    Robots & Pencils LP

    Winnipeg, MB
    25 minutes ago
  •  ...to customer sites Toronto, Canada Own deployments from an ambiguous problem through to a...  ...Aerium's FDEs sit at the intersection of engineering, customer deployments, and product discovery...  ...that context together, then train and deploy AI into their highest-value workflows.... 
    Full time

    Aerium

    Winnipeg, MB
    28 minutes ago
  •  ...the team to help push our shopping cart forward. If you're ready to do the best work of...  ...the playbook as we go. As a Forward Deployed Engineer, you are Instacart's hands-on technical...  ...business workflows. Design, build, and deploy AI and agentic solutions tailored to each... 
    Work at office
    Work from home
    Flexible hours

    EngineersOfAI

    Winnipeg, MB
    26 minutes ago
  • $100k - $150k per year

     ...professional growth.Your Opportunity BDO Canada is looking to onboard a Forward Deployment Engineer who is responsible for partnering directly with business and technology stakeholders to design, develop, and deploy technology solutions that address complex business challenges.... 
    Long term contract
    Work at office
    Local area
    Flexible hours

    BDO Canada LLP

    Winnipeg, MB
    28 minutes ago
  •  ...rapidly growing startup with strong product market fit and deployments at a growing number of top‑20 US and Canadian health systems...  ..., with early backing from Geoffrey Hinton. The roleAs a Forward Deployed Engineer, you own the implementation of Signal 1’s platform, AIMS,... 

    Signal 1

    Winnipeg, MB
    31 minutes ago
  •  ...secure access, reliable configuration, automated testing, deployment pipelines, monitoring, and rollback procedures. Troubleshoot...  ...and delivery practices. Ideal CandidateThe ideal Forward Deployment Engineer combines strong engineering fundamentals with curiosity about... 
    Work at office

    Optimus Information

    Winnipeg, MB
    30 minutes ago
  •  ...one solution at a time How do you turn ambitious use cases into real, working solutions that prove their value fast? As a Forward Deployed Engineer, you bring ideas to life through hands-on prototyping, transforming complex requirements into tangible, high-impact... 

    Coveo

    Winnipeg, MB
    31 minutes ago
  •  ...team that ships daily and moves fast. We're looking for a Forward Deployed Engineer who thrives at the intersection of engineering and client...  ...customers, including global reinsurers, brokers, and carriers, to deploy Ultrassure, build custom integrations, and ensure our... 
    Internship
    Work at office
    3 days per week

    Ultrassure Inc.

    Winnipeg, MB
    27 minutes ago
  • $201k - $335k per year

     ...Founded in 2019 and fully distributed, we're backed by Accel, CRV, Insight, Heavybit, and Uncork Capital. About the RoleAs a Forward Deployed Engineer at Tailscale, you’ll be the bridge between our technical capabilities and the needs of our most strategic customers. You... 
    Long term contract
    Internship
    Work at office
    Remote work
    Home office
    Flexible hours

    FDE Times

    Winnipeg, MB
    29 minutes ago
  •  ...against client systems. Own the last mile: deployment, monitoring, user adoption, and...  ...trusted technical counterpart to client engineering leads and executive sponsors; communicate...  ...directly when that's what moves the engagement forward. This isn't an architecture-only or... 

    3Pillar

    Winnipeg, MB
    31 minutes ago
  •  ...We work onsite in Toronto five days a week. The roleAs a Forward Deployed Engineer, you sit at the customer boundary. You'll work directly with...  ...workflows using agents, tools, APIs and browser automation Deploy to production, write evals for the outcomes that matter, and... 

    General Magic

    Winnipeg, MB
    26 minutes ago
  •  ...partners with venture-backed technology companies looking for Forward Deployed Engineers (FDEs) who can bridge the gap between sophisticated...  ..., workflows, and business challenges. Design, build, and deploy solutions using the company's core technology. Develop integrations... 
    Internship

    People Culture Talent

    Winnipeg, MB
    26 minutes ago
  •  ...Production experience required. Builder mindset non-negotiable. Salesforce is hiring Forward Deployed Engineers — experienced Technical Builders who design, build, and deploy agentic AI solutions directly inside enterprise customer environments. You'll work as part... 
    Live In

    Leadout Capital

    Winnipeg, MB
    31 minutes ago
  •  ...work on shelves everywhere — and outsized ownership while you build — we'd love to meet you. The RoleWe are looking for a Forward Deployed Engineer to work directly with enterprise customers to turn real-world financial workflows into production software. This role... 
    Internship
    Local area
    Relocation package
    Weekend work

    FDE Times

    Winnipeg, MB
    29 minutes ago
  • Forward-deployed engineers are the bridge between what a client needs and what we build. You will embed with a customer team, find the highest-leverage use case, and ship it, then iterate in production until it earns its place in their day. It is part engineering, part product... 

    Urban Ridge Supplies

    Winnipeg, MB
    30 minutes ago
  • $150k - $235k per year

     ...delivery partner. Engagements are production-grade: agents, data products, AI-augmented operations, workforce transformation. Forward Deployed Engineers live inside client organizations — in their standups, codebases, and architecture decisions. You own your assigned... 
    Long term contract
    Manual labor
    Work at office
    Remote work
    Work from home
    Worldwide

    Caylent

    Winnipeg, MB
    31 minutes ago
  • Build production AI systems with Caylent as a Forward Deployed Engineer, using LLM applications and cloud-native development remotely worldwide.This Caylent role sits within Anthropic’s dedicated AI services practice. You will own assigned workstreams, contribute to architecture... 
    Manual labor
    Remote work
    Worldwide

    Caylent

    Winnipeg, MB
    26 minutes ago
  • Deploy data solutions with Fiveonefour using Python or Typescript, SQL, and enterprise integrations on a remote-first engineering team. Work directly with customers and internal teams to solve real-world technical challenges.As a Forward Deployed Engineer, you will support... 
    Remote work

    Fiveonefour Labs Inc

    Winnipeg, MB
    29 minutes ago
  •  ...production-ready solutions through software engineering and systems integration at BDO Canada....  ...on complex business challenges.As a Forward Deployment Engineer, you will translate business...  ...requirementsDesign, develop, test, and deploy production-grade applications and APIsBuild... 

    BDO Canada

    Winnipeg, MB
    31 minutes ago
  • Job Description We are looking for a Technical Forward Deployed Engineer who will be responsible for the hands‑on development, engineering, and delivery of AI solutions and Proofs of Concept (POCs) based on client requirements. This is the more technically focused of the... 

    Insight Global (United States)

    Winnipeg, MB
    26 minutes ago
  • ## Forward Deployed Engineer(AI)We are hiring Forward Deployed Engineers (FDEs) - senior, product-minded builders who are handed a goal, not a backlog...  ...to a shipped, live product by yourself - design, implement, deploy, and operate it - across the full stack.• AI-native to the... 

    OpportuLand

    Winnipeg, MB
    27 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Forward Deployed Engineer, Inference. Be the first to apply!