Forward Deployed Engineer, Inference
FDE Times
Who are we?Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this role?Are you energized by bridging the gap between frontier AI capability and complex customer reality? Do you want to architect high-performance, resilient machine learning systems directly inside strategic enterprise environments? We are looking for a Staff Forward Deployed Engineer (FDE) to join our team. The team is responsible for taking our large language models and making them work reliably, securely, and at peak performance within our customers' custom infrastructure and data perimeters.
In this role, you will act as the principal technical translation layer between our core engineering teams and our strategic partners. You will own the architecture for highly ambiguous, customer-specific inference challenges—ranging from multi-tenant model serving to multi-datacenter disaster recovery and custom hardware validation. You will lead technical adoption end-to-end, ensuring our models achieve exceptionally low latency, high throughput, and seamless resilience in the field.
As a Forward Deployed Engineer, you will
Embed directly with customer engineering teams to architect the "connective tissue" between our AI models and their live, complex production environments.
Design advanced model serving topologies, implementing multi-tenant architectures, intelligent model routing, and cross-datacenter failover strategies for multi-cluster environments.
Optimize "AI-in-a-box" and private deployments, balancing localized SRE constraints like Kubernetes multi-cluster scale with raw model performance.
Conduct rigorous benchmarking and profiling of customer LLM workloads, root-causing performance degradation (e.G., slow generation) via metrics, dashboards, and distributed logs.
Accelerate hardware validation, collaborating with clients to run and support Cohere models on next-generation accelerators (GPUs, TPUs, AMD, and custom ASICs).
Translate complex field friction into platform upgrades, delivering prescriptive feedback and contributing directly back to core product features.
Ensure Day-1 production reliability, assisting customers in establishing sound deployment patterns, SLOs, and observability frameworks.
You may be a good fit if you have
8+ years of engineering experience running production infrastructure, designing large-scale distributed systems, or deploying enterprise software in complex environments.
Deep technical depth in production Kubernetes, including orchestration across multi-cluster and hybrid/multi-cloud ecosystems (GCP, Azure, AWS, OCI).
Strong understanding of LLM architecture and inference dynamics, specifically how attention mechanisms, compute-bound prefill, and memory-bound decode phases dictate live performance.
Hands-on experience with modern inference engines and optimization stacks (e.G., vLLM, TensorRT-LLM, lmd, or Dynamo).
Familiarity with distributed serving techniques, such as prefill/decode disaggregated serving, distributed KV caching, and multi-GPU workloads.
Exceptional customer-facing technical leadership, with a proven track record of scoping highly ambiguous problems and steering executive technical stakeholders.
The high agency, grit, and adaptability to write same-day production code while managing client-side deployment politics or blockers.
Strong programming foundations in Python, Go, or C++, comfortable moving fluidly between backend data pipelines and infrastructure layer tuning.
Full-Time Employees at Cohere enjoy these Perks
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
We strive to create an inclusive work environment for all;
we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
#J-18808-Ljbffr
We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.
We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.
We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!
Why this role?Are you energized by bridging the gap between frontier AI capability and complex customer reality? Do you want to architect high-performance, resilient machine learning systems directly inside strategic enterprise environments? We are looking for a Staff Forward Deployed Engineer (FDE) to join our team. The team is responsible for taking our large language models and making them work reliably, securely, and at peak performance within our customers' custom infrastructure and data perimeters.
In this role, you will act as the principal technical translation layer between our core engineering teams and our strategic partners. You will own the architecture for highly ambiguous, customer-specific inference challenges—ranging from multi-tenant model serving to multi-datacenter disaster recovery and custom hardware validation. You will lead technical adoption end-to-end, ensuring our models achieve exceptionally low latency, high throughput, and seamless resilience in the field.
As a Forward Deployed Engineer, you will
Embed directly with customer engineering teams to architect the "connective tissue" between our AI models and their live, complex production environments.
Design advanced model serving topologies, implementing multi-tenant architectures, intelligent model routing, and cross-datacenter failover strategies for multi-cluster environments.
Optimize "AI-in-a-box" and private deployments, balancing localized SRE constraints like Kubernetes multi-cluster scale with raw model performance.
Conduct rigorous benchmarking and profiling of customer LLM workloads, root-causing performance degradation (e.G., slow generation) via metrics, dashboards, and distributed logs.
Accelerate hardware validation, collaborating with clients to run and support Cohere models on next-generation accelerators (GPUs, TPUs, AMD, and custom ASICs).
Translate complex field friction into platform upgrades, delivering prescriptive feedback and contributing directly back to core product features.
Ensure Day-1 production reliability, assisting customers in establishing sound deployment patterns, SLOs, and observability frameworks.
You may be a good fit if you have
8+ years of engineering experience running production infrastructure, designing large-scale distributed systems, or deploying enterprise software in complex environments.
Deep technical depth in production Kubernetes, including orchestration across multi-cluster and hybrid/multi-cloud ecosystems (GCP, Azure, AWS, OCI).
Strong understanding of LLM architecture and inference dynamics, specifically how attention mechanisms, compute-bound prefill, and memory-bound decode phases dictate live performance.
Hands-on experience with modern inference engines and optimization stacks (e.G., vLLM, TensorRT-LLM, lmd, or Dynamo).
Familiarity with distributed serving techniques, such as prefill/decode disaggregated serving, distributed KV caching, and multi-GPU workloads.
Exceptional customer-facing technical leadership, with a proven track record of scoping highly ambiguous problems and steering executive technical stakeholders.
The high agency, grit, and adaptability to write same-day production code while managing client-side deployment politics or blockers.
Strong programming foundations in Python, Go, or C++, comfortable moving fluidly between backend data pipelines and infrastructure layer tuning.
Full-Time Employees at Cohere enjoy these Perks
A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.
Full health and dental benefits, including a separate budget for mental health.
RRSP matching, 401K, Pension Scheme.
100% Parental Leave top-up for up to 6 months, for either parent.
Annual enrichment benefits: Arts & culture, fitness/wellness, quality time, and a workspace improvement credit. Education & learning stipend for conferences, courses, and coaching.
6 weeks of paid vacation (30 working days!)
Budget for traveling to other offices if you are remote, plus an annual company offsite.
How and Where We Work
Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.
For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.
For those not near an office: a co-working benefit so you can work alongside others in your city.
Everyone receives a $500 home office stipend to set up your workspace properly.
We strive to create an inclusive work environment for all;
we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.
We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Forward Deployed Engineer, Inference in Winnipeg, MB vacancy
- ...leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside... ...environments. You will own the architecture for complex inference challenges, enable low latency and high throughput, and...Suggested
- ...a world-class digital product studio composed of 180+ senior engineers and designers with backgrounds from companies like Apple,... ...data, or AI practice at an MBB, Big Four, or equivalent firm. Forward-deployed or AI startup experience is a strong plus. Hands‑on AI power...SuggestedContract workInternshipWork at officeRemote workWorldwide
$165k - $330k per year
About BasetenBaseten powers mission‑critical inference for the world’s most dynamic AI companies, such as... ...Capital. Join us and help build the platform engineers turn to for shipping AI products. The RoleAs a Forward Deployed Engineer at Baseten, you will partner directly...SuggestedInternshipFlexible hours$95.13k - $145.13k per year
...Role Production experience required. Builder mindset non-negotiable. Salesforce is hiring Forward Deployed Engineers — experienced Technical Builders who design, build, and deploy agentic AI solutions directly inside enterprise customer environments. You'll work as part...SuggestedLive In- ...time-intensive workflows with AI agents, deploying cutting‑edge technology into one of... ...About the Role We are looking for a Forward Deployed Engineer to join our team. This role is ideal... ...solutions, and build the systems needed to deploy Didero successfully.You will work...SuggestedLong term contractCasual workWork at office
- ...We work onsite in Toronto five days a week. The roleAs a Forward Deployed Engineer, you sit at the customer boundary. You'll work directly with... ...workflows using agents, tools, APIs and browser automation Deploy to production, write evals for the outcomes that matter, and...
- ...improving the security, release reliability, maintainability, and operational resilience of business-critical banking applications. Forward Deployed Engineers will conduct targeted, hands-on engagements with development teams that are facing challenges with vulnerability remediation...Contract work
$100k per year
...contributors of all seniorities. We’re looking for a Staff Forward Deployed Engineer who’s excited to build with the engineers using the AI... ...will create continuity between customers, engineering, and AI inference service products. This is an engineering role first: you...Permanent employmentRemote work- ...one solution at a time How do you turn ambitious use cases into real, working solutions that prove their value fast? As a Forward Deployed Engineer, you bring ideas to life through hands-on prototyping, transforming complex requirements into tangible, high-impact...
- ...against client systems. Own the last mile: deployment, monitoring, user adoption, and... ...trusted technical counterpart to client engineering leads and executive sponsors; communicate... ...directly when that's what moves the engagement forward. This isn't an architecture-only or...
- ...offering meaningful virtual support to patients across an expansive array of specialties, in all 50 states.About The Role Forward Deployed Engineering is how we build that platform with real clients instead of guessing. An FDE embeds with a client, works in the client's own...Remote work
- Forward-deployed engineers are the bridge between what a client needs and what we build. You will embed with a customer team, find the highest-leverage use case, and ship it, then iterate in production until it earns its place in their day. It is part engineering, part product...
- ...DoppelDoppel is building the future of social engineering defense. Our AI-native platform uses... ...requirements and drive successful deployments. Build and maintain integrations with... ...scan over 150 billion entities daily and deploy continuously adaptive AI SOC agents, paired...Work at officeFlexible hours
- ...company-wide AI transformation program, embedding engineering talent directly inside business functions. Forward Deployed Engineers (FDEs) are the builders at the center... ...identify where AI creates real leverage, then build and deploy practical solutions that fit how work actually...Work at officeLocal area
- ...Production experience required. Builder mindset non-negotiable. Salesforce is hiring Forward Deployed Engineers — experienced Technical Builders who design, build, and deploy agentic AI solutions directly inside enterprise customer environments. You'll work as part...Live In
- ...the team to help push our shopping cart forward. If you're ready to do the best work of... ...the playbook as we go. As a Forward Deployed Engineer, you are Instacart's hands-on technical... ...business workflows. Design, build, and deploy AI and agentic solutions tailored to each...Work at officeWork from homeFlexible hours
- ...secure access, reliable configuration, automated testing, deployment pipelines, monitoring, and rollback procedures. Troubleshoot... ...and delivery practices. Ideal CandidateThe ideal Forward Deployment Engineer combines strong engineering fundamentals with curiosity about...Work at office
- ## Forward Deployed EngineerApply: Remote - Canada: Full time: Posted Today: R54287## ## Job Description:Forward Deployed Engineer (FDE) – AI-First Payments# Location-Remote (Canada)# Department-Professional... ...partners to design, build, and deploy AI-enhanced payment workflows and...Full timeRemote workWork from home
$176.61k - $243.68k per year
We're looking for a Staff Forward Deployed AI Engineer to lead the design, delivery, and adoption of AI/ML systems directly within client environments... ...makes it land. You'll raise the bar on how we build and deploy AI systems, and help clients actually adopt and scale what...Long term contract- ...to customer sites Toronto, Canada Own deployments from an ambiguous problem through to a... ...Aerium's FDEs sit at the intersection of engineering, customer deployments, and product discovery... ...that context together, then train and deploy AI into their highest-value workflows....Full time
- ...Solutions is a boutique, founder-led data engineering practice for startups andscale-ups... ...delivery bench. No handoffs.The role As a Forward Deploying Engineer at Aeolus, you sit directly at... ...teams to design, integrate, and deploy custom data and AI solutions straight intotheir...Full timeContract workRemote workFlexible hours
- ...FastAPI, PostgreSQL, AWS, Terraform, and enterprise ERP integrations, you'll serve as the technical bridge between customers and product engineering while delivering mission-critical solutions in production environments. The coolest part of this role is the ability to directly...Full timeRemote work
- ...partners with venture-backed technology companies looking for Forward Deployed Engineers (FDEs) who can bridge the gap between sophisticated... ..., workflows, and business challenges. Design, build, and deploy solutions using the company's core technology. Develop integrations...Internship
- ...professional growth.Your Opportunity BDO Canada is looking to onboard a Forward Deployment Engineer who is responsible for partnering directly with business and technology stakeholders to design, develop, and deploy technology solutions that address complex business challenges....Long term contract
$201k - $335k per year
...Founded in 2019 and fully distributed, we're backed by Accel, CRV, Insight, Heavybit, and Uncork Capital. About the RoleAs a Forward Deployed Engineer at Tailscale, you’ll be the bridge between our technical capabilities and the needs of our most strategic customers. You...Long term contractInternshipWork at officeRemote workHome officeFlexible hours$100k - $150k per year
...professional growth. Your OpportunityBDO Canada is looking to onboard a Forward Deployment Engineer who is responsible for partnering directly with business and technology stakeholders to design, develop, and deploy technology solutions that address complex business challenges....Long term contractWork at officeLocal areaFlexible hours- ...moving off legacy platforms — and they need someone to make that transition seamless.The Role We're looking for our first Forward Deployed Engineer. You'll be the person who makes sure every new customer has a seamless transition onto Stardex — owning data migration end-...FreelanceInternship
- Job DescriptionCurrent NeedThe US Oncology Network is seeking a Lead Forward Deployed Engineer (FDE) to partner directly with business and operational teams to turn complex, high-value problems into validated AI-enabled solutions. This is a hands-on, business-embedded engineering...Work at office2 days per week
$150k - $235k per year
...delivery partner. Engagements are production-grade: agents, data products, AI-augmented operations, workforce transformation. Forward Deployed Engineers live inside client organizations — in their standups, codebases, and architecture decisions. You own your assigned...Long term contractManual laborWork at officeRemote workWork from homeWorldwide$85.5k - $114k per year
Position Title: Forward Deployment EngineerPosition Type: Regular - Full-TimeRequisition ID: 44875In every role, McCainers are ambitious... ...with McCain easy.About The Role. The Forward Deployment Engineer is accountable for owning high-value AI use cases from...Permanent employmentWork at officeRemote workWork from home2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Forward Deployed Engineer, Inference. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB

