Backend Engineer for Inference Optimization
Best AI Tools Wiki
This position requires local presence. Please view similar jobs below.
Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services.
Candidates for this position must have over five years of backend engineering experience and strong programming skills in Go, Rust, or C++. You'll work on building backend services that enhance Cohere's enterprise API, focusing on batching strategies and performance optimization.
Key Responsibilities:
• Establish low-latency serving infrastructure for model inference
• Develop backend services for the enterprise-level API
• Implement batching strategies to maximize throughput efficiency
• Optimize model serving and inference processes
• Collaborate within a remote-first culture
Requirements:
• 5+ years of relevant backend engineering experience
• Proficiency in Go, Rust, or C++
• Experience with low-latency and high-throughput systems
• Knowledge of model serving optimization
• Familiarity with gRPC, REST APIs, and microservices
Utilize your expertise in backend engineering to drive innovations in model inference at Cohere.
#J-18808-Ljbffr
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Backend Engineer for Inference Optimization in Toronto, ON vacancy
$182k - $215k per year
...The Role We're looking for a Staff Backend Engineer to join our Customer Value Optimization (CVO) tribe at HelloFresh. This is a high-impact individual contributor role sitting at the intersection of Data Science and Backend Engineering. You'll be the technical bridge that...SuggestedWork at officeRemote workWork from homeFlexible hours3 days per week- ...customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...work closely with many teams to deploy optimized NLP models to production in low latency,... ...influence latency and throughput of inference. ~ Strong understanding or working experience...SuggestedFull timeWork at officeRemote workFlexible hours
- ...assistance programs and time away - don't worry, we've got you covered. The Job at a Glance As a Principal Backend Engineer, you will design, architect, and optimize scalable microservices that power our eCommerce and enterprise platforms. You'll drive backend architecture...SuggestedFull timeContract work
$88k - $110k per year
...at scale, leveraging Machine Learning to better serve our customers. The Machine Learning Platform (MLP) team is seeking a backend Software Engineer to help build and operate our platform, which supports real-time, online, and offline ML model execution, development, and iteration...SuggestedHourly payFull timeInternshipWork at officeFlexible hours3 days per week$100k - $145k per year
...Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting... ...an AI Inference Engineer is responsible for productionizing, optimizing, and scaling AI and LLM workloads that power TR’s AI driven products...SuggestedFull timeWork at officeLocal areaFlexible hours- ...learning platform. Develop reliable, performant, well-tested, readable, and maintainable backend code. Participate in code reviews and collaborate with Machine Learning Engineers, Data Scientists, and other cross-functional partners. Monitor deployed code, fix bugs,...InternshipWork at officeRemote work3 days per week
- ...Area , and is a Certified Great Place to Work in and . Introduction: AppLovin's Array team is seeking an experienced Staff Backend Software Engineer to join our team. Array is a seamless, end-to-end app management suite that delivers more value for mobile operators and end...Full timeWork from homeFlexible hours
$140k - $180k per year
...every message sent out of our systems. You will report to an Engineering manager in this role. What You’ll Do Contribute to... ...experience, with a strong track record of building and operating backend or platform systems in production. ~ Significant experience designing...- ...We are hiring a Senior Backend Engineer for its Customer Focus Group (CFG) — a technical team that bridges engineering and the commercial side of the product. CFG members handle development, architecture, product, and direct customer interaction: translating customer needs...
$92k - $118k per year
...Build scalable backend applications and integrate AI-powered workflows into complex financial services environments. The Role At Capco, we’re looking for a Java Backend Engineer with practical experience building AI-powered applications, workflows, and automation...InternshipImmediate start- ...protect and grow their revenue. What you’ll do As a software engineer on Radar, you’ll build products and infrastructure that help... ...businesses understand and stop fraud and abuse. Your work will span backend services, enterprise APIs, and user experiences that put...
$185k - $230k per year
...ingestion platform underneath it all. It is a mix of product and backend engineering, shaping the APIs and deeper backend components our customers... ..., SQS, Kafka, EventBridge). Orchestration and workflow engines (Step Functions, Temporal). JVM languages for cross-team...Full timeInternshipWork at officeFlexible hours- ...businesses to accept in-person payments. Optimized Checkout and Link teams work to create... ...drive merchant conversion rates. The Risk Engineering team develops products that minimize... ...What you’ll do We’re looking for Backend engineers who want to make an impact on...Internship
$180k - $220k per year
...Toronto office to support collaborative team dynamics and innovative problem-solving. BitGo is looking for a Senior Software Engineer (Backend) to join our Mobile team and help us build the first-time user experience for our retail users. Responsibilities: Design and...Full timeWork at officeWorldwide- ...What you'll do: Design and implement backend architecture following best software engineering principles Develop clean, efficient code with tests ensuring code quality Participate in code reviews and invite others to review your code Champion the importance of...Full timeWork at officeWork from home
$120k - $150k per year
...DoorDash is building the world's most reliable on-demand, logistics engine for delivery! We're looking for experienced engineers to join our... ..., merchants, and dashers. About the Role We’re looking for Backend Engineers to work on both Product and Product Platform based...Full timeWork at officeLocal area$149.5k - $187k per year
...About the Role We’re looking for Senior Backend Engineers to work on both Product and Product Platform based teams. Product focused Engineers work at the intersection of product and infrastructure to solve key business problems with elegant technical solutions. You'll operate...Full timeWork at officeLocal area$65 per hour
...refactoring. Work independently and asynchronously to meet project requirements. Collaborate with backend engineers and data practitioners to optimize workflows. Qualifications Must-Have PyCharm installed on a Mac running macOS ....Remote jobContract workSummer work$72.06k - $138.94k per year
...At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers,... ...seeking a hands-on machine learning systems engineer to optimize production-grade large language model inference across current and next-generation AWS Trainium...Permanent employmentFull timeLocal areaRemote work$185k - $231.5k per year
...DoorDash is building the world's most reliable on-demand, logistics engine for delivery! We're looking for experienced engineers to join our... ...problems with elegant technical solutions. You'll operate our backend services and architecture that support all product functionality...Full timeLocal area$40 - $50 per hour
...Larry Summers , and Jack Dorsey . Position: Software Engineer Type: Contract Compensation: $40–$50/hour... ...Have Strong Python skills. Experience with APIs , backend systems, and debugging. Familiarity with Docker , Linux...Remote jobContract workSummer workLocal area- ...Job Title- Spend Optimization Consultant We are: Supply Chain, and we move fast, think fast, and work fast. Our Fortune 500 clients need big-picture change, so we come at their challenges from all sides with functional insights, data power, digital leadership, and extensive...Hourly payFull timeWork at officeLocal areaMonday to friday
$20 per hour
...Ultraluxe Land, Private Jets, and Air. To learn more about Kensington, visit kensingtontours.com . About the Role The Revenue Optimization Intern is directly responsible for supporting the Kensington Partner Relations team to drive various supplier revenue optimization...Hourly payFull timeInternshipLocal areaWorldwide$108k - $158k per year
...Responsibilities In this opportunity as Senior Manager, Website Optimization & Personalization, you will own the end-to-end strategy,... ...and validate new personalization strategies Own the learning engine—create documentation, maintain learning repositories, and produce...Full timeWork at officeLocal areaFlexible hours- ...Innovative Companies, and is trusted by nearly 1,000 top brands—including Ford, Ace Hardware, Kumon, Liberty Tax, and more—to automate and optimize local marketing tasks across all locations. Founded in 2012 and backed by leading strategic investors, SOCi is transforming how multi...Full timeLocal area
- ...focuses on automation, data extraction, and intelligent workflows, with a strong emphasis on backend reliability and speed of execution. Were looking for a Full-Stack Engineer (backend-leaning) who can take ownership of features end to end. The role is approximately 70...Remote jobImmediate startFlexible hours
- ...Innovative Companies, and is trusted by nearly 1,000 top brands—including Ford, Ace Hardware, Kumon, Liberty Tax, and more—to automate and optimize local marketing tasks across all locations. Founded in 2012 and backed by leading strategic investors, SOCi is transforming how multi...Full timeLocal area
- ...you more specific details for this role. Job Description: Part of the Corporate Actuarial department, the Project Development & Optimization team participates in various projects with respect to the liability valuation, strategic planning, capital and risk management team...Full timeWork from home
- KittySpout / DoggySpout is looking for a hands-on CRO Lead to join our team! You will own every conversion test across our site, landing pages, paid-acquisition funnels, on-site offers and post-purchase upsells. This is an all-in-one role: you set the strategy and you do ...Full timeRemote workWeekend work
- ...Ergomed seeks a Director of Business and Process Optimization for its pharmacovigilance function in Toronto. This leadership role focuses on strategic direction, cross-functional process improvement, departmental management, and organizational performance optimization within...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer for Inference Optimization. Be the first to apply!
