Backend Engineer — Model Inference
Best AI Tools Wiki
This position requires local presence. Please view similar jobs below.
Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.
Requirements
- 5+ years of backend engineering experience
- Strong proficiency in Go, Rust, or C++
- Experience with high-throughput, low-latency systems
- Knowledge of model serving and inference optimization
- Experience with gRPC, REST APIs, and microservices
Nice to Have
- Experience with vLLM, TensorRT-LLM, or similar
- Familiarity with GPU memory management
- Experience with continuous batching techniques
Premium health and dental
Remote-first culture
Home office budget
Annual learning stipend
Flexible PTO
Skills
Go Rust Model Serving Backend Engineering gRPC Inference Optimization
This listing was posted on 2026-02-17 and is almost certainly closed. It is kept for reference — check the employer’s own careers page for current openings.
Vincony has all 400+ AI models in one place — compare responses, AI debate, Image/Video/Voice generator, and 20 more tools to help you learn and build with AI.
#J-18808-LjbffrVacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Backend Engineer — Model Inference in Toronto, ON vacancy
- ...industry-leading training and inference speeds; over 10 times faster than... ...works with the leading model labs, global enterprises, and... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer... ...across models and accelerator backends. This role sits at the...SuggestedFull time
$100k - $145k per year
...evolving business needs. Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance... ...Architecture, and Enterprise AI teams to onboard new research models into production. About the Role As a Senior Inference...SuggestedFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week- ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based... ...computation. Cerebras works with the leading model labs, global enterprises, and cutting-edge... ...-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to...SuggestedFull time
- ...humanity. We’re training and deploying frontier models for developers and enterprises who are... .... Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...they influence latency and throughput of inference. ~ Strong understanding or working experience...SuggestedFull timeWork at officeRemote workFlexible hours
$90 - $100 per hour
...Senior AI Backend Engineer (Python/FastAPI, Agentic AI & LLM Applications) Job Type: Contract Contract Duration: 6 Months Pay Rate: CAD... ...on innovative Agentic AI initiatives involving Large Language Models (LLMs), cloud-native architectures, API integrations, and modern...SuggestedContract workFor contractors$136.7k - $182.3k per year
..., so we pair a small, senior engineering team with the reach of one of... ...scaling it globally, and the backend has to stay fast, safe for kids... ...ML Serving engineer on GPU inference. Mature our observability:... ...we can see what each request, model and service actually costs....Full timeRemote workFlexible hours- ...requires more than selecting the newest model. It requires disciplined evaluation, high... ...We are looking for an applied AI Modeling Engineer to improve the intelligence, accuracy, safety... ..., model services, or training and inference pipelines. ~ Strong software engineering...Long term contractFull timeTemporary workInternshipImmediate start
- ...humanity. We’re training and deploying frontier models for developers and enterprises who are... .... Cohere is a team of researchers, engineers, designers, and more, who are passionate... ...boundaries of what AI systems can do — but inference is still the bottleneck. The Model Efficiency...Full timeWork at officeRemote workFlexible hours
$100k - $180k per year
...opportunity: Join our Blocks team as a Software Engineer and play a critical role in shaping the... ...and internal teams to create advanced modeling features. Here’s why this is an... .... If you're passionate about backend engineering, solving complex problems, and...Full timeRemote work$196.8k - $270.6k per year
...we’re just getting started. Role Overview As a Staff Backend Software Engineer at Harvey, you’ll play a pivotal role in shaping the... ...role is based in Toronto, Canada. We use an in-person work model and offer relocation assistance to new employees. What...Full timeWork at officeRelocation packageFlexible hours- ...revenue. What you’ll do As a software engineer on Radar, you’ll build products and infrastructure... ...fraud and abuse. Your work will span backend services, enterprise APIs, and user... ...and data scientists to bring new signals, models, and AI capabilities into production Own...Full time
$92k - $118k per year
...Build scalable backend applications and integrate AI-powered workflows into complex financial... ...Capco, we’re looking for a Java Backend Engineer with practical experience building AI-... ...backend services, integrate Large Language Models (LLMs) and AI capabilities into...InternshipImmediate start$136k - $160k per year
...Expectations are high, and so are the rewards. As a Software Engineer , you’ll build and own backend services, infrastructure, and data systems that support... ...architectures. ~ Strong grasp of system design, data modeling, and software engineering fundamentals. ~ Care for...Contract workWork at officeWorldwideFlexible hoursShift workNight shiftWeekend work3 days per week- ...financial systems, B2B payment processing and more. As a Software Engineer you will be responsible for building Zip’s core products and... ...Home office stipend ~ Phone/internet reimbursement ~ Hybrid model + 5 flexible remote days per quarter ~ Paid parental leave ~...Full timeImmediate startRemote workHome officeFlexible hours
$167.55k - $209.44k per year
...canonical and ready to query, with no engineering or maintenance required. We’re... ...across the systems, clouds, engines, and tools they rely on. dbt... ...a Staff Software Engineer, Backend to join our Reverse ETL... ...authentication, billing, data model, UI and more. You’ll be a senior...Full timeInternshipWork at officeRemote workFlexible hours2 days per week- ...and supporting production-ready products from scratch. ~5+ years of professional experience with Java. ~6+ years of experience in backend development. ~ Quick learner with an ambitious and results-driven personality. ~ Excellent communication and organizational...InternshipImmediate start
- ...items, and ensures seamless and quick payments. Across the Link Engineering org, we focus on building delightful payment experiences and... ...responsibility and an entrepreneurial mindset ~ Interest in working as a backend specialist across varying technologies and stacks to solve...Full timeInternship
- ...opportunities to reach your full potential in an environment that’s engineered for people. At CIMA+, we care about our people and make sure... ...a better world! We are looking for Senior Traffic Engineer/Modeller to support our expanding transportation sector in Ontario and work...Permanent employmentFull timeWork at officeWork from homeFlexible hours
- ...learning platform. Develop reliable, performant, well-tested, readable, and maintainable backend code. Participate in code reviews and collaborate with Machine Learning Engineers, Data Scientists, and other cross-functional partners. Monitor deployed code, fix bugs,...Full timeInternshipWork at officeRemote work3 days per week
- Build a better way to borrow Fig is a Canadian fintech making personal lending simpler, faster, and more accessible for Canadians. We offer fully digital personal loans, helping customers apply in minutes and receive decisions quickly, without paperwork, branch visits, or...Full time
usd205k per year
...company. We build cutting-edge foundation AI models and end-to-end products that are designed... .... Cohere is a team of researchers, engineers, designers, and more, who are all passionate... ...a senior product leader to own Cohere's Inference as a Service business end to end. The product...Full timeWork at officeLocal areaRemote workHome office$101k - $169k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133929 Primary Location: Toronto, ON All Available Locations... ...Statistics, Mathematics, Economics, Data Science, Computer Science, Engineering, Quantitative Finance, or a related quantitative discipline. ~...Permanent employmentManual laborFlexible hours- ...customer satisfaction and drive merchant conversion rates. The Risk Engineering team develops products that minimize financial and regulatory... ...can be found here . What you’ll do We’re looking for Backend engineers who want to make an impact on managing money at a...Internship
- ...match, employee assistance programs and time away - don't worry, we've got you covered. The Job at a Glance As a Principal Backend Engineer, you will design, architect, and optimize scalable microservices that power our eCommerce and enterprise platforms. You'll drive...Full timeContract work
$140k - $180k per year
...every message sent out of our systems. You will report to an Engineering manager in this role. What You’ll Do Contribute to... ...experience, with a strong track record of building and operating backend or platform systems in production. ~ Significant experience designing...- ...We are hiring a Senior Backend Engineer for its Customer Focus Group (CFG) — a technical team that bridges engineering and the commercial side of the product. CFG members handle development, architecture, product, and direct customer interaction: translating customer needs...
$68k - $102k per year
...Job Type: Temporary Contract Work Model: Hybrid Reference code: 133146 Primary Location: Toronto, ON All Available... ...develop your career with our exponentially expanding Financial Engineering and Modeling group? Are you up for the challenge to help the most...Temporary workFlexible hours$185k - $230k per year
...ingestion platform underneath it all. It is a mix of product and backend engineering, shaping the APIs and deeper backend components our customers... ..., SQS, Kafka, EventBridge). Orchestration and workflow engines (Step Functions, Temporal). JVM languages for cross-team...Full timeInternshipWork at officeFlexible hours$180k - $220k per year
...Toronto office to support collaborative team dynamics and innovative problem-solving. BitGo is looking for a Senior Software Engineer (Backend) to join our Mobile team and help us build the first-time user experience for our retail users. Responsibilities: Design and...Full timeWork at officeWorldwide$200k - $235k per year
...everything we do. Expectations are high, and so are the rewards. The Backend Platform team’s mission is to enable fast, safe, and reliable... ...frameworks, libraries, and tooling that support hundreds of engineers working across backend services. By improving development...Long term contractWork at officeFlexible hoursShift work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Backend Engineer — Model Inference. Be the first to apply!
