Engineering Manager, Inference Router: Global Low-Latency
Cerebras
Cerebras Systems is seeking an Engineering Manager, Inference Router to lead the team that directs where every inference request runs across Cerebras data centers and partners. You will own global routing, cache-aware scheduling, and autoscaling, partnering with ML and cloud teams to optimize latency, throughput, and reliability.You will build and grow a distributed engineering team, drive architectural decisions, and ensure high-availability, workload resilience, and efficient use of
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Inference Router: Global Low-Latency in Winnipeg, MB vacancy
- ...industry-leading training and inference speeds; over 10 times... ...with the leading model labs, global enterprises, and cutting-edge... ...About the RoleThe Inference Router team at Cerebras builds the systems... ...massive scale. As an Engineering Manager, Inference Router, you...Suggested
- Build deterministic low-latency compute for electronic trading at HSBC in Toronto, using Red Hat Enterprise Linux, hardware tuning, and automation.This hands-on engineering role supports latency-sensitive trading platforms across co-located and enterprise data centers. You will...SuggestedPermanent employment
- PeoplePilot in Mississauga, Ontario, seeks an experienced Senior Java Low Latency Developer to design and build high-performance enterprise applications. You will optimize Java applications, implement multithreading, and develop scalable microservices using Spring Boot and...Suggested
- Build low-latency Java systems onsite in Mississauga with N2P Systems, using RESTful APIs and enterprise application development expertise... ...delivery team. Apply 8+ years of hands-on Java, low-latency engineering, RESTful APIs, and microservices experience. This existing contract...SuggestedContract work
$83.3k - $124.9k per year
...postes de travail à très faible latence et à haut rendement. Elle... ...opportunity Parsec creates ultra-low latency, high-performance... ...IOKit, CoreGraphics, window/input management) and shipping native apps on... ...| Employee Resource Groups | Global Employee Assistance Program |...SuggestedDaily paidWork at officeRemote workWork from homeWorldwideHome officeFlexible hours- C++ systems engineering meets ultra-low-latency trading in Montreal, with hybrid work and performance measured in nanoseconds. Build software influencing... ...systems and develop trading platforms, matching engines, execution systems, and low-latency data stores. Modern C++...
$145k - $193k per year
...to you.About the TeamAs part of the Bet Engine team, you will be working with a group of... ..., and performance-tune GraphQL APIs, low-latency gRPC services, and SQL queries powering... ...enforcement, promotional records, and risk management, among other things.Own technical problems...- ...Uber Technologies Inc. is seeking software engineers to join the Hydration Platform team, building the foundation platform used by Uber... ...and checkout. The Hydration Platform powers high-throughput, low-latency services used by merchants, consumers and couriers in real time...
- Architect low-latency Java risk platforms as a senior engineering leader, using concurrency, performance tuning, and distributed systems expertise. This full-time role supports global trading desks.The Applications Development Technical Lead Analyst serves as principal designer...Full time
$120k - $130k per year
Software Engineering Onsite Contract ID: REQ-43709 N2P Systems Mississauga, Ontario, Canada 8+ years $120K - $130K CAD Posted 6 days... ..., you will put 8+ years of hands-on experience with Java, Low-Latency Development and RESTful APIs to work on mission-critical enterprise...Contract work- ...developer to design and enhance pricing features for a high-performance market risk platform. You will modernize components, optimize low-latency services, and collaborate with traders, sales and IT to deliver robust pricing solutions. The role requires expertise in C#/.NET...
- Build low-latency trading integrations from Canada as a Software Developer using C++, Python, Linux, and specialized networking infrastructure... ...live trade. The work combines software development, systems engineering, binary protocol adaptation, and latency optimization. You...
- Develop low-latency Java applications for Citi’s equities technology environment, with Unix or Linux and trading systems expertise. This is... ...Java development, agile collaboration, and trading application knowledge to support Citi’s global Delta One technology. #J-18808-LjbffrFull time
- Astra-North Infoteck Inc. in Mississauga, Canada, seeks a Java-focused software engineer to design, develop, test, and maintain enterprise-grade applications using Java. You will build RESTful APIs and microservices with Spring Boot and Spring Cloud, ensuring scalability and...
- ...CLR3 in Toronto is seeking a performance-focused systems engineer to write and tune decoders, stream processors and routing logic for real-time Solana data. You will measure latency, profile with flame graphs and benchmarks, and own regression tests so performance improvements...Work at office
- ...are seeking an experienced Senior Java Low Latency Developer to join our team in Mississauga... ...solutions while following modern software engineering and DevOps practices. Key... ...tuning, garbage collection, and memory management. Hands-on experience with Spring Boot, Spring...
$120.8k - $170.8k per year
...Development Technical Lead Analyst is a senior engineering and architectural leadership role, within the global Client Risk and Position Management technology organization. In this... ...hands‑on lead engineer for mission-critical, low latency, and high-throughput risk...Full time- ...Equities Technology transformation through low-latency Java, microservices, and execution... ...throughput applications, refine Smart Order Router performance, and address complex... ...business analysis. The role connects software engineering with trading protocols, distributed architecture...Full time
- Design, develop, test, and maintain enterprise-grade Java applications. Develop RESTful APIs and microservices using Spring Boot and Spring Cloud. Lead solution design discussions, code reviews, and performance optimization activities. Collaborate with architects, business...
- ...CLR3 in Toronto is growing its engineering team. You will design, build and ship backend services, APIs and data pipelines that run in production, collaborating with a small senior team. We work on real-time, high-throughput systems including streaming pipelines, RPC infrastructure...
- A technology solutions provider in Vancouver is seeking a Java Backend Developer to design and optimize backend services in a high-throughput environment. Candidates should have over 5 years of experience in backend development, strong proficiency in Java, and extensive knowledge...Full time
- ...experienced Senior Java Backend Developer to join our high-performing engineering team. You will drive backend development using Java, Spring,... ...Java development, strong TDD practice, and familiarity with low-latency systems in finance. You will collaborate across teams to...
- ...experienced real-time networked systems engineer to own the latency link between robots and operators. You will design, implement, and optimize low-latency video and control transport over... ...budgets, and monitor performance across global sites. This role requires deep hands-on...
- National Bank of Canada seeks an analyst/associate on the Electronic Trading Algorithmic Development team to help build and evolve our electronic trading capabilities for FX and Fixed Income. You will work with traders and quantitative colleagues to deliver production-ready...
- A leading capital markets firm in Ontario is seeking a driven C++ Software Engineer to design, build, and maintain high-performance trading systems. This mid-senior level role emphasizes solving complex challenges with clean code and collaboration with traders. Applicants should...Relocation package
- ...Cohere is a team of researchers, engineers, designers, and more, who are... ...their craft. We are a global technology company headquartered... ...ambiguous, customer-specific inference challenges—ranging from multi-... ...models achieve exceptionally low latency, high throughput, and...Full timeWork at officeLocal areaRemote workHome office
- Qualcomm Canada ULC is seeking an engineer to deploy ML models on a low power AI accelerator. You will map high level operators to hardware instructions... ...with quantization. The role focuses on improving inference efficiency and accuracy on Qualcomm's hardware, requiring...
- Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements 5+ years of backend engineering experienceStrong...Work at office
$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...Baseten multi-cloud capacity management (MCM) unifies deploymentsResponsibilities... ...APIs where reliability, latency, and scale are first-class...Flexible hours- Insight Global in Toronto seeks a lead Java developer to own the Rates Derivative Pricing System for a Canadian Tier 1 Bank. You’ll be hands-on, writing production code daily while setting the technical direction for architecture and performance. This front-office-facing role...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Inference Router: Global Low-Latency. Be the first to apply!

