Engineering Manager, Inference Router: Global Low-Latency
Cerebras
Cerebras Systems is seeking an Engineering Manager, Inference Router to lead the team that directs where every inference request runs across Cerebras data centers and partners. You will own global routing, cache-aware scheduling, and autoscaling, partnering with ML and cloud teams to optimize latency, throughput, and reliability.You will build and grow a distributed engineering team, drive architectural decisions, and ensure high-availability, workload resilience, and efficient use of
#J-18808-Ljbffr
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Engineering Manager, Inference Router: Global Low-Latency in Winnipeg, MB vacancy
- ...industry-leading training and inference speeds; over 10 times... ...with the leading model labs, global enterprises, and cutting-edge... ...About the RoleThe Inference Router team at Cerebras builds the systems... ...massive scale. As an Engineering Manager, Inference Router, you...Suggested
- Build low-latency Java systems onsite in Mississauga with N2P Systems, using RESTful APIs and enterprise application development expertise... ...delivery team. Apply 8+ years of hands-on Java, low-latency engineering, RESTful APIs, and microservices experience. This existing contract...SuggestedContract work
- Build deterministic low-latency compute for electronic trading at HSBC in Toronto, using Red Hat Enterprise Linux, hardware tuning, and automation.This hands-on engineering role supports latency-sensitive trading platforms across co-located and enterprise data centers. You will...SuggestedPermanent employment
- PeoplePilot in Mississauga, Ontario, seeks an experienced Senior Java Low Latency Developer to design and build high-performance enterprise applications. You will optimize Java applications, implement multithreading, and develop scalable microservices using Spring Boot and...Suggested
- C++ systems engineering meets ultra-low-latency trading in Montreal, with hybrid work and performance measured in nanoseconds. Build software influencing... ...systems and develop trading platforms, matching engines, execution systems, and low-latency data stores. Modern C++...Suggested
$83.3k - $124.9k per year
...postes de travail à très faible latence et à haut rendement. Elle... ...opportunity Parsec creates ultra-low latency, high-performance... ...IOKit, CoreGraphics, window/input management) and shipping native apps on... ...| Employee Resource Groups | Global Employee Assistance Program |...Daily paidWork at officeRemote workWork from homeWorldwideHome officeFlexible hours$145k - $193k per year
...to you.About the TeamAs part of the Bet Engine team, you will be working with a group of... ..., and performance-tune GraphQL APIs, low-latency gRPC services, and SQL queries powering... ...enforcement, promotional records, and risk management, among other things.Own technical problems...- ...Uber Technologies Inc. is seeking software engineers to join the Hydration Platform team, building the foundation platform used by Uber... ...and checkout. The Hydration Platform powers high-throughput, low-latency services used by merchants, consumers and couriers in real time...
- Architect low-latency Java risk platforms as a senior engineering leader, using concurrency, performance tuning, and distributed systems expertise. This full-time role supports global trading desks.The Applications Development Technical Lead Analyst serves as principal designer...Full time
- Build low-latency trading integrations from Canada as a Software Developer using C++, Python, Linux, and specialized networking infrastructure... ...live trade. The work combines software development, systems engineering, binary protocol adaptation, and latency optimization. You...
- ...CLR3 in Toronto is seeking a performance-focused systems engineer to write and tune decoders, stream processors and routing logic for real-time Solana data. You will measure latency, profile with flame graphs and benchmarks, and own regression tests so performance improvements...Work at office
- Develop low-latency Java applications for Citi’s equities technology environment, with Unix or Linux and trading systems expertise. This is... ...Java development, agile collaboration, and trading application knowledge to support Citi’s global Delta One technology. #J-18808-LjbffrFull time
- ...developer to design and enhance pricing features for a high-performance market risk platform. You will modernize components, optimize low-latency services, and collaborate with traders, sales and IT to deliver robust pricing solutions. The role requires expertise in C#/.NET...
- ...are seeking an experienced Senior Java Low Latency Developer to join our team in Mississauga... ...solutions while following modern software engineering and DevOps practices. Key... ...tuning, garbage collection, and memory management. Hands-on experience with Spring Boot, Spring...
- Design, develop, test, and maintain enterprise-grade Java applications. Develop RESTful APIs and microservices using Spring Boot and Spring Cloud. Lead solution design discussions, code reviews, and performance optimization activities. Collaborate with architects, business...
- Astra-North Infoteck Inc. in Mississauga, Canada, seeks a Java-focused software engineer to design, develop, test, and maintain enterprise-grade applications using Java. You will build RESTful APIs and microservices with Spring Boot and Spring Cloud, ensuring scalability and...
$120k - $130k per year
Software Engineering Onsite Contract ID: REQ-43709 N2P Systems Mississauga, Ontario, Canada 8+ years $120K - $130K CAD Posted 6 days... ..., you will put 8+ years of hands-on experience with Java, Low-Latency Development and RESTful APIs to work on mission-critical enterprise...Contract work- ...Equities Technology transformation through low-latency Java, microservices, and execution... ...throughput applications, refine Smart Order Router performance, and address complex... ...business analysis. The role connects software engineering with trading protocols, distributed architecture...Full time
- ...experienced real-time networked systems engineer to own the latency link between robots and operators. You will design, implement, and optimize low-latency video and control transport over... ...budgets, and monitor performance across global sites. This role requires deep hands-on...
- ...CLR3 in Toronto is growing its engineering team. You will design, build and ship backend services, APIs and data pipelines that run in production, collaborating with a small senior team. We work on real-time, high-throughput systems including streaming pipelines, RPC infrastructure...
$120.8k - $170.8k per year
...Development Technical Lead Analyst is a senior engineering and architectural leadership role, within the global Client Risk and Position Management technology organization. In this... ...hands‑on lead engineer for mission-critical, low latency, and high-throughput risk...Full time- ...experienced Senior Java Backend Developer to join our high-performing engineering team. You will drive backend development using Java, Spring,... ...Java development, strong TDD practice, and familiarity with low-latency systems in finance. You will collaborate across teams to...
- National Bank of Canada seeks an analyst/associate on the Electronic Trading Algorithmic Development team to help build and evolve our electronic trading capabilities for FX and Fixed Income. You will work with traders and quantitative colleagues to deliver production-ready...
- ...Cohere is a team of researchers, engineers, designers, and more, who are... ...their craft. We are a global technology company headquartered... ...ambiguous, customer-specific inference challenges—ranging from multi-... ...models achieve exceptionally low latency, high throughput, and...Full timeWork at officeLocal areaRemote workHome office
- Qualcomm Canada ULC is seeking an engineer to deploy ML models on a low power AI accelerator. You will map high level operators to hardware instructions... ...with quantization. The role focuses on improving inference efficiency and accuracy on Qualcomm's hardware, requiring...
- Insight Global in Toronto seeks a lead Java developer to own the Rates Derivative Pricing System for a Canadian Tier 1 Bank. You’ll be hands-on, writing production code daily while setting the technical direction for architecture and performance. This front-office-facing role...
$165k - $330k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to to ship AI products.... ...services with clear quality, latency, and cost outcomes.This role... ...includes aspects of product management, technical customer success,...InternshipFlexible hours$180k - $360k per year
...Baseten powers mission-critical inference for the world's most dynamic... ...and help build the platform engineers turn to ship AI products.... ...Baseten multi-cloud capacity management (MCM) unifies deploymentsResponsibilities... ...APIs where reliability, latency, and scale are first-class...Flexible hours$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform... ..., OpenSearch vector search, API managed model routing). The successful candidate... ...eliminate performance bottlenecks to reduce latency. Collaborate with Platform...Work at officeLocal areaFlexible hours2 days per week3 days per week- ...industry-leading training and inference speeds; over 10 times faster... ...with the leading model labs, global enterprises, and cutting-edge... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software... ...first token, throughput, tail latency, and capacity efficiency. This...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Engineering Manager, Inference Router: Global Low-Latency. Be the first to apply!

