Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff Ai Inference Infrastructure Engineer

Cerebras

Advance high-speed AI inference infrastructure at Cerebras Systems through latency optimization, reliability engineering, and production software.As a Staff Engineer, you will help build the next-generation architecture of a globally distributed inference platform. The Inference Platform team runs orchestration across datacenter clusters and connects cloud components with machine learning services. Your work includes improving latency, throughput, capacity efficiency, and resilience under unpredictable demand. You will also guide senior engineers, make high-consequence decisions, and collaborate across adjacent systems. Cerebras serves leading model labs, global enterprises, and AI-native startups.Key Responsibilities:
Optimize latency, throughput, capacity efficiency, and resilienceDevelop production software across testing and productionizationSet technical standards through design and code reviewsResolve production issues and cross-system bottlenecksTranslate requirements into scalable system designsRequirements:
Eight or more years of software engineering experienceExperience with large-scale distributed systems or cloud infrastructureBackground optimizing high-QPS system performanceStrong backend or systems programming in Go or C++Experience with ML inference or model serving preferredUse systems programming, performance optimization, and inference infrastructure experience to shape Cerebras Systems’ scalable AI platform.
#J-18808-Ljbffr
Vacancy posted 47 minutes ago
Similar jobs that could be interesting for youBased on the Staff Ai Inference Infrastructure Engineer in Winnipeg, MB vacancy
  •  ...enterprises who are building AI systems to power magical experiences...  ...is a team of researchers, engineers, designers, and more, who are...  ...looking for Members of Technical Staff to join the Model Serving team...  ...experience running production infrastructure at a large scale ~... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    Winnipeg, MB
    48 minutes ago
  •  ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver... 
    Suggested

    Cerebras

    Winnipeg, MB
    50 minutes ago
  • $180k - $210k per year

     ...is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design and build the networking automation that powers next-generation... 
    Suggested
    Local area
    Remote work
    Flexible hours

    Jobgether

    Winnipeg, MB
    53 minutes ago
  • Cerebras Systems is hiring a Software Engineer to productionize and optimize our GPU serving stack. You will work across custom inference APIs, vLLM, PyTorch, ROCm, and rack-scale AMD GPU infrastructure to ensure reliability, numerical correctness, observability, and high performance... 
    Suggested

    FDE Times

    Winnipeg, MB
    50 minutes ago
  • $165k - $330k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...applied AI research, flexible infrastructure, and seamless developer tooling,...  ...us and help build the platform engineers turn to to ship AI products.About... 
    Suggested
    Internship
    Flexible hours

    Baseten

    Winnipeg, MB
    48 minutes ago
  • Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical Staff Network Engineer role develops software-driven networking for large-scale AI workloads. You will automate... 

    Jobgether

    Winnipeg, MB
    51 minutes ago
  • Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for...  ...AI systems. About the roleOur Inference team is responsible for building... 
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    Winnipeg, MB
    54 minutes ago
  •  ...Systems builds the world's largest AI chip, 56 times larger than...  ...industry-leading training and inference speeds; over 10 times...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer...  ..., compiler, runtime, cloud infrastructure, product, customer-facing... 

    Cerebras

    Winnipeg, MB
    43 minutes ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...inference. About the RoleWe're hiring a Staff Engineer to help lead, drive, and contribute to... 

    Cerebras

    Winnipeg, MB
    53 minutes ago
  •  ...Systems builds the world's largest AI chip, 56 times larger than...  ...industry-leading training and inference speeds; over 10 times...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer...  ...stack, and rack-scale AMD GPU infrastructure, to make this new serving path... 

    Cerebras

    Winnipeg, MB
    54 minutes ago
  • $100k - $145k per year

    Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting...  ...successful candidate will help build the next generation of TR’s AI infrastructure, working alongside cloud engineering, data engineering,... 
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    45 minutes ago
  •  ...games and experiences they love. Our Vector Gamer AI team sits at the heart of that mission, governing ad...  ...-world impact converge at scale. We’re hiring a Staff Backend Engineer to build and operate the infrastructure those models depend on. You’ll design and operate the... 
    Work at office
    Worldwide

    Unity Technologies

    Winnipeg, MB
    54 minutes ago
  •  ...a highly experienced Back-End Software Engineer who wants to work on core systems that...  ...shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating models...  ...between a customer and the underlying AI infrastructure, including identity, deployments,... 
    Remote work

    Cohere

    Winnipeg, MB
    47 minutes ago
  •  ...Systems builds the world's largest AI chip, 56 times larger than...  ...-leading training and inference speeds; over 10 times faster...  ...architecture of secure, scalable cloud infrastructure and identity platforms in AWS...  .... Partner across Security, Engineering, and Infrastructure teams to... 

    Cerebras

    Winnipeg, MB
    45 minutes ago
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered... 

    Sarsfield Group

    Winnipeg, MB
    53 minutes ago
  • Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine...  ...systems • Experience with Kubernetes and cloud infrastructure • Strong knowledge of backend languages like Go... 

    Cerebras

    Winnipeg, MB
    54 minutes ago
  • $145k - $260k per year

     ...VGSVGS is building the trust infrastructure for a new era of commerce. As...  ...trusted by the most innovative AI and Fortune 500 companies,...  ...exceptional people. Trusted Engineering That Matters Engineering...  ...practices. About the RoleAs a Staff Infrastructure Engineer, you... 
    Work at office
    Local area
    Immediate start
    Remote work
    Flexible hours
    Shift work

    VGS

    Winnipeg, MB
    54 minutes ago
  • Purpose Unlimited is building the financial products infrastructure that prioritizes client outcomes. You will lead staff-level engineering to design scalable data foundations powering AI-enabled products, with a focus on fast, reliable systems in a regulated environment. You... 

    Purpose Unlimited

    Winnipeg, MB
    52 minutes ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo...  ...EquityResponsibilities Oversee and optimize the LLM inference engine to ensure performance, scalability, and cost-efficiency.... 

    Brix

    Winnipeg, MB
    45 minutes ago
  •  ...resiliency challenges in large-scale AI data center clusters. We are...  ...a talented Forward Deployed Engineer to be embedded with one of...  ..." who has built and run AI infrastructure at scale, ideally at a...  ...job scheduling, and training/inference workloads.Strong software problem... 
    Internship
    Manual labor
    Work at office
    Remote work

    Delos Data

    Winnipeg, MB
    54 minutes ago
  •  ...smarter, and more efficiently. Powered by AI. Backed by real humans . About the client An AI infrastructure company specializing in inference optimization for large-scale models....  ...As a founding Senior AI Infrastructure Engineer, you will report to the Chief... 
    Full time
    For contractors
    Direct hire
    Work at office

    Mission

    Winnipeg, MB
    48 minutes ago
  • Shape AI infrastructure products remotely from Canada, using bare-metal systems and high-performance...  ...cloud providers and hyperscalers.As Staff Product Manager for vMetal, you will...  ...infrastructure requirements into specifications and engineering priorities. The work connects physical... 
    Remote work

    Jobgether

    Winnipeg, MB
    45 minutes ago
  • $176.5k per year

     ...About The Team And Role Core Infrastructure builds and operates the foundations...  ...content that powers our products and our inference‑driven features. The core of the...  ...will join an existing team of Senior, Staff, and Principal engineers building the Content Library and... 
    Long term contract
    For contractors
    Local area
    Home office
    Flexible hours

    Scribd, Inc.

    Winnipeg, MB
    45 minutes ago
  • Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional teams...  ...in Python and C++ Leverage your expertise to shape the future of AI infrastructure at Thomson Reuters. #J-18808-Ljbffr

    Thomson Reuters

    Winnipeg, MB
    52 minutes ago
  •  ...performance computing, cloud, and AI. Whether you’re designing next-gen...  ...for a Senior Software Development Engineer to own the end-to-end model execution...  ...Instinct GPUs - spanning training infrastructure at scale and high-performance inference serving. The PersonThis role... 
    Internship
    Manual labor

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    47 minutes ago
  • $165k - $330k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...applied AI research, flexible infrastructure, and seamless developer tooling,...  ...us and help build the platform engineers turn to ship AI products. Baseten... 
    Long term contract
    Flexible hours

    Baseten

    Winnipeg, MB
    54 minutes ago
  •  ...operate security controls for AI platforms, generative AI...  ...AI Centre of Enablement, AI Engineering, Data Engineering, and Technology...  ...AI training, grounding, and inference in partnership with Data Governance...  ...with CI/CD pipelines, Infrastructure‑as‑Code, containers, and cloud... 
    Hourly pay
    Permanent employment
    Full time
    Internship
    Work at office

    EQ Bank

    Winnipeg, MB
    52 minutes ago
  •  .... We can’t wait to get to know you! The WorkThe Staff Engineer plays a key role within the Infrastructure Solutions team, defining infrastructure strategies and...  .... As part of our recruitment process, EQ uses AI to help screen, assess, and/or select applicants for... 
    Hourly pay
    Permanent employment
    Full time
    Internship
    Work at office

    EQ Bank | Canada's Challenger Bank

    Winnipeg, MB
    46 minutes ago
  • Build agentic AI infrastructure at Cohere from a remote position open to people in Canada, combining distributed systems and ML intuition.As a Staff or Senior Staff Software Engineer, you will create platforms powering autonomous AI agents at scale. The work spans ML systems... 
    Remote work

    The Briefed

    Winnipeg, MB
    53 minutes ago
  • Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise...  .... You will own the architecture for complex inference challenges, enable low latency and high throughput,... 

    Fdetimes

    Winnipeg, MB
    50 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff Ai Inference Infrastructure Engineer. Be the first to apply!