Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Ai Inference Software Engineer

Cerebras

Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model integration, request-routing services, and inference APIs. Your work supports streaming, multimodal inputs, tool use, structured outputs, and model configuration.Key Responsibilities:
Design and operate features for chat and text generationMaintain request and response semantics across inference backendsExtend integrations with vLLM, PyTorch, and Hugging FaceImprove latency, throughput, batching, and resource efficiencyInvestigate incidents and strengthen resilience and responseRequirements:
Five or more years owning production software componentsPython strength plus Go, C++, Rust, or another service languageExperience spanning service, framework, runtime, or infrastructure boundariesFamiliarity with REST, gRPC, or streaming protocolsStrong communication, technical leadership, and mentoring experienceBring production software judgment to Cerebras AI inference through model serving, API evolution, routing, and performance improvement.
#J-18808-Ljbffr
Vacancy posted 35 minutes ago
Similar jobs that could be interesting for youBased on the Senior Ai Inference Software Engineer in Winnipeg, MB vacancy
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...deliver industry-leading training and inference speeds; over 10 times faster than GPU-...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve... 
    Senior

    Cerebras

    Winnipeg, MB
    38 minutes ago
  • $100k - $145k per year

    Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production... 
    Senior
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Winnipeg, MB
    34 minutes ago
  • $111k - $160k per year

     ...and services that help people, businesses and governments realize their greatest potential.Title and Summary Senior Software Engineer (Sanctions Service & AI Inference)Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is... 
    Senior
    Internship
    Worldwide

    Mastercard Inc.

    Winnipeg, MB
    40 minutes ago
  • Transform the AI experience at Cerebras Systems as a Software Engineer on our Inference Platform team. Shape next-gen architecture while deploying ultra-fast machine learning services to boost performance and scalability. Cerebras Systems seeks a Software Engineer with 3+... 
    Suggested

    Cerebras

    Winnipeg, MB
    34 minutes ago
  • Staff + Senior Software Engineer, InferenceAbout AnthropicAnthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers... 
    Senior
    Long term contract
    Work at office
    Worldwide
    Visa sponsorship
    Flexible hours

    Anthropic Limited

    Winnipeg, MB
    39 minutes ago
  • Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto, CAEmployment type : Full-timeSalary : $250k - $350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference... 
    Senior

    Brix

    Winnipeg, MB
    35 minutes ago
  •  ...Cerebras Systems builds the world's largest AI chip and is hiring a Software Engineer to build and evolve the ML API layer for a disaggregated inference system. You will work across inference APIs, model integration, request-routing services, and Cerebras runtimes to deliver... 

    Cerebras

    Winnipeg, MB
    45 minutes ago
  • $165k - $330k per year

    About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,...  ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products. Baseten powers mission-critical... 
    Long term contract
    Flexible hours

    Baseten

    Winnipeg, MB
    36 minutes ago
  • $165k - $330k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...us and help build the platform engineers turn to ship AI products.THE ROLE...  ...who enjoy working across product, software development, performance engineering... 
    Internship
    Flexible hours

    Urban Ridge Supplies

    Winnipeg, MB
    44 minutes ago
  •  ...role is for a highly experienced Back-End Software Engineer who wants to work on core systems that...  ...-shelf solutionsModel Vault is Cohere’s inference platform for deploying and operating models...  ...between a customer and the underlying AI infrastructure, including identity,... 
    Senior
    Remote work

    Cohere

    Winnipeg, MB
    36 minutes ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...industry-leading training and inference speeds; over 10 times faster than...  ...fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and... 

    Cerebras

    Winnipeg, MB
    38 minutes ago
  • $165k - $330k per year

    About BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma...  ...and Spark Capital. Join us and help build the platform engineers turn to ship AI products. THE ROLEAs an Engineer on... 
    Flexible hours

    Baseten

    Winnipeg, MB
    44 minutes ago
  • Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise...  .... You will own the architecture for complex inference challenges, enable low latency and high throughput,... 
    Senior

    Fdetimes

    Winnipeg, MB
    38 minutes ago
  • Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional teams to deploy and scale cutting-edge AI workloads. In this influential role, you will be embedded within Platform Engineering... 
    Senior

    Thomson Reuters

    Winnipeg, MB
    36 minutes ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...deliver industry-leading training and inference speeds; over 10 times faster than GPU...  ...inference. About the RoleWe're hiring a Software Engineer to help contribute to projects on our... 

    Cerebras

    Winnipeg, MB
    38 minutes ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...us and help build the platform engineers turn to ship AI products.About...  ...or contributions to LLM inference engines and frameworks such as vLLM, SGLang... 
    Flexible hours

    Baseten

    Winnipeg, MB
    40 minutes ago
  • $180k - $360k per year

     ...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence...  ...us and help build the platform engineers turn to ship AI products.About...  ...Proficiency in enhancing the performance of software systems, particularly in the... 
    Flexible hours

    Baseten

    Winnipeg, MB
    36 minutes ago
  •  ...intersection of our people, our customers, and our brands. Senior Applied AI EngineerWho We Are.Newfold Digital is a leading web...  ...mark.We are looking for a hand on Senior Applied AI Engineer who combines strong software engineering with practical AI problem solving. You... 
    Senior

    Newfold Digital

    Winnipeg, MB
    41 minutes ago
  • AMD is seeking a Senior Software Development Engineer to own the end-to-end model execution stack on AMD Instinct GPUs, covering training infrastructure at scale and high-performance inference serving. You will ship LLMs on real hardware, optimize GPU kernels, and ensure frontier... 
    Senior

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    38 minutes ago
  •  ...Build AI Inference Networking software at Equinix using SDN, proxying, and open-source engineering expertise. Work within a globally distributed development team. As a Senior SDN Network Software Engineer, you will help develop open-source software for Equinix’s AI Inference... 
    Senior

    Equinix

    Winnipeg, MB
    5 days ago
  • Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This...  ...industry-leading training and inference speeds; over 10 times faster than...  ...fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML... 

    Cerebras

    Winnipeg, MB
    43 minutes ago
  •  ...rapid-growth technology firm in Toronto is seeking a Staff LLMOps Engineer to lead the design and optimization of large language model...  ...architecting deployment pipelines and ensuring high-performance AI applications. Competitive salary and equity are included in the offer... 
    Senior

    TEEMA Solutions Group

    Winnipeg, MB
    40 minutes ago
  • Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered... 

    Sarsfield Group

    Winnipeg, MB
    40 minutes ago
  •  ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare...  ...telemetry, and evaluation platforms. ~ Strong knowledge of software engineering best practices, testing, debugging, and performance... 
    Senior
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    5 days ago
  •  ...empowering better decisions for individuals and those managing money for millions.The Role We are seeking a Senior Software Engineer to build the applied systems that bring AI capabilities into production: the data pipelines, LLM integrations, agentic workflows, tool interfaces,... 
    Senior
    Internship
    Work at office
    Local area
    Immediate start
    Worldwide

    Morningstar

    Winnipeg, MB
    36 minutes ago
  •  ...of supercomputing, high-performance computing, cloud, and AI. Whether you’re designing next-gen processors, enabling AI...  ...world forward. The RoleThe AMD AI Group is looking for a Senior Software Development Engineer to own the end-to-end model execution stack on AMD... 
    Senior
    Internship
    Manual labor

    Advanced Micro Devices, Inc.

    Winnipeg, MB
    37 minutes ago
  • Build production AI features as a Senior AI Software Engineer at Safe Fleet, using LLMs, machine learning, and backend APIs. Help make fleet vehicles safer through scalable technology.This hands-on senior engineering role delivers AI-powered capabilities across Safe Fleet’s... 
    Senior

    Safe Fleet

    Winnipeg, MB
    35 minutes ago
  • $150k - $200k per year

     ...Stikeman Elliott is building its own agentic AI platform, with production agents working...  ...and continues to expand. This is the senior engineering role responsible for advancing its...  ...role that spans application architecture, software development and production delivery. You... 
    Senior

    Stikeman Elliott LLP

    Winnipeg, MB
    42 minutes ago
  • FullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You will...  ...into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML... 
    Senior
    Flexible hours

    FullStack

    Winnipeg, MB
    42 minutes ago
  • Select how often (in days) to receive an alert:Title: Senior AI Platform Software Engineer Requisition ID: 276518 Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Role The Senior AI Platform Software Engineer will... 
    Senior
    Flexible hours

    Scotiabank

    Winnipeg, MB
    38 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Ai Inference Software Engineer. Be the first to apply!