Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead/Senior Inference Engineer

Full-time

Jobgether

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Lead/Senior Inference Engineer based in Canada. The Lead/Senior Inference Engineer will build and operate the production inference infrastructure powering advanced large language models and AI-driven professional applications. This hands-on engineering role focuses on developing a reliable, scalable model-serving platform while optimizing performance, latency, and infrastructure costs. Working within a newly established engineering team, you will help shape its technical direction, engineering practices, and operational standards from the ground up. You will collaborate closely with model training, evaluation, research, and product teams to bring new model releases into production. The role offers significant autonomy and the opportunity to influence infrastructure strategy, reliability, and international platform expansion in a high-stakes, compliance-focused environment. Accountabilities - Build, maintain, and operate production-grade model-serving infrastructure supporting large-scale AI workloads. - Implement and optimize inference techniques, including batching, caching, quantization, and comparable approaches, to improve latency and reduce operating costs without compromising model quality. - Strengthen platform observability, monitoring, and operational visibility as traffic volumes and deployment requirements increase. - Develop the operational and compliance foundations required for production growth, including controls and evidence supporting the ISO 27001 compliance path. - Establish cost-tracking and attribution mechanisms that support financial planning, as well as GPU-capacity contingency plans that help prevent service interruptions and unnecessary parallel infrastructure costs. - Evaluate and document trade-offs between cost, latency, and reliability, communicating technical recommendations to engineering leadership and partner teams. - Work directly with model training and evaluation teams to integrate new model releases into the serving infrastructure.

- Help establish engineering practices and tools, including on-call processes, incident reviews, onboarding, and operational documentation. - Collaborate with research, product, and engineering stakeholders to ensure the serving platform evolves alongside model capabilities and product requirements. - Contribute to the team's technical strategy and mentor other engineers as the function grows. Requirements: - Hands-on infrastructure engineering experience with Kubernetes or comparable technologies, including ownership of production systems beyond prototyping. - Experience operating and maintaining model services across different workloads, including peak traffic, scaling, disaster recovery, and service reliability. - Direct experience with model-serving infrastructure and/or inference optimization for large language models, at a scale appropriate to previous roles. - Strong background in large-scale distributed systems, particularly production scalability, availability, and reliability. - Proven ability to troubleshoot distributed systems and resolve production incidents under real traffic conditions. - Demonstrated experience delivering software end to end, from technical design and implementation through deployment and ongoing operations. - Ability to establish and uphold engineering best practices while adapting to evolving product and business requirements. - Strong autonomy, technical judgment, and ownership, with the ability to operate as an early lead engineer and mentor colleagues as the team expands. - Preferred qualifications: - Experience with LLM-serving technologies such as vLLM, TensorRT-LLM, Triton, SGLang, or similar frameworks. - Exposure to GPU-cluster capacity planning and/or multi-region or multi-cloud deployment environments.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead/Senior Inference Engineer in Remote vacancy
  •  ..., and secured our place as a leader in the industry. If you have...  ...role: You will own the inference backbone behind QVAC's local...  ...hardware. The role is centered on engineering quality at runtime level,...  ...porting and enhancing inference engines like llama.cpp or similar, to... 
    Suggested
    Permanent employment
    Full time
    Local area
    Immediate start
    Remote work
    Worldwide

    Tether Operations Limited

    Remote
    13 days ago
  •  ...Lead a team to create and review software security training tasks. About Turing Turing is one of the world’s leading AGI infrastructure...  ...through high-quality training data, evaluations, and engineering talent. Role Overview We are seeking a Lead Software Security... 
    Senior
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    Remote
    6 days ago
  •  ...listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior/Staff Software Engineer – Tech Lead based in Canada. In this role, you will provide hands-on technical leadership for the development of innovative open... 
    Senior
    Long term contract
    Full time
    Remote work

    Jobgether

    Remote
    18 days ago
  •  ...all applications and next steps. Our partner is looking for a Lead Security Engineer based in Canada. We are looking for a hands-on Lead Security...  ...qualifications and skills are expected: - Significant experience as a senior security engineer or security lead, ideally as the most... 
    Senior
    Full time
    Remote work
    Flexible hours

    Jobgether

    Remote
    14 days ago
  •  ...applications and next steps. Our partner is looking for a Platform Engineering Lead based in Canada. The Platform Engineering Lead will shape the...  ...development plans, performance reviews, and hiring. Coach senior engineers and foster accountability, collaboration, and shared... 
    Senior
    Full time

    Jobgether

    Remote
    16 days ago
  •  ...orchestration, trusted by thousands of leading organizations to drive faster, more...  .... About the Role We're looking for a Senior Product Security Engineer to lead the design and implementation...  ...systems — model training, data pipelines, inference environments, and agentic workflows.... 
    Senior
    Full time

    AlphaSense

    Remote
    5 days ago
  •  ...TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Senior/Leading Software Engineer specialist to join one of our clients ' teams. If you're looking for an exciting opportunity to grow in a innovative... 
    Senior
    Permanent employment
    Full time
    Flexible hours

    TechBiz Global GmbH

    Remote
    3 days ago
  •  ...background job processing using Celery. We’re looking for a senior-level AI Engineer who is equally strong in backend engineering and applied AI...  ...ML. - Debug complex, cross-layer issues spanning backend, AI inference, and UI integration. - Conduct thorough dev testing before QA... 
    Senior
    Full time

    Novoed

    Remote
    16 days ago
  • $151.3k - $195.8k per year

     ...public company, you’ll have the autonomy and support to make an impact as we build for the long term. About this role:  As a Lead Design Engineer at Samsara, you'll build the systems that power our product and scale our impact as a design team. You'll define the components... 
    Long term contract
    Full time
    Internship
    Remote work
    Flexible hours

    Samsara

    Remote
    10 days ago
  • $80 per hour

     ...interviewer asks about your career, then matches you to projects like Lead Sales Engineer. Keep your CV open and walk through the roles and skills that...  ...Reliability Engineer Expert Ethos • STEM $80 /hr Senior Solutions Engineer Expert Ethos • STEM $80 /hr More... 
    Senior
    Hourly pay
    Weekly pay
    Immediate start
    Remote work
    Flexible hours

    Ethos

    Remote
    14 days ago
  •  ...recently public company, you’ll have the autonomy and support to make an impact as we build for the long term. About this role: As a Lead Design Engineer at Samsara, you'll build the systems that power our product and scale our impact as a design team. You'll define the components... 
    Long term contract
    Full time
    Remote work

    Samsara

    Remote
    14 days ago
  • $100 per hour

     ...professional experience Demonstrated expertise in Software Engineering How long hiring takes Across the platforms we work with,...  ...3 months ~80% Why this role At $100/hr, this Technical Lead / Senior Contract Engineer Expert position compensates Software Engineering... 
    Senior
    Hourly pay
    Contract work
    Remote work

    Ethos

    Remote
    a month ago
  •  ...applications and next steps. Our partner is looking for a Front End Engineer Team Lead based in Canada. As a Front End Engineer Team Lead, you will...  ...across multiple web applications, collaborating closely with senior and staff engineers. - Lead the development and continuous... 
    Senior
    Full time
    Remote work

    Jobgether

    Remote
    2 days ago
  • $160k - $200k per year

     ...on Wiser.  Job Description Wiser Solutions is hiring a Senior ML Engineer to help build our customer-facing AI platform and get the first...  ...train a smaller task-specific model  ~ Experience keeping inference cost down at high volume through distillation, quantization,... 
    Senior
    Full time
    Work at office
    Local area
    Worldwide

    Wiser Solutions

    Remote
    14 days ago
  • $65k per year

     ...Foundever® is the next-generation services leader reinventing customer experience (CX)....  ...+60 languages for more than 800 world-leading brands, helping them keep their brand...  ...role We are currently looking for a Senior Network Engineer to join the Foundever family!  80% virtual... 
    Senior
    Local area
    Remote work
    Work from home
    Shift work

    Foundever®

    Remote
    10 days ago
  • $140k - $190k per year

     ...We are expanding our Vancouver engineering team—our core product and...  ...development hub—and looking for a Senior Full Stack Engineer to take...  ...capable of handling complex pricing engines, high-volume procurement...  ...champion automated testing, and lead thoughtful peer code reviews... 
    Senior
    Long term contract
    For contractors
    Work at office
    Relocation

    Remarcable, Inc.

    Remote
    11 days ago
  • $147.3k - $192k per year

     ...Australia, and Japan. We’re looking for a Lead Software Engineer to join the Behavioural team,...  ...membership changes. You will report to the Senior Director of Engineering in this role....  ...support. Build the Behavioral Decisioning Engine : Design and implement services that... 
    Senior
    Full time

    Movable Ink

    Remote
    10 days ago
  •  ...canonical and ready to query, with no engineering or maintenance required. We’re...  ...together two industry-leading companies with a shared mission...  ...across the systems, clouds, engines, and tools they rely on. dbt Labs...  ..., staged technical plans. Lead the design and delivery of the... 
    Full time
    Internship
    Remote work
    Flexible hours

    Fivetran

    Remote
    9 days ago
  • $126.23k - $163.35k per year

     ...impact as we build for the long term. About the role: As a Senior Software Engineer on Safety Core, you’ll build software that helps customers...  ...new offices People Manager Roles : Hire, develop and lead an inclusive, engaged, and high performing team Minimum... 
    Senior
    Long term contract
    Full time
    Internship
    Remote work
    Relocation package
    Flexible hours

    Samsara

    Remote
    1 day ago
  • usd136.35k - usd203.85k per year

     ...no surprises, and no tradeoffs on what matters most. As a Senior Sales Engineer, you’ll combine your technical aptitude, exceptional communication...  ...the Affirm platform. You’ll support pre-sale activities by leading technical discovery, analyzing requirements, and identifying... 
    Senior
    Long term contract
    Work at office
    Remote work
    Flexible hours

    Affirm

    Remote
    2 days ago
  •  ...all applications and next steps. Our partner is looking for a Senior Data Engineer based in Canada. As a Senior Data Engineer, you will design and...  ...-first technology environment. Accountabilities: You will lead the development and operation of scalable data pipelines and cloud... 
    Senior
    Remote work

    Jobgether

    Remote
    3 days ago
  •  ...a remote position The Opportunity AAPC seeks a hands-on lead software engineer to help build and evolve the customer-facing digital products...  ...of writing and shipping production code yourself, including senior or lead-level ownership of systems that span multiple platforms... 
    Senior
    Full time
    Interim role
    Work at office
    Remote work

    AAPC

    Remote
    14 days ago
  • $170.25k - $204.3k per year

     ...members across 40+ countries, backed by leading investors including Lightspeed...  ..., Coatue, J.P. Morgan, CapitalG, and Lead Edge Capital. Learn more at and follow...  ...Quebec are not eligible for this role. Senior Full-Stack Software Engineer, Grafana Data Source Plugins The... 
    Senior
    Full time
    Local area
    Remote work
    Worldwide

    Grafana Labs

    Remote
    2 days ago
  •  ...platform, ensuring scalability, efficiency, and robustness. Lead cross-functional platform initiatives from discovery to rollout,...  ...the technical work on the project. Utilize a strong software engineering background to design, implement, and optimize critical services... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Braze

    Remote
    3 days ago
  • $148k - $180k per year

     ...About the Team Netlify’s engineering teams build the products, platforms, and infrastructure...  ...deployed. We’re hiring engineers at the senior and staff levels across multiple teams, spanning...  ...millions of developers worldwide and lead projects from conception to delivery... 
    Senior
    Full time
    Internship
    Remote work
    Worldwide

    Netlify

    Remote
    3 days ago
  • $168k - $177.5k per year

     ...building the operating system for brick-and-mortar grocery. As a Senior iOS Engineer on the In-Store Mode team, you will build the mobile...  ...powering in-store navigation and discovery. About the Job Lead iOS projects end to end, from technical design and rollout strategy... 
    Senior
    Permanent employment
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Remote
    5 days ago
  •  ...POWER A WORLD OF TRUST Incode is the leading provider of world-class identity solutions...  ...and security. Recently named a leader in the Gartner® Magic Quadrant™ for Identity...  ...fast. The Impact You’ll Make As a Senior Solutions Engineer – Web on our post-sales team, you’ll make... 
    Senior
    Full time
    Flexible hours

    Incode

    Remote
    7 days ago
  •  ...Responsibilities Lead iOS projects from technical design and rollout strategy through production operations and debugging. Shape...  ...to improve individual and team productivity. Collaborate with engineers, designers, data scientists, and product managers on cross-functional... 
    Senior
    Work at office
    Remote work
    Work from home

    Instacart

    Remote
    5 days ago
  • $103.71k - $152.11k per year

     ...flexibility you need to thrive and deliver lasting impact. Join us as we digitally connect the world and shape the future. The Role The Senior Lead Internal Communications Manager will be a leader in creating and successfully executing innovative communication strategies that... 
    Senior
    Long term contract
    Full time
    Temporary work

    Lumen

    Remote
    1 day ago
  • $161k - $170k per year

     .... Overview About the Role - As a Senior Sales Engineer at Instacart, you'll have a unique opportunity...  ...adoption of our flagship, industry leading ecommerce products and services directly...  ...the globe. This role requires you to lead consultative, technical-focused discussions... 
    Senior
    Permanent employment
    Internship
    Work at office
    Remote work
    Work from home
    Flexible hours

    Instacart

    Remote
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead/Senior Inference Engineer. Be the first to apply!