Lead/Senior Inference Engineer
Jobgether
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Lead/Senior Inference Engineer based in Canada. The Lead/Senior Inference Engineer will build and operate the production inference infrastructure powering advanced large language models and AI-driven professional applications. This hands-on engineering role focuses on developing a reliable, scalable model-serving platform while optimizing performance, latency, and infrastructure costs. Working within a newly established engineering team, you will help shape its technical direction, engineering practices, and operational standards from the ground up. You will collaborate closely with model training, evaluation, research, and product teams to bring new model releases into production. The role offers significant autonomy and the opportunity to influence infrastructure strategy, reliability, and international platform expansion in a high-stakes, compliance-focused environment. Accountabilities - Build, maintain, and operate production-grade model-serving infrastructure supporting large-scale AI workloads. - Implement and optimize inference techniques, including batching, caching, quantization, and comparable approaches, to improve latency and reduce operating costs without compromising model quality. - Strengthen platform observability, monitoring, and operational visibility as traffic volumes and deployment requirements increase. - Develop the operational and compliance foundations required for production growth, including controls and evidence supporting the ISO 27001 compliance path. - Establish cost-tracking and attribution mechanisms that support financial planning, as well as GPU-capacity contingency plans that help prevent service interruptions and unnecessary parallel infrastructure costs. - Evaluate and document trade-offs between cost, latency, and reliability, communicating technical recommendations to engineering leadership and partner teams. - Work directly with model training and evaluation teams to integrate new model releases into the serving infrastructure.
- Help establish engineering practices and tools, including on-call processes, incident reviews, onboarding, and operational documentation. - Collaborate with research, product, and engineering stakeholders to ensure the serving platform evolves alongside model capabilities and product requirements. - Contribute to the team's technical strategy and mentor other engineers as the function grows. Requirements: - Hands-on infrastructure engineering experience with Kubernetes or comparable technologies, including ownership of production systems beyond prototyping. - Experience operating and maintaining model services across different workloads, including peak traffic, scaling, disaster recovery, and service reliability. - Direct experience with model-serving infrastructure and/or inference optimization for large language models, at a scale appropriate to previous roles. - Strong background in large-scale distributed systems, particularly production scalability, availability, and reliability. - Proven ability to troubleshoot distributed systems and resolve production incidents under real traffic conditions. - Demonstrated experience delivering software end to end, from technical design and implementation through deployment and ongoing operations. - Ability to establish and uphold engineering best practices while adapting to evolving product and business requirements. - Strong autonomy, technical judgment, and ownership, with the ability to operate as an early lead engineer and mentor colleagues as the team expands. - Preferred qualifications: - Experience with LLM-serving technologies such as vLLM, TensorRT-LLM, Triton, SGLang, or similar frameworks. - Exposure to GPU-cluster capacity planning and/or multi-region or multi-cloud deployment environments.
- ..., and secured our place as a leader in the industry. If you have... ...role: You will own the inference backbone behind QVAC's local... ...hardware. The role is centered on engineering quality at runtime level,... ...porting and enhancing inference engines like llama.cpp or similar, to...SuggestedPermanent employmentFull timeLocal areaImmediate startRemote workWorldwide
- ...Lead a team to create and review software security training tasks. About Turing Turing is one of the world’s leading AGI infrastructure... ...through high-quality training data, evaluations, and engineering talent. Role Overview We are seeking a Lead Software Security...SeniorContract workPart timeFor contractorsFreelanceRemote work
- ...listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Senior/Staff Software Engineer – Tech Lead based in Canada. In this role, you will provide hands-on technical leadership for the development of innovative open...SeniorLong term contractFull timeRemote work
- ...all applications and next steps. Our partner is looking for a Lead Security Engineer based in Canada. We are looking for a hands-on Lead Security... ...qualifications and skills are expected: - Significant experience as a senior security engineer or security lead, ideally as the most...SeniorFull timeRemote workFlexible hours
- ...applications and next steps. Our partner is looking for a Platform Engineering Lead based in Canada. The Platform Engineering Lead will shape the... ...development plans, performance reviews, and hiring. Coach senior engineers and foster accountability, collaboration, and shared...SeniorFull time
- ...orchestration, trusted by thousands of leading organizations to drive faster, more... .... About the Role We're looking for a Senior Product Security Engineer to lead the design and implementation... ...systems — model training, data pipelines, inference environments, and agentic workflows....SeniorFull time
- ...TechBiz Global, we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Senior/Leading Software Engineer specialist to join one of our clients ' teams. If you're looking for an exciting opportunity to grow in a innovative...SeniorPermanent employmentFull timeFlexible hours
- ...background job processing using Celery. We’re looking for a senior-level AI Engineer who is equally strong in backend engineering and applied AI... ...ML. - Debug complex, cross-layer issues spanning backend, AI inference, and UI integration. - Conduct thorough dev testing before QA...SeniorFull time
$151.3k - $195.8k per year
...public company, you’ll have the autonomy and support to make an impact as we build for the long term. About this role: As a Lead Design Engineer at Samsara, you'll build the systems that power our product and scale our impact as a design team. You'll define the components...Long term contractFull timeInternshipRemote workFlexible hours$80 per hour
...interviewer asks about your career, then matches you to projects like Lead Sales Engineer. Keep your CV open and walk through the roles and skills that... ...Reliability Engineer Expert Ethos ⢠STEM $80 /hr Senior Solutions Engineer Expert Ethos ⢠STEM $80 /hr More...SeniorHourly payWeekly payImmediate startRemote workFlexible hours- ...recently public company, you’ll have the autonomy and support to make an impact as we build for the long term. About this role: As a Lead Design Engineer at Samsara, you'll build the systems that power our product and scale our impact as a design team. You'll define the components...Long term contractFull timeRemote work
$100 per hour
...professional experience Demonstrated expertise in Software Engineering How long hiring takes Across the platforms we work with,... ...3 months ~80% Why this role At $100/hr, this Technical Lead / Senior Contract Engineer Expert position compensates Software Engineering...SeniorHourly payContract workRemote work- ...applications and next steps. Our partner is looking for a Front End Engineer Team Lead based in Canada. As a Front End Engineer Team Lead, you will... ...across multiple web applications, collaborating closely with senior and staff engineers. - Lead the development and continuous...SeniorFull timeRemote work
$160k - $200k per year
...on Wiser. Job Description Wiser Solutions is hiring a Senior ML Engineer to help build our customer-facing AI platform and get the first... ...train a smaller task-specific model ~ Experience keeping inference cost down at high volume through distillation, quantization,...SeniorFull timeWork at officeLocal areaWorldwide$65k per year
...Foundever® is the next-generation services leader reinventing customer experience (CX).... ...+60 languages for more than 800 world-leading brands, helping them keep their brand... ...role We are currently looking for a Senior Network Engineer to join the Foundever family! 80% virtual...SeniorLocal areaRemote workWork from homeShift work$140k - $190k per year
...We are expanding our Vancouver engineering team—our core product and... ...development hub—and looking for a Senior Full Stack Engineer to take... ...capable of handling complex pricing engines, high-volume procurement... ...champion automated testing, and lead thoughtful peer code reviews...SeniorLong term contractFor contractorsWork at officeRelocation$147.3k - $192k per year
...Australia, and Japan. We’re looking for a Lead Software Engineer to join the Behavioural team,... ...membership changes. You will report to the Senior Director of Engineering in this role.... ...support. Build the Behavioral Decisioning Engine : Design and implement services that...SeniorFull time- ...canonical and ready to query, with no engineering or maintenance required. We’re... ...together two industry-leading companies with a shared mission... ...across the systems, clouds, engines, and tools they rely on. dbt Labs... ..., staged technical plans. Lead the design and delivery of the...Full timeInternshipRemote workFlexible hours
$126.23k - $163.35k per year
...impact as we build for the long term. About the role: As a Senior Software Engineer on Safety Core, you’ll build software that helps customers... ...new offices People Manager Roles : Hire, develop and lead an inclusive, engaged, and high performing team Minimum...SeniorLong term contractFull timeInternshipRemote workRelocation packageFlexible hoursusd136.35k - usd203.85k per year
...no surprises, and no tradeoffs on what matters most. As a Senior Sales Engineer, you’ll combine your technical aptitude, exceptional communication... ...the Affirm platform. You’ll support pre-sale activities by leading technical discovery, analyzing requirements, and identifying...SeniorLong term contractWork at officeRemote workFlexible hours- ...all applications and next steps. Our partner is looking for a Senior Data Engineer based in Canada. As a Senior Data Engineer, you will design and... ...-first technology environment. Accountabilities: You will lead the development and operation of scalable data pipelines and cloud...SeniorRemote work
- ...a remote position The Opportunity AAPC seeks a hands-on lead software engineer to help build and evolve the customer-facing digital products... ...of writing and shipping production code yourself, including senior or lead-level ownership of systems that span multiple platforms...SeniorFull timeInterim roleWork at officeRemote work
$170.25k - $204.3k per year
...members across 40+ countries, backed by leading investors including Lightspeed... ..., Coatue, J.P. Morgan, CapitalG, and Lead Edge Capital. Learn more at and follow... ...Quebec are not eligible for this role. Senior Full-Stack Software Engineer, Grafana Data Source Plugins The...SeniorFull timeLocal areaRemote workWorldwide- ...platform, ensuring scalability, efficiency, and robustness. Lead cross-functional platform initiatives from discovery to rollout,... ...the technical work on the project. Utilize a strong software engineering background to design, implement, and optimize critical services...SeniorWork at officeRemote workFlexible hours
$148k - $180k per year
...About the Team Netlify’s engineering teams build the products, platforms, and infrastructure... ...deployed. We’re hiring engineers at the senior and staff levels across multiple teams, spanning... ...millions of developers worldwide and lead projects from conception to delivery...SeniorFull timeInternshipRemote workWorldwide$168k - $177.5k per year
...building the operating system for brick-and-mortar grocery. As a Senior iOS Engineer on the In-Store Mode team, you will build the mobile... ...powering in-store navigation and discovery. About the Job Lead iOS projects end to end, from technical design and rollout strategy...SeniorPermanent employmentWork at officeRemote workWork from homeFlexible hours- ...POWER A WORLD OF TRUST Incode is the leading provider of world-class identity solutions... ...and security. Recently named a leader in the Gartner® Magic Quadrant™ for Identity... ...fast. The Impact You’ll Make As a Senior Solutions Engineer – Web on our post-sales team, you’ll make...SeniorFull timeFlexible hours
- ...Responsibilities Lead iOS projects from technical design and rollout strategy through production operations and debugging. Shape... ...to improve individual and team productivity. Collaborate with engineers, designers, data scientists, and product managers on cross-functional...SeniorWork at officeRemote workWork from home
$103.71k - $152.11k per year
...flexibility you need to thrive and deliver lasting impact. Join us as we digitally connect the world and shape the future. The Role The Senior Lead Internal Communications Manager will be a leader in creating and successfully executing innovative communication strategies that...SeniorLong term contractFull timeTemporary work$161k - $170k per year
.... Overview About the Role - As a Senior Sales Engineer at Instacart, you'll have a unique opportunity... ...adoption of our flagship, industry leading ecommerce products and services directly... ...the globe. This role requires you to lead consultative, technical-focused discussions...SeniorPermanent employmentInternshipWork at officeRemote workWork from homeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead/Senior Inference Engineer. Be the first to apply!
- lead structural engineer Remote
- lead process engineer Remote
- lead software engineer Remote
- senior financial accountant Remote
- senior sales consultant Remote
- senior communications specialist Remote
- senior bookkeeper Remote
- senior system administrator Remote
- senior technical recruiter Remote
- senior director Remote

