Lead/Senior Inference Engineer
$140k - $175k per yearThomson Reuters
Job Description Thomson Reuters Labs is the global research and development division of Thomson Reuters. We bring together scientists, engineers, and domain experts to explore emerging technologies and develop state-of-the-art AI products, bridging frontier science with practical application. Labs builds and ships custom models for professional workflows requiring fiduciary-grade AI. The Thomson LLM model family was developed by training leading open-weight models on decades of authoritative Thomson Reuters content, with thousands of hours of subject-matter-expert input. Owning the model layer is how we earn trust in the most regulated, highest-stakes professional workflows. You'll work hands-on building and operating Mariner, Thomson Reuters' custom inference platform. Mariner serves every production call to the Thomson model family, plus the frontier models we benchmark against, and is scaling to new product integrations and business lines. It is a key pillar of our infrastructure sovereignty strategy. This is a hands-on engineering seat, not a research role: you'll be the one actually building the serving stack, tuning inference for cost and latency, and keeping production traffic reliable as Mariner scales to new product integrations and international deployments. You'll join as one of the founding engineers on a newly built team, reporting to the Director, Model Inference Engineering, with real autonomy and the expectation to shape the team's technical strategy from the start. For more on the latest model release, see the Thomson 1.0 Technical Report on Hugging Face: 10 Technical Report.pdf
Key Responsibilities
- Build and operate the model-serving infrastructure that runs Thomson's production traffic.
- Implement and tune inference-optimization techniques (batching, caching, quantization, or comparable) to reduce cost and latency without sacrificing quality.
- Improve Mariner's observability as call volume and the deployment surface grow.
- Build out Thomson's production footing: implement the controls and evidence for the ISO 27001 compliance path, the cost-tracking and attribution Finance relies on, and GPU-capacity contingency plans so a capacity change doesn't force downtime or costly parallel running.
- Make and document cost vs. latency vs. reliability tradeoffs, and bring them to the Director and partner teams.
- Work directly with the training and evaluation pods to get new model releases live on the serving stack.
- Help stand up the team's own practices and tooling (on-call, incident reviews, onboarding) as an early member, rather than inheriting a fixed system.
- Collaborate with research and product stakeholders and engineering leadership so the serving stack keeps pace with new model releases.
Required Qualifications
- Hands-on infrastructure engineering experience with Kubernetes or similar, comfortable owning a system in production rather than only prototyping one.
- Experience keeping model services up across multiple use cases: peak load, scaling, disaster recovery, and operational excellence.
- Direct experience with model-serving infrastructure and/or inference optimization for large models, at whatever scale you've worked at so far.
- Large-scale distributed systems experience, including scaling and reliability under production load.
- Comfort debugging distributed systems and production incidents under real traffic.
- A track record of shipping software end to end: design, build, and operate production systems.
- Champion and enforce engineering best practices while working with dynamic product requirements.
- Ability to operate autonomously as an early lead engineer, and to mentor and grow other team members as the team scales.
Preferred Qualifications
- Experience with common LLM-serving stacks (vLLM, TensorRT-LLM, Triton, SGLang, or similar).
- Exposure to GPU-cluster capacity planning or multi-region/multi-cloud deployment.
- Exposure to a regulated or compliance-heavy production environment (ISO 27001, SOC 2, or comparable).
- Familiarity with systems development languages (Rust, Go, etc.).
- Comfort with systems-level optimization: improvements to rate-limiting and routing approaches, and identifying bottlenecks across networking, hardware, and lower-level software.
What’s in it For You?
- Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, including work from anywhere for up to 8 weeks per year, empowering employees to achieve a better work-life balance.
- Career Development and Growth: By fostering a culture of continuous learning and skill development, we prepare our talent to tackle tomorrow’s challenges and deliver real-world solutions. Our Grow My Way programming and skills-first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future.
- Industry Competitive Benefits: We offer comprehensive benefit plans to include flexible vacation, two company-wide Mental Health Days off, access to the Headspace app, retirement savings, tuition reimbursement, employee incentive programs, and resources for mental, physical, and financial wellbeing.
- Culture: Globally recognized, award-winning reputation for inclusion and belonging, flexibility, work-life balance, and more. We live by our values: Obsess over our Customers, Compete to Win, Challenge (Y)our Thinking, Act Fast / Learn Fast, and Stronger Together.
- Social Impact: Make an impact in your community with our Social Impact Institute. We offer employees two paid volunteer days off annually and opportunities to get involved with pro-bono consulting projects and Environmental, Social, and Governance (ESG) initiatives.
- Making a Real-World Impact: We are one of the few companies globally that helps its customers pursue justice, truth, and transparency. Together, with the professionals and institutions we serve, we help uphold the rule of law, turn the wheels of commerce, catch bad actors, report the facts, and provide trusted, unbiased information to people all over the world.
Our use of AI within the recruitment process
Thomson Reuters utilizes Artificial Intelligence (AI) to support parts of our global recruitment process. Unless you opt-out, our AI system will assess the information provided by you and compare it to the requirements listed for the role, and present the result to our recruitment personnel for further review. The AI system acts as a supporting tool, but there is always a human making the decision if you will be considered for the role. In the United States, Thomson Reuters offers a comprehensive benefits package to our employees. Our benefit package includes market competitive health, dental, vision, disability, and life insurance programs, as well as a competitive 401k plan with company match. In addition, Thomson Reuters offers market leading work life benefits with competitive vacation, sick and safe paid time off, paid holidays (including two company mental health days off), parental leave, sabbatical leave. These benefits meet or exceeds the requirements of paid time off in accordance with any applicable state or municipal laws. Finally, Thomson Reuters offers the following additional benefits: optional hospital, accident and sickness insurance paid 100% by the employee; optional life and AD&D insurance paid 100% by the employee; Flexible Spending and Health Savings Accounts; fitness reimbursement; access to Employee Assistance Program; Group Legal Identity Theft Protection benefit paid 100% by employee; access to 529 Plan; commuter benefits; Adoption & Surrogacy Assistance; Tuition Reimbursement; and access to Employee Stock Purchase Plan. Thomson Reuters complies with local laws that require upfront disclosure of the expected pay range for a position. The base compensation range varies across locations. For any eligible US locations, unless otherwise noted, the base compensation range for this role is $127,400 USD - $236,600 USD. For Ontario, Canada, the base compensation range for this role is $140,000 CAD - $175,000 CAD. Base pay is positioned within the range based on several factors including an individual’s knowledge, skills and experience with consideration given to internal equity. Base pay is one part of a comprehensive Total Reward program which also includes flexible and supportive benefits and other wellbeing programs. This role may also be eligible for an Annual Bonus based on a combination of enterprise and individual performance. This job posting will close 03/31/2027.About Us
Thomson Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the right decisions. We serve professionals across legal, tax, accounting, compliance, government, and media. Our products combine highly specialized software and insights to empower professionals with the data, intelligence, and solutions needed to make informed decisions, and to help institutions in their pursuit of justice, truth, and transparency. Reuters, part of Thomson Reuters, is a world leading provider of trusted journalism and news. We are powered by the talents of 26,000 employees across more than 70 countries, where everyone has a chance to contribute and grow professionally in flexible work environments. At a time when objectivity, accuracy, fairness, and transparency are under attack, we consider it our duty to pursue them. Sound exciting? Join us and help shape the industries that move society forward. As a global business, we rely on the unique backgrounds, perspectives, and experiences of all employees to deliver on our business goals. To ensure we can do that, we seek talented, qualified employees in all our operations around the world regardless of race, color, sex/gender, including pregnancy, gender identity and expression, national origin, religion, sexual orientation, disability, age, marital status, citizen status, veteran status, or any other protected classification under applicable law. Thomson Reuters is proud to be an Equal Employment Opportunity Employer providing a drug-free workplace. We also make reasonable accommodations for qualified individuals with disabilities and for sincerely held religious beliefs in accordance with applicable law. More information on requesting an accommodation here. Learn more on how to protect yourself from fraudulent job postings here. More information about Thomson Reuters can be found on thomsonreuters.com$100k - $145k per year
...support our evolving business needs. Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to... ...first approach ensures you have the tools and knowledge to grow, lead, and thrive in an AI-enabled future. Industry Competitive...SeniorFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week- ...Who are we? Cohere is the leading security-first enterprise AI company... ...is a team of researchers, engineers, designers, and more, who are... ...applications? We are looking for a Lead Member of Technical Staff to... ...coding standards and conduct senior-level technical reviews...SeniorFull timeWork at officeLocal areaRemote workHome office
- ...GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale... ...prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to productionize and...SuggestedFull time
- ...GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale... ...prefill with ultra-fast decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the...SuggestedFull time
- ...what’s best for our customers. Cohere is a team of researchers, engineers, designers, and more, who are passionate about their craft.... ...accelerators), especially how they influence latency and throughput of inference. ~ Strong understanding or working experience with...SuggestedFull timeWork at officeRemote workFlexible hours
$100k - $145k per year
...family was developed by training leading open-weight models on decades... ...model release. Our research engineers build the systems that train,... ...and at scale. We are hiring at Senior and Lead level across two areas... ...across training frameworks, inference engines and evaluation code....SeniorFull timeLocal areaFlexible hours- ...other trading applications and partners, within RBC and Capital Markets, and external vendor partners. We are looking for a lead senior software engineer, a seasoned technologist to build cutting-edge, products and solutions in cloud environments. You'll join a very dynamic,...Senior
- ...management responsibilities. Ready to lead Summit system across AMER trading? Why... ...Markets and Securities Services team as a Lead Engineer supporting Summit - the primary trading... ...and support teams Partner with senior IT and business stakeholders including global...SeniorFlexible hours
usd205k per year
...Who are we? Cohere is the leading security-first enterprise AI company. We... ...Cohere is a team of researchers, engineers, designers, and more, who are all... ...Role Overview We're seeking a senior product leader to own Cohere's Inference as a Service business end to end....SeniorFull timeWork at officeLocal areaRemote workHome office$115k - $165k per year
...Job Description Overview The Engineering Lead role will be hired under the Engineering Management Centre of Excellence group within the Engineering... ...identification. Demonstrable experience in managing senior stakeholder relationships and providing strategic level...SeniorFull timeContract workFor contractorsInternshipWork at officeFlexible hours- ...same. You’ll be working with varied and diverse teams to deliver unique and unprecedented products across industries. As a Senior Lead AI Engineer , you are primarily responsible for managing technical projects and helping teams design and build AI/ML systems and pipelines...SeniorFull timeWork at officeLocal areaRemote workFlexible hours3 days per week1 day per week
$115k - $165k per year
...Job Description Overview The Engineering Lead role will be hired under the Engineering Management Centre of Excellence group within the... ...solution identification. Demonstrable experience in managing senior stakeholder relationships and providing strategic level...SeniorFull timeContract workFor contractorsInternshipWork at officeFlexible hours$72.06k - $138.94k per year
...At Capgemini Engineering, the world leader in engineering services, we... ...production-grade large language model inference across current and next-... ...benchmarking against leading GPU platforms. Your role... ...audiences and business impact to senior stakeholders . ~ Preferred...SeniorPermanent employmentFull timeLocal areaRemote work- ...as Regional Head of electronic Trading (eTrading) Infrastructure Engineering in Toronto, Canada. This role owns the regional infrastructure... ...and carriers to deliver regional outcomes. Regional execution: Lead data-centre builds, migrations, refreshes and exchange...Permanent employmentRemote work
- ...helping businesses grow through technology. The Role The Lead IT Engineer leads complex IT implementation, migration, and... ...services for existing clients. Technical Escalations: Serve as a senior escalation point for complex issues involving Microsoft 365, Azure...SeniorPermanent employmentFull timeWork at officeFlexible hours3 days per week
- ...pace, and raising the bar. This is the place. The Role As Lead Legal Engineer , you’ll operate as a player-coach: leading Legora’s most... ...scalable onboarding and implementation frameworks. Acting as a senior thought partner to clients, building trusted relationships...SeniorWork at office
- We are looking to engage an experienced Senior FinOps Engineer / Cloud Cost Optimization Lead to help us establish a sustainable cloud cost optimization practice within our Data Platforms group. Our objective is not simply a one-time AWS cost assessment or cleanup. We want...SeniorLong term contractFor subcontractor
$140.6k - $190.6k per year
...We are seeking a highly skilled and experienced Lead IAM Engineer to join our team. This role will be responsible for the design, implementation... ...-factor authentication (MFA). This individual will serve as a senior technical resource for identity architecture, security...SeniorRemplacementLong term contractWork at officeLocal areaFlexible hours$95k - $130k per year
...PCMag and others, Cosmo is on the rise. About the Role Reports To: QA Engineering Manager Department: Engineering Role Summary: We are seeking a highly skilled and forward-thinking Lead QA Engineer to guide our global QA efforts while introducing and embedding AI...Full time$130k - $168k per year
...ll make things happen fast. As a Senior Software Engineer, you will design, build, and operate software... ...impact. You will independently lead substantial technical projects within... ...support applications, analytics, and model inference. Define and measure success....SeniorRemote work$84k - $175k per year
...ones, in accounting, compliance and tax, are in build. You'll lead a small engineering team across our platform and one of our first products,... ...structured SOPs, and automated workflows across ERPs, CRMs, tax engines, and financial systems. A reusable, multi-agent operating...Permanent employmentFlexible hours- ...is the opportunity? Are you a hands-on data platform engineer who thrives on building cloud-native, high-scale data... ...analytics and controls using a medallion architecture. As a Lead Data Platform Engineer, you will be a senior individual contributor and technical lead, owning the...SeniorContract work
$94k - $138k per year
Lead IT Support Engineer Job Description Overview: CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential... ...will require travel. Responsibilities Serve as the senior onsite technical resource and escalation point for complex hardware...SeniorHourly payFull timeWork at officeLocal areaRemote work$162k - $176k per year
...missions get to space, our world-class Space Systems team is empowering some of the boldest and most ambitious space missions LEAD, MANUFACTURING ENGINEER Based out of Rocket Lab's site Sinclair Interplanetary in Toronto, Ontario, Canada, this role reports to the engineering...Permanent employmentLocal area$108.7k - $158.7k per year
...The Opportunity We are seeking a forward-thinking AI Engineering Lead to join our innovative team and drive the future of Property & Casualty... ...in building robust AI solutions. Collaborate with senior leadership, underwriting, claims and other business and product...SeniorLong term contract$115k - $165k per year
...Position Description: The Senior Technical Lead leads and contributes to hands-on engineering delivery, turning business requirements into secure, resilient cloud services... ...and tracing, model and prompt versioning, and inference cost optimization; relevant cloud, Kubernetes, or...SeniorFull time$100k - $135k per year
...portfolio in the industry. Every day, more than 80 000 colleagues lead the way to greener and smarter mobility worldwide, connecting... ...Delivers and manage Interlocking Hardware and signalling bungalow engineering designs, including equipment and rack layouts, electrical...Seasonal workWork at officeWorldwide$70k - $150k per year
...West Job Family Group: Technology Lead the Next Wave of Innovation at BMO At... ...leveraging emerging technologies, modern engineering practices, and AI-powered solutions to... ...banking. We are seeking a highly motivated Senior Technical Lead who combines deep technical...SeniorContract workPart timeWork at office2 days per week$80k - $175k per year
...and scalable. We are seeking experienced Senior Engineers to help build and operate the core... ...AI runs at BMO : the AI Gateway, Policy Engine, Identity Fabric, AI Registry, Guardrails... ...set by the team's Principal Engineers and Leads, contribute to design discussions, and mentor...SeniorPermanent employmentFull timeContract workPart timeInternshipWork at officeRelocation$120k - $200k per year
...IXL Learning, a global edtech leader with personalized learning products used by millions of students worldwide, is seeking a Lead Software Engineer to manage a team of talented engineers and provide hands-on technical and project leadership. You will participate directly in...Full timeWork at officeWorldwide
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead/Senior Inference Engineer. Be the first to apply!
- lead structural engineer Toronto, ON
- lead process engineer Toronto, ON
- lead software engineer Toronto, ON
- senior financial accountant Toronto, ON
- senior sales consultant Toronto, ON
- senior communications specialist Toronto, ON
- senior bookkeeper Toronto, ON
- senior system administrator Toronto, ON
- senior technical recruiter Toronto, ON
- senior director Toronto, ON
