Lead Engineer for AI Model Infrastructure
Medium
Step into the role of Lead Engineer focusing on building AI model infrastructure. Harness GPU resources and create self-service platforms to enhance AI deployment capabilities.
As a Lead Engineer, your responsibilities include designing and operating GPU infrastructures tailored for diverse AI model use cases. You'll prioritize robust systems for model serving, while also implementing multi-model routing strategies. By spearheading initiatives on model optimization and self-service platforms, you will enhance team efficiency in deploying AI solutions.
Key Responsibilities:
• Design and manage GPU infrastructures for AI models
• Optimize model serving systems for latency and availability
• Drive comprehensive model lifecycle management
• Create self-service tools for developer teams
• Establish observability metrics for system performance
Requirements:
• 8+ years in software engineering
• Proven experience with ML infrastructure and cloud services
• Strong background in GPU-related technologies
• Proficient in Python, Go, or C++
• Familiarity with infrastructure-as-code practices
Transform how teams leverage AI by refining infrastructure standards and enhancing model deployment processes.
#J-18808-Ljbffr
As a Lead Engineer, your responsibilities include designing and operating GPU infrastructures tailored for diverse AI model use cases. You'll prioritize robust systems for model serving, while also implementing multi-model routing strategies. By spearheading initiatives on model optimization and self-service platforms, you will enhance team efficiency in deploying AI solutions.
Key Responsibilities:
• Design and manage GPU infrastructures for AI models
• Optimize model serving systems for latency and availability
• Drive comprehensive model lifecycle management
• Create self-service tools for developer teams
• Establish observability metrics for system performance
Requirements:
• 8+ years in software engineering
• Proven experience with ML infrastructure and cloud services
• Strong background in GPU-related technologies
• Proficient in Python, Go, or C++
• Familiarity with infrastructure-as-code practices
Transform how teams leverage AI by refining infrastructure standards and enhancing model deployment processes.
#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Engineer for AI Model Infrastructure in Toronto, ON vacancy
$130k - $145k per year
...We are seeking a highly skilled and passionate Senior DevOps Engineer, AI infrastructure to join our team! You will play a key role in designing,... ...evaluate, and analyze the performance of LLM and other GenAI models. Collaborate closely with engineering teams to deploy and...SuggestedFull timeInternshipWork at officeFlexible hours$101k - $169k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 131871 Primary Location: Toronto, ON... ...the best solutions to their complex challenges. Lead and oversee complex, high-impact engagements in the AI Model Risk Space, ensuring alignment with industry best...SuggestedPermanent employmentContract workFlexible hours$140.6k - $190.6k per year
...The Lead AI Forward Engineer designs and guides the delivery of AI-powered solutions that reduce operational toil and accelerate technology teams... ...and fit. Design flexible architectures that can evolve with model/provider changes and emerging AI capabilities. Apply sound...SuggestedFull timeManual laborWork at officeLocal areaFlexible hours2 days per week3 days per week$140k - $175k per year
...Analytics is building self-service tools and operating AI agents that influence product development; agents... ...to scale agentic solutions and own the shared infrastructure underneath it. We are seeking an AI Engineering Lead to own that layer across a team of roughly 35 analysts...SuggestedRemplacementFull timeWork at officeLocal areaFlexible hours2 days per week3 days per week$140k - $175k per year
...organization. Are you excited about building AI‑driven software that redefines how... ...resources of a global leader. As a Lead Software Engineer, you will play a pivotal role in developing... ...in distributed systems, API and data model design. ~ Strong debugging skills and...SuggestedWork at officeLocal areaFlexible hours2 days per week3 days per week- Step into a transformative role as Lead Software Engineer focusing on AI Innovations at CPP Investments in New York. This hands-on position combines leadership... ...experience with AI focus • Experience in Gen AI models and frameworks • Proficient in AWS services and container...
$140k - $175k per year
...connected set of products spanning Engagement Manager and Guided Assurance. As a Lead Software Engineer AI (Staff Engineer AI), you will own core backend and AI orchestration systems that turn frontier models into reliable, production‑grade workflows at scale. You will also help...Long term contractFull timeWork at officeLocal areaFlexible hoursShift work2 days per week3 days per week- ...now. We are currently seeking a Agentic AI Engineer to join our team in toronto, Ontario (CA-... ...orchestration) Develop classical ML models (risk scoring, prediction, clustering, anomaly... ...innovation. We are one of the world's leading AI and digital infrastructure providers,...Work at officeRemote workFlexible hours
- ...Role: Azure Cloud Infrastructure Engineer with AI Total Experience: 8–10 Years Required Skill Set Architectural Design: Define and implement robust, secure, and scalable Azure cloud architectures, including Azure Landing Zones for multi-account environments....Contract work
$135k - $210k per year
...Overview: Guidepoint seeks an experienced AI Engineer as an integral member of the Toronto-... ..., dedicated to building a modern data infrastructure for advanced analytics and the... ...powered systems, including large language model (LLM) applications and research agents,...Full timeWorldwide- ...on-demand space connectivity - we're leading it! Our mission is to provide... ...five years in a row! As a Senior Modeling & Simulation (M&S) Engineer , you will develop models, tools, and... ...new tools and technology (including AI) to learn, grow, and improve. Success...Full timeWork at officeRelocation package
$147k - $245k per year
...now. We are currently seeking a Senior AI Engineer - Remote to join our team in Toronto,... ...have a strong background in implementing AI models, analyzing and improving existing AI architectures... ...to Have; (But not a must) • Project lead experience with a global team •...Work at officeRemote workFlexible hours$65k - $85k per year
...group, an international consulting and engineering group, a world leader in the design of transport infrastructures. SYSTRA Canada is an engineering and... .../ BIM Manager / Structural Lead Engineer Job Purpose The BIM Modeller – Structural Engineering is responsible...Internship- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With... ...efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and... ...maintainability of the world model codebase and infrastructure. - Stay on top of emerging advances...Full time
- ...Threat Modeler / Security Architect – AI Security, Cloud & DevSecOps Must Have Technical/Functional Skills... ...programs. Secure Design & Engineering Enablement • Develop, maintain... ...security capabilities using industry-leading technologies to improve IT risk...Permanent employment
$130k - $165k per year
...What We Need We’re looking for a Senior AI Engineer to design and build production-grade... ...integrations) Evaluate AI frameworks and infrastructure (e.g., LangChain, LangGraph, AutoGen,... ..., prompt regressions, agent failures) Lead system design and drive technical decisions...Work at office1 day per week- ...that makes this real: a unified AI agent that sells, supports,... ...of ecommerce, and we’re leading that shift. Our mission is... ...platforms and tooling used by AI and engineering teams Reduce manual... ..., production-ready agent. Infrastructure Collaboration: Partner with...Long term contractRemplacementFull timeInternshipWork at officeWork from homeShift work
$72k - $138k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 130069 Primary Location... ...-- We are looking for a passionate AI Research Engineer to join our team. You will work at the... ...you and how you can contribute. Be the leader you want to be Some guide teams, some...Permanent employmentFlexible hours$101k - $169k per year
...Temporary Contract Work Model: Hybrid Reference code: 133422... ...expanding Financial Engineering and Modeling group? Are you up... ...you can contribute. Be the leader you want to be Some guide teams... ...human screening combined with AI technology to help identify the...Temporary workFlexible hours$84k - $175k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 133810 Primary... ...GenAI & Agent Solution Delivery • Lead design and implementation of AI-powered applications and agents... ...GenAI solutions including: o Prompt engineering o Retrieval-Augmented Generation...Permanent employmentFlexible hours- ...of the agentic enterprise. To usher in this new era, we seek AI-native thinkers across every function who are energized by the... ...redefine the future of how work gets done. Come join our Engineering Infrastructure team as a Software Engineer focused on the CI/CD platform that...Full time
$140.6k - $190.6k per year
...seeking a highly skilled and experienced Lead IAM Engineer to join our team. This role will be... ...support of complex enterprise identity infrastructure across both on-premises and cloud-integrated... ...controls, and secure administrative models. Partner with other IAM and security...Long term contractRemplacementWork at officeLocal areaFlexible hours2 days per week3 days per week- We are looking for an experienced AI Engineer to design and deliver scalable Gen AI solutions.... ...Responsibilities Lead and actively contribute to the... ...initiatives. Gen AI models (GPT, Claude, Gemini, LLaMA) and prompt...For subcontractor
- Join TMX as a Systems Engineer in Toronto, managing patch processes across diverse platforms in a hybrid work model. Drive vulnerability management and optimize... ...patch management tools, you’ll lead validation protocols and enhance infrastructure resilience. Key...Contract workInternship
- ...developed in partnership with Nebius AI. Our team is fully remote and... ...a program for experienced engineers transitioning into system... ...Systems Module 4 — Cloud Infrastructure & Platform Engineering (Kubernetes... ...(Zero-trust, threat modeling, compliance, secure CI/CD)...Work at officeRemote workFlexible hours
- ...Your role and responsibilities: As a Lead Data Engineer you will take Xanadus existing data... ...across the organization and build the infrastructure that enables data-driven decisions at every... ...transformation serving) Define data models in collaboration with researchers and analysts...Full time
$90k - $130k per year
...AI Lead Consultant Greenlight helps organizations solve complex business challenges through... ...deep consulting expertise with hands-on engineering to bridge the gap between strategy and... ...the right thing. Working in a two-in-a-box model alongside a Forward Deployed Engineer,...Casual workLive InRemote work- ...Leadership & Team Development Lead and grow multiple teams across SRE, Cloud Infrastructure, and MLOps. Coach and develop engineering managers and senior individual contributors... ...ML‑specific reliability, ensuring that model inference pipelines and vector databases...
- ...we're building the world's first operating system for data and AI. We use the term "operating system" in the truest sense: just... ...tailored to each business's unique needs. We are seeking an Infrastructure Engineer to join our Business Automation team to own and operate the...Full time
$69k - $114k per year
...Job Type: Permanent Work Model: Remote Reference code: 133733... ...Deloitte Global is the engine of the Deloitte network. Our professionals... ...and borders to develop and lead global initiatives. We deliver... ...human screening combined with AI technology to help identify the...Permanent employmentRemote workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Engineer for AI Model Infrastructure. Be the first to apply!
