Senior Ai Engineer (Nvidia + Llm Inference) - Onsite - Toronto, Canada
FullStack
About FullStackFullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI;
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
About FullStackFullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI;
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
We’re Most Proud Of
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
The OpportunityJoin our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).
You will integrate directly into our client's team and work alongside their existing designers and engineers on a daily basis.
What We're Looking For
5+ years of professional experience in AI/ML engineering, software engineering, or machine learning infrastructure.
Advanced English is required.
Successful completion of a four-year college degree is required.
Strong hands-on experience with NVIDIA's AI inference stack, particularly NVIDIA NIM, NeMo, NeMo Guardrails, TensorRT-LLM, and Triton Inference Server.
Proven experience deploying and self-hosting LLMs and embedding models in production on GPU infrastructure.
Practical experience serving and scaling inference workloads, including GPU cluster operations and Kubernetes-based environments, ideally using the NVIDIA GPU Operator.
Strong theoretical and applied understanding of LLMs, including inference optimization, model serving, and the operational challenges of running models at scale.
Experience building and operating private, on-premises AI inference platforms in secure environments.
Ability to implement guardrails and controls for production LLM applications.
Experience working in banking or other regulated industries is a plus.
Ability to work through new and difficult issues and contribute to libraries as needed.
Ability to create and maintain continuous integration and delivery of applications.
Forensic attention to detail.
A positive mindset and a can-do attitude.
Experience working on Agile / Scrum teams.
Meaningful experience working on large, complex systems.
Ability to take extreme ownership over your work. Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon.
Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them.
Nice To HaveWe’re Seeking Engineers Who Are AI-enthusiastic In Their Workflow. Professional Experience Or Personal Project Work With The Following Is a Significant Plus
Cursor, Windsurf, or Google Antigravity.
Claude Code, Gemini CLI, Codex, or Copilot CLI.
Work Authorization Requirements
Applicants must be currently authorized to work in the country of this job posting on a full-time basis.
FullStack will not sponsor applicants for work visas now or in the future.
What We Offer
Competitive pay.
The ability to work with leading startups and Fortune 500 companies.
Continuing education opportunities.
Opportunity to grow and expand your career.
Our talent network is committed to fostering a diverse, inclusive, and accessible environment where IT professionals can find opportunities that match their skills. We welcome individuals of all races, religions, genders, sexual orientations, national origins, abilities, and experiences. Our focus is on connecting talent with projects based on qualifications, ensuring a fair and transparent process that values diverse perspectives and global collaboration.
Learn more about our Applicants Privacy Notice.
#J-18808-Ljbffr
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
About FullStackFullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI;
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
We’re Most Proud Of
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
The OpportunityJoin our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).
You will integrate directly into our client's team and work alongside their existing designers and engineers on a daily basis.
What We're Looking For
5+ years of professional experience in AI/ML engineering, software engineering, or machine learning infrastructure.
Advanced English is required.
Successful completion of a four-year college degree is required.
Strong hands-on experience with NVIDIA's AI inference stack, particularly NVIDIA NIM, NeMo, NeMo Guardrails, TensorRT-LLM, and Triton Inference Server.
Proven experience deploying and self-hosting LLMs and embedding models in production on GPU infrastructure.
Practical experience serving and scaling inference workloads, including GPU cluster operations and Kubernetes-based environments, ideally using the NVIDIA GPU Operator.
Strong theoretical and applied understanding of LLMs, including inference optimization, model serving, and the operational challenges of running models at scale.
Experience building and operating private, on-premises AI inference platforms in secure environments.
Ability to implement guardrails and controls for production LLM applications.
Experience working in banking or other regulated industries is a plus.
Ability to work through new and difficult issues and contribute to libraries as needed.
Ability to create and maintain continuous integration and delivery of applications.
Forensic attention to detail.
A positive mindset and a can-do attitude.
Experience working on Agile / Scrum teams.
Meaningful experience working on large, complex systems.
Ability to take extreme ownership over your work. Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon.
Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them.
Nice To HaveWe’re Seeking Engineers Who Are AI-enthusiastic In Their Workflow. Professional Experience Or Personal Project Work With The Following Is a Significant Plus
Cursor, Windsurf, or Google Antigravity.
Claude Code, Gemini CLI, Codex, or Copilot CLI.
Work Authorization Requirements
Applicants must be currently authorized to work in the country of this job posting on a full-time basis.
FullStack will not sponsor applicants for work visas now or in the future.
What We Offer
Competitive pay.
The ability to work with leading startups and Fortune 500 companies.
Continuing education opportunities.
Opportunity to grow and expand your career.
Our talent network is committed to fostering a diverse, inclusive, and accessible environment where IT professionals can find opportunities that match their skills. We welcome individuals of all races, religions, genders, sexual orientations, national origins, abilities, and experiences. Our focus is on connecting talent with projects based on qualifications, ensuring a fair and transparent process that values diverse perspectives and global collaboration.
Learn more about our Applicants Privacy Notice.
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Senior Ai Engineer (Nvidia + Llm Inference) - Onsite - Toronto, Canada in Winnipeg, MB vacancy
- FullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You will... ...into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML...SeniorFlexible hours
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- Senior AI Engineer, AI Inference Systems Join to apply for the Senior AI Engineer, AI Inference Systems role at Brix .Location : Palo Alto, CAEmployment type : Full-timeSalary : $250k - $350k USD/year + EquityResponsibilities Oversee and optimize the LLM inference...Senior
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
- Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development... ...-based event-driven workflowsPromote AI-assisted engineering with GitHub...SeniorWork at office
- Hygiena in Mississauga, Ontario seeks an Applied AI Engineer to design, build, and deploy GenAI/LLM applications across Hygiena products, including data-driven copilots, retrieval systems, and automation. You will collaborate with product, data, and safety teams to implement...
- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Senior
- Owl.co, based in Toronto, seeks a highly technical Solutions Engineer to own the customer technical relationship and ensure seamless AI integrations in enterprise environments. The role is 5 days a week onsite in our Toronto office, collaborating with Sales, Product, and Engineering...Work at office
$127k - $225k per year
...Huawei Canada has an immediate permanent opening for a Senior Engineer. About the team: The Computing Data Application Acceleration Lab aims to create a leading... ...post-training pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside upstream frameworks (Megatron...SeniorLong term contractPermanent employmentInternshipLocal areaImmediate start- Enhance AI capabilities as a Senior Inference Engineer with Thomson Reuters, where hybrid work enables flexibility. Collaborate with cross-functional teams to deploy and scale cutting-edge AI workloads. In this influential role, you will be embedded within Platform Engineering...Senior
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.About Baseten Baseten powers...InternshipFlexible hours- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...deliver industry-leading training and inference speeds; over 10 times faster than... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve...Senior
- Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise... .... You will own the architecture for complex inference challenges, enable low latency and high throughput,...Senior
$185k - $220k per year
Prime Talent Recruiting is seeking a Senior Product Manager to lead an AI/LLM-driven product line from discovery through deployment. You'll work directly... ...strategy, roadmap, and success metrics. This role targets a Toronto-on-site candidate with 5–10 years of PM experience, data...Senior- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Senior
- Project DescriptionWe are seeking an experienced AI Engineer to design and deliver scalable GenAI solutions. This subcontractor role focuses... ..., and AWS, while leveraging modern architectures such as LLM pipelines, RAG, and agent-based systems . ResponsibilitiesAI...SeniorFor subcontractor
- Le Développeur Java Senior chez DELAN - IT Talent Solutions conçoit et développe des fonctionnalités IA générative (LLM) dans une plateforme SaaS en Java. Vous bâtissez des API REST robustes... ...d expérience, vous maîtrisez MCP, Vertex AI, GCP et Kubernetes, et vous collaborez au...Senior
- Senior Customer Engineer - Toronto CanadaHybrid About UsAt Cloudflare, we are on a mission to help build a better Internet. Today the company runs one... ...who have the instinct to spot a "normalized" problem and the AI-native curiosity to create a solution using the latest...Senior
- Senior AI EngineerLocation: Toronto, ON | Hybrid (3 days onsite: Tuesday-Thursday, 8:30 AM to 5:00 PM)We are seeking an experienced and highly motivated Senior AI Engineer to join the Technology Strategy team supporting transformative AI initiatives. This role is focused on...SeniorInternship
- ...a remote-first company and a people-first global community of senior engineers. Kake engineers are behind some of the world’s most innovative... ...people stay, grow, and thrive (and love eating kake!). Senior AI/LLM Engineers with strong Python experience, skilled in designing...SeniorRemote workFlexible hours
- ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... .... ~2+ years of experience with LangChain, including building LLM-powered applications, tool integrations, retrieval-augmented generation...SeniorFull timeInternshipRemote workRelocation
- Drive innovation at NVIDIA as a Senior ASIC Verification Engineer, focusing on cutting-edge AI designs using formal verification. Collaborate closely to ensure accuracy and enhance verification methodologies. In this senior role, you will verify sophisticated ASIC designs...Senior
$158.4k - $237.6k per year
...Technologies, Inc. Job AreaEngineering Group, Engineering Group Machine Learning Engineering LLM Serving Engineer (Cloud AI Engineering)Qualcomm is utilizing its... ...developing hardware and software solutions for Inference Acceleration. We are hiring LLM Serving...SeniorWork from home- Elevate your career as a Lead Software Engineer at NVIDIA, specializing in AI and conversational tools. You'll drive innovation while creating significant AI-driven applications that carry weight in user interactions. In this role, your contributions will be vital to the...
$111k - $160k per year
...services that help people, businesses and governments realize their greatest potential.Title and Summary Senior Software Engineer (Sanctions Service & AI Inference)Who is Mastercard? Mastercard is a global technology company in the payments industry. Our mission is to connect...SeniorInternshipWorldwide- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered...
- A rapid-growth technology firm in Toronto is seeking a Staff LLMOps Engineer to lead the design and optimization of large language model infrastructure on the... ...deployment pipelines and ensuring high-performance AI applications. Competitive salary and equity are included...Senior
$195k - $390k per year
NVIDIA's technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and... ...Conversational AI!What you'll be doing:Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and...SeniorFlexible hours- Lead Java and LLM engineering for Miratech in a hybrid Toronto role, building scalable microservices and intelligent automation for banking systems.As a Senior Java Developer with LLM expertise, you will design and deliver core banking application systems for a major financial...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ai Engineer (Nvidia + Llm Inference) - Onsite - Toronto, Canada. Be the first to apply!
Related searches
- senior financial accountant Winnipeg, MB
- senior sales consultant Winnipeg, MB
- senior communications specialist Winnipeg, MB
- senior bookkeeper Winnipeg, MB
- senior system administrator Winnipeg, MB
- senior technical recruiter Winnipeg, MB
- senior director Winnipeg, MB
- senior technical specialist Winnipeg, MB
- senior internal auditor Winnipeg, MB
- senior line cook Winnipeg, MB

