Senior Ai Engineer (Nvidia + Llm Inference) - Onsite - Toronto, Canada
FullStack
About FullStackFullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI;
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
About FullStackFullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI;
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
We’re Most Proud Of
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
The OpportunityJoin our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).
You will integrate directly into our client's team and work alongside their existing designers and engineers on a daily basis.
What We're Looking For
5+ years of professional experience in AI/ML engineering, software engineering, or machine learning infrastructure.
Advanced English is required.
Successful completion of a four-year college degree is required.
Strong hands-on experience with NVIDIA's AI inference stack, particularly NVIDIA NIM, NeMo, NeMo Guardrails, TensorRT-LLM, and Triton Inference Server.
Proven experience deploying and self-hosting LLMs and embedding models in production on GPU infrastructure.
Practical experience serving and scaling inference workloads, including GPU cluster operations and Kubernetes-based environments, ideally using the NVIDIA GPU Operator.
Strong theoretical and applied understanding of LLMs, including inference optimization, model serving, and the operational challenges of running models at scale.
Experience building and operating private, on-premises AI inference platforms in secure environments.
Ability to implement guardrails and controls for production LLM applications.
Experience working in banking or other regulated industries is a plus.
Ability to work through new and difficult issues and contribute to libraries as needed.
Ability to create and maintain continuous integration and delivery of applications.
Forensic attention to detail.
A positive mindset and a can-do attitude.
Experience working on Agile / Scrum teams.
Meaningful experience working on large, complex systems.
Ability to take extreme ownership over your work. Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon.
Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them.
Nice To HaveWe’re Seeking Engineers Who Are AI-enthusiastic In Their Workflow. Professional Experience Or Personal Project Work With The Following Is a Significant Plus
Cursor, Windsurf, or Google Antigravity.
Claude Code, Gemini CLI, Codex, or Copilot CLI.
Work Authorization Requirements
Applicants must be currently authorized to work in the country of this job posting on a full-time basis.
FullStack will not sponsor applicants for work visas now or in the future.
What We Offer
Competitive pay.
The ability to work with leading startups and Fortune 500 companies.
Continuing education opportunities.
Opportunity to grow and expand your career.
Our talent network is committed to fostering a diverse, inclusive, and accessible environment where IT professionals can find opportunities that match their skills. We welcome individuals of all races, religions, genders, sexual orientations, national origins, abilities, and experiences. Our focus is on connecting talent with projects based on qualifications, ensuring a fair and transparent process that values diverse perspectives and global collaboration.
Learn more about our Applicants Privacy Notice.
#J-18808-Ljbffr
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
About FullStackFullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI;
few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value every step of the way. With now over 600 customers in North America, FullStack is one integrated partner for all your AI engineering needs. With FullStack, you move forward with confidence.
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
We’re Most Proud Of
Offering life-changing career opportunities to talented software professionals across the Americas.
Building highly-skilled software development teams for hundreds of the world’s greatest companies.
Having delivered hundreds of successful custom software solutions, which have positively impacted the lives and careers of millions of users.
Our 4.1-star rating on GlassDoor.
Our client Net Promoter Score of 68, twice the industry average.
The OpportunityJoin our talent network and connect with U.S. clients for flexible, project-based development work as a Senior AI Engineer (NVIDIA + LLM Inference).
You will integrate directly into our client's team and work alongside their existing designers and engineers on a daily basis.
What We're Looking For
5+ years of professional experience in AI/ML engineering, software engineering, or machine learning infrastructure.
Advanced English is required.
Successful completion of a four-year college degree is required.
Strong hands-on experience with NVIDIA's AI inference stack, particularly NVIDIA NIM, NeMo, NeMo Guardrails, TensorRT-LLM, and Triton Inference Server.
Proven experience deploying and self-hosting LLMs and embedding models in production on GPU infrastructure.
Practical experience serving and scaling inference workloads, including GPU cluster operations and Kubernetes-based environments, ideally using the NVIDIA GPU Operator.
Strong theoretical and applied understanding of LLMs, including inference optimization, model serving, and the operational challenges of running models at scale.
Experience building and operating private, on-premises AI inference platforms in secure environments.
Ability to implement guardrails and controls for production LLM applications.
Experience working in banking or other regulated industries is a plus.
Ability to work through new and difficult issues and contribute to libraries as needed.
Ability to create and maintain continuous integration and delivery of applications.
Forensic attention to detail.
A positive mindset and a can-do attitude.
Experience working on Agile / Scrum teams.
Meaningful experience working on large, complex systems.
Ability to take extreme ownership over your work. Every day is a challenge to ensure you are performing to the expectations you and your team have agreed upon.
Ability to identify with the goals of FullStack's clients, and dedicate yourself to delivering on the commitments you and your team make to them.
Nice To HaveWe’re Seeking Engineers Who Are AI-enthusiastic In Their Workflow. Professional Experience Or Personal Project Work With The Following Is a Significant Plus
Cursor, Windsurf, or Google Antigravity.
Claude Code, Gemini CLI, Codex, or Copilot CLI.
Work Authorization Requirements
Applicants must be currently authorized to work in the country of this job posting on a full-time basis.
FullStack will not sponsor applicants for work visas now or in the future.
What We Offer
Competitive pay.
The ability to work with leading startups and Fortune 500 companies.
Continuing education opportunities.
Opportunity to grow and expand your career.
Our talent network is committed to fostering a diverse, inclusive, and accessible environment where IT professionals can find opportunities that match their skills. We welcome individuals of all races, religions, genders, sexual orientations, national origins, abilities, and experiences. Our focus is on connecting talent with projects based on qualifications, ensuring a fair and transparent process that values diverse perspectives and global collaboration.
Learn more about our Applicants Privacy Notice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Ai Engineer (Nvidia + Llm Inference) - Onsite - Toronto, Canada in Winnipeg, MB vacancy
- FullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You will... ...into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML...SeniorFlexible hours
- Randstad Canada in Toronto is seeking a Senior Software Developer for a 7-month onsite contract to lead AI/ML engineering, LLM pipelines, and model inference workloads. You will run batch inferences in Databricks and cloud ML environments, work with DSPy, LangChain, and Hugging...SeniorContract work
$100k - $145k per year
Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week- ...lululemon Athletica Inc. is seeking a Senior Software Engineer for Data & AI Platforms to design and build enterprise data systems and AI-enabled capabilities... ...teams in a fast-paced retail environment. Based in Canada, this role requires collaboration with product and business...Senior
- Build Java microservices and LLM-powered features with Miratech in a hybrid Toronto role requiring two office days weekly.As a Senior Java Developer, you will lead technical design, development... ...-based event-driven workflowsPromote AI-assisted engineering with GitHub...SeniorWork at office
- Build Java microservices and LLM-powered features as a Senior Java Developer with LLM expertise in a hybrid downtown Toronto role.Miratech seeks a senior engineer to develop core banking systems for a major financial services client. You will apply Java, Spring Boot, RESTful...Senior
- Build production LLM services in Downtown Toronto using Python, Go, and modern AI coding assistants within a hybrid engineering team. This full-time role centers on enterprise AI platform development.As a Senior AI Engineer, you will design, ship, and run services used across...SeniorFull time
- Shape AI inference software at Cerebras Systems with Python, model serving, and production API experience across accelerator backends.This Senior Software Engineer role focuses on making disaggregated inference accessible, reliable, and consistent. You will work across model...Senior
$127k - $225k per year
...Huawei Canada has an immediate permanent opening for a Senior Engineer. About the team: The Computing Data Application Acceleration Lab aims to create a leading... ...post-training pipelines using MindSpeed (MindSpeed-LLM / MindSpeed-MM) alongside upstream frameworks (Megatron...SeniorLong term contractPermanent employmentInternshipLocal areaImmediate start- ...Drive AI innovation as a Senior AI Engineer in Mississauga, Canada. Craft Python-based AI applications using FastAPI or Flask while optimizing performance and scalability for enterprise solutions. We are seeking an experienced Senior AI Engineer with over 8 years in software...Senior
- Owl.co, based in Toronto, seeks a highly technical Solutions Engineer to own the customer technical relationship and ensure seamless AI integrations in enterprise environments. The role is 5 days a week onsite in our Toronto office, collaborating with Sales, Product, and Engineering...Work at office
$165k - $330k per year
About Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay,... ...and Spark Capital. Join us and help build the platform engineers turn to to ship AI products.About Baseten Baseten powers...InternshipFlexible hours- Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This... ...deliver industry-leading training and inference speeds; over 10 times faster than... ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Senior Software Engineer to build and evolve...Senior
- ...Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare... .... ~2+ years of experience with LangChain, including building LLM-powered applications, tool integrations, retrieval-augmented generation...SeniorFull timeInternshipRemote workRelocation
- ...signals into trusted detections at NVIDIA, using Splunk, KQL, Python, and... ...telemetry analysis. This senior role supports a distributed security... ...seeks a Senior Detection Engineer for its Detection and Automation... ...identity, endpoint, developer, AI, and production environments. The...Senior
- Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise... .... You will own the architecture for complex inference challenges, enable low latency and high throughput,...Senior
- ...a remote-first company and a people-first global community of senior engineers. Kake engineers are behind some of the world’s most innovative... ...people stay, grow, and thrive (and love eating kake!). Senior AI/LLM Engineers with strong Python experience, skilled in designing...SeniorRemote workFlexible hours
- A rapid-growth technology firm in Toronto is seeking a Staff LLMOps Engineer to lead the design and optimization of large language model infrastructure on the... ...deployment pipelines and ensuring high-performance AI applications. Competitive salary and equity are included...Senior
- Drive innovation at NVIDIA as a Senior ASIC Verification Engineer, focusing on cutting-edge AI designs using formal verification. Collaborate closely to ensure accuracy and enhance verification methodologies. In this senior role, you will verify sophisticated ASIC designs...Senior
- Build AI inference systems with Python and PyTorch as a Backend Engineer, AI, powering production interactions through reliable, observable APIs.You will own the inference and orchestration layer between models and users. The work covers production backend systems, AI-powered...
- Build generative AI applications in Toronto as a Senior Applied AI Engineer focused on LLMs, code generation, and agentic systems.Bloomberg’s Applied AI Engineers bridge pioneering research and production across financial query understanding, structured data, and customer-facing...Senior
- Drive model integration projects as a Senior Engineer focused on AI LLMs. Engage in end-to-end processes from architecture translation to runtime... ...optimizations and performance debugging. Be a vital member of the Inference Core Model Bringup team, responsible for the integration...Senior
- Design Generative AI and machine learning solutions as a Senior AI Engineer with Celestica’s hybrid Data & Analytics team in Toronto.This senior role connects business stakeholders with technical AI teams across Celestica. You will scope use cases, architect production-ready...Senior
- Build production LLM agents with Python and retrieval-augmented generation at Thomson Reuters in a hybrid Toronto position. Shape reliable AI for go-to-market teams.As a Senior AI Engineer, you will design, develop, and deploy agentic applications end to end. You will create...Senior
- ...247labs is a leading software development company headquartered in Toronto, Canada. We specialize in providing custom software solutions, mobile... ...: About the role247 Labs is looking for a hands-on AI Engineer to design, develop, deploy, and maintain production AI solutions...
- ...about new Director Of Software Engineering jobs in United States . 7,... ...) Director of Engineering - Inference Platform Director, Software... ...Clearance Director, Engineering-(Onsite) Overland Park, KS Director... ..., Software Engineering - AI Platform and Full Stack...Work at officeRemote work
- Smart IT Frame LLC is seeking an experienced software engineer to design, build, and deploy Python-based AI/LLM applications using FastAPI or Flask. The role includes developing REST APIs, scalable enterprise solutions, and AI-powered data analytics platforms. You will optimize...Senior
$165k - $330k per year
...Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence... ...Join us and help build the platform engineers turn to ship AI products. Baseten... ...— with streaming and diarization NVIDIA Nemotron 3 Diarization: real-time...Long term contractFlexible hours- ..., interpretable, and steerable AI systems. We want AI to be safe... ...group of committed researchers, engineers, policy experts, and business leaders... ...systems. About the roleOur Inference team is responsible for... ...management systems Familiarity with LLM inference optimization,...SeniorLong term contractWork at officeWorldwideVisa sponsorshipFlexible hours
$195k - $285k per year
...including but not limited to: Toronto and Montreal.LOCATIONS We are... ...outcomes for their toughest AI challenges. We blend the power... ...across industries. As a Senior Lead AI Developer, you are primarily... ...that leverage our AI and engineering capabilitiesBuilding and...SeniorWork at officeLocal areaRemote workFlexible hours3 days per week1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Ai Engineer (Nvidia + Llm Inference) - Onsite - Toronto, Canada. Be the first to apply!
Related searches
- senior disability case manager Winnipeg, MB
- senior hardware engineer Winnipeg, MB
- senior cook Winnipeg, MB
- amica senior lifestyles Winnipeg, MB
- senior building operator Winnipeg, MB
- senior project manager Winnipeg, MB
- senior communications Winnipeg, MB
- sr. IT support analyst Winnipeg, MB
- senior marketing Winnipeg, MB
- senior manager investigations Winnipeg, MB

