Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, LLM

$195k - $390k per year

NVIDIA

NVIDIA's technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and intelligent assistants. Come join the team and see how you can make a lasting impact on the world! We are looking for someone who's curious, tenacious, and passionate to join our applied research team. We develop tools for powerful, flexible and trustworthy conversational agents. Be a part of the team that builds NeMo Guardrails, an open-source toolkit for easily adding programmable guardrails to large language model-based conversational systems. We build innovative projects connecting dialogue systems, AI safety, and cybersecurity, all working with the latest powerful large language models. Join us to influence and build the next generation of Conversational AI!

What you'll be doing:

  • Work closely with senior engineers to deliver, optimize, maintain, debug, unit test and document next-generation dialogue and security toolkits for large language models
  • Tackle difficult and ambitious problems by contributing to the core development of NeMo Guardrails and Colang
  • Deliver rapid iterations of software based on user feedback and metrics
  • Collaborate with your peers and other teams to craft, develop, test, and maintain integrated applications and features
  • Actively contribute to the adoption of frameworks, standards, and new technologies

What we need to see:

  • BS or MS (or equivalent experience) in Computer Science, Electrical Engineering, or a related field
  • 5+ years of software development experience
  • Strong software engineering and Python programming skills
  • Knowledge of RESTful APIs
  • Proficient in agile methodology
  • Experience in software shipping cycles (dev, deploy, release, CI) and open-source software development
  • You are highly motivated, passionate and curious about new technologies
  • Ability to work optimally with multi-functional teams, principals and architects. Coordinates across organizational boundaries and geographies.

Ways to stand out from the crowd:

  • Research or product development experience with task-oriented dialogue systems
  • Experience with programming language design and development
  • Systems software engineering knowledge and expertise in optimizing software for computational performance
  • Experience with Cloud Service Providers such as AWS, Azure, GCP, and OCI
  • Contributions to open-source software

The base salary range is 195,000 CAD - 390,000 CAD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

#J-18808-Ljbffr
Vacancy posted 7 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, LLM in Toronto, ON vacancy
  • Elevate global supply chains as a Senior LLM Engineer at DATAHEAD. Join a hybrid work model, leveraging your expertise in LLM systems and production features. In this essential, full-time role, you’ll design, build, and optimize LLM systems and retrieval-augmented generation... 
    Senior
    Long term contract
    Full time

    DATAHEAD

    Toronto, ON
    3 hours ago
  •  ...the people who make care possible. The Opportunity As a Senior Software Engineer at Caribou, you will shape the architecture, quality, and...  ...equivalent. Experience with AI/Voice technologies or LLM-powered automations You're excited to both teach and learn... 
    Senior
    Summer work
    Work at office
    Remote work
    1 day per week

    Caribou

    Toronto, ON
    14 days ago
  •  ...an RFP, or which agency is buying a new software system often requires detective-level research...  ...About The Role: Own a product and engineering leadership role in our rapidly growing startup...  ...(e.g., OpenAI, fine‑tuned models, or LLM‑based applications). Familiarity with... 
    Senior
    Internship
    Work from home
    Flexible hours

    NationGraph

    Toronto, ON
    7 days ago
  •  ...healthcare infrastructure. We are hiring Senior Full Stack Engineers to join our Product Engineering...  ...background in shipping production-grade software in modern cloud environments. You are comfortable...  ..., and third-party integrations. AI/LLM Curiosity: Practical experience or... 
    Senior
    Work at office
    Remote work

    OpenLoop Health

    Toronto, ON
    14 days ago
  • Position Description Senior Software Engineer Reporting to: Director of Software Engineering Signal 1 helps health systems accelerate AI adoption...  ...in both technological (pre‑evaluation, post‑evaluation, LLM monitoring, agent monitoring) and healthcare (bias, governance... 
    Senior
    Internship

    Signal 1

    Toronto, ON
    14 days ago
  •  ...experiences (screening, matching, automation) Integrate and apply AI/LLM tools, agents, and automation frameworks to improve product...  ...system design, performance, and scalability Improve engineering velocity through tooling, experimentation, and AI‑assisted development... 
    Senior
    Long term contract
    Temporary work
    Work at office
    Work from home

    Homebase

    Toronto, ON
    7 days ago
  • $130k - $180k per year

    Senior Software Engineer – Python Requisition ID: 49154 Business Unit: Fitch Group Category: Information Technology Location: Toronto, ON,...  ...AI fluency – familiarity with integrating AI/ML services, LLM APIs (e.g., OpenAI, AWS Bedrock), or building AI‑powered features... 
    Senior
    Long term contract
    Temporary work
    Work at office
    Immediate start
    2 days per week
    3 days per week

    Fitch-Group

    Toronto, ON
    7 days ago
  •  ...in real time. We're looking for a Senior Staff Front-End Engineer to define the architecture behind that...  ...systems that connect AI copilots and LLM-powered experiences directly into analytical...  ...What You Will Need ~10+ years of software engineering experience, including... 
    Senior
    Long term contract
    Work at office
    3 days per week

    Rippling

    Toronto, ON
    10 days ago
  • $150k - $200k per year

     ...reality for millions more patients across North America. As a Senior Software Engineer on our Platform team, you'll build the foundational...  ...engineering organization. Claude Code, agentic workflows, and LLM‑driven automation are part of how we design, build, and operate... 
    Senior
    Work at office
    2 days per week

    PocketHealth

    Toronto, ON
    14 days ago
  •  ...Senior Software Engineer – Nubank Join to apply for the Senior Software Engineer role at Nubank . About Us Nubank is one of the largest digital financial platforms in the world, with more than 122 million customers across Brazil, Mexico, and Colombia. Guided by... 
    Senior
    Full time
    Work at office
    Work from home

    Nubank

    Toronto, ON
    7 days ago
  • $148.5k - $181.5k per year

     ...owners can use to run stronger, more resilient businesses. Our Engineering team is at the heart of building banking products that help...  ...reinvent banking, and we’re looking for a curious, impact‑driven Senior Software Engineer to join our growing team – someone who thrives on... 
    Senior
    Long term contract
    Internship

    Dormont Manufacturing Co

    Toronto, ON
    7 days ago
  •  ...design, development and deployment of AI software products. Our objective is to create a software...  ...has been developed by physicists and engineers with decades of experience in designing...  ...delays and costs. We’re looking for a Senior Python developer to join our team (company... 
    Senior

    Edjuster

    Toronto, ON
    7 days ago
  • $160k - $185k per year

     ...partner‑facing tools. You’ll help shape the experience customers and partners depend on to stay connected anywhere. As a Senior Software Engineer, you’ll lead technically significant initiatives across the stack — building React interfaces, Node.js services, and PostgreSQL... 
    Senior
    Remote work
    Flexible hours

    Roadpost

    Toronto, ON
    7 days ago
  •  ...that operate reliably at global scale. We’re looking for a Senior Software Engineer with a strong platform mindset to help design, build, and...  ...cold‑start tradeoffs. Experience running a multi‑provider LLM gateway, including routing between providers, migrating models... 
    Senior
    Immediate start
    Home office

    Mozilla

    Toronto, ON
    1 day ago
  • Fulfil invites you to apply for the Senior Software Engineer II position in Toronto, Ontario. This full-time role emphasizes ownership of web functionalities...  ...and build REST and GraphQL APIs effectively • Integrate LLM features into merchant service areas • Modernize legacy code... 
    Senior
    Full time
    Flexible hours

    Fulfil

    Toronto, ON
    7 days ago
  • $65 - $70 per hour

     ...in integrating, configuring, extending Mindbreeze InSpire insight engine. Proficiency in Java, Python, C, or C++ for using Mindbreeze REST...  ...Mindbreeze Vendor to implement business requirements. Experience with AI/LLM functionalities is a value add. Essential Skills Mindbreeze... 
    Senior

    LanceSoft

    Toronto, ON
    7 days ago
  •  ...career to new heights with Loopio! ✨ Loopio is looking for a senior engineering leader to own our SRE, Infrastructure, and MLOps teams. In this...  ...standards for model deployment, monitoring, and scaling (including LLM orchestration and RAG pipelines). Lead Cloud FinOps, ensuring... 
    Senior
    Remote work
    Work from home
    Home office
    Flexible hours

    Loopio Inc.

    Toronto, ON
    7 days ago
  • $112k - $152k per year

    Senior Software Application Engineer Lead the architectural evolution of core business systems. Analyze existing system designs and data models, identify critical optimization opportunities for scale, performance, resilience, and cost, and drive execution of the vision. What... 
    Senior
    Local area

    Warner Music Group

    Toronto, ON
    14 days ago
  • Job Summary We are seeking a talented and motivated Senior Software Engineer to contribute to the development and evolution of our SaaS platform. This role is primarily focused on backend services and platform architecture, with opportunities to contribute to full-stack features... 
    Senior
    Work at office
    Remote work

    Apertera (formerly Alexa Translations)

    Toronto, ON
    13 days ago
  • Qualifications 5+ years as Software Developer with proven project track record. Strong knowledge of PHP 8, Laravel 9+, MySQL, React...  ...are delivered reliably and efficiently. The codebase and engineering workflows improve over time thanks to your contributions. The... 
    Senior
    Remote work
    Home office
    Flexible hours

    Newrich Network

    Toronto, ON
    14 days ago
  • $100k - $150k per year

     ...first and only cloud-based, fully-customizable, end-to-end software solution to automate securities-based lending from origination...  ...’s contributions make a real impact. About the Role As a Senior Software Engineer, you will play a critical role in defining the architecture... 
    Senior
    Long term contract

    Supernova Technology

    Toronto, ON
    14 days ago
  • What You'll Do We are seeking a highly motivated and experienced Senior Software Engineer to join our fast-growing team. You will design and build large-scale, multi-tenant SaaS systems that power Nue's core revenue workflows. You'll work across a powerful stack — Java... 
    Senior
    Long term contract

    Nue.io

    Toronto, ON
    14 days ago
  • $108.32k - $119.73k per year

     ...Bikini Bottom Consulting. Dive into success with us and navigate the future together. About The Role We are seeking a Senior Software Engineer to join our Engineering team, dedicated to building innovative solutions using cutting-edge technologies. As a key member of... 
    Senior
    Long term contract

    Bikini Bottom Consulting

    Toronto, ON
    14 days ago
  •  ...Best Bank. Visit our institutional page About the role Our Engineering team helps Nubank to create and use the technology that...  ...build the best financial products. We strive for state-of-the-art software development practices that currently include a variety of technologies... 
    Senior

    Nu

    Toronto, ON
    14 days ago
  • Drive innovation at ZoomInfo as a Senior Software Engineer focusing on Internal Developer Platforms. Utilize TypeScript and Node.js to craft high-quality APIs and enhance system performance. In this critical role, you’ll apply your extensive experience to design and maintain... 
    Senior

    ZoomInfo

    Toronto, ON
    3 hours ago
  •  ...Collaborate with product managers, designers, and architects to translate business requirements into technical solutions Contribute to system design discussions and help shape engineering best practices Continuously improve code quality, performance, and reliability #J-18808-Ljbffr
    Senior

    MSR Technology Group

    Toronto, ON
    1 day ago
  • Transform cross-border banking solutions with Loop as a Senior Software Engineer in downtown Toronto. Leverage your expertise in full-stack development and technical leadership to drive innovation. In this pivotal role, you will spearhead architectural decisions and full-... 
    Senior

    LOOP

    Toronto, ON
    3 hours ago
  •  ...or niche expertise) Role Description We are looking for a Senior Software Developer to support the Cyber Security portfolio within Cyber...  ...development practices while collaborating closely with engineering, AI/ML, and cybersecurity teams. Key Responsibilities Design... 
    Senior

    Amaris Consulting

    Toronto, ON
    3 hours ago
  • Join TRADER as a Senior Software Engineer and lead backend development with PHP and AI tools in our AutoSync team. Shape automotive retail solutions by pushing technological boundaries while collaborating with top talent. In this influential role within the AutoSync engineering... 
    Senior

    AutoTrader.ca

    Toronto, ON
    3 hours ago
  •  ...real solutions, and measure ourselves by customer outcomes. Our engineering team operates with high autonomy and direct customer impact....  ...look for people who do the same. The Role We’re hiring a Senior Software Engineer to build and scale our platform. You’ll work across... 
    Senior
    Immediate start
    Remote work
    Flexible hours

    SuiteSpot Technology

    Toronto, ON
    7 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, LLM. Be the first to apply!