Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Inference & Compiler Architect

$135k - $185k per year

NVIDIA Corporation

This position requires local presence. Please view similar jobs below.

A leading technology company located in Toronto is seeking a Senior Machine Learning Applications and Compiler Engineer to develop and optimize algorithms for inference and compiler stacks. Ideal candidates should have a strong background in C/C++, compiler development, and deep learning frameworks. This role involves close collaboration with hardware teams, benchmarking performance metrics, and contributing innovative solutions for NVIDIA's platforms. The base salary ranges from 135,000 CAD to 185,000 CAD, depending on level and experience. #J-18808-Ljbffr

Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Senior ML Inference & Compiler Architect in Toronto, ON vacancy
  • $135k - $185k per year

     ...We are now looking for a Senior Machine Learning Applications and Compiler Engineer! NVIDIA is seeking engineers to develop...  ...and optimizations for our inference and compiler stack. You will work...  ...Collaborate closely with hardware architects and design teams to feedback software... 
    Senior

    Nvidia

    Toronto, ON
    3 days ago
  • $100k - $145k per year

     ...support our evolving business needs. Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams...  .... This role ensures that our trained models—from classical ML to generative AI—run efficiently across TR’s multi cloud... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Toronto, ON
    4 days ago
  •  ...to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based...  ...Software Engineer to build and evolve the ML API layer that makes this heterogeneous serving...  ...will work closely with model enablement, compiler, runtime, cloud infrastructure, product,... 
    Suggested
    Full time

    Cerebras

    Toronto, ON
    1 day ago
  • $64k - $106k per year

     ...PySpark over hundreds of millions of transaction records, with the profiling skills to know why a job is shuffling. Design and operate our ML platform layer — feature store, reproducible training pipelines, and cloud training job submission — so retraining is cheap and routine... 
    Senior
    Internship
    Work at office

    Canadian Tire Corporation

    Toronto, ON
    1 day ago
  •  ...that expect a very high level of availability. Backend Developers/architects at IBM/Confluent work on a set of diverse and complex challenges...  ...Cloud (including Connect, Apache Flink, Kafka and more) . As a senior software engineer, you think strategically and you help drive... 
    Senior
    Full time

    IBM

    Toronto, ON
    8 days ago
  • usd205k per year

     ...New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us! Role Overview We're seeking a senior product leader to own Cohere's Inference as a Service business end to end. The product is sovereign, self-serve inference: a mid-market or enterprise buyer... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Toronto, ON
    1 day ago
  •  ...architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud...  ...vLLM, SGLang, PyTorch, Triton, TensorRT-LLM, or another open-source ML systems project. Experience optimizing prefill-heavy or... 
    Full time

    Cerebras

    Toronto, ON
    1 day ago
  • $120 - $180 per hour

     ...investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Senior Software Engineering Experts Type: Contract Compensation: $120–$180/hour Location: Remote Role... 
    Senior
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    14 days ago
  • $123.2k per year

     ...Affirm from incurring financial loss, and increase the trust that consumers and partners have in the Affirm ecosystem Partner with the ML platform team to build fraud specific ML infrastructure Research ground breaking solutions and develop prototypes that drive the... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Affirm

    Toronto, ON
    4 hours ago
  • usd180k - usd247.5k per year

     ...the team's bar through design reviews, pairing, and honest post-mortems You're a great fit if you have ~3+ years building production ML systems, with meaningful time in search, recommendations, or another retrieval-and-relevance domain. ~ Shipped models that served real... 
    Senior
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Toronto, ON
    1 day ago
  •  ...infrastructure and energy management. In this senior technical leadership role, you will drive...  ..., quality and security compliance. AI/ML Energy Optimization: Spearhead advanced AI...  ...guidance and mentorship to engineers and architects on power and energy infrastructure.... 
    Senior
    Long term contract
    Full time
    Work at office
    Local area
    3 days per week

    Bell

    Toronto, ON
    1 day ago
  • usd180k - usd247.5k per year

     ...s rich proprietary data with agentic AI and web search, and is increasingly able to take action on retailers’ behalf. As a Senior Applied AI/ML Scientist on the Compass team, you will be the science and technical lead for this product — driving agent quality through data... 
    Senior
    Internship
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Toronto, ON
    1 day ago
  •  ...for who they are and what they contribute. To learn more about CIBC, please visit CIBC.com What You’ll Be Doing As a Senior Solutions Architect Management in Enterprise Solution Design, you will join CIBC’s Technology department responsible for the delivery of... 
    Senior
    Remote work

    CIBC

    Toronto, ON
    1 day ago
  • $80k - $138k per year

     ...skills. On a typical engagement you will: Architect and lead delivery of modern data platforms...  ...us, let’s talk about you This is a Senior Consultant role: 7–10 years of total experience...  ...). Exposure to real-time features for ML and agentic use cases. Familiarity with... 
    Senior
    Permanent employment
    Apprenticeship
    Flexible hours

    Deloitte

    Toronto, ON
    19 hours ago
  • $96.2k - $120.2k per year

     ...Job Description Senior Data Architect at a glance... Location : Toronto, ON Hybrid : 3 days/week This position implements and maintains domain specific data architecture at Kraft Heinz, ensuring assigned data assets are properly organized, structured, and secured. Collaborate... 
    Senior
    Full time
    Flexible hours
    3 days per week

    Kraft Heinz

    Toronto, ON
    4 days ago
  • $113k - $163k per year

     ...The Senior Integration Architect shapes the strategy, standards, target-state architecture and governance required to enable secure, scalable, resilient and reusable integration across the US Segment. The role provides architecture leadership across APIs, services, events,... 
    Senior
    Long term contract
    Temporary work
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Manulife

    Toronto, ON
    1 day ago
  •  ...We are looking for a Senior Data Architect to design and implement the end-to-end data platform for APEX, integrating call center telephony and quality data from the Genesys A3S Snowflake database and Verint Workforce Management (WFM) feeds. The role will focus on building... 
    Senior
    Internship
    Work at office
    Remote work
    Relocation
    2 days per week

    Miratech

    Toronto, ON
    1 day ago
  • $99.45k - $209.9k per year

     ...working on exciting client initiatives are limitless in this ever-changing space. You Are: We are looking for a highly effective Senior AEM Architect to join our team. This person will utilize best practices and methodologies to design and implement the best solution for our... 
    Senior
    Full time
    Work at office
    Local area

    Accenture Global

    Toronto, ON
    5 days ago
  • $160k per year

     ...platforms, at scale. What You'll Do Senior AI Tech Architects - AI Platforms at BCG Platinion are: Collaborative...  ...implementation of batch and real-time inference pipelines with attention to performance...  ...experience building or integrating AI/ML or LLM-based components. ~... 
    Senior
    Long term contract
    Full time
    Work at office
    Local area
    Immediate start
    Flexible hours

    Boston Consulting Group

    Toronto, ON
    4 days ago
  • $72.06k - $138.94k per year

     ...of engineers, scientists, and architects to help the world’s most...  ...production-grade large language model inference across current and next-...  ...workloads at the framework, compiler, or kernel level, and designing...  ...and business impact to senior stakeholders . ~ Preferred... 
    Senior
    Permanent employment
    Full time
    Local area
    Remote work

    Capgemini

    Toronto, ON
    11 days ago
  • $113k - $163k per year

     ...Job Description: The Senior Cybersecurity Architect is responsible for supporting projects that apply new and existing technologies and solutions to solve business needs in the cyber security space, for the US business segment. This Architect works with other architects,... 
    Senior
    Long term contract
    Temporary work
    Work at office
    Local area
    Remote work
    Work from home

    Manulife

    Toronto, ON
    1 day ago
  •  ...nearly 1000 full-time professionals, and our annual growth rate exceeds 25%. Job Description We are looking for a Senior Data Architect to design the end-to-end data platform for APEX. The platform ingests contact centre telephony and quality data from the... 
    Senior
    Hourly pay
    Full time
    Internship
    Work at office
    Remote work
    Relocation
    2 days per week

    Miratech

    Toronto, ON
    15 days ago
  •  ...Strategy team is seeking a highly motivated and visionary leader to join the team defining our long-term network architecture. In this senior technical leadership role, you will drive the strategic 3+ year roadmap with a heavy focus on Wireless Core Networks, Satellite... 
    Senior
    Long term contract
    Full time
    Work at office
    Shift work
    3 days per week

    Bell

    Toronto, ON
    1 day ago
  • Responsibilities: Applied to both the process and the outcome of thinking out and specifying the overall structure, logical components, and the logical interrelationships of a computer, its operating system, a network, or other conception. Defines the structure and ...
    Senior
    Contract work

    Maarut

    Toronto, ON
    7 hours ago
  •  ...Building Code Excellent written and verbal communication skills Education and Experience Degree in Architecture; Registered Architect (OAA preferred) Minimum 15 years of experience in data centre and industrial building projects Typical office environment... 
    Senior
    Work at office

    Stantec

    Toronto, ON
    1 day ago
  •  ...computational characteristics of accelerators (GPUs, TPUs, and/or custom accelerators), especially how they influence latency and throughput of inference. ~ Strong understanding or working experience with distributed systems. ~ Experience in Golang, C++ or other languages designed... 
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    Toronto, ON
    4 days ago
  •  ...We are seeking an experienced Senior Data Architect/Modeller to lead the review, analysis, and design of robust data architectures within complex, distributed application environments. In this role, you will analyze business requirements and existing source applications to... 
    Senior
    Contract work
    Remote work
    Flexible hours

    Randstad Canada

    Toronto, ON
    1 day ago
  •  ...dynamic forms Requirements Experience and Skill Set Requirements: Must Haves: Strong application/data/ information architect Microsoft Azure: Expert in Azure architecture, including security, networking, identity, data services, and monitoring.  Enterprise... 
    Senior
    Contract work
    Internship

    Maarut

    Toronto, ON
    7 hours ago
  •  ...in Golang, C++ or other languages designed for high-performance scalable servers, with the ability to set coding standards and conduct senior-level technical reviews Full-Time Employees At Cohere Enjoy These Perks A weekly lunch stipend of $75/£75 or equivalent in your... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Toronto, ON
    1 day ago
  • $120 per hour

    Job Responsibility: on behalf of our client on Public Sector. we are looking for contract Sr Solutions Architect Duration : 6 month WORK MODE: Hybrid, Must Haves: - 10 years of experience in the development and implementation of application architectures - large-scale... 
    Senior
    Hourly pay
    Full time
    Contract work
    Fixed term contract
    Remote work
    Day shift

    EBF

    Toronto, ON
    4 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Inference & Compiler Architect. Be the first to apply!