Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Inference Engineer — Model Efficiency

Cohere

A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time. #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Inference Engineer — Model Efficiency in Toronto, ON vacancy
  •  ...training and deploying frontier models for developers and enterprises who...  ...Cohere is a team of researchers, engineers, designers, and more, who are passionate...  ...of what AI systems can do — but inference is still the bottleneck. The Model Efficiency team is responsible for pushing... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    Toronto, ON
    4 days ago
  • $100k - $145k per year

     ...support our evolving business needs. Thomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to...  ..., and Enterprise AI teams to onboard new research models into production. About the Role As a Senior Inference Engineer... 
    Senior
    Full time
    Work at office
    Local area
    Flexible hours
    2 days per week
    3 days per week

    Thomson Reuters

    Toronto, ON
    4 days ago
  •  ...training and deploying frontier models for developers and enterprises who...  ...Cohere is a team of researchers, engineers, designers, and more, who are passionate...  ...focused on building reliable ML systems and pushing the boundaries of LLM inference efficiency. We develop techniques... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    Toronto, ON
    4 days ago
  • $136.7k - $182.3k per year

     ...company, which means we pair our small, senior engineering team with the reach of one of the world's...  ...will you work on?You'll build and tune the models and pipelines that let kids make stickers...  ...and shipped. Partner with our ML Serving engineer to get new products into... 
    Senior
    Full time
    Flexible hours

    Spin Master

    Toronto, ON
    4 days ago
  • $101k - $169k per year

     ...Job Type:  Permanent   Work Model:  Hybrid   Reference code: 131871 Primary Location:  Toronto, ON All Available Locations:  Toronto, ON   Our Purpose   At Deloitte, we are driven to inspire and help our people, organization, communities, and country to... 
    Suggested
    Permanent employment
    Contract work
    Flexible hours

    Deloitte

    Toronto, ON
    15 hours ago
  • $64k - $106k per year

     ...online lift. Research and apply modelling methodology to select (and...  ...optimize large-scale feature engineering in PySpark over hundreds of millions...  .... Design and operate our ML platform layer — feature store...  ...AI solutions that automate model improvement — extending our in... 
    Senior
    Internship
    Work at office

    Canadian Tire Corporation

    Toronto, ON
    1 day ago
  •  ...potential in an environment that’s engineered for people. At CIMA+, we care about...  ...cyclists co-exist safely and travel efficiently. Join us and immerse yourself in a dynamic...  ...better world! We are looking for Senior Traffic Engineer/Modeller to support our expanding... 
    Senior
    Permanent employment
    Full time
    Work at office
    Work from home
    Flexible hours

    CIMA+

    Toronto, ON
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ...works with the leading model labs, global enterprises, and...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer...  ..., tail latency, and capacity efficiency. This is a hands-on role... 
    Full time

    Cerebras

    Toronto, ON
    2 days ago
  •  ...industry-leading training and inference speeds; over 10 times faster than...  ...works with the leading model labs, global enterprises, and cutting...  ...decode on the Cerebras Wafer-Scale Engine. We are hiring a Software Engineer to build and evolve the ML API layer that makes this... 
    Full time

    Cerebras

    Toronto, ON
    2 days ago
  • $120 - $180 per hour

     ...Angelo , Larry Summers , and Jack Dorsey . Position: Senior Software Engineering Experts Type: Contract Compensation: $120...  ...task realism, verification, and challenges for current AI models . Illustrate "what good looks like" with reference... 
    Senior
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    15 days ago
  • $123.2k per year

     ...solves problems critical to our business model - personalizing shopping experiences, detecting...  ...the Affirm ecosystem Partner with the ML platform team to build fraud specific ML...  ...production models Collaborate with the engineering, fraud, and product teams to define... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Affirm

    Toronto, ON
    1 day ago
  • We are seeking an experienced Senior Data Architect/Modeller to design, evolve, and implement enterprise data...  ...physical data models supporting AI/ML pipelines, Generative AI workloads, Retrieval...  ...-Augmented Generation (RAG), feature engineering, and advanced analytical solutions.... 
    Senior
    Contract work
    3 days per week

    Randstad

    Toronto, ON
    8 days ago
  •  ...training and deploying frontier models for developers and...  ...Cohere is a team of researchers, engineers, designers, and more, who are...  ...ensure smooth operations and efficient teamwork ~ The grit and adaptability...  ...latency and throughput of inference. ~ Strong understanding or... 
    Full time
    Work at office
    Remote work
    Flexible hours

    cohere

    Toronto, ON
    4 days ago
  • $84k - $126k per year

     ...Job Type:  Permanent   Work Model:  Hybrid   Reference code: 133157 Primary Location:  Toronto, ON All Available Locations:  Toronto, ON   Our Purpose   At Deloitte, our Purpose is to make an impact that matters. We exist to inspire and help our people,... 
    Senior
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    1 day ago
  •  ...more than selecting the newest model. It requires disciplined...  ...looking for an applied AI Modeling Engineer to improve the intelligence, accuracy...  ...and experience with modern ML tooling such as PyTorch, JAX,...  ...services, or training and inference pipelines. ~ Strong software... 
    Long term contract
    Full time
    Temporary work
    Internship
    Immediate start

    Palona AI

    Toronto, ON
    more than 2 months ago
  • usd118.8k per year

     ...scooters, or on foot in the most efficient way. To serve these needs, we...  ...are hiring a Machine Learning Engineer to join our Routing team. Our...  ...to explore and compare ML and non-ML solutions Be able...  ...make effective tradeoffs between model accuracy, its productization complexity... 
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft

    Toronto, ON
    2 days ago
  • $154k - $199.5k per year

     ...We are looking for an AI Platform Product Engineer who can lead AI initiatives from idea to production...  ...pipelines for managing training models and production models. Own the vision,...  ..., security, risk and compliance, and keep senior leaders informed.  Identify and track cross... 
    Senior
    Manual labor
    Work at office
    Work from home

    TD Bank

    Toronto, ON
    1 day ago
  • $84k - $126k per year

     ...Job Type:  Permanent   Work Model:  Hybrid   Reference code: 133963 Primary Location...  ...Science, Economics, Computer Science, Engineering, Actuarial Science, Quantitative Finance,...  ...experience; for Consultant, 2-4 years; for Senior Consultant, 4+ years of experience in... 
    Senior
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    2 days ago
  • $150 per hour

     ...challenging machine learning engineering tasks in a long-horizon AI...  ...tasks that challenge frontier models, ensuring solutions in no more...  ...of 8 attempts. Focus on inference, evaluation, and systems work...  ...Current or recent role as an ML research engineer , research... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    17 days ago
  • $69k - $114k per year

     ...Job Type:  Permanent   Work Model:  Hybrid   Reference code: 135144 Primary Location:  Toronto, ON All Available Locations:  Toronto, ON; Calgary, AB; Halifax, NS; Montreal, QC; Vancouver, BC   Our Purpose   At Deloitte, our Purpose is to make an impact... 
    Senior
    Permanent employment
    Work at office
    Flexible hours
    Shift work
    Early shift

    Deloitte

    Toronto, ON
    2 days ago
  • $136.7k - $182.3k per year

     ...company, which means we pair our small, senior engineering team with the reach of one of the world's...  ...eval suites, and use them to decide when a model, prompt or threshold change is ready to...  ...retention and deletion. Partner with our ML and Backend / Platform engineers so... 
    Senior
    Full time
    Flexible hours

    Spin Master

    Toronto, ON
    4 days ago
  • usd205k per year

     ...We build cutting-edge foundation AI models and end-to-end products that are...  .... Cohere is a team of researchers, engineers, designers, and more, who are all passionate...  ...Role Overview We're seeking a senior product leader to own Cohere's Inference as a Service business end to end.... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Toronto, ON
    2 days ago
  •  ...We are seeking an experienced Senior Data Architect/Modeller to lead the review, analysis, and design of robust data architectures within complex,...  ...directly with enterprise architects, solution designers, and engineering leads to shape data strategy. Advanced Data Ecosystem:... 
    Senior
    Contract work
    Remote work
    Flexible hours

    Randstad Canada

    Toronto, ON
    1 day ago
  • $81.6k - $115.2k per year

     ...Job Description: Department Overview: Model Risk Management (MRM) group is responsible...  ...be a brand ambassador who can help strive efficiencies for the bank, then join our team and make...  ...TD and your own success. Summary : The Senior Analyst, Model Risk Governance, is responsible... 
    Senior
    Full time
    Work from home

    TD

    Toronto, ON
    23 hours ago
  • $250k per year

     ...company. We build cutting-edge foundation AI models and end-to-end products that are designed...  .... Cohere is a team of researchers, engineers, designers, and more, who are all passionate...  ...pipelines; and improving evaluation efficiency. Build scalable and reusable tools for... 
    Senior
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Toronto, ON
    2 days ago
  •  ...specializing in Generative AI Models. In this role, you will develop...  ..., including the creation of efficient indexing and retrieval systems...  ...Data Preprocessing and Feature Engineering: Prepare and preprocess large...  ...Decision Making, Machine Learning (ML), Natural Language Processing... 

    Royal Bank of Canada

    Toronto, ON
    1 day ago
  • $85.5k - $185k per year

     ...independent challenge on some of the Bank's most critical AML and Fraud models. This role is designed for an experienced model validation leader...  ...who can provide rigorous oversight of complex models, influence senior stakeholders, and ensure adherence to evolving regulatory... 
    Senior
    Contract work
    Part time
    Shift work

    Bank of Montreal

    Toronto, ON
    1 day ago
  • usd180k - usd247.5k per year

     ...independent sources, relevance modeling, and result-page surfaces like...  ...understanding here, you own the models, the roadmap, and the metrics....  ...to the next-generation Search engine, integrating LLMs, query understanding...  ...~3+ years building production ML systems, with meaningful time... 
    Senior
    Internship
    Work at office
    Local area
    Remote work
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Toronto, ON
    2 days ago
  • usd180k - usd247.5k per year

     ...action on retailers’ behalf. As a Senior Applied AI/ML Scientist on the Compass team, you will...  ...quality through data, evaluation, and modeling, while shipping product features end-...  ..., data strategy) with cross-stack engineering range to build the retailer assistant... 
    Senior
    Internship
    Work at office
    Local area
    Immediate start
    Remote work
    Work from home
    Monday to friday
    Flexible hours
    3 days per week

    Faire

    Toronto, ON
    2 days ago
  • $81.6k - $115.2k per year

     ...Description: Department Overview: The Model Validation (MV) group is a centralized...  ...Description: The position reports to Senior Manager, Retail Credit Risk, Model Validation...  ..., mathematics, computer science and engineering. 3-5 years of experience with model development... 
    Senior
    Work from home

    TD Bank

    Toronto, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Inference Engineer — Model Efficiency. Be the first to apply!