Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist In Ai Evaluation

Cohere Inc.

Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities.
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
Vacancy posted 39 minutes ago
Similar jobs that could be interesting for youBased on the Research Scientist In Ai Evaluation in Winnipeg, MB vacancy
  •  ...enterprises who are building AI systems to power magical experiences...  .... Cohere is a team of researchers, engineers, designers, and more...  ...the future!Why this role? Evaluation is critical to making progress...  ...progress. As a Senior Research Scientist, Model Evaluation, You Will... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Cohere

    Winnipeg, MB
    43 minutes ago
  • Job DescriptionRBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes...  ...that possible. As Staff Data Scientist, AI Evaluations, you will be...  ...methods. Partner with AI research, platform engineering, product... 
    Suggested
    Full time
    Worldwide
    Flexible hours

    ODAIA

    Winnipeg, MB
    37 minutes ago
  • $140k - $175k per year

     ...Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery...  ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable...  ..., collaborating closely with research scientists, engineering teams, and product... 
    Suggested
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    42 minutes ago
  • $140k - $180k per year

     ...-Time, Permanent Department: Toronto AI Lab Work Location: Downtown Toronto...  ...Lab is looking for a Sr. Physical AI Research Scientist who will contribute to designing and...  ...critical simulation pipelines to rigorously evaluate and stress-test robot agents prior to... 
    Suggested
    Permanent employment
    Full time
    Work visa
    Shift work
    3 days per week

    Dayforce HCM, Inc.

    Winnipeg, MB
    37 minutes ago
  • Advance agentic AI safety research at Amii through rigorous evaluations and applied machine learning expertise. Edmonton-based work supports safer autonomous systems.As an Applied Research Scientist, you will investigate risks in increasingly autonomous AI systems. You will... 
    Suggested

    Amii

    Winnipeg, MB
    37 minutes ago
  • Lead agentic AI research at LG’s Toronto AI Lab, advancing autonomous planning and lifelong learning for intelligent products worldwide.This...  ...–User–Memory frameworks for proactive personalizationEstablish evaluation protocols for reasoning, planning, and skill retentionTranslate... 
    Worldwide

    LG Electronics Canada

    Winnipeg, MB
    36 minutes ago
  • Advance your expertise as an AI Research Scientist for Robotics at LG’s Toronto Lab. This senior role focuses on enhancing robot safety, intelligence, and real-world adaptability while working in a hybrid model. In this full-time, permanent position, you will develop innovative... 
    Permanent employment
    Full time

    LG Electronics

    Winnipeg, MB
    44 minutes ago
  • Transform Amazon Talent Acquisition with advanced AI research, machine learning, and cross-functional product integration. Help build fair...  ...systems at scale.Within Intelligent Talent Acquisition, the Applied Scientist develops advanced models and software tools for Global Hiring... 

    Amazon.com

    Winnipeg, MB
    44 minutes ago
  • Remote Generative AI Research Scientist leadership calls for deep generative modeling expertise, spanning GANs, VAEs, diffusion models, and large language models.As a Principal scientist, you will lead fundamental artificial intelligence research and innovation. The work includes... 
    Long term contract
    Remote work

    Placements24

    Winnipeg, MB
    43 minutes ago
  • Turn AI research into Shopify product impact using machine learning, analytical skills, and experimentation across complex commerce challenges...  ...is remote by design, as stated.As a Machine Learning Applied Scientist, you will explore new methodologies while designing and... 
    Remote work
    Flexible hours

    Shopify Inc.

    Winnipeg, MB
    43 minutes ago
  • $95k - $110k per year

     ...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto, Toronto, ON, CA Salary Range: $95,000.00 To $110,000.00 Annually Job title Applied AI Evaluation & Product Researcher (12 Month Contract) Department Reports to Director... 
    Full time
    Contract work
    Live In
    2 days per week
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    40 minutes ago
  •  ...WhatJobs Direct is actively seeking a highly accomplished Senior AI Research Scientist with a specialization in Reinforcement Learning (RL) to join...  ...new algorithms and methodologies. Design, implement, and evaluate RL agents for complex decision-making tasks. Collaborate with... 
    Remote work
    Work from home
    Home office
    Flexible hours

    Placements24

    Winnipeg, MB
    40 minutes ago
  •  ...Toronto-Dominion Bank (TD) is seeking talented researchers for Layer 6, the AI research centre of excellence. We evaluate applicants from junior to senior levels to advance...  ...of customers. As a Research Machine Learning Scientist, you will develop and apply new deep learning... 

    The Toronto-Dominion Bank (Canada)

    Winnipeg, MB
    44 minutes ago
  •  ...science and Python expertise to evaluate coding agents through...  ...verification.This Competitive Data Scientist role focuses on building...  ...learning, quantitative modeling, or research competition experience.Key...  ..., practical programming, and evaluation expertise to strengthen coding... 

    Great Value Hiring

    Winnipeg, MB
    41 minutes ago
  • Lenovo is seeking an AI Data Intelligence Staff Researcher to develop intelligent, efficient, and reliable AI solutions for Hybrid AI computing and data infrastructure. In this role, you will use machine learning, deep learning, data science, and software engineering to improve... 

    Lenovo Group

    Winnipeg, MB
    38 minutes ago
  • Advance AI and data science at Sanofi in Toronto, translating experiments, storytelling...  ...production-ready analytics solutions.This Data Scientist applies advanced analytics across Sanofi’s...  ...with Python, R, Scala, SQL, or NoSQLApply research-minded data science, communication, and AI... 
    3 days per week

    Sanofi

    Winnipeg, MB
    42 minutes ago
  •  ...IntuitionLabs seeks an AI Specialist for Discovery and Preclinical Science. This fully remote Canada/US role partners with scientists to map data workflows and apply AI to literature, targets and IND prep. You will teach practitioners how to search internal and external... 
    Remote work

    IntuitionLabs

    Winnipeg, MB
    37 minutes ago
  • WhatJobs Direct is seeking a Senior AI Research Scientist specializing in Reinforcement Learning to join our fully remote team. You will lead research initiatives, develop novel RL algorithms, and contribute to state-of-the-art AI projects from your home office. The role emphasizes... 
    Remote work
    Home office

    Placements24

    Winnipeg, MB
    41 minutes ago
  • Alberta Machine Intelligence Institute (Amii) in Edmonton seeks an Applied Research Scientist to advance the safety of autonomous AI systems. You will investigate agentic AI safety, develop rigorous evaluation methods, and translate research into practical tools supporting safer... 

    Alberta Machine Intelligence Institute (Amii)

    Winnipeg, MB
    44 minutes ago
  •  ...the Role Our client, a world-renowned research institution and technology leader, is...  ...seeking an exceptional Remote Principal AI Research Scientist with deep expertise in Generative...  ...forefront of AI research by continuously evaluating new methodologies and technologies. Contribute... 
    Long term contract
    Remote work

    Placements24

    Winnipeg, MB
    39 minutes ago
  •  ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business...  ...collaborating with Product, Engineering, Design, Research, Product Analytics, Data Engineering and...  ...prototype analysis pipelines, leverage AI to accelerate execution, and communicate... 

    Pinterest

    Winnipeg, MB
    7 days ago
  • $80.15k - $125.95k per year

     .... Learn how you can start or jumpstart your career with us. Research Scientist – Mechanical Engineering (Thermal Materials for Electronics & Semiconductors...  ...is for an existing vacancy. We use Artificial Intelligence (AI) to enhance our recruitment process. The Pay range for this... 

    Qnity Electronics, Inc.

    Winnipeg, MB
    36 minutes ago
  •  ...unique opportunity to contribute to cutting-edge AI research in Trust and Safety, with a particular focus on understanding and evaluating the risks of autonomous AI systems. You’ll...  .... About the RoleThe Applied Research Scientist will advance the understanding and safety of... 
    Casual work
    Work at office
    Flexible hours
    Shift work

    Amii

    Winnipeg, MB
    41 minutes ago
  • Advance GenAI evaluation and testing at TD in Toronto or Montréal, working with LLMs, NLP, and deep...  ...models. The role is office focused.This senior scientist position leads research and a team responsible for validating Generative AI, Agentic AI, LLM, NLP, and other deep... 
    Work at office

    TD Bank Group

    Winnipeg, MB
    44 minutes ago
  • $75k - $110k per year

     ...Design experiments including but not limited to OLED device performance and material characteristic tests Perform literature review on research projects Analyze and present experimental data to summarize key project findings or identify new objectives for the subsequent... 
    Shift work

    OTI Lumionics Inc.

    Winnipeg, MB
    39 minutes ago
  • $126k - $176k per year

    Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing...  ...software engineers, and data scientists to make sure our products...  ...technology, including online legal research and practice tools Have... 
    Remplacement
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    42 minutes ago
  •  ...Limited is a leading lithium-ion battery research and development company located in Pitt...  ...success is driven by a team of passionate scientists, engineers, and technical professionals...  ...with internal stakeholders.Support the evaluation, acquisition, installation, and commissioning... 
    Casual work
    Work from home

    E-One Moli Energy

    Winnipeg, MB
    40 minutes ago
  • Research Associate (Senior Research Scientist)Below you will find the details for the position including any supplementary...  ...by artificial intelligence (AI). The incumbent will lead and coordinate...  ..., field deployment, performance evaluation, data analysis, documentation,... 
    Permanent employment
    Full time
    Temporary work
    Part time
    For subcontractor
    Summer work
    Work at office
    Local area
    Remote work
    Afternoon shift

    University of Regina Careers

    Winnipeg, MB
    42 minutes ago
  • $140k - $250k per year

     ...ranging from junior to senior levels, and will evaluate your application in its entirety. Layer 6 is the AI research centre of excellence for TD Bank Group. We develop...  ...applications.As a Research Machine Learning Scientist, you will Join a world-class team of machine learning... 
    Temporary work
    Work from home

    TD Bank Group

    Winnipeg, MB
    44 minutes ago
  • $115k - $130k per year

     ...Toronto Blue Jays are seeking a Data Scientist, Baseball Research to help drive innovative, data-informed...  ...research related to in‑game strategy, player evaluation and player procurement whilst...  ...Demonstrated ability to use LLMs and generative AI in the research process ~ Experience... 
    Afternoon shift

    Toronto Blue Jays

    Winnipeg, MB
    44 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist In Ai Evaluation. Be the first to apply!