Research Scientist In Ai Evaluation
Cohere Inc.
Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities.
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Research Scientist In Ai Evaluation in Winnipeg, MB vacancy
- ...leading security-first enterprise AI company. We build cutting-edge... .... Cohere is a team of researchers, engineers, designers, and more... ...Seoul. Join us!Role Overview: Evaluation is critical to making progress... ...repeatable evaluations. Conduct research to advance the state-of-the-...SuggestedFull timeWork at officeLocal areaRemote workHome office
- Job DescriptionRBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes... ...that possible. As Staff Data Scientist, AI Evaluations, you will be... ...methods. Partner with AI research, platform engineering, product...SuggestedFull timeWorldwideFlexible hours
- Advance agentic AI safety research at Amii through rigorous evaluations and applied machine learning expertise. Edmonton-based work supports safer autonomous systems.As an Applied Research Scientist, you will investigate risks in increasingly autonomous AI systems. You will...Suggested
- Lead agentic AI research at LG’s Toronto AI Lab, advancing autonomous planning and lifelong learning for intelligent products worldwide.This... ...–User–Memory frameworks for proactive personalizationEstablish evaluation protocols for reasoning, planning, and skill retentionTranslate...SuggestedWorldwide
$140k - $180k per year
...-Time, Permanent Department: Toronto AI Lab Work Location: Downtown Toronto... ...Lab is looking for a Sr. Physical AI Research Scientist who will contribute to designing and... ...critical simulation pipelines to rigorously evaluate and stress-test robot agents prior to...SuggestedPermanent employmentFull timeWork visaShift work3 days per week$140k - $175k per year
...Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery... ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable... ..., collaborating closely with research scientists, engineering teams, and product...InternshipWork at officeLocal areaFlexible hours- Turn AI research into Shopify product impact using machine learning, analytical skills, and experimentation across complex commerce challenges... ...is remote by design, as stated.As a Machine Learning Applied Scientist, you will explore new methodologies while designing and...Remote workFlexible hours
- Remote Generative AI Research Scientist leadership calls for deep generative modeling expertise, spanning GANs, VAEs, diffusion models, and large language models.As a Principal scientist, you will lead fundamental artificial intelligence research and innovation. The work includes...Long term contractRemote work
$95k - $110k per year
...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto, Toronto, ON, CA Salary Range: $95,000.00 To $110,000.00 Annually Job title Applied AI Evaluation & Product Researcher (12 Month Contract) Department Reports to Director...Full timeContract workLive In2 days per week1 day per week- ...WhatJobs Direct is actively seeking a highly accomplished Senior AI Research Scientist with a specialization in Reinforcement Learning (RL) to join... ...new algorithms and methodologies. Design, implement, and evaluate RL agents for complex decision-making tasks. Collaborate with...Remote workWork from homeHome officeFlexible hours
- ...Toronto-Dominion Bank (TD) is seeking talented researchers for Layer 6, the AI research centre of excellence. We evaluate applicants from junior to senior levels to advance... ...of customers. As a Research Machine Learning Scientist, you will develop and apply new deep learning...
- ...IntuitionLabs seeks an AI Specialist for Discovery and Preclinical Science. This fully remote Canada/US role partners with scientists to map data workflows and apply AI to literature, targets and IND prep. You will teach practitioners how to search internal and external...Remote work
- Lenovo is seeking an AI Data Intelligence Staff Researcher to develop intelligent, efficient, and reliable AI solutions for Hybrid AI computing and data infrastructure. In this role, you will use machine learning, deep learning, data science, and software engineering to improve...
- WhatJobs Direct is seeking a Senior AI Research Scientist specializing in Reinforcement Learning to join our fully remote team. You will lead research initiatives, develop novel RL algorithms, and contribute to state-of-the-art AI projects from your home office. The role emphasizes...Remote workHome office
- ...science and Python expertise to evaluate coding agents through... ...verification.This Competitive Data Scientist role focuses on building... ...learning, quantitative modeling, or research competition experience.Key... ..., practical programming, and evaluation expertise to strengthen coding...
$80.15k - $125.95k per year
.... Learn how you can start or jumpstart your career with us. Research Scientist – Mechanical Engineering (Thermal Materials for Electronics & Semiconductors... ...is for an existing vacancy. We use Artificial Intelligence (AI) to enhance our recruitment process. The Pay range for this...- Alberta Machine Intelligence Institute (Amii) in Edmonton seeks an Applied Research Scientist to advance the safety of autonomous AI systems. You will investigate agentic AI safety, develop rigorous evaluation methods, and translate research into practical tools supporting safer...
- ...the Role Our client, a world-renowned research institution and technology leader, is... ...seeking an exceptional Remote Principal AI Research Scientist with deep expertise in Generative... ...forefront of AI research by continuously evaluating new methodologies and technologies. Contribute...Long term contractRemote work
- ...unique opportunity to contribute to cutting-edge AI research in Trust and Safety, with a particular focus on understanding and evaluating the risks of autonomous AI systems. You’ll... ....About the Role The Applied Research Scientist will advance the understanding and safety of...Casual workWork at officeFlexible hoursShift work
- ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business... ...collaborating with Product, Engineering, Design, Research, Product Analytics, Data Engineering and... ...prototype analysis pipelines, leverage AI to accelerate execution, and communicate...
$75k - $110k per year
...Design experiments including but not limited to OLED device performance and material characteristic tests Perform literature review on research projects Analyze and present experimental data to summarize key project findings or identify new objectives for the subsequent...Shift work$115k - $130k per year
...Toronto Blue Jays are seeking a Data Scientist, Baseball Research to help drive innovative, data-informed... ...research related to in‑game strategy, player evaluation and player procurement whilst... ...Demonstrated ability to use LLMs and generative AI in the research process ~ Experience...Afternoon shift$140k - $250k per year
...ranging from junior to senior levels, and will evaluate your application in its entirety. Layer 6 is the AI research centre of excellence for TD Bank Group. We develop... ...applications.As a Research Machine Learning Scientist, you will Join a world-class team of machine learning...Temporary workWork from home- Research Associate (Senior Research Scientist)Below you will find the details for the position including any supplementary... ...by artificial intelligence (AI). The incumbent will lead and coordinate... ..., field deployment, performance evaluation, data analysis, documentation,...Permanent employmentFull timeTemporary workPart timeFor subcontractorSummer workWork at officeLocal areaRemote workAfternoon shift
- Advance GenAI evaluation and testing at TD in Toronto or Montréal, working with LLMs, NLP, and deep... ...models. The role is office focused.This senior scientist position leads research and a team responsible for validating Generative AI, Agentic AI, LLM, NLP, and other deep...Work at office
- Research Scientist, develop predictive world models from video using Python and PyTorch within Meta’s Fundamental AI Research team. Build efficient algorithms for planning and control.This Research Scientist role advances artificial intelligence through world modelling and embodied...
- Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we're unlocking the next era... ...algorithms for Waabi World, our simulation platform. As a Research Scientist on the Behaviors team, you will work closely with our multidisciplinary...
- ...decisions across Baseball Operations. Apply quantitative research to complex baseball questions.This Data Scientist role requires four to five-plus years of data... ...models and advanced metricsResearch strategy, player evaluation, and player procurementCollaborate with coaches,...
- Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we’re unlocking the next era... ..., scalable, controllable, and efficient simulation. As a Research Scientist in World Models, you will develop algorithms and productionize...
- As an AI Scientist, you never believed that AI boiled down to calling an API. Rather than assembling prefabricated models and hoping it holds up, you understand what's going on under the hood and you choose the right model (or the right chain of models) for the client's real...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist In Ai Evaluation. Be the first to apply!
Related searches
- consultant scientifique Winnipeg, MB
- research scientist Winnipeg, MB
- communication scientifique Winnipeg, MB
- r&d research scientist Winnipeg, MB
- concierge recherché Winnipeg, MB
- centricity research Winnipeg, MB
- research officer Winnipeg, MB
- legal research Winnipeg, MB
- recherche sous-traitant Winnipeg, MB
- nutrition research Winnipeg, MB

