Research Scientist In Ai Evaluation
Cohere Inc.
Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities.
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
Vacancy posted 28 minutes ago
Similar jobs that could be interesting for youBased on the Research Scientist In Ai Evaluation in Winnipeg, MB vacancy
- ...leading security-first enterprise AI company. We build cutting-edge... .... Cohere is a team of researchers, engineers, designers, and more... ...Seoul. Join us!Role Overview: Evaluation is critical to making progress... ...repeatable evaluations. Conduct research to advance the state-of-the-...SuggestedFull timeWork at officeLocal areaRemote workHome office
- Job DescriptionRBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes... ...that possible. As Staff Data Scientist, AI Evaluations, you will be... ...methods. Partner with AI research, platform engineering, product...SuggestedFull timeWorldwideFlexible hours
$140k - $175k per year
...Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery... ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable... ..., collaborating closely with research scientists, engineering teams, and product...SuggestedInternshipWork at officeLocal areaFlexible hours- Lead agentic AI research at LG’s Toronto AI Lab, advancing autonomous planning and lifelong learning for intelligent products worldwide.This... ...–User–Memory frameworks for proactive personalizationEstablish evaluation protocols for reasoning, planning, and skill retentionTranslate...SuggestedWorldwide
- Advance agentic AI safety research at Amii through rigorous evaluations and applied machine learning expertise. Edmonton-based work supports safer autonomous systems.As an Applied Research Scientist, you will investigate risks in increasingly autonomous AI systems. You will...Suggested
$140k - $180k per year
...-Time, Permanent Department: Toronto AI Lab Work Location: Downtown Toronto... ...Lab is looking for a Sr. Physical AI Research Scientist who will contribute to designing and... ...critical simulation pipelines to rigorously evaluate and stress-test robot agents prior to...Permanent employmentFull timeWork visaShift work3 days per week$95k - $110k per year
...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto, Toronto, ON, CA Salary Range: $95,000.00 To $110,000.00 Annually Job title Applied AI Evaluation & Product Researcher (12 Month Contract) Department Reports to Director...Full timeContract workLive In2 days per week1 day per week- Remote Generative AI Research Scientist leadership calls for deep generative modeling expertise, spanning GANs, VAEs, diffusion models, and large language models.As a Principal scientist, you will lead fundamental artificial intelligence research and innovation. The work includes...Long term contractRemote work
- Turn AI research into Shopify product impact using machine learning, analytical skills, and experimentation across complex commerce challenges... ...is remote by design, as stated.As a Machine Learning Applied Scientist, you will explore new methodologies while designing and...Remote workFlexible hours
- Advance your expertise as an AI Research Scientist for Robotics at LG’s Toronto Lab. This senior role focuses on enhancing robot safety, intelligence, and real-world adaptability while working in a hybrid model. In this full-time, permanent position, you will develop innovative...Permanent employmentFull time
- Transform Amazon Talent Acquisition with advanced AI research, machine learning, and cross-functional product integration. Help build fair... ...systems at scale.Within Intelligent Talent Acquisition, the Applied Scientist develops advanced models and software tools for Global Hiring...
- ...science and Python expertise to evaluate coding agents through... ...verification.This Competitive Data Scientist role focuses on building... ...learning, quantitative modeling, or research competition experience.Key... ..., practical programming, and evaluation expertise to strengthen coding...
- ...WhatJobs Direct is actively seeking a highly accomplished Senior AI Research Scientist with a specialization in Reinforcement Learning (RL) to join... ...new algorithms and methodologies. Design, implement, and evaluate RL agents for complex decision-making tasks. Collaborate with...Remote workWork from homeHome officeFlexible hours
- ...Toronto-Dominion Bank (TD) is seeking talented researchers for Layer 6, the AI research centre of excellence. We evaluate applicants from junior to senior levels to advance... ...of customers. As a Research Machine Learning Scientist, you will develop and apply new deep learning...
- WhatJobs Direct is seeking a Senior AI Research Scientist specializing in Reinforcement Learning to join our fully remote team. You will lead research initiatives, develop novel RL algorithms, and contribute to state-of-the-art AI projects from your home office. The role emphasizes...Remote workHome office
- ...IntuitionLabs seeks an AI Specialist for Discovery and Preclinical Science. This fully remote Canada/US role partners with scientists to map data workflows and apply AI to literature, targets and IND prep. You will teach practitioners how to search internal and external...Remote work
- Advance AI and data science at Sanofi in Toronto, translating experiments, storytelling... ...production-ready analytics solutions.This Data Scientist applies advanced analytics across Sanofi’s... ...with Python, R, Scala, SQL, or NoSQLApply research-minded data science, communication, and AI...3 days per week
- Lenovo is seeking an AI Data Intelligence Staff Researcher to develop intelligent, efficient, and reliable AI solutions for Hybrid AI computing and data infrastructure. In this role, you will use machine learning, deep learning, data science, and software engineering to improve...
- ...the Role Our client, a world-renowned research institution and technology leader, is... ...seeking an exceptional Remote Principal AI Research Scientist with deep expertise in Generative... ...forefront of AI research by continuously evaluating new methodologies and technologies. Contribute...Long term contractRemote work
- ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business... ...collaborating with Product, Engineering, Design, Research, Product Analytics, Data Engineering and... ...prototype analysis pipelines, leverage AI to accelerate execution, and communicate...
- Alberta Machine Intelligence Institute (Amii) in Edmonton seeks an Applied Research Scientist to advance the safety of autonomous AI systems. You will investigate agentic AI safety, develop rigorous evaluation methods, and translate research into practical tools supporting safer...
- Advance GenAI evaluation and testing at TD in Toronto or Montréal, working with LLMs, NLP, and deep... ...models. The role is office focused.This senior scientist position leads research and a team responsible for validating Generative AI, Agentic AI, LLM, NLP, and other deep...Work at office
$80.15k - $125.95k per year
.... Learn how you can start or jumpstart your career with us. Research Scientist – Mechanical Engineering (Thermal Materials for Electronics & Semiconductors... ...is for an existing vacancy. We use Artificial Intelligence (AI) to enhance our recruitment process. The Pay range for this...- ...unique opportunity to contribute to cutting-edge AI research in Trust and Safety, with a particular focus on understanding and evaluating the risks of autonomous AI systems. You’ll... ....About the Role The Applied Research Scientist will advance the understanding and safety of...Casual workWork at officeFlexible hoursShift work
$126k - $176k per year
Sr. Legal AI Prompter / EvaluatorJob DescriptionSr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing... ...software engineers, and data scientists to make sure our products... ...technology, including online legal research and practice tools Have...RemplacementWork at officeLocal areaFlexible hours$75k - $110k per year
...Design experiments including but not limited to OLED device performance and material characteristic tests Perform literature review on research projects Analyze and present experimental data to summarize key project findings or identify new objectives for the subsequent...Shift work- # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython... ...USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through... ...and collaboration skills to work with researchers and engineering teams.What You’ll Work On...Hourly payContract workTemporary workFreelanceImmediate startRemote work
- Use management consulting judgment to evaluate AI models against business problems, with flexible remote project availability through DataAnnotation... ..., insight, and storyline. Work may draw on strategy, market research, communications, operations, transformation, or transactions....Remote workFlexible hours
- ...Limited is a leading lithium-ion battery research and development company located in Pitt... ...success is driven by a team of passionate scientists, engineers, and technical professionals... ...with internal stakeholders.Support the evaluation, acquisition, installation, and commissioning...Casual workWork from home
$115k - $130k per year
...Toronto Blue Jays are seeking a Data Scientist, Baseball Research to help drive innovative, data-informed... ...research related to in‑game strategy, player evaluation and player procurement whilst... ...Demonstrated ability to use LLMs and generative AI in the research process ~ Experience...Afternoon shift
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist In Ai Evaluation. Be the first to apply!
Related searches
- research scientist Winnipeg, MB
- consultant scientifique Winnipeg, MB
- r&d research scientist Winnipeg, MB
- communication scientifique Winnipeg, MB
- professionnelle ou professionnel de recherche Winnipeg, MB
- phd research Winnipeg, MB
- legal research Winnipeg, MB
- remote legal research Winnipeg, MB
- chauffeur recherché Winnipeg, MB
- étudiants recherchés Winnipeg, MB

