Research Scientist In Ai Evaluation
Cohere Inc.
Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities.
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Research Scientist In Ai Evaluation in Winnipeg, MB vacancy
- ...leading security-first enterprise AI company. We build cutting-edge... .... Cohere is a team of researchers, engineers, designers, and more... ...Seoul. Join us!Role Overview: Evaluation is critical to making progress... ...repeatable evaluations. Conduct research to advance the state-of-the-...SuggestedFull timeWork at officeLocal areaRemote workHome office
- Advance agentic AI safety research at Amii through rigorous evaluations and applied machine learning expertise. Edmonton-based work supports safer autonomous systems.As an Applied Research Scientist, you will investigate risks in increasingly autonomous AI systems. You will...Suggested
$140k - $180k per year
...-Time, Permanent Department: Toronto AI Lab Work Location: Downtown Toronto... ...Lab is looking for a Sr. Physical AI Research Scientist who will contribute to designing and... ...critical simulation pipelines to rigorously evaluate and stress-test robot agents prior to...SuggestedPermanent employmentFull timeWork visaShift work3 days per week- Lead agentic AI research at LG’s Toronto AI Lab, advancing autonomous planning and lifelong learning for intelligent products worldwide.This... ...–User–Memory frameworks for proactive personalizationEstablish evaluation protocols for reasoning, planning, and skill retentionTranslate...SuggestedWorldwide
- Applied AI evaluation and user-centred research define this full-time contract role with Kids Help Phone in Toronto, using qualitative and quantitative methods.As an Applied AI Evaluation & Product Researcher, you will evaluate a youth-facing generative AI product. You will...SuggestedFull timeContract work1 day per week
- Job DescriptionRBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes... ...that possible. As Staff Data Scientist, AI Evaluations, you will be... ...methods. Partner with AI research, platform engineering, product...Full timeWorldwideFlexible hours
- ...Toronto-Dominion Bank (TD) is seeking talented researchers for Layer 6, the AI research centre of excellence. We evaluate applicants from junior to senior levels to advance... ...of customers. As a Research Machine Learning Scientist, you will develop and apply new deep learning...
- ...WhatJobs Direct is actively seeking a highly accomplished Senior AI Research Scientist with a specialization in Reinforcement Learning (RL) to join... ...new algorithms and methodologies. Design, implement, and evaluate RL agents for complex decision-making tasks. Collaborate with...Remote workWork from homeHome officeFlexible hours
$140k - $175k per year
...Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery... ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable... ..., collaborating closely with research scientists, engineering teams, and product...InternshipWork at officeLocal areaFlexible hours- ...IntuitionLabs seeks an AI Specialist for Discovery and Preclinical Science. This fully remote Canada/US role partners with scientists to map data workflows and apply AI to literature, targets and IND prep. You will teach practitioners how to search internal and external...Remote work
- ...CIBC in Toronto is seeking a Quantum Machine Learning Research Scientist to drive applied research and design quantum algorithms for banking use... ...cases such as fraud and optimization. You will collaborate with AI researchers, engineers and business stakeholders to translate theory...
- About the Role Our client, a world-renowned research institution pushing the boundaries of artificial intelligence, is seeking a highly accomplished Principal AI Research Scientist to lead initiatives in Generative Models. This is a fully remote position, offering unparalleled...Remote work
- WhatJobs Direct is seeking a Senior AI Research Scientist specializing in Reinforcement Learning to join our fully remote team. You will lead research initiatives, develop novel RL algorithms, and contribute to state-of-the-art AI projects from your home office. The role emphasizes...Remote workHome office
- Alberta Machine Intelligence Institute (Amii) in Edmonton seeks an Applied Research Scientist to advance the safety of autonomous AI systems. You will investigate agentic AI safety, develop rigorous evaluation methods, and translate research into practical tools supporting safer...
- ...mémoire et savoir tacite des agents, apprentissage continu, sûreté et alignement, sécurité et détection de menaces, confidentialité, évaluation d'agentsExpérience de travail sur des systèmes d'IA opérant dans des environnements d'entreprise réels, avec les contraintes de...ApprenticeshipWork at officeRemote workFlexible hours
$40 - $80 per hour
Synthires is seeking detail-oriented Generalists to help benchmark and improve advanced AI models. You will create research questions, answers, and evaluation materials using your academic or professional expertise. The opportunity is open to individuals with experience across...Hourly payPart time10 hours per week$95k - $110k per year
...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto, Toronto, ON, CA Salary Range: $95,000.00 To $110,000.00 Annually Job title Applied AI Evaluation & Product Researcher (12 Month Contract) Department Reports to Director...Full timeContract workLive In2 days per week1 day per week- ...unique opportunity to contribute to cutting-edge AI research in Trust and Safety, with a particular focus on understanding and evaluating the risks of autonomous AI systems. You’ll... ....About the Role The Applied Research Scientist will advance the understanding and safety of...Casual workWork at officeFlexible hoursShift work
$75k - $110k per year
...Design experiments including but not limited to OLED device performance and material characteristic tests Perform literature review on research projects Analyze and present experimental data to summarize key project findings or identify new objectives for the subsequent...Shift work- ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business... ...collaborating with Product, Engineering, Design, Research, Product Analytics, Data Engineering and... ...prototype analysis pipelines, leverage AI to accelerate execution, and communicate...
- Placements24 seeks a Principal AI Research Scientist to lead generative AI research for LLMs, diffusion models, and GANs. This fully remote role covers South Africa, with impact across product and strategy. You will mentor researchers and guide patent work, staying at the frontier...Remote work
- Research Associate (Senior Research Scientist)Below you will find the details for the position including any supplementary... ...by artificial intelligence (AI). The incumbent will lead and coordinate... ..., field deployment, performance evaluation, data analysis, documentation,...Permanent employmentFull timeTemporary workPart timeFor subcontractorSummer workWork at officeLocal areaRemote workAfternoon shift
$115k - $130k per year
...Toronto Blue Jays are seeking a Data Scientist, Baseball Research to help drive innovative, data-informed... ...research related to in‑game strategy, player evaluation and player procurement whilst... ...Demonstrated ability to use LLMs and generative AI in the research process ~ Experience...Afternoon shift- ...science and Python expertise to evaluate coding agents through... ...verification.This Competitive Data Scientist role focuses on building... ...learning, quantitative modeling, or research competition experience.Key... ..., practical programming, and evaluation expertise to strengthen coding...
$140k - $250k per year
...ranging from junior to senior levels, and will evaluate your application in its entirety. Layer 6 is the AI research centre of excellence for TD Bank Group. We develop... ...applications.As a Research Machine Learning Scientist, you will Join a world-class team of machine learning...Temporary workWork from home- ..., and deployment of practical AI solutions, taking ideas from early... ...the bank. As a Senior AI Scientist, you'll apply your expertise in... ...that balances experimentation, research, and delivery. Solution... ...applied tool calling, memory, evaluation, and guardrails to support secure...3 days per week1 day per week
- ...decisions across Baseball Operations. Apply quantitative research to complex baseball questions.This Data Scientist role requires four to five-plus years of data... ...models and advanced metricsResearch strategy, player evaluation, and player procurementCollaborate with coaches,...
- Research Scientist, develop predictive world models from video using Python and PyTorch within Meta’s Fundamental AI Research team. Build efficient algorithms for planning and control.This Research Scientist role advances artificial intelligence through world modelling and embodied...
- Develop world models at Waabi using generative AI and predictive modeling for autonomous transportation. Work with complex, dynamic 4D environments.As a Research Scientist in World Models, you will conduct fundamental and applied research for Waabi World. Your work spans video...
- ...for the Toronto Blue Jays. Bring quantitative research and statistical programming to Baseball Operations.As a Data Scientist, Baseball Research, you will solve complex baseball... ...decisionsResearch in-game strategy, player evaluation, and procurementIntegrate new information with...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist In Ai Evaluation. Be the first to apply!
Related searches
- consultant scientifique Winnipeg, MB
- research scientist Winnipeg, MB
- communication scientifique Winnipeg, MB
- r&d research scientist Winnipeg, MB
- centricity research Winnipeg, MB
- research officer Winnipeg, MB
- legal research Winnipeg, MB
- recherche sous-traitant Winnipeg, MB
- nutrition research Winnipeg, MB
- phd research Winnipeg, MB

