Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Scientist In Ai Evaluation

Cohere Inc.

Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities.
As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment.
Key Responsibilities: - Create ambitious new evaluation benchmarks for AI models - Collaborate cross-functionally for trustworthy evaluations - Conduct research on LLM evaluation methods - Develop scalable tools for performance analysis
Requirements: - Experience in building AI prototypes and evaluations - Proficiency in data review for quality assurance - Commitment to rigorous measurement practices - Strong software engineering skills
Drive innovation in AI evaluation techniques with your expertise at Cohere and significantly impact model performance.#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Research Scientist In Ai Evaluation in Winnipeg, MB vacancy
  •  ...leading security-first enterprise AI company. We build cutting-edge...  .... Cohere is a team of researchers, engineers, designers, and more...  ...Seoul. Join us!Role Overview: Evaluation is critical to making progress...  ...repeatable evaluations. Conduct research to advance the state-of-the-... 
    Suggested
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere Inc.

    Winnipeg, MB
    1 hour ago
  • Advance agentic AI safety research at Amii through rigorous evaluations and applied machine learning expertise. Edmonton-based work supports safer autonomous systems.As an Applied Research Scientist, you will investigate risks in increasingly autonomous AI systems. You will... 
    Suggested

    Amii

    Winnipeg, MB
    1 hour ago
  • $140k - $180k per year

     ...-Time, Permanent Department: Toronto AI Lab Work Location: Downtown Toronto...  ...Lab is looking for a Sr. Physical AI Research Scientist who will contribute to designing and...  ...critical simulation pipelines to rigorously evaluate and stress-test robot agents prior to... 
    Suggested
    Permanent employment
    Full time
    Work visa
    Shift work
    3 days per week

    Dayforce HCM, Inc.

    Winnipeg, MB
    1 hour ago
  • Lead agentic AI research at LG’s Toronto AI Lab, advancing autonomous planning and lifelong learning for intelligent products worldwide.This...  ...–User–Memory frameworks for proactive personalizationEstablish evaluation protocols for reasoning, planning, and skill retentionTranslate... 
    Suggested
    Worldwide

    LG Electronics Canada

    Winnipeg, MB
    1 hour ago
  • Applied AI evaluation and user-centred research define this full-time contract role with Kids Help Phone in Toronto, using qualitative and quantitative methods.As an Applied AI Evaluation & Product Researcher, you will evaluate a youth-facing generative AI product. You will... 
    Suggested
    Full time
    Contract work
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    1 hour ago
  • Job DescriptionRBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes...  ...that possible. As Staff Data Scientist, AI Evaluations, you will be...  ...methods. Partner with AI research, platform engineering, product... 
    Full time
    Worldwide
    Flexible hours

    ODAIA

    Winnipeg, MB
    1 hour ago
  •  ...Toronto-Dominion Bank (TD) is seeking talented researchers for Layer 6, the AI research centre of excellence. We evaluate applicants from junior to senior levels to advance...  ...of customers. As a Research Machine Learning Scientist, you will develop and apply new deep learning... 

    The Toronto-Dominion Bank (Canada)

    Winnipeg, MB
    1 hour ago
  •  ...WhatJobs Direct is actively seeking a highly accomplished Senior AI Research Scientist with a specialization in Reinforcement Learning (RL) to join...  ...new algorithms and methodologies. Design, implement, and evaluate RL agents for complex decision-making tasks. Collaborate with... 
    Remote work
    Work from home
    Home office
    Flexible hours

    Placements24

    Winnipeg, MB
    1 hour ago
  • $140k - $175k per year

     ...Thomson Reuters Labs is seeking a Lead Research Engineer to lead the design and delivery...  ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable...  ..., collaborating closely with research scientists, engineering teams, and product... 
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Winnipeg, MB
    1 hour ago
  •  ...IntuitionLabs seeks an AI Specialist for Discovery and Preclinical Science. This fully remote Canada/US role partners with scientists to map data workflows and apply AI to literature, targets and IND prep. You will teach practitioners how to search internal and external... 
    Remote work

    IntuitionLabs

    Winnipeg, MB
    1 hour ago
  •  ...CIBC in Toronto is seeking a Quantum Machine Learning Research Scientist to drive applied research and design quantum algorithms for banking use...  ...cases such as fraud and optimization. You will collaborate with AI researchers, engineers and business stakeholders to translate theory... 

    CIBC

    Winnipeg, MB
    1 hour ago
  • About the Role Our client, a world-renowned research institution pushing the boundaries of artificial intelligence, is seeking a highly accomplished Principal AI Research Scientist to lead initiatives in Generative Models. This is a fully remote position, offering unparalleled... 
    Remote work

    Placements24

    Winnipeg, MB
    1 hour ago
  • WhatJobs Direct is seeking a Senior AI Research Scientist specializing in Reinforcement Learning to join our fully remote team. You will lead research initiatives, develop novel RL algorithms, and contribute to state-of-the-art AI projects from your home office. The role emphasizes... 
    Remote work
    Home office

    Placements24

    Winnipeg, MB
    1 hour ago
  • Alberta Machine Intelligence Institute (Amii) in Edmonton seeks an Applied Research Scientist to advance the safety of autonomous AI systems. You will investigate agentic AI safety, develop rigorous evaluation methods, and translate research into practical tools supporting safer... 

    Alberta Machine Intelligence Institute (Amii)

    Winnipeg, MB
    1 hour ago
  •  ...mémoire et savoir tacite des agents, apprentissage continu, sûreté et alignement, sécurité et détection de menaces, confidentialité, évaluation d'agentsExpérience de travail sur des systèmes d'IA opérant dans des environnements d'entreprise réels, avec les contraintes de... 
    Apprenticeship
    Work at office
    Remote work
    Flexible hours

    ServiceNow

    Winnipeg, MB
    1 hour ago
  • $40 - $80 per hour

    Synthires is seeking detail-oriented Generalists to help benchmark and improve advanced AI models. You will create research questions, answers, and evaluation materials using your academic or professional expertise. The opportunity is open to individuals with experience across... 
    Hourly pay
    Part time
    10 hours per week

    Synthires

    Winnipeg, MB
    1 hour ago
  • $95k - $110k per year

     ...Applied AI Evaluation & Product Researcher (Contract) Applied Research FT Contract Toronto, Toronto, ON, CA Salary Range: $95,000.00 To $110,000.00 Annually Job title Applied AI Evaluation & Product Researcher (12 Month Contract) Department Reports to Director... 
    Full time
    Contract work
    Live In
    2 days per week
    1 day per week

    Kids Help Phone

    Winnipeg, MB
    1 hour ago
  •  ...unique opportunity to contribute to cutting-edge AI research in Trust and Safety, with a particular focus on understanding and evaluating the risks of autonomous AI systems. You’ll...  ....About the Role The Applied Research Scientist will advance the understanding and safety of... 
    Casual work
    Work at office
    Flexible hours
    Shift work

    Alberta Machine Intelligence Institute (Amii)

    Winnipeg, MB
    1 hour ago
  • $75k - $110k per year

     ...Design experiments including but not limited to OLED device performance and material characteristic tests Perform literature review on research projects Analyze and present experimental data to summarize key project findings or identify new objectives for the subsequent... 
    Shift work

    OTI Lumionics Inc.

    Winnipeg, MB
    1 hour ago
  •  ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business...  ...collaborating with Product, Engineering, Design, Research, Product Analytics, Data Engineering and...  ...prototype analysis pipelines, leverage AI to accelerate execution, and communicate... 

    Pinterest

    Winnipeg, MB
    3 days ago
  • Placements24 seeks a Principal AI Research Scientist to lead generative AI research for LLMs, diffusion models, and GANs. This fully remote role covers South Africa, with impact across product and strategy. You will mentor researchers and guide patent work, staying at the frontier... 
    Remote work

    Placements24

    Winnipeg, MB
    1 hour ago
  • Research Associate (Senior Research Scientist)Below you will find the details for the position including any supplementary...  ...by artificial intelligence (AI). The incumbent will lead and coordinate...  ..., field deployment, performance evaluation, data analysis, documentation,... 
    Permanent employment
    Full time
    Temporary work
    Part time
    For subcontractor
    Summer work
    Work at office
    Local area
    Remote work
    Afternoon shift

    University of Regina Careers

    Winnipeg, MB
    1 hour ago
  • $115k - $130k per year

     ...Toronto Blue Jays are seeking a Data Scientist, Baseball Research to help drive innovative, data-informed...  ...research related to in‑game strategy, player evaluation and player procurement whilst...  ...Demonstrated ability to use LLMs and generative AI in the research process ~ Experience... 
    Afternoon shift

    Toronto Blue Jays

    Winnipeg, MB
    1 hour ago
  •  ...science and Python expertise to evaluate coding agents through...  ...verification.This Competitive Data Scientist role focuses on building...  ...learning, quantitative modeling, or research competition experience.Key...  ..., practical programming, and evaluation expertise to strengthen coding... 

    Great Value Hiring

    Winnipeg, MB
    1 hour ago
  • $140k - $250k per year

     ...ranging from junior to senior levels, and will evaluate your application in its entirety. Layer 6 is the AI research centre of excellence for TD Bank Group. We develop...  ...applications.As a Research Machine Learning Scientist, you will Join a world-class team of machine learning... 
    Temporary work
    Work from home

    TD Bank Group

    Winnipeg, MB
    1 hour ago
  •  ..., and deployment of practical AI solutions, taking ideas from early...  ...the bank. As a Senior AI Scientist, you'll apply your expertise in...  ...that balances experimentation, research, and delivery. Solution...  ...applied tool calling, memory, evaluation, and guardrails to support secure... 
    3 days per week
    1 day per week

    CIBC

    Winnipeg, MB
    1 hour ago
  •  ...decisions across Baseball Operations. Apply quantitative research to complex baseball questions.This Data Scientist role requires four to five-plus years of data...  ...models and advanced metricsResearch strategy, player evaluation, and player procurementCollaborate with coaches,... 

    torontobluejays

    Winnipeg, MB
    1 hour ago
  • Research Scientist, develop predictive world models from video using Python and PyTorch within Meta’s Fundamental AI Research team. Build efficient algorithms for planning and control.This Research Scientist role advances artificial intelligence through world modelling and embodied... 

    Meta

    Winnipeg, MB
    1 hour ago
  • Develop world models at Waabi using generative AI and predictive modeling for autonomous transportation. Work with complex, dynamic 4D environments.As a Research Scientist in World Models, you will conduct fundamental and applied research for Waabi World. Your work spans video... 

    Waabi

    Winnipeg, MB
    1 hour ago
  •  ...for the Toronto Blue Jays. Bring quantitative research and statistical programming to Baseball Operations.As a Data Scientist, Baseball Research, you will solve complex baseball...  ...decisionsResearch in-game strategy, player evaluation, and procurementIntegrate new information with... 

    Toronto Blue Jays

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Scientist In Ai Evaluation. Be the first to apply!