Research Scientist in AI Evaluation
Cohere Inc.
Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical for AI model scaling. Collaborate with cross-functional teams to refine model feedback and improve evaluation processes. Your contributions will be pivotal in advancing the standards for assessing AI performance and capability alignment. Key Responsibilities:
- Create ambitious new evaluation benchmarks for AI models
- Collaborate cross-functionally for trustworthy evaluations
- Conduct research on LLM evaluation methods
- Develop scalable tools for performance analysis
- Experience in building AI prototypes and evaluations
- Proficiency in data review for quality assurance
- Commitment to rigorous measurement practices
- Strong software engineering skills
Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Research Scientist in AI Evaluation in Toronto, ON vacancy
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract... ...pipelines , and A/B test write-ups . Evaluate AI-generated or human-created work...SuggestedFull timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago- ...leading security-first enterprise AI company. We build cutting-edge... .... Cohere is a team of researchers, engineers, designers, and more... ...Join us! Role Overview: Evaluation is critical to making progress... ...repeatable evaluations. Conduct research to advance the state-of-the-...SuggestedFull timeWork at officeLocal areaRemote workHome office
$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Compliance / regulatory response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedFull timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$55 - $80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...quality data by developing challenging problems in your domain. Evaluate and improve AI model performance with a focus on accuracy and...SuggestedRemote jobContract workSummer work- ...collaboration with other disciplines - all foundational ingredients in successful digital experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team in a forward-leaning role that proves the platform actually...Full timeImmediate start
Appnovation Technologies
Toronto, ONa month ago $100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...and Jack Dorsey . Position: Data Scientist Talent Network Type: Contract... ...pipelines , and technical reports. Evaluate AI-generated or human-created work...Remote jobContract workSummer work$70k - $73.85k per year
...This Job Posting will be closed on July 29, 2026 at 5:00 pm and this posting is for an existing vacancy. Objective: The Research and Evaluation Specialist will lead the analysis and development of sector-based program and policy research and evaluation that will...Full timeInternshipOfifc
Toronto, ONmore than 2 months ago$80 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated...Full timeContract workSummer workRemote workMercor
Toronto, ONa month ago$85 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-...Full timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago- ...’s Possible. At Pinterest, AI isn't just a feature, it's a powerful... ...are looking for a Senior Data Scientist. You will shape the future of... ...Product, Engineering, Design, Research, Product Analytics, Data... ...Strong track record of critical evaluation and verification of AI-...Full timeWork at officeRelocationRelocation package
Pinterest
Toronto, ON12 days ago - ...Position: Data Scientist Location: Toronto, ON Job ID#: RQ11452 Duration... ...provide actionable insights. Initiate, research, develop, and manage information studies... ...assignments with proven Experts uniquely evaluated by our proven QMS- Quality Management System...Full time
Symbiotic Digital
Toronto, ON18 days ago $55 - $80 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobContract workSummer work- ...Principal Data Scientist – (Gen AI, Machine Learning): Are you energized by the idea of innovating with Generative AI? Do you want to create... ...direction and organizational priorities Lead high-impact research initiatives in ML, GenAI, and Graph ML, push the boundaries...Long term contractFull timeWorldwideShift work
Extreme Networks
Toronto, ONmore than 2 months ago $68.8k - $100k per year
...contract opportunity* The Data Scientist will be a pivotal member of... ...advanced analytics and AI models. Leverage statistical techniques... ...models AI and Data Science research and development Research,... ...– The ability to analyze, evaluate and interpret information from...Full timeContract workWork at officeRemote workMeridian Credit Union
Toronto, ONmore than 2 months ago$100 - $150 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability in a software...Contract workSummer workWork at officeRemote workMercor
Toronto, ON22 days ago$149.3k - $249.3k per year
...Are you a passionate scientist in the computer vision area who is aspired to apply your skills... ...Participate in the design, development, evaluation, deployment and updating of data-driven... ...for computer vision applications. Research and implement the state-of-the-art computer...- ...Mecka AI in Toronto, Canada, is hiring a Research Scientist to architect and train foundation models for 3D human body tracking and articulated pose estimation. You will build proprietary articulation models, train at scale, and tackle perception challenges in real-world,...
$120k - $160k per year
...We're hiring a Senior Data Scientist to own machine-learning models... ...if you're looking for a pure research or notebook-only role, this isn... ...retraining, champion-challenger evaluation and promotion. Partner... ...and rollout. Move fast with AI-assisted development -we use...Full timeContract workApprenticeshipRemote workFlexible hoursFlinks
Toronto, ONmore than 2 months ago$80 - $100 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Full timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$88k - $110k per year
...members belong and have the opportunity to thrive. As a Data Scientist on the Mapping team, you will collaborate with our world class team... ...field such as statistics, economics, applied math, operations research or engineering (advanced degrees preferred), or relevant work...Hourly payFull timeWork at officeFlexible hours3 days per weekLyft
Toronto, ON12 days ago$120k - $150k per year
...DataVisor DataVisor is the world's leading AI-powered Fraud and Risk Platform that... ...We are looking for a Senior-Level Data Scientist to join our Fraud Detection team — someone... ...banking, SaaS, marketplace risk, or security research). ~ Solid understanding of both classic...Full timeDatavisor
Toronto, ON18 days ago- ...About Mecka AI Mecka AI is building the data infrastructure layer for robotics and... ...publication. What we're looking for A research record in physics-based character... ...and scheduling workflows. All candidate evaluations, interviews, and hiring decisions are made...
- ...Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team,... ...reliability. We are looking for a hands-on Applied Data Scientist to help drive a unified view of our multi-faceted evaluation methodology. This is a highly collaborative, cross...Full timeWork at officeWork from homeFlexible hours
Waabi
Toronto, ONmore than 2 months ago - ...About Mecka AI Mecka AI is building the data infrastructure layer for robotics... ...human-scene interaction. We are hiring a Research Scientist to architect and train proprietary foundation... ...and scheduling workflows. All candidate evaluations, interviews, and hiring decisions are...Shift work
$150k - $190k per year
...The engineering team is looking for an AI Engineer who can build the LLM and agentic... ...delivery) to LLM-based features — including evaluating and regression-testing prompt and agent... ...and/or agentic workflows (not limited to a research or notebook context) Strong software engineering...Long term contractFull timeFor contractorsInternshipWork at officeLocal areaSleeping nightsQuartermaster
Toronto, ON4 days ago$15 - $20 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., Larry Summers , and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract Compensation: $15–...Full timeContract workSummer workRemote workMercor
Toronto, ONa month ago$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Dorsey . Position: Exceptional Data Scientists Type: Contract... ...datasets to build predictive models. Evaluate and improve AI models using TensorFlow...Full timeContract workSummer workRemote workMercor
Toronto, ONmore than 2 months ago$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...Summers , and Jack Dorsey . Position: Legal / compliance Evaluator Type: Contract Compensation: $80–$120/hour...Full timeContract workSummer workWork at officeRemote workMercor
Toronto, ONmore than 2 months ago$75k - $100k per year
...organization, we want to hear from you! We are seeking a Data Scientist, Risk Analytics & Modeling, to work under the direction of the Director... ...to apply automation, data pipelines, machine learning, and AI to your work Participate in strategic projects and partner with...Full timeInternshipWork at officeFlexible hoursFinanceit
Toronto, ON10 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Scientist in AI Evaluation. Be the first to apply!
Related searches
- scientifique biologie Toronto, ON
- communication scientifique Toronto, ON
- research scientist Toronto, ON
- research scientist - biology Toronto, ON
- r&d research scientist Toronto, ON
- consultant scientifique Toronto, ON
- centricity research Toronto, ON
- summer research Toronto, ON
- research intern Toronto, ON
- research nurse Toronto, ON