Lead Data Scientist, AI Evaluation & Quality Benchmarks
Full-time
Skillhub Solutions Inc.
RBC's AI Group is seeking a Staff Data Scientist to lead evaluation of model and agent quality, safety and performance. You will define standards, own datasets and scorecards, and mentor junior data scientists.
Location: Montréal, QC; Hours: 37.5 per week; Employment type: Full-time, salaried. Applications accepted until soon. You will collaborate across research, engineering, product, risk, and governance to embed evaluations into lifecycle stages.
#J-18808-LjbffrVacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Data Scientist, AI Evaluation & Quality Benchmarks in Montréal, QC vacancy
- ...About the opportunity RBC's AI Group is building trusted AI capabilities for the enterprise. The Staff Data Scientist, AI Evaluations will lead the data science work for measuring model and agent quality, safety, risk, and performance. This includes developing evaluation...QualityFull time
- ...What is the opportunity? RBC's AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Staff Data Scientist, AI Evaluations, you will be a senior technical leader in the data science function...QualityFull timeWorldwideFlexible hours
- We're seeking an experienced leader to join our team as a Data Governance & Quality Lead, responsible for leading... ..., analytical, regulatory, and AI-enabled use across the firm.In the Human... ...indicateurs et de mesures de performance pour évaluer la qualité des données, communiquer...QualityWork at officeRemote work
- ...career as a Senior Artificial Intelligence (AI) Scientist on the AI Factory team at National Bank means playing a key role in evaluating, optimising and monitoring the performance... ...monitoring, you will directly contribute to the quality, robustness and impact of AI solutions...QualityFlexible hours
- ...our own satellites and aircraft sensors, combined with third-party data, to help industrial emitters better understand, control, and... ...visualize and quantify their emissions. We are looking for a data scientist to join the Science and Systems team. You will focus on applying...SuggestedFull timeWork at officeLocal areaRemote workFlexible hours
- ...Artefact North America is hiring a Senior AI & Data Scientist to own end-to-end modeling—from framing problems to production. You will build... ...-ready solutions. Leverage embeddings, retrieval, and LLM evaluation; collaborate with clients to translate methodology into business...Flexible hours
- ...encourage candidates who may fall outside of this range to apply as well. About the role We're looking for a Team Lead to join our Claims Data Analytics Team (CDAT). The size and scope of our team will allow you to work on a variety of different projects. Join our...Long term contractFlexible hours
Intact Financial
Montréal, QC2 days ago $70 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...integumentary systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and...QualityHourly payPermanent employmentPart time10 hours per week- ...Artefact is a next-generation data and AI consulting firm dedicated to accelerating the adoption... ...teams bring together consultants, data scientists, data engineers, AI engineers, analysts,... ...; fine-tuning experiments and LLM evaluation on the next. You will own your models: the...Quality
- ...experiences and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly... ...proves the platform actually improves answer quality. You will run evaluations at scale — from... ...QA / test engineering, with exposure to data/ML systems. ~ Strong Python and data-...QualityFull timeApprenticeshipImmediate start
- ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking... ...AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project....QualityRemote jobFor contractors
- ...Context We are looking for a Project Quality Lead to provide site support, ensure... ...actions. Perform supplier qualification and evaluation activities, including First Article Inspections... ...and includes the feminine. We use AI-enabled tools in our recruitment platform...QualityFor subcontractor
- ...sagemcom in Montreal invites a Lead Software Engineer – AI, Data Visualization & Platform to bridge architectural vision, product innovation, advanced visualization, and day-to-day engineering execution. This hands-on role allocates about 70% to technical development and 30...
- ...This Full time on site position offers great opportunities for career growth. Datalytics Business recherche un(e) Data Scientist passionné(e) pour rejoindre notre équipe à Montréal. Vous travaillerez sur des projets d'analyse avancée, de modélisation prédictive et de machine...Full timeRemote workWork from home
- ...someone to join our team as a Data Scientist (NLP Specialist) in Non-... ...to develop and deploy advanced AI models using NLP, Machine Learning... ...Stanley is known as a global leader in financial services, always... ...analytics. Experience with benchmark creation and evaluation...Full timeApprenticeshipWork at officeRemote work
- ...can guide a team to deliver high-quality, sustainable solutions. If you... ...line manager for a chapter of Data Engineering Specialists, fostering... ...—particularly around emerging AI technologies—and proactively... ...meet evolving domain demands. Lead your chapter in designing,...Quality
- ...might just be in the right place! We’re looking for a Lead Data Analyst, Growth Marketing to join our Growth Marketing Team... ...analytical skill set to drive insightful analyses. Evaluate and improve data quality, completeness, compliance and cleanliness in Google Analytics...QualityFull timeRemote workFlexible hours
- ...is a high-tech, dynamic Swiss leader in AI and data analytics consulting, renowned for solving... ...Senior Data & AI Consultant / Consulting Lead to help expandestablish our Canadian presence... ...AI opportunities our engineers and data scientists can build. You are the bridge between the...Full time
- ...healthcare organizations depend on. AI is now at the heart of that... ..., we believe the future of quality assurance lies in combining robust... ...resolution; Maintain reliable test data and evidence and contribute to... ...synthesis; Critically evaluate AI-generated outputs, exercise...QualityFull time
- ...to join an innovative, market-leading company where you can truly elevate... ...About The Role The Product AI & Automation Lead is... ...capabilities that improve speed, quality, decision-making, and organizational... ...partner with Product, IT, Security, Data, and R&D teams to redesign how...QualityLong term contractWork at officeRemote workFlexible hours
- ...eating kake!). We’re looking for Senior Data Engineers with strong experience in data... ...solve business problems. Ensure data quality, consistency, and integrity across sources... ...tools such as Airflow, dbt, or similar. AI-forward mindset with active use of AI-...QualityRemote workFlexible hours
- ...experiences at scale. As a leader in Open Finance in Canada, we’... ...We're hiring a Senior Data Scientist to own machine-learning models... ...retraining, champion-challenger evaluation and promotion. Partner... ...and rollout. Move fast with AI-assisted development -we use...QualityContract workApprenticeshipRemote workFlexible hours
- ...market? Well… you might just be in the right place! As the Team Lead, Quality Specialist , you will reinforce quality standards across... ...leveraging tools such as Postman to ensure system reliability and data integrity. Agile & Continuous Delivery Experience: Solid understanding...QualityFull timeWork at officeRemote workFlexible hours
- ...National Bank of Canada is seeking a Senior AI Scientist to join the AI Factory team. You will evaluate, optimise and monitor AI models, including generative AI, fine-tune models, design prompts, and implement production monitoring in a hybrid work environment. You will...
$60.57k - $100.96k per year
...required. The Opportunity: We are a leading Canadian financial services co-operative... ...our clients. As a Claims Analytics Data Scientist you will contribute on initiatives through... ...projects related to incorporation of Gen AI such as determining work drivers, developing...Full timeWork at officeLocal areaFlexible hours- ...YOU We are looking for a Tech Lead to drive delivery and cross-... ...for the Shop Builder DevX and AI team. You are the bridge between... ...ops, and catalog, and own the quality of what ships. This is a hands... ...Familiarity with LLM-generated code evaluation: assessing whether an AI-...QualityFull timeLocal areaWorldwide
- ...alongside global innovators to build AI-powered solutions that solve... ...discipline across our data pipelines (DataOps/CI-CD), optimizing... ...workflows, and reinforcing data quality and security standards.... ...Data Engineering Competency: Lead the end-to-end design and execution...QualityWork at officeLocal areaRemote workWork from homeHome officeFlexible hours
- ...nos clients. Ton quotidien Comprendre le besoin d'un client, évaluer le ROI et définir un scope de POC qui se tient Réaliser des... ...fonctionner une idée Profil idéal Un mix entre un.e scientifique AI et un.e vendeur.euse : tu vois les possibilités techniques ET tu...QualityDaily paidWork at officeFlexible hoursNight shift
$150k - $170k per year
...technologies de sécurité. Nous recherchons un data scientist senior doté dun esprit très analytique et... ...Senior Data Scientist to join GDs new AI Hub. The ideal candidate will... ...feature engineering and model performance evaluation Develop statistical forecasting classification...Permanent employmentContract workApprenticeshipLocal areaImmediate start- ...sized organizations in Canada/US. We are currently hiring an Data Governance Lead for our global consulting client. Role: Data Governance... ...frameworks, policies, standards, and controls to ensure data quality, integrity, security, compliance, and effective data lifecycle...QualityFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Scientist, AI Evaluation & Quality Benchmarks. Be the first to apply!
