Senior Data Scientist - AI Evaluations at RBC

Lead the charge in AI evaluation as a Senior Data Scientist for RBC's AI Group. You will facilitate trusted AI capabilities through innovative evaluation methodologies and technical mentorship. As a Staff Data Scientist specializing in AI Evaluations, you will take on a senior role in shaping how RBC evaluates model quality and performance. You will design and improve evaluation datasets, quality benchmarks, and methodologies that will transition AI systems into reliable production. Your work will involve collaborating with multiple teams to ensure comprehensive evaluation integration throughout the AI development lifecycle. Key Responsibilities:

• Drive advanced evaluation methodologies including datasets and rubrics
• Define measurable criteria for model risk and product quality
• Own lifecycle processes for evaluation datasets and scorecards
• Partner with teams to embed evaluations into release workflows
• Establish protocols for human evaluation and data quality

• 8+ years in data science or AI evaluation
• Strong experience with evaluation frameworks for ML and AI systems
• Practical knowledge of LLM evaluation methods
• Proficiency in Python, SQL, and AI/ML practices
• Excellent communication and stakeholder management skills