Data Scientist Specializing in Model Monitoring
Jobber
Become a key contributor as a Data Scientist specializing in ML and LLM model monitoring and validation. Your expertise will help uphold the integrity and performance of our machine learning systems. As a Data Scientist reporting to the Director, you'll focus on model validation and build critical evaluation frameworks. You’ll engage in designing custom metrics and regression test suites while collaborating with MLOps teams to ensure model performance remains consistent. Experience in Python and SQL will be essential for overseeing various aspects of model evaluations. Key Responsibilities:
- Design and implement ML model evaluation frameworks
- Build regression test suites to identify unexpected behaviors
- Conduct MCP evaluations to assess model reliability
- Monitor and address model performance issues proactively
- Clearly document and present evaluation methodologies
- Proven experience in data science or a related field
- Proficient in Python and the data science stack
- Strong understanding of statistical evaluation methods
- High-level SQL skills for data handling
- Effective communication across technical teams
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Data Scientist Specializing in Model Monitoring in Toronto, ON vacancy
- Seize the moment as a Data Scientist specializing in cutting-edge AI/ML model development. This role embraces remote work, providing a unique opportunity to drive innovation and foster inclusivity. Your primary focus will be on developing and deploying AI/ML models, working...SuggestedRemote work
- ...effectively prepare for and manage emerging model risk related to AI would subject RBC to... ...considerations such as conceptual soundness, data processing, metric reproducibility &... ...You will work with model developers (data scientists, researchers, engineers) and business stakeholders...Suggested
- Elevate retail decision-making with Canadian Tire Corporation as a Senior Data Scientist specializing in Predictive Modelling. Use your machine learning and statistical expertise to drive impactful business solutions. In this senior‑level role, you will leverage over four years...Suggested
- Join Chexy as a Senior Data Scientist focusing on Building Risk Models in downtown Toronto, Ontario. Craft the future of payments through innovative credit... ...development of strategic risk and underwriting models • Monitor and improve decision-making frameworks for Flex...Suggested
- Excel as a Senior Data Scientist focused on machine learning advancements. Utilize your programming skills to transform complex data into actionable... ...benefit customers. In this pivotal role, you will focus on model development and deployment while working on massive data sets....Suggested
- ...with the flexibility of RAG and AI models. Gather and clean relevant data sets for training and fine-tuning Large... .... Develop and fine-tune specialized Large Language Models (LLMs) and advanced... ...bias mitigation. Continuously monitor, update, and re-train models to adapt...Work at officeMonday to friday2 days per week3 days per week
- ...We are seeking a talented and driven Data Scientist to join our team. The role reports to the... ...machine learning algorithms, statistical model development and related technologies. This... ...and prototyping through deployment, monitoring and continuous improvement. Design, build...Work at officeRemote workFlexible hours
- Requirements Strong applied data science experience (roughly 4+... ...a track record of shipping models that made it into a real product... ...involves We're seeking a Data Scientist to join our team You will... ...into production reliably, and monitor and improve them once they are...
- Summary As the Specialist, SCM Data, you will be joining a team... ...the data, clean and prepare for modelling. Data analysis: support and... ...visual concentration on a computer monitor or on numbers and other... ...valued, respected and supported. Special arrangements can be made for...InternshipWork at officeLocal area
- We are currently requesting resumes for the following position : Data Modeler Resume Due Date : Thursday, August 21, 2025 (5:00PM EST) Job ID: 25-143 Number of Vacancies : 1 Level : MP4 Duration : 12 Months Hours of work: 35 Hours per week Location : Temp – 700 University...Long term contractTemporary workRemote workRotating shift
- ...is powered by Waabi World, which aims to deliver realistic, scalable, controllable, and efficient simulation. As a Research Scientist in World Models, you will develop algorithms and productionize the next generation of World Models that can reason about complex, dynamic...Full timeWork at officeWork from homeFlexible hours
$180k - $220k per year
...Canada and beyond. Join our global Data Science team and take a... ...learning. As a Principal Data Scientist, you’ll spearhead high‑impact... ...Generative AI and Large Language Models (LLMs). You should be comfortable... ...through robust governance and monitoring. Provide technical leadership...Long term contractWorldwide$90k - $110k per year
...have endured into decades and navigated every technology cycle, from mainframes in the 1970s to artificial intelligence today. Data Modeler Job Summary We are seeking an experienced Data Modeler with strong expertise in ACORD Information and Data Models within the insurance...Long term contractWorldwide- ## Data Scientist IIIApplyremote type: On Sitelocations: Toronto, Ontariotime type: Full... ...guidance for complex situations.* Monitor service, productivity and assess efficiency... ...expert, requiring broad managerial and deep specialized knowledge at the enterprise, business,...Long term contractWork from home
$90k - $110k per year
Data Scientist Key Requirements Experience in software development with focus on AI/ML Experience in AI/ML model development and deployment Hands‑on experience with Generative AI frameworks such as TensorFlow and PyTorch Strong understanding of MLOps/LLMOps practices...$111k - $160k per year
...realize their greatest potential. Senior Data Scientist Overview Our Purpose Mastercard powers... ...(AI) and Machine Learning (ML) models that support Mastercard’s Identity and risk... ...experimentation, validation, deployment, and monitoring. These systems are built to operate at...Worldwide- ...teams. From moving petabytes of data and optimizing with AI to... ...looking for a Staff Data Scientist who can bring their depth and... ...implement advanced machine learning models, lead large-scale projects,... ...production performance monitoring frameworks and KPIs Work together...Flexible hours1 day per week
- ...governments realize their greatest potential. Data Scientist II Overview Our Purpose The Security... ...(AI) and Machine Learning (ML) models that power Mastercard’s Identity and risk... ...engineering to validation, deployment, and monitoring. These capabilities must be designed to...Long term contractWorldwide
- Role Overview We are seeking a hands-on Data Scientist to join our Insurance Analytics & AI Vertical. The ideal candidate will bring a blend... ...impact. The role shall be responsible for leading critical model development and delivery activities, including model design,...Flexible hours
- Influence next-gen AI with Prolific as an AI Model Training Scientist. Collaborate remotely as a self-employed expert, engaging in research-driven... ...in a related field • Proficient in scientific methodology and data analysis • Access to reliable computer and internet connection...Self employmentRemote workFlexible hours
$77k - $117k per year
...can trust. We are looking for a skilled Data Scientist to join our team. In this role, you will... ...analysis. Build custom machine learning models and natural language processing systems... ...Kubernetes, and Nvidia Triton Servers to develop specialized large‑language models tailored to...Flexible hours- ...role. Role Summary Within Sun Life, the Data and Analytics COE comprises savvy and... ...solving problems. The most successful data scientists’ solution for what the right data to use,... ...implementation Focus on feature engineering, model training, model evaluation, and prompt...Contract workWork at officeWork from home
$57.46 - $67.04 per hour
...are seeking a highly experienced Senior Data Scientist to lead the development and implementation... ...through high-visibility predictive modeling. Professional Growth: Collaborate with... ...Design, develop, and deploy machine learning models for predictive analytics, demand...Long term contractContract workImmediate start2 days per week$84k - $126k per year
Data Scientist 2 What it’s like to be a Northbridge Data Scientist. The Data Science Team is a central partner to the business for Northbridge... ...in the data science lifecycle to develop and deploy analytical models, tackling a breadth of challenges from wrangling data to...Work at officeWork from homeFlexible hours$182.24k - $209.58k per year
...plays a critical role in driving data-informed decision-making... ...everything from foundational data modeling and reporting to advanced... ...and forecasting. Senior Data Scientist We’re looking for a Senior Data... ...business value. Location & Work Model This is a hybrid role, with an...Long term contractFull timeTemporary workLocal areaHome officeFlexible hours3 days per week- Requirements Hands on experience in data science with a strong focus on financial crime... ...of delivering production machine learning models in complex, large‑scale environments, with... ...of a small, high‑performing team of data scientists You will own end‑to‑end model development...Manual labor
- Title posted on Talent.com - Data Scientist - SQL, Python, Banking or Capital Markets Posted onMay 23, 2026 by Employer details Astra North Infoteck Inc. Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content....
- ...stronger, more resilient businesses. We're looking for a Senior Data Scientist to join our high-impact Data team. In this role you'll be... ...for elevating Relay's data capabilities — building predictive models, supporting experimentation across the organization, and...InternshipWork at office3 days per week
$92.19k - $171.21k per year
...Opportunity We are seeking a highly skilled and motivated Senior Data Scientist to join the Group Functions Advanced Analytics team. As a... ...prompt engineering, working with RAG applications, fine‑tuning LLM models, and deploying applications on cloud platforms like Azure. Your...Flexible hours$111k - $160k per year
...governments realize their greatest potential. Title and Summary Sr. Data Scientist Overview Services within Mastercard is responsible for... ...banking networks to detect cyber attacks. Leverage AI models to provide automated transaction risk decisions. All About You...WorldwideFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Scientist Specializing in Model Monitoring. Be the first to apply!
Related searches
- public health data scientist Toronto, ON
- senior data scientist Toronto, ON
- data scientist Toronto, ON
- data scientist no experience Toronto, ON
- scientifique de données Toronto, ON
- environmental data scientist Toronto, ON
- junior data scientist Toronto, ON
- energy modelling Toronto, ON
- male model Toronto, ON
- hair models wanted Toronto, ON