Quantitative AI Model Evaluation Scientist
DataAnnotation
Use statistical methods and predictive modeling to evaluate AI outputs remotely for DataAnnotation, with flexible scheduling across approved countries. Technical accuracy matters.
DataAnnotation is seeking an experienced quantitative practitioner to support AI model development. The work involves evaluating generated analysis, solving technical problems, and explaining whether outputs hold up in practice. Your expertise may come from data science, economics, statistics, physics, biology, or another quantitative field.
Key Responsibilities:
- Assess statistical analysis and predictive modeling outputs
- Validate scientific reasoning and data-driven insights
- Develop problems covering forecasting and experimental analysis
- Review and write well-documented analytical code
- Shape AI models through direct technical feedback
Requirements:
- Two-plus years of quantitative hands-on experience
- Comfort writing and reviewing analytical code
- Experience with statistical methods and predictive modeling
- Practical experiment design experience, including A/B testing
- Bachelor's degree in a quantitative field preferred
Bring quantitative analysis, experiment design, coding, and scientific reasoning to DataAnnotation's remote AI evaluation work.
#J-18808-LjbffrVacancy posted 18 hours ago
Similar jobs that could be interesting for youBased on the Quantitative AI Model Evaluation Scientist in Toronto, ON vacancy
- ...training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences... ...the future! Why this role?Evaluation is critical to making progress in... ...progress. As a Senior Research Scientist, Model Evaluation, you will:...SuggestedFull timeWork at officeRemote workFlexible hours
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Data Scientist Talent Network Type:... ...data analyses , statistical modeling work , machine learning pipelines... ..., and technical reports. Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$101k - $169k per year
...Job Type: Permanent Work Model: Hybrid Reference code: 134470 Primary Location... ...and international clients to solve their quantitative and modelling issues? What will your typical... ...utilize human screening combined with AI technology to help identify the skills and...SuggestedPermanent employmentFlexible hours- ...vibrant community where data scientists and data analysts learn and grow... ...Data Science team builds the models, risk frameworks, and decision... .... Together you'll develop the quantitative foundation for how Stripe measures... ...such as MBRs and QBRs Use AI tools (code assistants, LLM-...SuggestedFull timeInternship
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Data Scientist Talent Network Type:... ...data analyses , statistical modeling work , machine learning pipelines... ...and A/B test write-ups . Evaluate AI-generated or human-created...SuggestedRemote jobContract workSummer work$75k - $100k per year
...hear from you! We are seeking a Data Scientist, Risk Analytics & Modeling, to work under the direction of the... ...data pipelines, machine learning, and AI to your work Participate in... ...Applied Sciences, Finance, or another quantitative discipline ~0–3 years of full-time...Full timeInternshipWork at officeFlexible hours$85 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks. Review model-generated implementations involving cloud platforms...Remote jobContract workSummer work$80 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review model-generated implementations involving ETL pipelines...Remote jobContract workSummer work- ...Description: Department Overview The Model Validation (MV) group is a... .... The Artificial Intelligence (AI) Model Validation (MV) group is... ...R&D in the GenAI/Agentic/LLM evaluation and testing areas. Lead a team of Machine Learning Scientists to perform validation/review of...Full timeTemporary workWork from home
$81.6k - $115.2k per year
...provide you more specific details for this role. Job Description: The Model Validation (MV) group in Enterprise Risk, Risk Management is... ...knowledge of techniques and developments in actuarial methodology and ML/AI modeling for Insurance ~ Develops different validation testing...Full timeWork from home$120 - $180 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Senior Data Scientist and Data Engineering Experts... ...exploratory analyses , statistical modeling , machine learning pipelines... ...work. Train and evaluate frontier AI models using expertise...Remote jobContract workSummer work- ...R2873670 Position Title: Data Scientist Location: Toronto, ON -... ...Sanofi We’re an R&D-driven, AI-powered biopharma company... ...analytics projects. Build models, algorithms, simulations, and... ...statistics, economics, or a related quantitative discipline with strong coding...Work from home3 days per week
$110.5k - $143k per year
...and partner with the line of business to evaluate KPI measurement needs. Communicate the... ...functional team and data stewardship, data modelling, data architecture and master data/metadata... ...an existing vacancy. Hydro One uses AI tools to assist in the screening and assessing...- ...looking for a highly skilled quantitative researcher. This role offers a... ...and maintain machine learning models to identify and deliver high impact... ...macroeconomics news Use AI methods to detect mis pricings... ...back testing framework to evaluate strategy performance - focused...Full timeFlexible hoursShift work
- ...Palona’s AI agents operate in real restaurant environments: noisy phone lines, varied accents, complex menus, interruptions... ...these systems requires more than selecting the newest model. It requires disciplined evaluation, high-quality data, modeling judgment, experimentation,...Long term contractFull timeTemporary workInternshipImmediate start
$55 - $80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...involving state-of-the-art large language models . Create high-quality data by developing... ...challenging problems in your domain. Evaluate and improve AI model performance with a...Remote jobContract workSummer work$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...reliable, maintainable tools, collaborating closely with research scientists, engineering teams, and product partners while helping shape...Full timeInternshipWork at officeLocal areaFlexible hours$30 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...tasks guiding it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote work$105.5k - $134.5k per year
...Description: Department Overview TD Model Validation (MV) group is... ...of models used for Generative AI, Natural Language Processing (... ...Applied Machine Learning Scientist in the AI/ML Model Validation... ...publications, foundation models, evaluation metrics, explainability, technology...Full timeTemporary workWork from home$69k - $114k per year
...Job Type: Permanent Work Model: Hybride Reference code:... ...données internes et externes; évaluer la qualité des données; maintenir... ...affaires ou dans un domaine quantitatif connexe, et cinq ans ou plus d... ...human screening combined with AI technology to help identify the...Permanent employmentApprenticeshipWork at officeFlexible hoursDay shift- ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...Part timeFor contractorsRemote workFlexible hours
$96.9k - $136.8k per year
...Job Description: We are seeking a Data Scientist III to lead AI adoption and AI-enabled process... ...future-state workflows. Identify, evaluate, and prioritize opportunities to embed... ...analytics, operations research, or a related quantitative field; graduate degree preferred. ~5+...Full timeWork from home$127k - $203k per year
...potential. Title and Summary Lead Data Scientist Overview: We work to connect and... ...Machine Learning, Deep Learning, and other AI techniques. Responsibilities: 1.... ...analysis, data cleaning, preparation, modeling, and evaluation 5. Deploy, document, maintain and monitor...Full timeWorldwide- ...products, and our business have the models, data products, and insights... .... We're looking for data scientists with a passion for analyzing data... ...8+ years of data science or quantitative modeling experience Proficiency... ...Proficiency with AI tools to accelerate model development...Full time
$180k - $247.5k per year
...mission is Compass — Faire’s user facing AI bet within the Discovery Pillar —... ...behalf. As a Senior Applied AI/ML Scientist on the Compass team, you will be the science... ...— driving agent quality through data, evaluation, and modeling, while shipping product features end-to...InternshipWork at officeLocal areaImmediate startRemote workMonday to friday3 days per week$69.7k - $98.4k per year
...Department Description: TD Model Validation (MV) group is responsible... ...pricing, hedging, and capital evaluation for portfolio of financial... ...the TBSM MV group covering both quantitative and qualitative models... ...asset. Experience developing AI agent workflows to increase productivity...Full timeWork from home- ...looking for an experienced Data Scientist to join our team and help... ...team manages a large enterprise model portfolio supporting customer... ...hyperparameter tuning, and model evaluation. Monitor deployed model... ...emerging machine learning and AI technologies and identify opportunities...Full timeContract workFlexible hoursShift work
$88k - $132k per year
...Job Summary As a Senior Data Scientist, you will be an integral part of the AI Centre of Excellence (COE) within the... ...cases, including large language model (LLM) applications, and help shape... ...Engineering: Implement, fine-tune, and evaluate large language model (LLM)...Work at officeImmediate startWeekend work$96.9k - $136.8k per year
...Overview The Manager, Compliance – Model and Data Governance is responsible for ensuring AI and data usage within TDS... ...role will work closely with data scientists and data analysts within the Compliance... ...intelligence dashboards. Evaluate AI usage within Compliance to ensure...Full timeWork from home$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...tasks that challenge frontier models, ensuring they are solved in... ...attempts. Focus on inference, evaluation, and systems work rather than... ...engineer , research scientist , or applied scientist ....Remote jobContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Quantitative AI Model Evaluation Scientist. Be the first to apply!
