AI Model Evaluation Specialist
Temporary
Rise Data Labs
Key Responsibilities
• Design and implement evaluation metrics for AI models
• Conduct thorough testing of model performance across different scenarios
• Analyze model outputs for bias, fairness, and accuracy
• Collaborate with ML engineers to implement improvements
• Document findings and recommendations
Ideal Candidate:
• PhD or Masters in Computer Science, ML, or related field
• 5+ years experience in AI/ML model evaluation
• Strong background in statistical analysis
• Experience with evaluation frameworks and metrics
• Excellent communication skills
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the AI Model Evaluation Specialist in Remote vacancy
- ...ready deliverable should include Grade AI-generated deliverables (often Word... ...part in calibration sessions with other evaluators to align scoring standards Preferred... ...review skills Prior experience with AI model training, evaluation, or benchmark development is a plus...SuggestedContract workFlexible hours
$40 per hour
...Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the... ...help evaluate and rank AI responses so future models can better tailor their answers to individual users...SuggestedPart timeRemote workFlexible hours- ...Key Responsibilities Train and improve AI models through effective data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Utilize Bash scripting to automate data processing tasks and improve efficiency. Provide domain...SuggestedHourly payContract workFlexible hours
- ...a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for... ...Healthcare, Finance, Education and other specialist disciplines. You do not need a... ...concepts and technical outputs Model reasoning and performance Data...SuggestedPart time
- ...optimization About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject... ...-world expertise into high-quality training data, evaluations, and feedback loops that improve how AI systems...SuggestedPart timeFor contractorsRemote work
- ...production data, building cost or capacity models, evaluating supplier quotes, or reviewing technical... ...a client would expect Grade AI-generated deliverables (often Excel models... ...Prior experience with AI model training, evaluation, or benchmark development is a plus What...Contract workFlexible hours
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California,... ...implied. Project Description: This project supports the evaluation and improvement of safety behavior in large language model...Ongoing contractPart timeFor contractors
- ...next steps. Our partner is looking for a Portuguese Audio Evaluations Specialist – Freelance AI Trainer Project based in Canada. Contribute to the... ...of advanced conversational AI by evaluating audio-based models in realistic customer support scenarios. In this remote freelance...Hourly payFull timeFor contractorsFreelanceRemote workFlexible hours
- ...quality deliverable looks like Grade AI-generated deliverables (often PDFs,... ...Join calibration sessions with other evaluators to align scoring standards across the benchmark... ...documents Prior experience with AI model training, evaluation, or benchmark development is a plus...Contract workFlexible hours
- ...Job Application for French Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial Back to jobs French Audio Evaluations Specialist... ...evaluation project assessing advanced agentic audio models. As AI models increasingly handle complex workflows in this...Hourly payPart timeFor contractorsFreelanceRemote work
$22 per hour
...Job Application for 3D Modeling & Python Specialist - Freelance AI Trainer Project at Meridial Back to jobs 3D Modeling & Python Specialist - Freelance... ...for a specialized AI 3D asset collection project. As AI models increasingly generate and interact with 3D environments,...Hourly payPart timeFor contractorsFreelanceRemote work- ...· Radiological Science · Health Physics · AI Safety · CBRN What this pays Rates are... ...behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US,... ...Responsibilities •Tier 1: review AI prompts and model responses •Tier 1: classify content as...Hourly payContract workFor contractorsRemote work
- ...next steps. Our partner is looking for a Senior Data Scientist AI Evaluation based in Canada. We are seeking a senior-level data scientist to... ...that measure the quality, reliability, and correctness of AI models and intelligent agents. In this role, you will transform complex...Full time
$100 per hour
...chemical safety professionals to audit how AI models respond to sensitive questions in the... ...professionals; CWC or chemical-security specialists; hazmat, poison-control or chemical incident... ...subjects. Optimize AI Performance: Evaluate and rank AI responses to enhance the...Permanent employmentFull time- © 2026 Smart Ecosystems. All rights reserved.Full time
usd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type... ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours$55 - $100 per hour
...Pay: $55–100/hour You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural... ...litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate doctrinal knowledge...Contract work$13 per hour
...Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to respond... .... • Follow project guidelines for consistent, confidential evaluation work. Important account-access requirement • This project...Hourly payContract workFor contractorsRemote work- ...Join a leading AI lab's cutting-edge GenAI team to be at the core... ...of the most advanced AI models. # Overview We are hiring... ...are looking for a practising specialist rather than a generalist. This... ...challenging finance tasks and evaluation sets, and help build finance-specific...Full timeContract workPart timeFreelanceLive InManual laborRelocationRelocation package
$130 per hour
...English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.... ...clinical EHR vignettes for a medical AI evaluation program. General and internal medicine...Hourly payPermanent employmentPart time10 hours per week- ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Contract workImmediate startRemote workFlexible hours
$75 - $90 per hour
...Location: United States | Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your... .... Build or configure coding environments for evaluation and reinforcement learning. Follow detailed annotation...Long term contractContract workRemote work- ...What You'll Do Review real user interaction traces with an AI shopping assistant Identify logical failures, inaccuracies, or poor... ...verifiers to judge response quality Commit to 20+ hours per week of evaluation work on our internal platform Who Should Apply Experience...Contract workFor contractorsRemote work
$50 - $150 per hour
...6 more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic... ...industry) Prior experience with data annotation or AI model evaluation Experience reviewing or publishing research papers...Contract workTemporary workInternshipRemote workFlexible hours$30 - $90 per hour
...backgrounds to support quality control on AI reasoning datasets. This role requires professional... ...Provide detailed feedback to improve model performance Collaborate with the team... ...Nice to Have Experience with AI/ML evaluation or data annotation Background in AI, NLP...Contract workRemote work10 hours per weekFlexible hours- ...ll use your finance expertise to help evaluate and improve advanced AI systems on complex, realistic... ...professional quality. Develop clear evaluation rubrics and scoring criteria, identifying... ...research, asset management, financial modeling and valuation, corporate finance/FP&A...Contract work
- ...What You'll Do Review AI-generated business strategy documents and advisory outputs... ...Provide structured written feedback to improve model performance Who Should Apply Current... ...Comfortable working independently on text evaluation tasks Contract & Payment Terms You...Contract workFor contractorsRemote work
$90 per hour
...small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives... ...and reactor physicists, safeguards and nonproliferation specialists (IAEA, NRC or equivalent, export control, national labs), health...Contract work$50 - $150 per hour
...PhD-level quantitative finance experts to help train and evaluate advanced AI models on financial and quantitative reasoning. This is remote, flexible... ..., and assessment performance. Quantitative finance specialists are among our most sought-after experts. Location This...Contract workTemporary workInternshipRemote workFlexible hours- ...editing skills in your native language. Strong attention to detail and ability to follow written guidelines. Comfortable working with AI-generated content. Reliable internet connection. Ability to work remotely using a client-provided laptop. French (France)...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Model Evaluation Specialist. Be the first to apply!
