Italian Language Evaluator
Temporary
Rise Data Labs
About the Role
We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian.
What You’ll Do
• Review AI-generated content in Italian
• Identify message drift (detect output deviation)
• Detect hallucinations (fabricated claims, unrealistic visuals, incorrect attributes)
• Provide structured feedback that improves model performance over time
What We’re Looking For
• Native or fluent Italian speaker
• Strong understanding of Italian language and cultural context
• Ability to distinguish subtle differences in tone, quality, and correctness
• High attention to detail and consistency in applying guidelines
• Bonus: experience in marketing and data annotations
• Availability: short-term engagement starting ASAP
Valutatore/trice lingua italiana
Descrizione del ruolo
Cerchiamo annotatori freelance madrelingua o fluenti in italiano per valutare contenuti generati dall’IA, con grande attenzione ai dettagli e alle sfumature culturali. Dovrai stabilire se gli output sono coerenti, sensati e realistici.
Responsabilità
• Revisionare contenuti generati dall’IA in italiano
• Identificare deviazioni nel messaggio
• Rilevare allucinazioni (informazioni inventate, elementi irrealistici, attributi errati)
• Fornire feedback strutturato per migliorare le performance del modello
Requisiti
• Madrelingua o fluente in italiano
• Ottima comprensione linguistica e culturale
• Capacità di cogliere differenze sottili di tono, qualità e correttezza
• Elevata attenzione ai dettagli e coerenza nell’applicazione delle linee guida
• Plus: esperienza in marketing o data annotation
• Disponibilità: incarico a breve termine, inizio immediato
Vacancy posted 12 days ago
Similar jobs that could be interesting for youBased on the Italian Language Evaluator in Remote vacancy
- ...Analyze content in Italian and improve AI language models through research. About Turing: Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with...Italian language skillsContract workPart timeFor contractorsFreelanceRemote workFlexible hours1 day per week
- ...data lab for training frontier models and evaluating AI agents. Experts contribute their... ...expertise into high-quality training data, evaluations, and feedback loops that improve how AI... ...for frontier AI. Role Title: Cantonese Language Evaluator Role Type: Contractor...SuggestedPart timeFor contractorsRemote work
- ...’re looking for contract, remote Swedish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...or fluent Swedish speaker • Strong understanding of Swedish language and cultural context • Ability to distinguish subtle...SuggestedContract workTemporary workImmediate startRemote work
- ...’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...or fluent Turkish speaker • Strong understanding of Turkish language and cultural context • Ability to distinguish subtle...SuggestedContract workTemporary workFreelanceImmediate startRemote work
- ...’re looking for contract, remote Spanish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...Native or fluent Spanish speaker Strong understanding of language and cultural context Ability to distinguish subtle differences...SuggestedContract workTemporary workImmediate startRemote work
- ...looking for contract, remote Portuguese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...Portuguese speaker • Strong understanding of Portuguese language and cultural context • Ability to distinguish subtle differences...Contract workTemporary workFreelanceImmediate startRemote work
- ...contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for... ...speaker Strong understanding of language and cultural context Ability to distinguish... ...engagement that starts ASAP Rôle : Évaluateur(trice) de langue française À propos du...Contract workTemporary workFreelanceImmediate startRemote work
- ...re looking for contract, remote Japanese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...or fluent Japanese speaker • Strong understanding of Japanese language and cultural context • Ability to distinguish subtle...Contract workTemporary workImmediate startRemote work
- ...Job Application for Italian Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial Back to jobs Italian Audio Evaluations... ...evaluation. Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening...Italian language skillsHourly payPart timeFor contractorsFreelanceRemote work
$25 - $40 per hour
...Flexible hours · Payouts: Weekly Overview AI produces textbook Italian that still feels off: it forces gender and number agreement... ...the way Italians actually speak. What you’ll actually do Evaluate translations between English and Italian for fidelity, rhythm,...Italian language skillsWeekly payFull timeContract workFor contractorsRemote workFlexible hours$35 - $45 per hour
...auditory experiences across diverse languages, accents, and cultural... ...: Native proficiency in Italian with exposure to diverse accents... ...audio content, including evaluating speech accuracy, cultural vocal... ..., speech data, or speech evaluation and research are especially encouraged...Italian language skillsFull timePart timeFor contractorsRemote workWorldwide10 hours per week$40 per hour
..., you will work as a Maltese Language Expert (SME) to review AI-generated... ...Maltese reference content, evaluating language quality and step-by-... ...claims, English- or Italian-influenced phrasing, or culturally... ...localization QA, or rubric-based evaluation is strongly preferred....Italian language skillsHourly payContract workFor contractorsRemote workShift work- ...We have a new quick-turnaround audio project and are looking for authentic Italian-accented English speakers to join as voice contributors. You will record yourself reading a short script by following a simple step-by-step guide — the work takes approximately 15 minutes or...Italian language skillsContract work
$25 per hour
...Pay: up to $25/hour In this hourly, remote contractor role, you will review AI-generated English-language responses and/or generate expert language content, evaluating reasoning quality and step-by-step edits while providing precise, actionable feedback. You will assess...Hourly payContract workFor contractorsRemote work$15 per hour
...hour In this hourly, remote contractor role, you will work as a Bengali Language Specialist (SME) to review AI-generated Bengali content and/or create high-quality Bengali reference content, evaluating language quality and step-by-step reasoning while providing precise...Hourly payContract workFor contractorsRemote work$15 per hour
.../hour In this hourly, remote contractor role, you will work as a Nepali Language Expert (SME) to review AI-generated Nepali content and/or create high-quality Nepali reference content, evaluating language quality and step-by-step reasoning while providing precise written...Hourly payPart timeFor contractorsRemote work$40 per hour
...role, you will review AI-generated responses and/or generate language content, evaluate reasoning quality and step-by-step problem-solving, and... ...proficiency (reading/writing) for interpreting prompts, sources, and evaluation guidelines. ~5+ years of professional localization/...Hourly payContract workFor contractorsRemote work- ...pay Required Skills apanese Language Fluency Audio Transcription Attention to... ...data lab for training frontier models and evaluating AI agents. Experts contribute their... ...expertise into high-quality training data, evaluations, and feedback loops that improve how AI...Part timeFor contractorsRemote work
- ...data lab for training frontier models and evaluating AI agents. Experts contribute their... ...expertise into high-quality training data, evaluations, and feedback loops that improve how AI... ...for frontier AI. Role Title: Korean Language Expert Role Type: Contractor Location...Part timeFor contractorsRemote work
- ...will review AI-generated responses and/or generate Vietnamese language content, evaluate reasoning quality and step-by-step problem-solving, and... ...proficiency (reading/writing) for interpreting prompts, sources, and evaluation guidelines. Bachelor's degree (completed or in progress)...Hourly payContract workFor contractorsImmediate startRemote work
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based... ...Project Description: This project supports the evaluation and improvement of safety behavior in large language model systems. Contractors engaged on this project...Ongoing contractPart timeFor contractors
- ...Lead teams to create and evaluate realistic LLM conversational data. About Turing Turing... ...training and evaluating advanced Large Language Models (LLMs). The role involves managing... ...teams to deliver reliable training and evaluation datasets. What You’ll Do ~Lead and manage...Contract workPart timeFreelanceRemote work
usd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs... ...English skills and a keen eye for language quality? Join a remote AI project where... ...appropriateness. - Providing structured evaluations and feedback following the project instructions...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours- ...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... ...system ensures both quality and velocity. Role Title: Spanish-Language Consumer Reviewer Role Type: Contractor Location: Remote...Temporary workFor contractorsRemote work
- ...building a global community of experts to evaluate, challenge and improve advanced AI... ...AI-generated text and conversations Language, meaning, context and reasoning Hallucinations... ...AI behaviour Domain-Specific AI Evaluation Healthcare & Medicine Law Finance...Part time
$55 - $100 per hour
...will be shared during onboarding. Skills & requirements Physics problem solving Graduate-level mechanics and electromagnetism Technical written communication Critical evaluation of mathematical derivations Meta-level scientific reasoning Category: RLHF...Contract work$40 per hour
...centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending on the... .... This is not a traditional job — you'll use your French language skills to help evaluate and rank AI responses so future models...Part timeRemote workFlexible hours$10 - $15 per hour
...1 more About this role Interview language: English In this hourly, remote contractor... ...high-quality Punjabi reference content, evaluating language quality and step-by-step... ...translation QA, editorial QA, or rubric-based evaluation is strongly preferred. Key...Hourly payContract workFor contractorsRemote workShift work- ...Category: Frontier Model Evaluation · Pay: Hourly rate confirmed after the interview process · Location: Remote — US-eligible · Contractor French Language Expert (Canada) is a remote evaluation track for reviewing french generalist evaluation prompts and responses against...Hourly payContract workFor contractorsRemote work10 hours per week
- ...Key Responsibilities • Curate and prepare text datasets for training • Evaluate language model performance • Design and implement NLP evaluation metrics • Conduct error analysis and model debugging • Research and implement state-of-the-art NLP techniques Requirements...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Italian Language Evaluator. Be the first to apply!
