Italian Language Evaluator
Temporary
Rise Data Labs
About the Role
We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian.
What You’ll Do
• Review AI-generated content in Italian
• Identify message drift (detect output deviation)
• Detect hallucinations (fabricated claims, unrealistic visuals, incorrect attributes)
• Provide structured feedback that improves model performance over time
What We’re Looking For
• Native or fluent Italian speaker
• Strong understanding of Italian language and cultural context
• Ability to distinguish subtle differences in tone, quality, and correctness
• High attention to detail and consistency in applying guidelines
• Bonus: experience in marketing and data annotations
• Availability: short-term engagement starting ASAP
Valutatore/trice lingua italiana
Descrizione del ruolo
Cerchiamo annotatori freelance madrelingua o fluenti in italiano per valutare contenuti generati dall’IA, con grande attenzione ai dettagli e alle sfumature culturali. Dovrai stabilire se gli output sono coerenti, sensati e realistici.
Responsabilità
• Revisionare contenuti generati dall’IA in italiano
• Identificare deviazioni nel messaggio
• Rilevare allucinazioni (informazioni inventate, elementi irrealistici, attributi errati)
• Fornire feedback strutturato per migliorare le performance del modello
Requisiti
• Madrelingua o fluente in italiano
• Ottima comprensione linguistica e culturale
• Capacità di cogliere differenze sottili di tono, qualità e correttezza
• Elevata attenzione ai dettagli e coerenza nell’applicazione delle linee guida
• Plus: esperienza in marketing o data annotation
• Disponibilità: incarico a breve termine, inizio immediato
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Italian Language Evaluator in Remote vacancy
- ...Participate in group recordings of natural Italian conversations for AI training. About Turing: Turing is one of the world’s fastest... ...Flexible agreement; not full-time or part-time employment. Evaluation Process Candidates will be shortlisted based on qualifications...Italian language skillsFull timeContract workPart timeRemote workFlexible hours
- ...Analyze content in Italian and improve AI language models through research. About Turing: Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with...Italian language skillsContract workPart timeFor contractorsFreelanceRemote workFlexible hours1 day per week
- ...hourly contractor role supporting AI data and language projects on a project-based, flexible... ...to support AI training datasets. LLM evaluation: reviewing AI-generated responses for accuracy... ...outputs. You will apply senior-level Italian localization and translation judgment...Italian language skillsHourly payContract workFor contractorsRemote workFlexible hours
- ...’re looking for contract, remote Swedish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...or fluent Swedish speaker • Strong understanding of Swedish language and cultural context • Ability to distinguish subtle...SuggestedContract workTemporary workImmediate startRemote work
- ...contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for... ...speaker Strong understanding of language and cultural context Ability to distinguish... ...engagement that starts ASAP Rôle : Évaluateur(trice) de langue française À propos du...SuggestedContract workTemporary workFreelanceImmediate startRemote work
- ...re looking for contract, remote Japanese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...or fluent Japanese speaker • Strong understanding of Japanese language and cultural context • Ability to distinguish subtle...Contract workTemporary workImmediate startRemote work
- ...We’re looking for contract, remote German-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural... ...Native or fluent German speaker • Strong understanding of German language and cultural context • Ability to distinguish subtle...Contract workTemporary workImmediate startRemote work
- ...looking for contract, remote Portuguese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...Portuguese speaker • Strong understanding of Portuguese language and cultural context • Ability to distinguish subtle differences...Contract workTemporary workFreelanceImmediate startRemote work
- ...’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...or fluent Turkish speaker • Strong understanding of Turkish language and cultural context • Ability to distinguish subtle...Contract workTemporary workFreelanceImmediate startRemote work
- ...Job Application for Italian Audio Evaluations Specialist - Freelance AI Trainer Project at Meridial Back to jobs Italian Audio Evaluations... ...evaluation. Native or bilingual proficiency in the target language, including fluency across all language skills (reading, listening...Italian language skillsHourly payPart timeFor contractorsFreelanceRemote work
$25 - $40 per hour
...Flexible hours · Payouts: Weekly Overview AI produces textbook Italian that still feels off: it forces gender and number agreement... ...the way Italians actually speak. What you’ll actually do Evaluate translations between English and Italian for fidelity, rhythm,...Italian language skillsWeekly payFull timeContract workFor contractorsRemote workFlexible hours$30 - $65 per hour
...communication verbal communication Italian bilingual proficiency About micro1 micro1... ...models and agents. We provide frontier evaluations and reinforcement learning environments... ...Experts to contribute to an impactful language and AI training project for a valued customer...Italian language skillsPart timeFor contractorsRemote work$35k per year
...***This is a Full-time permanent position. Must be fluent in [Italian] at an expert or native proficiency level*** Responsibilities... ...and we are committed to an equitable process where applicants are evaluated based on job-related knowledge, skills, and abilities in accordance...Italian language skillsPermanent employmentFull timeWork at officeRemote workFlexible hours$40 per hour
..., you will work as a Maltese Language Expert (SME) to review AI-generated... ...Maltese reference content, evaluating language quality and step-by-... ...claims, English- or Italian-influenced phrasing, or culturally... ...localization QA, or rubric-based evaluation is strongly preferred....Italian language skillsHourly payContract workFor contractorsRemote workShift work- ...systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing... ...to support a frontier AI training and evaluation initiative focused on improving the... ...experience with at least one of the following languages: Python, JavaScript/TypeScript, Java, Go...Part timeFor contractorsFreelanceRemote work
- ...We have a new quick-turnaround audio project and are looking for authentic Italian-accented English speakers to join as voice contributors. You will record yourself reading a short script by following a simple step-by-step guide — the work takes approximately 15 minutes or...Italian language skillsContract work
$17.5 per hour
...Additional performance-based incentives may be available Responsibilities Join 15-minute recorded conversations with a matched Italian-speaking partner Talk naturally about the topic you're given Listen actively and respond with genuine interest Make sure your audio stays...Italian language skillsHourly payContract work$25 - $30 per hour
...services to international students in Canada, including tutoring and intercultural communication. We are now hiring part-time English Language and Literature Teachers for our clients who are international students in high schools in Canada. Join us if you are enthusiastic,...Hourly payFull timePart timeCasual workFreelanceRemote workFlexible hoursWeekend workWeekday work$100 per hour
...professionals who can help train their latest language model on professional document,... ...-cultural business experience to create, evaluate, and refine AI-generated documents, spreadsheets... ...assessments, native-fluency writing evaluation, terminology and glossary management, and...Contract workImmediate startRemote workFlexible hours$80 per hour
...Paid, remote contract work turning published programming languages research into coding tasks for frontier AI agents. For PhD-level researchers... ...own benchmarks. You write the task statement, define held-out evaluation workloads and per-metric pass thresholds, and supply a hidden...Contract workRemote work- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Evaluation Consultant based in Canada. This opportunity offers experienced evaluation professionals the chance to contribute to international development...Full timeRemote work
- ...- **Software engineering:** algorithms, systems, databases, data engineering, frontend, and programming languages - **Machine learning:** training, inference, evaluation, and kernels - **Security:** cryptography, reverse engineering, forensics, and application security - **...Shift work
$15 per hour
.../hour In this hourly, remote contractor role, you will work as a Nepali Language Expert (SME) to review AI-generated Nepali content and/or create high-quality Nepali reference content, evaluating language quality and step-by-step reasoning while providing precise written...Hourly payPart timeFor contractorsRemote work$25 per hour
...Pay: up to $25/hour In this hourly, remote contractor role, you will review AI-generated English-language responses and/or generate expert language content, evaluating reasoning quality and step-by-step edits while providing precise, actionable feedback. You will assess...Hourly payContract workFor contractorsRemote work$15 per hour
...hour In this hourly, remote contractor role, you will work as a Bengali Language Specialist (SME) to review AI-generated Bengali content and/or create high-quality Bengali reference content, evaluating language quality and step-by-step reasoning while providing precise...Hourly payContract workFor contractorsRemote work$40 per hour
...role, you will review AI-generated responses and/or generate language content, evaluate reasoning quality and step-by-step problem-solving, and... ...proficiency (reading/writing) for interpreting prompts, sources, and evaluation guidelines. ~5+ years of professional localization/...Hourly payContract workFor contractorsRemote work$20 - $30 per hour
...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... ...system ensures both quality and velocity. Role Title: Spanish-Language Consumer Reviewer Role Type: Contractor Location: Remote...Temporary workPart timeFor contractorsRemote work- ...Requirements Requirements Native in the Target language. Proficient in the Source language, with the ability to accurately interpret... ...Detail-oriented and comfortable with linguistic and stylistic evaluation tasks as well as the technical aspect of this evaluation (...Part time
$15 per hour
...contractor role, you will work as a Punjabi Language Specialist (SME) to review AI-generated... ...high-quality Punjabi reference content, evaluating language quality and step-by-step... ...translation QA, editorial QA, or rubric-based evaluation is strongly preferred. Skills:...Hourly payContract workFor contractorsRemote workShift work$20 - $60 per hour
...Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM... ...English (fluency required, but it does not need to be your first language). Talent for crafting nuanced and well-structured questions...Part timeFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Italian Language Evaluator. Be the first to apply!
