Remote English AI Evaluator
Scale AI
Use fluent English and sharp attention to detail as a remote evaluator reviewing AI-generated media on your own schedule. Work independently from anywhere.
Outlier Experts support Scale AI’s training platform by evaluating model performance across voice, images, video, and audio. You will roleplay conversations, compare outputs, identify artifacts, and explain findings in clear written English. This is a 1099 freelance contract opportunity.
Key Responsibilities:
- Hold scenario-based conversations with AI voice models
- Compare generated images and videos against prompts
- Inspect outputs for visual, motion, text, and audio problems
- Rate adherence, quality, realism, and naturalness
- Write specific evidence-based explanations in English
Requirements:
- Fluent English and clear written communication
- Strong attention to detail and patience
- Comfort with natural conversational speech
- Experience writing short reviews or explanations
- Valid identification and mobile phone
Bring careful observation, conversational English, and evidence-based judgment to Outlier’s AI evaluation projects remotely.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote English AI Evaluator in Toronto, ON vacancy
$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: English Linguistic Experts Type:... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...Remote jobEnglish language skillsContract workSummer work$30 per hour
...technical talent with leading AI research labs. Headquartered in... ...$30/hour Location: Remote Commitment: 10 hours/week... ...questions, and correcting errors. Evaluate the experience and deliverables... ...Clear writing skills in English . Compensation & Legal...Remote jobEnglish language skillsHourly payWeekly payContract workFor contractorsSummer work- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...QA (a plus); Strong written English (C1+). This project is not...Remote workEnglish language skillsPart timeFor contractorsFlexible hours
$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: English Language and Literature Expert... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...Remote jobEnglish language skillsContract workSummer work$30 - $40 per hour
...technical talent with leading AI research labs. Headquartered in... ...$40/hour Location: Remote Role Responsibilities... ...queries each day to ensure timely evaluation. Provide short notes and... ...relevance. Strong written English skills. Careful...Remote workEnglish language skillsDaily paidFull timeContract workSummer workFlexible hours$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$30 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: English AI Safety Specialist Type... ...$30/hour Location: Remote Role Responsibilities... ...English-language conversations to evaluate AI responses . Apply appropriate...Remote jobEnglish language skillsContract workSummer work$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible for improving CoCounsel Legal by writing... ...case Build gold-standard datasets with SMEs, coordinate evaluations, and design evaluation schemes, including rubrics, metrics,...RemplacementFull timeWork at officeLocal areaFlexible hours$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...AI writing tools . Native English fluency required. Application...Remote jobContract workSummer work$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...with financial-services AI Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Native or professional fluency in English . ~ Highly proficient in...Remote jobContract workSummer workWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...with financial-services AI Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Native or professional fluency in English . ~ Highly proficient in...Remote jobContract workSummer workWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Software / AI / IT / data Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Native or professional fluency in English . ~ Highly proficient in...Remote jobContract workSummer workWork at office$39 per hour
...technical talent with leading AI research labs. Headquartered in... ...$39/hour Location: Remote Duration: Up to 6 months... ...Role Responsibilities Evaluate AI model output lyrics , voice... ...and follow directions in the English language for effective collaboration...Remote jobEnglish language skillsContract workSummer workImmediate start$140k - $175k per year
...is seeking a Lead Research Engineer to lead the design and delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation infrastructure that enables research and product teams to compare large language...Full timeInternshipWork at officeLocal areaFlexible hours$20 - $160 per hour
...technical talent with leading AI research labs. Headquartered in... ...AI Conversation Quality Evaluation Type: Contract... ...$160/hour Location: Remote Role Responsibilities... ...Must-Have Strong written English skills. Ability to explain...Remote jobEnglish language skillsContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$24 - $30 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: AI Session Annotator (English) Type: Contract... ...24–$30/hour Location: Remote Role Responsibilities... ...and spatial language use. Evaluate if the assistant appropriately...Remote jobEnglish language skillsContract workSummer workImmediate start$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $39/hour Location: Remote Commitment: 10 hours/week Role... ...assistants. ~ Clear written communication in English. Application Process (Takes 2030...Remote workEnglish language skillsFull timeContract workSummer work$39 per hour
...technical talent with leading AI research labs. Headquartered in... ...$39/hour Location: Remote Commitment: 10 hours/week... ...concise notes on performance. Evaluate AI model interactions to ensure... ...~ Ability to write clearly in English. Preferred ~...Remote job$57 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $57/hour Location: Remote Commitment: 10 hours/week Role... ...assistants . ~ Ability to write clearly in English . Compensation & Legal ~...Remote jobEnglish language skillsHourly payContract workFor contractorsSummer work$52.38 - $57.39 per hour
...Analytics, in the Policy and Strategic Planning Branch of Parks, Forestry & Recreation, the Evaluator, Programs will help design, plan, and lead the implementation of small and large evaluations, performance measurement frameworks, needs assessments, and applied research projects....Hourly payPermanent employmentFull timePart timeInternshipMonday to fridayShift work- ...agency (Facebook and Google ads management for contractors) that also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC-style ads for our ecommerce products and need someone who...Remote workHourly payOngoing contractFor contractorsFreelance
$120 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Software / AI / IT / data Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Native or professional fluency in English . ~ Highly proficient in...Remote jobContract workSummer workWork at office$42 per hour
...technical talent with leading AI research labs. Headquartered in... ...14–$42/hour Location: Remote Duration: Up to 6 months... ...Role Responsibilities Evaluate AI-generated music across... ...detailed written instructions in English . Experience as a songwriter...Remote jobEnglish language skillsContract workSummer workImmediate startFlexible hours$120 per hour
...technical talent with leading AI research labs. Headquartered in... ...QA / workbook maintenance Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...Native or professional fluency in English . ~ Highly proficient in...Remote jobContract workSummer workWork at office$150 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...Compensation: $150/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses on...Remote jobContract workSummer workImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote English AI Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON