AI Media Evaluation Expert
Scale AI
Evaluate AI-generated media remotely on your own schedule using fluent English, careful listening, and close visual inspection skills. Your feedback helps improve AI model performance.
Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers for freelance evaluation projects. You will roleplay conversations with AI voice models, compare images and videos, and explain findings in writing. Tasks may also include caption labeling and audio evaluations.
Key Responsibilities:
- Hold scenario-based conversations with AI voice models
- Compare generated images and videos against prompts
- Inspect outputs for visual, motion, text, and audio problems
- Rate adherence, quality, realism, and naturalness
- Write specific evidence-based explanations in English
Requirements:
- Fluent English and clear written communication
- Strong attention to detail and patience
- Comfort with natural conversational speech
- Experience writing short evidence-based reviews
- Valid ID, mobile phone, resume, and LinkedIn profile
Apply your English communication, media judgment, and evidence-based writing skills to evaluate AI outputs for Outlier.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Media Evaluation Expert in Toronto, ON vacancy
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...Collaborate with subject matter experts to ensure consistency and relevance...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ..., Larry Summers , and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract Compensation: $80–$120...SuggestedRemote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., and Jack Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour...SuggestedRemote jobContract workSummer workWork at office$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ..., and Jack Dorsey . Position: Mathematics PhD Coding Experts Type: Contract Compensation: $70/hour Location...SuggestedRemote jobContract workSummer workImmediate start$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...SuggestedRemote jobContract workSummer work$39 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...experience and deliverables, providing concise notes on performance. Evaluate AI model interactions to ensure alignment with professional...Remote job$39 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey . Position: Healthcare...Full timeContract workSummer workRemote work$57 per hour
...About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position...Remote jobHourly payContract workFor contractorsSummer work$60 - $100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Marketing Expert — Social Media (AI Agent Environments) Type: Contract... ...ones. Review AI agent attempts and evaluate them against established standards....Remote jobContract workSummer work$50 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: French Linguistic Experts Type: Contract Compensation... ...Remote Role Responsibilities Evaluate the quality and accuracy of LLM-generated...Remote jobContract workSummer work$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses on challenging...Remote jobContract workSummer workImmediate start$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...with specialized legal subject matter experts (SMEs), software engineers, and data... ...accounting, compliance, government, and media. Our products combine highly specialized...RemplacementFull timeWork at officeLocal areaFlexible hours$150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Healthcare Expert Type: Contract Compensation... ...hours/week Role Responsibilities Evaluate and compare AI-generated responses to challenging...Remote jobContract workSummer workImmediate startFlexible hours$140k - $175k per year
...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build... ...accounting, compliance, government, and media. Our products combine highly specialized... ...Human Resources Department at HR.Leave-Expert@thomsonreuters.com. Disability accommodations...Full timeInternshipWork at officeLocal areaFlexible hours$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Data Science Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Remote jobContract workSummer workWork at office$30 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors... ...tasks guiding it answering questions and correcting errors. Evaluate the experience and deliverables providing concise feedback on performance...Hourly payWeekly payFull timeContract workFor contractorsSummer workRemote work- ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based... ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the...Part timeFor contractorsRemote workFlexible hours
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...pipelines , and technical reports. Evaluate AI-generated or human-created work against... ...Provide detailed written justifications for evaluations and scores to maintain transparency....Remote jobContract workSummer work$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Language and Literature Expert Type: Contract... ...Role Responsibilities Evaluate the quality and accuracy of LLM... ...linguistic annotation, language evaluation, or NLP data work in English...Remote jobContract workSummer work$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software Engineer Expert Type: Contract Compensation... ...Remote Role Responsibilities Evaluate AI-generated artifacts for usability in...Remote jobContract workSummer workWork at office$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... .... Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Position: Pricing / ROI / revenue economics Evaluator Type: Contract Compensation... ...meet deadlines and ensure high-quality evaluations. Qualifications Must-Have...Remote jobContract workSummer workWork at office$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: B2B Sales Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$70 - $100 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Summers , and Jack Dorsey . Position: Business Domain Expert — AI Model Evaluation Pilot (Admin, Marketing, HR, Accounting) Type:...Remote jobContract workSummer workInternship$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Finance operations / audit support Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at office$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Sales Engineering Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$14 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Music Audio Expert - Telugu Type: Contract Compensation... .../week Role Responsibilities Evaluate AI model output lyrics , voice...Remote jobContract workSummer workImmediate start$50 - $70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Jack Dorsey . Position: Generalist Expert (US/Canada) Type: Contract... ...Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobContract workSummer workFlexible hours$80 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Design Expert Type: Contract Compensation... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$80 - $120 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ...Jack Dorsey . Position: Biology / environmental science Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobContract workSummer workWork at officeFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Media Evaluation Expert. Be the first to apply!
