Remote AI Content Evaluator
Scale AI
Review AI-generated media remotely on your own schedule using fluent English, careful observation, and evidence-based judgment. Evaluate voices, images, videos, and captions.
Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers. You will assess model outputs, identify errors, and explain decisions clearly in writing. The work supports evaluation and feedback for AI systems.
Key Responsibilities:
- Hold English conversations with AI voice models
- Rank speech for naturalness, usefulness, and clarity
- Compare images and videos against text prompts
- Inspect outputs for visual, motion, text, and audio problems
- Write specific explanations supporting evaluation ratings
Requirements:
- Fluent English and clear written communication
- Strong attention to detail and patience
- Comfort with natural conversational situations
- Experience writing evidence-based explanations or reviews
- Ability to choose between flawed alternatives
Apply careful English communication and media evaluation skills to help Outlier improve advanced AI systems remotely.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Content Evaluator in Toronto, ON vacancy
- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...medical AI evaluation, clinical content or exam-question review, or medical...Remote workContentPart timeFor contractorsFlexible hours
$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...datasets with SMEs, coordinate evaluations, and design evaluation schemes, including... ...originate (prompting, tooling, retrieval, or content), and provide strategic feedback to...ContentRemplacementFull timeWork at officeLocal areaFlexible hours$50 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobContentContract workSummer workFlexible hours$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct... ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations...Remote workDaily paidFull timeContract workSummer workFlexible hours$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the...ContentFull timeInternshipWork at officeLocal areaFlexible hours- ...system spans everything from Paid Media and Content Marketing, to PR and Paid Social, to... ...industry trends, including actively learning how AI and automation can enhance marketing and... ...! Work Environment Requirements As a remote-first company, you’ll have the ability to...Remote workContentWork at officeWork from homeHome office
$20 - $160 per hour
...technical talent with leading AI research labs. Headquartered in... ...AI Conversation Quality Evaluation Type: Contract... ...$160/hour Location: Remote Role Responsibilities... ...human-feedback, evaluation, or content review. Background in explaining...Remote jobContentContract workSummer work$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...accurate application of structured evaluation guidelines. Work...Remote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $39/hour Location: Remote Duration: Up to 6 months... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobContract workSummer workImmediate start$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Marketing Expert — Content Marketing (AI Agent Environments... ...–$100/hour Location: Remote Role Responsibilities... ...them against your standards. Evaluate AI-generated content to improve...Remote jobContentContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work- ...Chatbot Content Developer – Documentation Modernization & AI Enablement Work Arrangement: 1 day onsite per week Experience Required: 6–8 years Role Description Key Roles & Responsibilities Review, analyze, and improve technical documentation used...ContentPermanent employment1 day per week
$75 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Content Designer Type: Contract Compensation... ...: $75/hour Location: Remote Commitment: 25 hours/week...Remote jobContentHourly payContract workFor contractorsSummer work$75k - $100k per year
...Financial Services Marketplace, and a content business across Ratehub and... ...insights, and emerging AI search data to identify opportunities... ...Use performance insights to evaluate results and recommend improvements... ...and the Canadian market. Remote-First Environment : The flexibility...Remote workContentFull timeFlexible hours$72.5k - $92.9k per year
...Location TORONTO GO Job Description As the Content Editor, you will transform assets and... ...and social demands Test and learn with AI-driven content Stay close to social trends... ...[ et complétez votre candidature ET les évaluations le plus tôt possible, car nous examinons...ContentFull timeLocal areaImmediate start- ...also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC... ...application. - Experience with UGC-style ecommerce ad content is a plus. Duration: Freelance, per-project. First...Remote workContentHourly payOngoing contractFor contractorsFreelance
$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... ...Edit, refine, or rewrite French content to meet linguistic and cultural...Remote jobContentContract workSummer work- ...and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG,... ...shape the future! Why this role?Evaluation is critical to making progress in... ...time, and workspace improvement ~? Remote-flexible, offices in Toronto, New...Remote workContentFull timeWork at officeFlexible hours
$85k - $100k per year
...Job Title: Content Marketing Manager Primary Job Location: Hybrid, three days per week, Toronto / Greater Toronto Area (GTA), Ontario,... ...lead who owns HubSpot configuration and funnel reporting. We use AI extensively for research, drafting, repurposing and analysis, with...ContentLong term contractPermanent employmentFull timeInternshipWork at officeImmediate startFlexible hours3 days per week$36 per hour
...technical talent with leading AI research labs. Headquartered in... ...$36/hour Location: Remote Commitment: 10 hours/... ...Enhance AI model training by evaluating outputs against professional standards... ...experience in marketing content production or design. ~...Remote workContentFull timeContract workSummer workFlexible hours$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $39/hour Location: Remote Commitment: 10 hours/week Role... ...providing concise notes on performance. Evaluate AI model interactions to ensure alignment...Remote job
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Content Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON