Remote AI Content Evaluator
Scale AI
Evaluate AI-generated media remotely on your own schedule using fluent English, close observation, and evidence-based written feedback.
Outlier, Scale AI’s AI training platform, seeks detail-oriented English speakers to assess voice, image, video, and audio outputs. You will roleplay conversations, compare media against prompts, identify artifacts, and explain decisions clearly. Your evaluations support model improvement.
Key Responsibilities:
- Conduct live scenario-based conversations with AI voice models
- Compare generated images and videos against text prompts
- Inspect outputs for visual, motion, text, and audio problems
- Rate adherence, quality, realism, and conversational performance
- Write specific English explanations supporting evaluation decisions
Requirements:
- Fluent English with clear written communication
- Strong attention to detail and patience
- Comfort with natural conversational situations
- Experience writing short evidence-based explanations
- Ability to decide when both options have flaws
Apply your English communication, media judgment, and careful analysis to evaluate AI outputs for Outlier projects.
#J-18808-LjbffrVacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Content Evaluator in Toronto, ON vacancy
$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...medical AI evaluation, clinical content or exam-question review, or medical...Remote workContentPart timeFor contractorsFlexible hours
$50 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobContentContract workSummer workFlexible hours$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...datasets with SMEs, coordinate evaluations, and design evaluation schemes, including... ...originate (prompting, tooling, retrieval, or content), and provide strategic feedback to...ContentRemplacementFull timeWork at officeLocal areaFlexible hours$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$85k - $125k per year
...More than 10,000 businesses are running AI agents on Chatbase. We started with self-serve, and now we're moving upmarket and building... ...profitable. The role This is a product marketing role focused on content. You'll work closely with product, push new features to their...ContentInternship$30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct... ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations...Remote workDaily paidFull timeContract workSummer workFlexible hours$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the...ContentFull timeInternshipWork at officeLocal areaFlexible hours$20 - $160 per hour
...technical talent with leading AI research labs. Headquartered in... ...AI Conversation Quality Evaluation Type: Contract... ...$160/hour Location: Remote Role Responsibilities... ...human-feedback, evaluation, or content review. Background in explaining...Remote jobContentContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Contract Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to strengthen reasoning and...Remote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $39/hour Location: Remote Duration: Up to 6 months... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobContract workSummer workImmediate start$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Marketing Expert — Content Marketing (AI Agent Environments... ...–$100/hour Location: Remote Role Responsibilities... ...them against your standards. Evaluate AI-generated content to improve...Remote jobContentContract workSummer work$120k - $150k per year
...Type: On-site Department: Content Salary: $120,000 – $150,000... ...as locations double Use AI aggressively across ideation,... ...videographers or content crews remotely and across time zones, including... ...including to screen, assess, or evaluate applicants. POSITION STATUS...Remote workContentPermanent employmentFull timeContract workSummer workFreelanceSeasonal workWork at officeNight shift$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$75 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Content Designer Type: Contract Compensation... ...: $75/hour Location: Remote Commitment: 25 hours/week...Remote jobContentHourly payContract workFor contractorsSummer work- ...Chatbot Content Developer – Documentation Modernization & AI Enablement Work Arrangement: 1 day onsite per week Experience Required: 6–8 years Role Description Key Roles & Responsibilities Review, analyze, and improve technical documentation used...ContentPermanent employment1 day per week
- ...also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC... ...application. - Experience with UGC-style ecommerce ad content is a plus. Duration: Freelance, per-project. First...Remote workContentHourly payOngoing contractFor contractorsFreelance
$75k - $100k per year
...Financial Services Marketplace, and a content business across Ratehub and... ...insights, and emerging AI search data to identify opportunities... ...Use performance insights to evaluate results and recommend improvements... ...and the Canadian market. Remote-First Environment : The flexibility...Remote workContentFull timeFlexible hours$72.5k - $92.9k per year
...Location TORONTO GO Job Description As the Content Editor, you will transform assets and... ...and social demands Test and learn with AI-driven content Stay close to social trends... ...[ et complétez votre candidature ET les évaluations le plus tôt possible, car nous examinons...ContentFull timeLocal areaImmediate start$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... ...Edit, refine, or rewrite French content to meet linguistic and cultural...Remote jobContentContract workSummer work$85k - $100k per year
...Job Title: Content Marketing Manager Primary Job Location: Hybrid, three days per week, Toronto / Greater Toronto Area (GTA), Ontario,... ...lead who owns HubSpot configuration and funnel reporting. We use AI extensively for research, drafting, repurposing and analysis, with...ContentLong term contractPermanent employmentFull timeInternshipWork at officeImmediate startFlexible hours3 days per week- ...and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG,... ...shape the future! Why this role?Evaluation is critical to making progress in... ...time, and workspace improvement ~? Remote-flexible, offices in Toronto, New...Remote workContentFull timeWork at officeFlexible hours
$36 per hour
...technical talent with leading AI research labs. Headquartered in... ...$36/hour Location: Remote Commitment: 10 hours/... ...Enhance AI model training by evaluating outputs against professional standards... ...experience in marketing content production or design. ~...Remote workContentFull timeContract workSummer workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Content Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON