Remote AI Content Evaluator
Scale AI
Evaluate AI-generated conversations, images, videos, and audio remotely while choosing your own schedule as an English-speaking Outlier Expert.
Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for varied AI evaluation projects. You will score model outputs, compare media against prompts, inspect artifacts, and write evidence-based explanations in English. The work supports evaluation and feedback for advanced AI systems.
Key Responsibilities:
- Hold scenario-based conversations with AI voice models
- Compare generated images and videos against prompts
- Inspect outputs for visual, motion, text, and audio problems
- Rate adherence, quality, and realism across outputs
- Explain evaluation decisions clearly in English
Requirements:
- Fluent English and clear written communication
- Strong attention to detail and patience
- Comfort with natural conversational situations
- Experience writing concise, evidence-based reviews
- Valid ID, mobile phone, resume, and LinkedIn profile
Apply English communication, careful observation, and evidence-based judgment to help Outlier improve advanced AI models.
#J-18808-LjbffrVacancy posted 19 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Content Evaluator in Toronto, ON vacancy
- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...medical AI evaluation, clinical content or exam-question review, or medical...Remote workContentPart timeFor contractorsFlexible hours
$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$50 - $70 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our... ...Compensation: $50–$70/hour Location: Remote Role Responsibilities Review and evaluate documents, slides, spreadsheets, and similar...Remote jobContentContract workSummer workFlexible hours$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...datasets with SMEs, coordinate evaluations, and design evaluation schemes, including... ...originate (prompting, tooling, retrieval, or content), and provide strategic feedback to...ContentRemplacementFull timeWork at officeLocal areaFlexible hours$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$85k - $125k per year
...More than 10,000 businesses are running AI agents on Chatbase. We started with self-serve, and now we're moving upmarket and building... ...profitable. The role This is a product marketing role focused on content. You'll work closely with product, push new features to their...ContentInternship$30 - $40 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30$40/hour Location: Remote Role Responsibilities Conduct... ...assigned queries each day to ensure timely evaluation. Provide short notes and annotations...Remote workDaily paidFull timeContract workSummer workFlexible hours$140k - $175k per year
...delivery of production-ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable evaluation... ...Reuters informs the way forward by bringing together the trusted content and technology that people and organizations need to make the...ContentFull timeInternshipWork at officeLocal areaFlexible hours$20 - $160 per hour
...technical talent with leading AI research labs. Headquartered in... ...AI Conversation Quality Evaluation Type: Contract... ...$160/hour Location: Remote Role Responsibilities... ...human-feedback, evaluation, or content review. Background in explaining...Remote jobContentContract workSummer work$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...accurate application of structured evaluation guidelines. Work...Remote jobContract workSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...detailed written justifications for evaluations and scores to maintain...Remote jobContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...response with financial-services AI Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $39/hour Location: Remote Duration: Up to 6 months... ...hours/week Role Responsibilities Evaluate AI model output lyrics , voice generation...Remote jobContract workSummer workImmediate start$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Marketing Expert — Content Marketing (AI Agent Environments... ...–$100/hour Location: Remote Role Responsibilities... ...them against your standards. Evaluate AI-generated content to improve...Remote jobContentContract workSummer work$120k - $150k per year
...Type: On-site Department: Content Salary: $120,000 – $150,000... ...as locations double Use AI aggressively across ideation,... ...videographers or content crews remotely and across time zones, including... ...including to screen, assess, or evaluate applicants. POSITION STATUS...Remote workContentPermanent employmentFull timeContract workSummer workFreelanceSeasonal workWork at officeNight shift$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work$75 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Summers , and Jack Dorsey . Position: Content Designer Type: Contract Compensation... ...: $75/hour Location: Remote Commitment: 25 hours/week...Remote jobContentHourly payContract workFor contractorsSummer work- ...Chatbot Content Developer – Documentation Modernization & AI Enablement Work Arrangement: 1 day onsite per week Experience Required: 6–8 years Role Description Key Roles & Responsibilities Review, analyze, and improve technical documentation used...ContentPermanent employment1 day per week
- ...also runs its own ecommerce stores. We are hiring an AI video creator (freelance, per-project, remote). About the role: We are building AI-generated UGC... ...application. - Experience with UGC-style ecommerce ad content is a plus. Duration: Freelance, per-project. First...Remote workContentHourly payOngoing contractFor contractorsFreelance
$75k - $100k per year
...Financial Services Marketplace, and a content business across Ratehub and... ...insights, and emerging AI search data to identify opportunities... ...Use performance insights to evaluate results and recommend improvements... ...and the Canadian market. Remote-First Environment : The flexibility...Remote workContentFull timeFlexible hours$72.5k - $92.9k per year
...Location TORONTO GO Job Description As the Content Editor, you will transform assets and... ...and social demands Test and learn with AI-driven content Stay close to social trends... ...[ et complétez votre candidature ET les évaluations le plus tôt possible, car nous examinons...ContentFull timeLocal areaImmediate start$50 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... ...Edit, refine, or rewrite French content to meet linguistic and cultural...Remote jobContentContract workSummer work$85k - $100k per year
...Job Title: Content Marketing Manager Primary Job Location: Hybrid, three days per week, Toronto / Greater Toronto Area (GTA), Ontario,... ...lead who owns HubSpot configuration and funnel reporting. We use AI extensively for research, drafting, repurposing and analysis, with...ContentLong term contractPermanent employmentFull timeInternshipWork at officeImmediate startFlexible hours3 days per week- ...and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG,... ...shape the future! Why this role?Evaluation is critical to making progress in... ...time, and workspace improvement ~? Remote-flexible, offices in Toronto, New...Remote workContentFull timeWork at officeFlexible hours
$36 per hour
...technical talent with leading AI research labs. Headquartered in... ...$36/hour Location: Remote Commitment: 10 hours/... ...Enhance AI model training by evaluating outputs against professional standards... ...experience in marketing content production or design. ~...Remote workContentFull timeContract workSummer workFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Content Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON