Remote AI Voice Evaluator & Media Quality Rater
Scale AI
Outlier, an AI evaluation platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and write precise explanations of issues found.
This is a remote, flexible, freelance opportunity with weekly payments and a performance-based incentive structure. You will evaluate images, videos, captions, and audio, providing evidence-based feedback.
#J-18808-Ljbffr$30 - $35 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $30–$35/hour Location: Remote Role Responsibilities Use Meta... ...in an ongoing study with the same group of raters each week. Work independently and asynchronously...Remote jobContract workSummer work$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...legal expertise into practical, high-quality AI outputs. Key Responsibilities Create... ..., compliance, government, and media. Our products combine highly specialized...QualityRemplacementFull timeWork at officeLocal areaFlexible hours- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...Score the clinical reasoning quality of benchmark items: vignette accuracy...Remote workQualityPart timeFor contractorsFlexible hours
- ...changelog . About the Role Rootly is building the AI-native future of incident management, and we need someone... ...our AI to its limits before our customers do. As our AI Quality Engineer, you'll own the evaluation and optimization of Rootly's agentic AI features -- designing...QualityFull timeInternshipHome office
$30 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Role Responsibilities Evaluate pairs of AI-generated images... ...based on prompt alignment, visual quality, anatomy, structure, rendered text,...Remote jobQualityHourly payWeekly payContract workFor contractorsSummer work$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...–$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...established criteria to ensure quality and accuracy. Provide detailed...Remote jobQualityContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobQualityContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobQualityContract workSummer workWork at office$30 - $50 per hour
...competitive advantage. Cresta’s unified AI platform combines... ...our AI Delivery team as AI Quality Assurance Interns . This is... ...hands-on role where you will evaluate the behavior, accuracy, and reliability... ...Intent recognition evaluation Conversation quality assessment...QualityHourly payInternshipWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ public administration Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual...Remote jobQualityContract workSummer workWork at office$30 - $40 per hour
...technical talent with leading AI research labs. Headquartered in... ...$40/hour Location: Remote Role Responsibilities... ...queries each day to ensure timely evaluation. Provide short notes and... ...annotations to enhance training data quality . Work independently...Remote workQualityDaily paidFull timeContract workSummer workFlexible hours$140k - $175k per year
...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build... ...compare large language models (LLMs), measure quality, cost, and latency, and make informed... ...accounting, compliance, government, and media. Our products combine highly specialized...QualityFull timeInternshipWork at officeLocal areaFlexible hours- ...Clinical Independent Rater - French Speaking Location: Remote/Virtual (Canada) Hours: Estimated 10–16 hours... ...cutting-edge technology to deliver high-quality data and insights that shape the... ...practices. Responsibilities include evaluating assessment quality, engaging in...Remote workQuality16 hoursFull timePart timeWork at officeImmediate startWorldwide
$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: $39/hour Location: Remote Duration: Up to 6 months... ...week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards in music...Remote jobQualityContract workSummer workImmediate start$45 per hour
...technical talent with leading AI research labs. Headquartered in... ...French-Canadian Professional Voice Actor Type: Contract... ...–$300/hour Location: Remote Commitment: 2–10 hours... ...audio recording setup for high-quality submissions. Submit audio...Remote jobQualityContract workSummer work$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...to improve training data quality and downstream performance. Develop...Remote jobQualityContract workSummer work$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Software / AI / IT / data Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual...Remote jobQualityContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...–$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...established criteria to ensure quality and consistency. Provide detailed...Remote jobQualityContract workSummer work$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities...Remote jobQualityContract workSummer work- ...looking for a Senior Programmable Voice Engineer to develop... ...capabilities, call control services, media processing, and API-driven communications... ..., media, telephony, and call-quality issues across distributed... .... Practical experience with AI-assisted software development or...Remote workQualityInternshipRelocation
- ...Quality Engineer (QE) / SDET – AI Chatbot Validation Job Description: We are looking for a seasoned AI first Senior Quality Engineer who is... ...deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and...QualityContract work
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work- ...eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1... ...number. You can live anywhere. We are remote and we hire worldwide. The one hard requirement... ...removes the constraint. We are heavy AI users and we expect you to build, not just...Remote workWorldwideShift work
$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Marketing Expert — Social Media (AI Agent Environments)... ...–$100/hour Location: Remote Role Responsibilities... ...Review AI agent attempts and evaluate them against established standards...Remote jobContract workSummer work$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Voice Actor: CX Agent Voice Cloning (... ...–$150/hour Location: Remote Commitment: 5–10 hours... ...Responsibilities Record high-quality voice samples across diverse...Remote jobQualityContract workSummer work10 hours per week$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Voice Actor: CX Agent Voice Cloning (... ...$50/hour Location: Remote Commitment: 5–10 hours... ...Responsibilities Record high-quality voice samples across diverse...Remote jobQualityContract workSummer work10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Voice Evaluator & Media Quality Rater. Be the first to apply!
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
