Remote AI Voice & Media Quality Evaluator
Scale AI
Outlier, owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank how natural and clear exchanges are, and provide written explanations of issues, all remotely and on your own schedule.
Responsibilities include evaluating images, videos, captions, and audio, then rating dimensions like adherence and realism. This freelance role offers flexible hours and weekly payments in USD.
#J-18808-Ljbffr$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...legal expertise into practical, high-quality AI outputs. Key Responsibilities Create... ..., compliance, government, and media. Our products combine highly specialized...QualityRemplacementFull timeWork at officeLocal areaFlexible hours- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...Score the clinical reasoning quality of benchmark items: vignette accuracy...Remote workQualityPart timeFor contractorsFlexible hours
- ...changelog . About the Role Rootly is building the AI-native future of incident management, and we need someone... ...our AI to its limits before our customers do. As our AI Quality Engineer, you'll own the evaluation and optimization of Rootly's agentic AI features -- designing...QualityFull timeInternshipHome office
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...–$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created... ...established criteria to ensure quality and accuracy. Provide detailed...Remote jobQualityContract workSummer work$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobQualityContract workSummer workWork at office$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract... ...$80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobQualityContract workSummer workWork at office$30 - $50 per hour
...competitive advantage. Cresta’s unified AI platform combines... ...our AI Delivery team as AI Quality Assurance Interns . This is... ...hands-on role where you will evaluate the behavior, accuracy, and reliability... ...Intent recognition evaluation Conversation quality assessment...QualityHourly payInternshipWork at office$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ public administration Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual...Remote jobQualityContract workSummer workWork at office$30 - $40 per hour
...technical talent with leading AI research labs. Headquartered in... ...$40/hour Location: Remote Role Responsibilities... ...queries each day to ensure timely evaluation. Provide short notes and... ...annotations to enhance training data quality . Work independently...Remote workQualityDaily paidFull timeContract workSummer workFlexible hours$140k - $175k per year
...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build... ...compare large language models (LLMs), measure quality, cost, and latency, and make informed... ...accounting, compliance, government, and media. Our products combine highly specialized...QualityFull timeInternshipWork at officeLocal areaFlexible hours$39 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: $39/hour Location: Remote Duration: Up to 6 months... ...week Role Responsibilities Evaluate AI model output lyrics , voice generation, and other standards in music...Remote jobQualityContract workSummer workImmediate start$45 per hour
...technical talent with leading AI research labs. Headquartered in... ...French-Canadian Professional Voice Actor Type: Contract... ...–$300/hour Location: Remote Commitment: 2–10 hours... ...audio recording setup for high-quality submissions. Submit audio...Remote jobQualityContract workSummer work$70 per hour
...and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...to improve training data quality and downstream performance. Develop...Remote jobQualityContract workSummer work$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... ...: Software / AI / IT / data Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual...Remote jobQualityContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...–$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created... ...established criteria to ensure quality and consistency. Provide detailed...Remote jobQualityContract workSummer work$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities...Remote jobQualityContract workSummer work- ...looking for a Senior Programmable Voice Engineer to develop... ...capabilities, call control services, media processing, and API-driven communications... ..., media, telephony, and call-quality issues across distributed... .... Practical experience with AI-assisted software development or...Remote workQualityInternshipRelocation
- ...Quality Engineer (QE) / SDET – AI Chatbot Validation Job Description: We are looking for a seasoned AI first Senior Quality Engineer who is... ...deterministic and non-deterministic AI behavior, including evaluation datasets, expected behavior, quality thresholds, and...QualityContract work
$80 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $80/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex data engineering tasks. Review...Remote jobContract workSummer work$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $85/hour Location: Remote Role Responsibilities Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks....Remote jobContract workSummer work$70 per hour
...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include... ...: Contract Compensation: $70/hour Location: Remote Duration: 6 weeks Commitment: 20+ hours/week...Remote jobContract workSummer workImmediate start$120 - $170 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $120–$170/hour Location: Remote Role Responsibilities Design... ...~ Prior experience with AI training , evaluation, or human-data projects. Application...Remote jobContract workSummer work- ...eCommerce brands, 20 to 25 of them on paid media. We spend $6 to $9M a month on Meta and $1... ...number. You can live anywhere. We are remote and we hire worldwide. The one hard requirement... ...removes the constraint. We are heavy AI users and we expect you to build, not just...Remote workWorldwideShift work
$60 - $100 per hour
...technical talent with leading AI research labs. Headquartered in... ...Position: Marketing Expert — Social Media (AI Agent Environments)... ...–$100/hour Location: Remote Role Responsibilities... ...Review AI agent attempts and evaluate them against established standards...Remote jobContract workSummer work$150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Voice Actor: CX Agent Voice Cloning (... ...–$150/hour Location: Remote Commitment: 5–10 hours... ...Responsibilities Record high-quality voice samples across diverse...Remote jobQualityContract workSummer work10 hours per week$50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Voice Actor: CX Agent Voice Cloning (... ...$50/hour Location: Remote Commitment: 5–10 hours... ...Responsibilities Record high-quality voice samples across diverse...Remote jobQualityContract workSummer work10 hours per week$60k - $75k per year
...ROLE: MEDIA SPECIALIST TEAM: MEDIA LOCATION: TORONTO - HYBRID... ...combine strategic thinking with AI-powered tools, automation and... ...accountability of the media plan, regularly evaluating and monitoring execution to... ...presence in the agency; have a voice in meetings Awareness of...Full timeSeasonal work$86.1k - $136.1k per year
...efficient applications. We are looking for a Quality Engineer who is curious about emerging... ...digital solutions. You will have an active voice in a collaborative and supportive team where... ...Selenium, Xray, Postman, and JMeter. Use AI-enabled tools and practices to support test...QualityLong term contractTemporary workLocal areaFlexible hours$52.38 - $57.39 per hour
...Branch of Parks, Forestry & Recreation, the Evaluator, Programs will help design, plan, and... ...the implementation of small and large evaluations, performance measurement frameworks, needs... ..., improvement, and communication of quality of life outcomes for the public. Major...QualityHourly payPermanent employmentFull timePart timeInternshipMonday to fridayShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Voice & Media Quality Evaluator. Be the first to apply!
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON
