Remote AI Data Quality Evaluator
Scale AI
Outlier is seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange, compare generated images and videos to judge which follows the prompt better, and explain in writing what looked or sounded wrong, all remotely and on your own schedule.
At Outlier, your expertise helps shape how advanced AI systems reason, learn, and improve.
#J-18808-LjbffrVacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Data Quality Evaluator in Toronto, ON vacancy
$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...–$150/hour Location: Remote Role Responsibilities... ..., and technical reports. Evaluate AI-generated or human-created...Remote jobDataQualityContract workSummer work$80 - $120 per hour
...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors... ..., Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour...Remote jobDataQualityContract workSummer workWork at office$100 - $150 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Scientist Talent Network... ...–$150/hour Location: Remote Role Responsibilities... ...and A/B test write-ups . Evaluate AI-generated or human-created...Remote jobDataQualityContract workSummer work$80 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Engineer (Coding Agent Experience... ...$80/hour Location: Remote Role Responsibilities... ...coding agents to complete and evaluate complex data engineering tasks...Remote jobDataContract workSummer work$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...–$170/hour Location: Remote Role Responsibilities... ...experience with AI training , evaluation, or human-data projects....Remote jobDataContract workSummer work$30 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role... ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing...Remote jobHourly payWeekly payContract workFor contractorsSummer work$30 - $40 per hour
...technical talent with leading AI research labs. Headquartered in... ...30$40/hour Location: Remote Role Responsibilities... ...queries each day to ensure timely evaluation. Provide short notes and annotations... ...to enhance training data quality . Work independently...Remote workDataQualityDaily paidFull timeContract workSummer workFlexible hours- ...changelog . About the Role Rootly is building the AI-native future of incident management, and we need someone... ...our AI to its limits before our customers do. As our AI Quality Engineer, you'll own the evaluation and optimization of Rootly's agentic AI features -- designing...QualityFull timeInternshipHome office
- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...Score the clinical reasoning quality of benchmark items: vignette accuracy...Remote workQualityPart timeFor contractorsFlexible hours
$100 - $150 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...and Jack Dorsey . Position: Data Science Expert Type:... ...$100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability...Remote jobDataQualityContract workSummer workWork at office$126k - $176k per year
...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible... ...(SMEs), software engineers, and data scientists to make sure our products deliver... ...translate legal expertise into practical, high-quality AI outputs. Key Responsibilities...DataQualityRemplacementFull timeWork at officeLocal areaFlexible hours$110.5k - $143k per year
...Develop and execute comprehensive data governance strategy to ensure... ...with the line of business to evaluate KPI measurement needs. Communicate... ...procedures. Improve Data Quality Measure data quality for the... ...vacancy. Hydro One uses AI tools to assist in the...DataQuality$80 - $120 per hour
...technical talent with leading AI research labs. Headquartered in... .../ public administration Evaluator Type: Contract... ...$120/hour Location: Remote Role Responsibilities... ...artifacts against domain-specific quality rubrics. Identify factual...Remote jobQualityContract workSummer workWork at office$30 - $50 per hour
...competitive advantage. Cresta’s unified AI platform combines... ...our AI Delivery team as AI Quality Assurance Interns . This is... ...hands-on role where you will evaluate the behavior, accuracy, and reliability... ...Intent recognition evaluation Conversation quality assessment...QualityHourly payInternshipWork at office$120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobDataQualityContract workSummer workWork at office$140k - $175k per year
...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build... ...compare large language models (LLMs), measure quality, cost, and latency, and make informed... ...repeatable experiments, separate evaluation data from model development, and make results...DataQualityFull timeInternshipWork at officeLocal areaFlexible hours- ...specific details for this role. Job Description: CUSTOMER Perform data analysis and assist in assessing data management requirements for... ...data, including knowledge provided through data profiling, data quality reporting, and via the production of metadata Support the...DataQualityFull timeWork from home
- ...What you’ll be doing The Analyst will support the Director of Data Quality and Reconciliations team, Treasury Data Management to ensure... ...you’ll spend 1-3 days per week on-site, while other days will be remote. How you'll succeed Accountability- Take accountability...DataQualityWork at office3 days per week1 day per week
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobDataQualityContract workSummer workWork at office$70 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to... ...written feedback to improve training data quality and downstream performance....Remote jobDataQualityContract workSummer work$39 per hour
...technical talent with leading AI research labs. Headquartered in... ...$39/hour Location: Remote Duration: Up to 6 months... ...Role Responsibilities Evaluate AI model output lyrics , voice... ...standards in music. Score the quality of musical training data to...Remote jobDataQualityContract workSummer workImmediate start$165k - $175k per year
...Responsibilities Define and execute an integrated AI and data roadmap in partnership with business and... ...against budgets, timelines, and quality standards, and apply agile methods... ...RAG, agentic workflows, prompt and model evaluation, vector search, and guardrails. Oversee...DataQualityManual labor$110k - $160k per year
...working world for all. As AI Engineer, you will design and build... ..., multi-agent coordination, evaluation frameworks, observability and... ...Architect, AI Platform Engineers, and Data Scientists to translate complex... ...to measure AI solution quality, consistency, and implement telemetry...DataQualityLong term contract- ...suggestions that will ensure client needs are met with the highest quality. As a Data Test Coordinator, you’ll be a team lead on CIBC’s Technology... ...’ll spend 1-3 days per week on-site, while other days will be remote. How You'll Succeed Testing Expertise – Lead the...DataQualityPermanent employmentFull time3 days per week1 day per week
$20 - $160 per hour
...creative and technical talent with leading AI research labs. Headquartered in San... ...Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities...Remote jobQualityContract workSummer work$120 - $170 per hour
...technical talent with leading AI research labs. Headquartered in... ...Jack Dorsey . Position: Data Science Expert Type:... ...–$170/hour Location: Remote Role Responsibilities... ...teams to improve training data quality and downstream performance....Remote jobDataQualityContract workSummer work$110k - $150k per year
...give you the space to grow. About the Role We are seeking AI Data Protection Architects to contribute to major projects. The Data... ...while enabling secure and responsible data usage. The role will be remote. Why Join Levio? Work on complex, high impact digital...Remote workDataPermanent employmentFull timeFlexible hours$120 - $180 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: Senior Data Scientist and Data Engineering... ...–$180/hour Location: Remote Role Responsibilities... ...submitted work. Train and evaluate frontier AI models using expertise...Remote jobDataContract workSummer work- ...AI-Aware Data Engineer (Oracle, PostgreSQL & Azure) About the Role As an AI-Aware Data Engineer, you will make an impact by designing,... ...process documentation, and operational procedures. Prepare high-quality, AI-ready datasets, metadata assets, and curated data...DataQualityWork at officeDay shift3 days per week
$20 - $50 per hour
...technical talent with leading AI research labs. Headquartered in... ...Dorsey . Position: Quality Analyst Type: Contract... ...–$50/hour Location: Remote Role Responsibilities... ...quality processes, checklists, and evaluation criteria. Collaborate asynchronously...Remote jobDataQualityContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Data Quality Evaluator. Be the first to apply!
Related searches
- admissions evaluator Toronto, ON
- évaluateur-estimateur Toronto, ON
- remote social media evaluator Toronto, ON
- estimateur - dessinateur Toronto, ON
- test evaluator Toronto, ON
- estimateur automobile Toronto, ON
- estimateur en bâtiment Toronto, ON
- estimateur structure Toronto, ON
- estimateur industriel Toronto, ON
- chargé de projet estimateur Toronto, ON