Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Data Quality Evaluator

$15 per hour

Scale AI

Scale AI's Outlier platform seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model and score naturalness, then explain in writing what looked or sounded off, all on a flexible schedule.

Responsibilities include comparing AI-produced images and videos to prompts, inspecting outputs for issues, and providing concise English explanations. This freelance role offers up to $15 per hour with weekly payments.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Data Quality Evaluator in Toronto, ON vacancy
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Scientist Talent Network...  ...–$150/hour Location: Remote Role Responsibilities...  ..., and technical reports. Evaluate AI-generated or human-created... 
    Remote job
    Data
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $80 - $120 per hour

     ...connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors...  ..., Larry Summers , and Jack Dorsey . Position: Data quality / CRM operations Evaluator Type: Contract Compensation: $80–$120/hour... 
    Remote job
    Data
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Scientist Talent Network...  ...–$150/hour Location: Remote Role Responsibilities...  ...and A/B test write-ups . Evaluate AI-generated or human-created... 
    Remote job
    Data
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Engineer (Coding Agent Experience...  ...$80/hour Location: Remote Role Responsibilities...  ...coding agents to complete and evaluate complex data engineering tasks... 
    Remote job
    Data
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $120 - $170 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Science Expert Type:...  ...–$170/hour Location: Remote Role Responsibilities...  ...experience with AI training , evaluation, or human-data projects.... 
    Remote job
    Data
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role...  ...answering questions, and correcting errors. Evaluate the experience and deliverables, providing... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...Score the clinical reasoning quality of benchmark items: vignette accuracy... 
    Remote work
    Quality
    Part time
    For contractors
    Flexible hours

    Mindrift

    Toronto, ON
    4 days ago
  •  ...changelog . About the Role Rootly is building the AI-native future of incident management, and we need someone...  ...our AI to its limits before our customers do. As our AI Quality Engineer, you'll own the evaluation and optimization of Rootly's agentic AI features -- designing... 
    Quality
    Full time
    Internship
    Home office

    Rootly

    Toronto, ON
    1 day ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  ...(SMEs), software engineers, and data scientists to make sure our products deliver...  ...translate legal expertise into practical, high-quality AI outputs. Key Responsibilities... 
    Data
    Quality
    Remplacement
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 hours ago
  • $100 - $150 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Data Science Expert Type:...  ...$100–$150/hour Location: Remote Role Responsibilities Evaluate AI-generated artifacts for usability... 
    Remote job
    Data
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    29 days ago
  • $30 - $40 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...30$40/hour Location: Remote Role Responsibilities...  ...queries each day to ensure timely evaluation. Provide short notes and annotations...  ...to enhance training data quality . Work independently... 
    Remote work
    Data
    Quality
    Daily paid
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    1 day ago
  • $110.5k - $143k per year

     ...Develop and execute comprehensive data governance strategy to ensure...  ...with the line of business to evaluate KPI measurement needs. Communicate...  ...procedures. Improve Data Quality Measure data quality for the...  ...vacancy.    Hydro One uses AI tools to assist in the... 
    Data
    Quality

    Hydro One Networks Inc

    Toronto, ON
    19 hours ago
  • $30 - $50 per hour

     ...competitive advantage. Cresta’s unified AI platform combines...  ...our  AI Delivery team as  AI Quality Assurance Interns . This is...  ...hands-on role where you will evaluate the behavior, accuracy, and reliability...  ...Intent recognition evaluation Conversation quality assessment... 
    Quality
    Hourly pay
    Internship
    Work at office

    Cresta

    Toronto, ON
    1 day ago
  • $80 - $120 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .../ public administration Evaluator Type: Contract...  ...$120/hour Location: Remote Role Responsibilities...  ...artifacts against domain-specific quality rubrics. Identify factual... 
    Remote job
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $140k - $175k per year

     ...ready software for artificial intelligence (AI) model evaluation and benchmarking. You will build...  ...compare large language models (LLMs), measure quality, cost, and latency, and make informed...  ...repeatable experiments, separate evaluation data from model development, and make results... 
    Data
    Quality
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 days ago
  •  ...specific details for this role. Job Description: CUSTOMER Perform data analysis and assist in assessing data management requirements for...  ...data, including knowledge provided through data profiling, data quality reporting, and via the production of metadata Support the... 
    Data
    Quality
    Full time
    Work from home

    TD

    Toronto, ON
    4 days ago
  • $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Data
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...What you’ll be doing  The Analyst will support the Director of Data Quality and Reconciliations team, Treasury Data Management to ensure...  ...you’ll spend 1-3 days per week on-site, while other days will be remote. How you'll succeed Accountability- Take accountability... 
    Data
    Quality
    Work at office
    3 days per week
    1 day per week

    CIBC

    Toronto, ON
    1 day ago
  • $165k - $175k per year

     ...Responsibilities Define and execute an integrated AI and data roadmap in partnership with business and...  ...against budgets, timelines, and quality standards, and apply agile methods...  ...RAG, agentic workflows, prompt and model evaluation, vector search, and guardrails. Oversee... 
    Data
    Quality
    Manual labor

    TSX Inc.

    Toronto, ON
    1 day ago
  • $110k - $160k per year

     ...working world for all.  As AI Engineer, you will design and build...  ..., multi-agent coordination, evaluation frameworks, observability and...  ...Architect, AI Platform Engineers, and Data Scientists to translate complex...  ...to measure AI solution quality, consistency, and implement telemetry... 
    Data
    Quality
    Long term contract

    Ernst & Young

    Toronto, ON
    1 day ago
  • $70 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...: $70/hour Location: Remote Role Responsibilities Evaluate AI-generated responses to...  ...written feedback to improve training data quality and downstream performance.... 
    Remote job
    Data
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: Software / AI / IT / data Evaluator Type: Contract Compensation: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Data
    Quality
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $39 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$39/hour Location: Remote Duration: Up to 6 months...  ...Role Responsibilities Evaluate AI model output lyrics , voice...  ...standards in music. Score the quality of musical training data to... 
    Remote job
    Data
    Quality
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...suggestions that will ensure client needs are met with the highest quality. As a Data Test Coordinator, you’ll be a team lead on CIBC’s Technology...  ...’ll spend 1-3 days per week on-site, while other days will be remote. How You'll Succeed Testing Expertise – Lead the... 
    Data
    Quality
    Permanent employment
    Full time
    3 days per week
    1 day per week

    CIBC

    Toronto, ON
    3 days ago
  • $120 - $170 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Jack Dorsey . Position: Data Science Expert Type:...  ...–$170/hour Location: Remote Role Responsibilities...  ...teams to improve training data quality and downstream performance.... 
    Remote job
    Data
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Generalist Annotator — Health AI Conversation Quality Evaluation Type: Contract Compensation: $20–$160/hour Location: Remote Role Responsibilities... 
    Remote job
    Quality
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  •  ...AI-Aware Data Engineer (Oracle, PostgreSQL & Azure) About the Role As an AI-Aware Data Engineer, you will make an impact by designing,...  ...process documentation, and operational procedures. Prepare high-quality, AI-ready datasets, metadata assets, and curated data... 
    Data
    Quality
    Work at office
    Day shift
    3 days per week

    Cognizant

    Toronto, ON
    1 day ago
  • $120 - $180 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: Senior Data Scientist and Data Engineering...  ...–$180/hour Location: Remote Role Responsibilities...  ...submitted work. Train and evaluate frontier AI models using expertise... 
    Remote job
    Data
    Contract work
    Summer work

    Mercor

    Toronto, ON
    3 days ago
  • $80k - $138k per year

     ...friends, families, and communities to enjoy the quality of life that comes with a sustainable...  ...: Architect and lead delivery of modern data platforms on Google Cloud — data lakes, lakehouses...  ..., VPC-SC — so downstream analytics and AI workloads are safe and auditable.... 
    Data
    Quality
    Permanent employment
    Apprenticeship
    Flexible hours

    Deloitte

    Toronto, ON
    19 hours ago
  •  ...No. R2873670 Position Title: Data Scientist Location: Toronto...  ...Sanofi We’re an R&D-driven, AI-powered biopharma company...  ...wellbeing benefits including high-quality healthcare, prevention and wellness...  ...related to performance evaluation. Information collected and processed... 
    Data
    Quality
    Work from home
    3 days per week
    Toronto, ON
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Data Quality Evaluator. Be the first to apply!