Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Evaluation Specialist — Language & Media

Scale AI

Scale AI’s Outlier platform seeks detail-oriented English speakers to review AI-generated media and rate conversational quality. You will roleplay live conversations with an AI voice model, compare AI images and videos, and explain in writing what looked off.

As a freelance contractor on Outlier, you’ll set your own schedule, work remotely, and earn up to USD $15 per hour plus incentives. Applicants from multiple countries are encouraged to apply.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist — Language & Media in Toronto, ON vacancy
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30/hour Location: Remote Commitment: 10 hours/week Role...  ...answering questions and correcting errors. Evaluate the experience and deliverables providing... 
    Remote work
    Hourly pay
    Weekly pay
    Full time
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    1 day ago
  • $50 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-...  .... Identify model errors and language gaps, and collaborate with AI... 
    Remote job
    Language
    Contract work
    Summer work

    Mercor

    Toronto, ON
    14 days ago
  •  ...About the company Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task...  ...choose which tasks to take and when ~ Remote: open to US-licensed physicians based in... 
    Remote work
    Part time
    For contractors
    Flexible hours

    Mindrift

    Toronto, ON
    4 days ago
  • $126k - $176k per year

     ...Sr. Legal AI Prompter / Evaluator Job Description Sr. Legal AI Prompters / Evaluators are responsible...  ...; experimenting with large language models (LLMs), including Thomson, our proprietary...  ...accounting, compliance, government, and media. Our products combine highly... 
    Language
    Remplacement
    Full time
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 hours ago
  • $60k - $75k per year

     ...ROLE: MEDIA SPECIALIST TEAM: MEDIA LOCATION: TORONTO - HYBRID ONSITE 2X/WEEK COMPANY OVERVIEW...  ...people combine strategic thinking with AI-powered tools, automation and advanced...  ...of the media plan, regularly evaluating and monitoring execution to implement meaningful... 
    Suggested
    Full time
    Seasonal work

    SALT XC

    Toronto, ON
    13 days ago
  • $140k - $175k per year

     ...software for artificial intelligence (AI) model evaluation and benchmarking. You will build scalable...  ...and product teams to compare large language models (LLMs), measure quality, cost,...  ...support ownership, and work with data specialists to implement access controls, permitted... 
    Language
    Full time
    Internship
    Work at office
    Local area
    Flexible hours

    Thomson Reuters

    Toronto, ON
    4 days ago
  • $60k - $68k per year

     ...Katalyst, and btwelve), Klick Media, Klick Applied Sciences (including...  ...-winning data science and AI capabilities. Founded in 1997,...  ...Description The Media Planning Specialist supports the development and...  ...reports and insights that evaluate campaign effectiveness and... 
    Full time

    Klick Health

    Toronto, ON
    8 days ago
  • $30 - $40 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$40/hour Location: Remote Role Responsibilities...  ...queries each day to ensure timely evaluation. Provide short notes and...  ...TV. Proficiency in other languages. Application Process (Takes... 
    Remote work
    Language
    Daily paid
    Full time
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    1 day ago
  • $100 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$150/hour Location: Remote Role Responsibilities...  ..., and technical reports. Evaluate AI-generated or human-created...  ...detailed written justifications for evaluations and scores to maintain... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    20 days ago
  • $62.85k - $104.75k per year

     ...Director of Content, Brand, the Social Media Specialist is a key member of Manulife Canada’s Brand...  ...Look for opportunities to integrate AI tools that allow for efficiencies in workflows...  ...and verbal communication skills in both languages. Experience managing organic social... 
    Language
    Long term contract
    Temporary work
    Local area
    Flexible hours

    Manulife

    Toronto, ON
    1 day ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $50k - $65k per year

     ...ROLE: SOCIAL MEDIA SPECIALIST TEAM: CREATOR LOCATION: TORONTO (HYBRID) COMPANY OVERVIEW  Salt is a North American marketing agency that...  ...improve output.   Explore emerging technologies, including AI-powered creative and production tools, to improve workflows and... 
    Full time
    Seasonal work
    Work at office
    Shift work
    2 days per week

    SALT XC

    Toronto, ON
    4 days ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Media / journalism / communications Evaluator Type: Contract...  ...$80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...connected future through world-class networks, AI-powered solutions, and digital experiences...  ...and ever-changing industries. On the Bell Media team you will be a part of creating and...  ...for an experienced, ideally bilingual CRM Specialist to join our dynamic team at the leading... 
    Long term contract
    Full time
    Work at office
    3 days per week

    Bell

    Toronto, ON
    1 day ago
  •  ...interior designers, sustainability specialists, and technologists are...  ...across the Buildings business. The AI & Automation Solutions Specialist is a Hybrid / Remote optional and responsible for identifying...  ...stakeholders to identify, evaluate, and prioritize high-value AI opportunities... 
    Remote work
    Language
    Work at office
    Local area

    Stantec

    Toronto, ON
    1 day ago
  • $90 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$90/hour Location: Remote Role Responsibilities...  ...semantic markup, flexbox, grid, media queries, and legacy float- and...  ..., preference-labeling, model-evaluation, or structured code-review work... 
    Remote job
    Contract work
    Summer work
    Local area

    Mercor

    Toronto, ON
    more than 2 months ago
  • $45 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Position: English AI Safety Specialist Type: Contract...  ...40–$45/hour Location: Remote Role Responsibilities Review short English-language conversations to evaluate AI responses... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    24 days ago
  • $39 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$39/hour Location: Remote Duration: Up to 6 months...  ...Role Responsibilities Evaluate AI model output lyrics ,...  ...Write music in the domain language listed in the title, ensuring... 
    Remote job
    Language
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $20 - $160 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...AI Conversation Quality Evaluation Type: Contract...  ...$160/hour Location: Remote Role Responsibilities...  ...the question in understandable language for non-experts. Detect sycophancy... 
    Remote job
    Language
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $160 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $80–$160/hour Location: Remote Role Responsibilities Review...  ...analytical skills to contribute to high-impact evaluation projects. Collaborate with teams to... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $64k - $106k per year

     ...Sourcing, the Strategic Sourcing Specialist position is responsible for...  ...and Marketing, including Media and Events. The Strategic Sourcing...  ...determination of the evaluation and negotiation strategies for...  ...age, perceived ability, spoken language, sexual orientation, and identification... 
    Language
    Contract work

    Canadian Tire Corporation

    Toronto, ON
    1 day ago
  • $50 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Jack Dorsey . Position: German Language and Literature Expert (German)...  ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... 
    Remote job
    Language
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $50 per hour

     ...and technical talent with leading AI research labs. Headquartered in San...  ...Dorsey . Position: English Language and Literature Expert Type:...  ...Compensation: $50/hour Location: Remote Role Responsibilities Evaluate the quality and accuracy of LLM-... 
    Remote job
    Language
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  •  ...Find Your Limitless with Reliance By joining Reliance as an AI Enablement Specialist, you’ll become an important Team Member and will be provided...  ...or a related discipline. • Experience working with large language models (LLMs) and generative AI platforms such as ChatGPT,... 
    Language

    Reliance Home Comfort

    Toronto, ON
    1 day ago
  •  ...Communication & Social Media Specialist - VIE Contract ~ Location: Canada, Toronto ~ Target...  ...About Sanofi We’re an R&D-driven, AI-powered biopharma company committed to improving...  ..., Marketing, or Social Media. Languages: ~ Excellent written and spoken English... 
    Language
    Contract work
    Worldwide
    Flexible hours

    Sanofi

    Toronto, ON
    6 days ago
  • $22 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $16–$22/hour Location: Remote Role Responsibilities Red team...  ...and Odia . Strong judgment about language and content accuracy. Rigorous attention... 
    Remote job
    Language
    Contract work
    Summer work

    Mercor

    Toronto, ON
    25 days ago
  • $80 - $150 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...: MS Excel / Google Sheets Evaluator Type: Contract...  ...$150/hour Location: Remote Role Responsibilities...  ...feedback to improve document evaluation processes. Utilize MS Excel... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $70 - $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $70–$100/hour Location: Remote Commitment: 10–20+ hours/week...  ...responses and select the stronger one. Evaluate both the content and rendering of each document... 
    Remote job
    Contract work
    Summer work
    Work at office
    Immediate start

    Mercor

    Toronto, ON
    more than 2 months ago
  • $15 - $20 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...and Jack Dorsey . Position: Video Evaluation Generalist Type: Contract...  ...Compensation: $15–$20/hour Location: Remote Commitment: 20 hours/week Role... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    more than 2 months ago
  • $30 per hour

     ...enterprises who are building AI systems to power magical experiences...  ...process. Machines (or Large Language Models to be exact) learn in...  ...Your Own Device (laptop). Remote work within Canada or the US is...  ...included! As a Data Quality Specialist, you will: Label and Rank:... 
    Remote work
    Language
    Hourly pay
    Full time
    Contract work
    Part time
    For contractors
    Work at office
    Flexible hours

    cohere

    Toronto, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Evaluation Specialist — Language & Media. Be the first to apply!