Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Benchmark Evaluator - Freelance

Scale AI

Outlier is an AI evaluation platform operated by Scale AI. We are seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with an AI voice model and scoring each exchange.

You will compare AI-generated images and videos to judge which follows prompts more accurately and explain in writing what looked or sounded wrong, remotely and on your own schedule. At Outlier, your work helps shape how advanced AI systems reason and improve, contributing to a

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Benchmark Evaluator - Freelance in Montréal, QC vacancy
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...clinical reasoning quality of benchmark items: vignette accuracy and completeness... 
    Remote work
    Part time
    For contractors
    Flexible hours

    Mindrift

    Montréal, QC
    4 days ago
  •  ...We are seeking an experienced  Freelance Growth Marketing Strategist to support a high-profile business executive and entrepreneur in expanding...  ...can combine strategy and execution across areas including SEO, AI search optimisation (AEO), website conversion, audience growth,... 
    Freelance
    Remote work

    Digital

    Montréal, QC
    a month ago
  •  ...cliniques et une expertise dans les évaluations psychiatriques ?Chez IQVIA ,...  ...de prestation de services (freelance) Profil recherché...  ...role you can expect: ~100% Remote Opportunity ~ Flexible Working...  ...use artificial intelligence (AI) in the processing of your application... 
    Freelance
    Remote work
    Full time
    Contract work
    Part time
    Immediate start
    Worldwide
    Flexible hours

    IQVIA

    Montréal, QC
    3 days ago
  •  ...by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le...  ...langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante...  ...d'ensembles de données ( datasets ) et de benchmarks, ainsi qu'en red-teaming . Diriger l'... 
    Suggested
    Apprenticeship
    Work at office
    Flexible hours
    Day shift

    LoiZéro

    Montréal, QC
    a month ago
  •  ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers... 
    Suggested
    Work at office
    Flexible hours

    Totem recruteur de talent

    Montréal, QC
    8 days ago
  •  ...IQVIA seeks bilingual mental health clinicians for freelance remote work as Central Independent Raters on a major depressive disorder clinical...  ...Conduct independent, standardized psychiatric evaluations of trial participants Administer and score depression rating... 
    Freelance
    Remote work

    IQVIA

    Montréal, QC
    a month ago
  •  ...développement de projets majeurs en énergie, infrastructures et ressources naturelles. Nous recherchons actuellement un(e) leader senior en évaluation environnementale souhaitant jouer un rôle clé dans la réalisation et le positionnement de projets structurants au Québec et à l’... 
    Local area
    Flexible hours
    Day shift

    Hatch

    Montréal, QC
    1 day ago
  •  ...comprendre les besoins de nos clients, à évaluer les occasions d’affaires et à communiquer...  ...who can help us understand client needs, evaluate opportunities, and communicate the value...  ...sector RFPs or procurement processes Remote applications are welcome, although candidates... 
    Freelance
    Remote work
    Full time
    Apprenticeship
    Work at office
    Flexible hours
    2 days per week

    Evolving Web

    Montréal, QC
    13 days ago
  •  ...modèle. Renseignements sur l’équipe   Les Services-conseils en évaluation d’entreprises et modélisation se spécialisent dans la résolution...  ...and hiring teams will utilize human screening combined with AI technology to help identify the skills and qualities that matter... 
    Permanent employment
    Apprenticeship
    Work at office
    Local area
    Flexible hours
    Day shift

    Deloitte

    Montréal, QC
    1 day ago
  •  ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation...  ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between... 
    Remote work
    Daily paid
    Full time
    Temporary work
    Work at office

    JLL

    Montréal, QC
    4 days ago
  • $28 - $35 per hour

     ...Location: Remote - proximity to Montreal Hours: Ability to work a flexible schedule to meet business needs, including evenings, weekends, and some holidays. Employment Type: Freelance Salary Range: $28-$35 an hour About Medik8 Medik8 is a UK-based clinical... 
    Freelance
    Remote work
    Hourly pay
    Internship
    Home office
    Flexible hours
    Shift work
    Afternoon shift

    Medik8

    Montréal, QC
    19 days ago
  • Votre opportunité Axés sur la santé, la sécurité, la qualité et l’éthique, nos experts dirigent la réalisation de projets avec de la détermination, un esprit créatif et une vision de croissance. Présents partout dans le monde et comptant des professionnels dans plus de 20...
    Full time
    Contract work
    Temporary work
    Part time
    Work at office

    Stantec

    Montréal, QC
    1 day ago
  •  ...and deploy autonomous and semi autonomous AI agents to automate complex tasks across...  ...production (monitoring, tracing, output evaluation). Actively monitor technological developments...  ...). Experience in LLM evaluation and benchmarking (LLM as a judge, RAGAS, PromptFlow, etc.)... 
    Full time

    CGI

    Montréal, QC
    4 days ago
  •  ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes... 
    Permanent employment
    Apprenticeship
    Work at office

    Veriforce

    Montréal, QC
    12 days ago
  • usd16 - usd50 per hour

     ...We are looking for AI Data Specialists to support the improvement of AI-generated...  ...content in French from Canada. Job Type: Freelance Location: Remote anywhere Work Schedule: Part-time - 10+...  ...tasks, including: - Data collection, evaluation, and annotation. - Pairwise comparisons... 
    Freelance
    Remote work
    Hourly pay
    Full time
    Part time
    Immediate start
    Work from home
    10 hours per week
    Flexible hours

    Rws

    Montréal, QC
    15 days ago
  • $60 - $120 per hour

     ...AI & Software Engineers – Remote Opportunities Full-Time & Flexible Contract Options | Remote $60 - $120 per hour We are recruiting for multiple opportunities with a fast-growing AI technology business working on advanced AI systems and software engineering projects... 
    Remote job
    Hourly pay
    Full time
    Contract work
    Flexible hours

    Andrews Recruitment Group

    Montréal, QC
    a month ago
  •  ...job Artefact is a next-generation data and AI consulting firm dedicated to accelerating...  ...; fine-tuning experiments and LLM evaluation on the next. You will own your models: the...  ...Build evaluation suites for LLM systems: benchmarks, LLM-as-judge patterns, and regression tests... 
    Full time

    Artefact

    Montréal, QC
    4 days ago
  • The Event Vehicle Coordinator acts as a Red Bull Brand ambassador and face of our brand, who is ultimately responsible for the Red Bull Event Vehicle (EV); a core marketing asset in our grassroots, field marketing initiatives. Responsibilities entail planning and executing ...
    Freelance
    Full time

    Red Bull

    Montréal, QC
    4 days ago
  •  ...Job Description Job Description Job Title: AI/ML Architect Location: Montreal, QC Duration: 12 Months   Responsibilities...  ...software architecture of new analytical and AI tools; ·        Evaluate in a structured manner technological components or libraries... 

    Adient One LLC.

    Montréal, QC
    2 days ago
  •  ...Description École de technologie supérieure – ETS Conseillère ou Conseiller en gestion et en évaluation de programmes d’études NUMÉRO D'AFFICHAGE: 26-27/176 CATÉGORIE D'EMPLOI: Professionnel STATUT D'EMPLOI: Remplacement- 12 mois avec possibilité de prolongation... 
    Daily paid
    Remplacement
    Monday to friday

    École de technologie supérieure

    Montréal, QC
    8 days ago
  • usd16 per hour

     ...Contributors to join a French (Canada) voice evaluation project and help support the development of the next generation of AI technologies. Job Type: Freelance Location: Work from home Work Schedule...  ...platform. What We Offer - Flexible, remote work. - Timely and reliable payments.... 
    Freelance
    Remote work
    Full time
    Immediate start
    Work from home
    Flexible hours

    Rws

    Montréal, QC
    6 days ago
  • $180k - $230k per year

     ...better enabling teams to deliver complex capital projects.  The AI buildout runs on physical things: data centers, power, and the...  ...timeline amelioration for major projects.  ~ Continuous improvement: Evaluate models repeatedly and prototype methods and new models to improve... 
    Full time
    For contractors
    Internship
    Work at office

    Foresight Works Ltd

    Montréal, QC
    4 days ago
  •  ...Localisation: Partout au Québec Nous recherchons un(e) spécialiste en milieux humides et végétation, possédant une expertise en évaluation environnementale. La personne retenue apportera un soutien technique pour les études environnementales, les évaluations d'impact et... 
    Full time
    Flexible hours

    AtkinsRéalis

    Montréal, QC
    12 days ago
  • $114.75k - $162k per year

     ...into reliable foundations for AI-enabled applications. As part...  ..., contextualize, govern, and evaluate content from multiple sources...  ...for training, validation, benchmarking, and regression testing. Connect...  ..., RAG, and datasets used for evaluation. The ability to... 
    Full time
    Temporary work
    Direct hire
    Flexible hours

    Schneider Electric

    Montréal, QC
    4 days ago
  •  ...employees. This is a fully remote position. While we welcome applications...  ...run. That means building the evaluation infrastructure that tells us...  ...role. Today we ship AI features and form opinions about...  ...workloads rather than published benchmarks  ~ Maintain a current view... 
    Remote work
    Full time
    Live In

    Velixo

    Montréal, QC
    more than 2 months ago
  •  ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain...  ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong knowledge of...  ...the most of the flexibility that comes with remote work. Growth Mindset : reap the benefits... 
    Remote work
    Full time
    Internship
    Relocation

    Miratech

    Montréal, QC
    9 hours ago
  •  ...quotidien sera de gérer et de coordonner la production tant des études d’impact sur l’environnement (ÉIE), que des autres types d’évaluations environnementales et de demandes d’autorisation et de permis. Vous devrez être familier avec les législations, réglementations et... 
    Daily paid
    Work at office

    Stantec

    Montréal, QC
    1 day ago
  •  ...consiste principalement à prendre des décisions judicieuses en tirant parti d’informations exactes. En tant que membre de l’équipe Évaluation, voilà ce que vous contribuerez à rendre possible. Vous serez un membre important de notre équipe diversifiée et hautement expérimentée... 
    Daily paid
    Weekend work

    Ernst & Young

    Montréal, QC
    7 days ago
  •  ...that the hours of your life spent working will be appreciated by a company that envisions a human and long-term relationship with its freelancers ? We are looking for talented freelancers to contribute to the quality of our client interventions located on the island of... 
    Freelance
    Remote work
    Long term contract
    Full time
    Part time
    Flexible hours
    Day shift

    Miyagi

    Montréal, QC
    more than 2 months ago
  • $180k - $230k per year

     ...AI Engineer (Portless) Location : Remote, North America (~6h overlap ET) Engagement : Full-time, remote Salary : $180,000 – $230,000 (EUR 155,615...  ...features Own the full ML lifecycle: data, training, evaluation, deployment Monitor and improve model performance in... 
    Remote job
    Full time

    Cross Border Talents

    Montréal, QC
    26 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Benchmark Evaluator - Freelance. Be the first to apply!