Remote AI Benchmark Evaluator - Freelance
Scale AI
Outlier is an AI evaluation platform operated by Scale AI. We are seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with an AI voice model and scoring each exchange.
You will compare AI-generated images and videos to judge which follows prompts more accurately and explain in writing what looked or sounded wrong, remotely and on your own schedule. At Outlier, your work helps shape how advanced AI systems reason and improve, contributing to a
#J-18808-Ljbffr- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...clinical reasoning quality of benchmark items: vignette accuracy and completeness...Remote workPart timeFor contractorsFlexible hours
- ...We are seeking an experienced Freelance Growth Marketing Strategist to support a high-profile business executive and entrepreneur in expanding... ...can combine strategy and execution across areas including SEO, AI search optimisation (AEO), website conversion, audience growth,...FreelanceRemote work
- ...cliniques et une expertise dans les évaluations psychiatriques ?Chez IQVIA ,... ...de prestation de services (freelance) Profil recherché... ...role you can expect: ~100% Remote Opportunity ~ Flexible Working... ...use artificial intelligence (AI) in the processing of your application...FreelanceRemote workFull timeContract workPart timeImmediate startWorldwideFlexible hours
- ...by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le... ...langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante... ...d'ensembles de données ( datasets ) et de benchmarks, ainsi qu'en red-teaming . Diriger l'...SuggestedApprenticeshipWork at officeFlexible hoursDay shift
- ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers...SuggestedWork at officeFlexible hours
- ...IQVIA seeks bilingual mental health clinicians for freelance remote work as Central Independent Raters on a major depressive disorder clinical... ...Conduct independent, standardized psychiatric evaluations of trial participants Administer and score depression rating...FreelanceRemote work
- ...développement de projets majeurs en énergie, infrastructures et ressources naturelles. Nous recherchons actuellement un(e) leader senior en évaluation environnementale souhaitant jouer un rôle clé dans la réalisation et le positionnement de projets structurants au Québec et à l’...Local areaFlexible hoursDay shift
- ...comprendre les besoins de nos clients, à évaluer les occasions d’affaires et à communiquer... ...who can help us understand client needs, evaluate opportunities, and communicate the value... ...sector RFPs or procurement processes Remote applications are welcome, although candidates...FreelanceRemote workFull timeApprenticeshipWork at officeFlexible hours2 days per week
- ...modèle. Renseignements sur l’équipe Les Services-conseils en évaluation d’entreprises et modélisation se spécialisent dans la résolution... ...and hiring teams will utilize human screening combined with AI technology to help identify the skills and qualities that matter...Permanent employmentApprenticeshipWork at officeLocal areaFlexible hoursDay shift
- ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation... ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between...Remote workDaily paidFull timeTemporary workWork at office
$28 - $35 per hour
...Location: Remote - proximity to Montreal Hours: Ability to work a flexible schedule to meet business needs, including evenings, weekends, and some holidays. Employment Type: Freelance Salary Range: $28-$35 an hour About Medik8 Medik8 is a UK-based clinical...FreelanceRemote workHourly payInternshipHome officeFlexible hoursShift workAfternoon shift- Votre opportunité Axés sur la santé, la sécurité, la qualité et l’éthique, nos experts dirigent la réalisation de projets avec de la détermination, un esprit créatif et une vision de croissance. Présents partout dans le monde et comptant des professionnels dans plus de 20...Full timeContract workTemporary workPart timeWork at office
- ...and deploy autonomous and semi autonomous AI agents to automate complex tasks across... ...production (monitoring, tracing, output evaluation). Actively monitor technological developments... ...). Experience in LLM evaluation and benchmarking (LLM as a judge, RAGAS, PromptFlow, etc.)...Full time
- ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes...Permanent employmentApprenticeshipWork at office
usd16 - usd50 per hour
...We are looking for AI Data Specialists to support the improvement of AI-generated... ...content in French from Canada. Job Type: Freelance Location: Remote anywhere Work Schedule: Part-time - 10+... ...tasks, including: - Data collection, evaluation, and annotation. - Pairwise comparisons...FreelanceRemote workHourly payFull timePart timeImmediate startWork from home10 hours per weekFlexible hours$60 - $120 per hour
...AI & Software Engineers – Remote Opportunities Full-Time & Flexible Contract Options | Remote $60 - $120 per hour We are recruiting for multiple opportunities with a fast-growing AI technology business working on advanced AI systems and software engineering projects...Remote jobHourly payFull timeContract workFlexible hours- ...job Artefact is a next-generation data and AI consulting firm dedicated to accelerating... ...; fine-tuning experiments and LLM evaluation on the next. You will own your models: the... ...Build evaluation suites for LLM systems: benchmarks, LLM-as-judge patterns, and regression tests...Full time
- The Event Vehicle Coordinator acts as a Red Bull Brand ambassador and face of our brand, who is ultimately responsible for the Red Bull Event Vehicle (EV); a core marketing asset in our grassroots, field marketing initiatives. Responsibilities entail planning and executing ...FreelanceFull time
- ...Job Description Job Description Job Title: AI/ML Architect Location: Montreal, QC Duration: 12 Months Responsibilities... ...software architecture of new analytical and AI tools; · Evaluate in a structured manner technological components or libraries...
- ...Description École de technologie supérieure – ETS Conseillère ou Conseiller en gestion et en évaluation de programmes d’études NUMÉRO D'AFFICHAGE: 26-27/176 CATÉGORIE D'EMPLOI: Professionnel STATUT D'EMPLOI: Remplacement- 12 mois avec possibilité de prolongation...Daily paidRemplacementMonday to friday
usd16 per hour
...Contributors to join a French (Canada) voice evaluation project and help support the development of the next generation of AI technologies. Job Type: Freelance Location: Work from home Work Schedule... ...platform. What We Offer - Flexible, remote work. - Timely and reliable payments....FreelanceRemote workFull timeImmediate startWork from homeFlexible hours$180k - $230k per year
...better enabling teams to deliver complex capital projects. The AI buildout runs on physical things: data centers, power, and the... ...timeline amelioration for major projects. ~ Continuous improvement: Evaluate models repeatedly and prototype methods and new models to improve...Full timeFor contractorsInternshipWork at office- ...Localisation: Partout au Québec Nous recherchons un(e) spécialiste en milieux humides et végétation, possédant une expertise en évaluation environnementale. La personne retenue apportera un soutien technique pour les études environnementales, les évaluations d'impact et...Full timeFlexible hours
$114.75k - $162k per year
...into reliable foundations for AI-enabled applications. As part... ..., contextualize, govern, and evaluate content from multiple sources... ...for training, validation, benchmarking, and regression testing. Connect... ..., RAG, and datasets used for evaluation. The ability to...Full timeTemporary workDirect hireFlexible hours- ...employees. This is a fully remote position. While we welcome applications... ...run. That means building the evaluation infrastructure that tells us... ...role. Today we ship AI features and form opinions about... ...workloads rather than published benchmarks ~ Maintain a current view...Remote workFull timeLive In
- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain... ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong knowledge of... ...the most of the flexibility that comes with remote work. Growth Mindset : reap the benefits...Remote workFull timeInternshipRelocation
- ...quotidien sera de gérer et de coordonner la production tant des études d’impact sur l’environnement (ÉIE), que des autres types d’évaluations environnementales et de demandes d’autorisation et de permis. Vous devrez être familier avec les législations, réglementations et...Daily paidWork at office
- ...consiste principalement à prendre des décisions judicieuses en tirant parti d’informations exactes. En tant que membre de l’équipe Évaluation, voilà ce que vous contribuerez à rendre possible. Vous serez un membre important de notre équipe diversifiée et hautement expérimentée...Daily paidWeekend work
- ...that the hours of your life spent working will be appreciated by a company that envisions a human and long-term relationship with its freelancers ? We are looking for talented freelancers to contribute to the quality of our client interventions located on the island of...FreelanceRemote workLong term contractFull timePart timeFlexible hoursDay shift
$180k - $230k per year
...AI Engineer (Portless) Location : Remote, North America (~6h overlap ET) Engagement : Full-time, remote Salary : $180,000 – $230,000 (EUR 155,615... ...features Own the full ML lifecycle: data, training, evaluation, deployment Monitor and improve model performance in...Remote jobFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Benchmark Evaluator - Freelance. Be the first to apply!
- admissions evaluator Montréal, QC
- évaluateur-estimateur Montréal, QC
- remote social media evaluator Montréal, QC
- estimateur - dessinateur Montréal, QC
- test evaluator Montréal, QC
- estimateur automobile Montréal, QC
- estimateur en bâtiment Montréal, QC
- estimateur structure Montréal, QC
- estimateur industriel Montréal, QC
- chargé de projet estimateur Montréal, QC

