Remote Multimodal AI Evaluator
Scale AI
Evaluate multimodal AI outputs remotely on your own schedule using fluent English, careful observation, and clear written explanations. Review voice, images, and videos.
Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will roleplay conversations with AI voice models, compare generated media, and explain errors. The work supports Outlier’s evaluation and feedback loop for improving advanced AI systems.
Key Responsibilities:
- Hold scenario-based English conversations with AI voice models
- Compare generated images and videos against prompts
- Inspect outputs for visual, motion, text, and audio problems
- Rate adherence, quality, realism, and naturalness
- Write specific evidence-based explanations in English
Requirements:
- Fluent English and strong written communication
- Strong attention to detail and patience
- Comfort with natural conversational situations
- Experience writing short evidence-based reviews
- Valid ID, mobile phone, resume, and LinkedIn profile
Use English communication, media judgment, and precise feedback to evaluate AI outputs remotely for Outlier projects.
#J-18808-LjbffrVacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote Multimodal AI Evaluator in Montréal, QC vacancy
- ...including LLMs, RL, NLP, computer vision, AI theory, and Autonomous driving. About the job: Proposing and developing multimodal representation learning frameworks, including... ...on large-scale datasets to validate and evaluate proposed ideas and solutions. Staying current...SuggestedLong term contractInternshipImmediate start
- ...specialists with project-based AI opportunities for leading tech... ..., focused on testing, evaluating, and improving AI systems. This... ...which tasks to take and when ~ Remote: open to US-licensed physicians... ...EHR vignettes for a medical AI evaluation project. General and internal...Remote workPart timeFor contractorsFlexible hours
$180k - $230k per year
...deliver complex capital projects. The AI buildout runs on physical things: data centers... ...the platform. You will be using complex, multimodal high stakes data to make predictions that... ...projects. ~ Continuous improvement: Evaluate models repeatedly and prototype methods and...SuggestedFull timeFor contractorsInternshipWork at office- ...Titre du poste : Évaluateur(trice) immobilier / Appraiser Lieu : Montréal Salaire : selon expérience À propos du poste Joindre cette opportunité, c'est intégrer une organisation multidisciplinaire bien établie dans le secteur de l'évaluation et des services immobiliers...SuggestedWork at officeFlexible hours
- ...développement de projets majeurs en énergie, infrastructures et ressources naturelles. Nous recherchons actuellement un(e) leader senior en évaluation environnementale souhaitant jouer un rôle clé dans la réalisation et le positionnement de projets structurants au Québec et à l’...SuggestedLocal areaFlexible hoursDay shift
- ...modèle. Renseignements sur l’équipe Les Services-conseils en évaluation d’entreprises et modélisation se spécialisent dans la résolution... ...and hiring teams will utilize human screening combined with AI technology to help identify the skills and qualities that matter...Permanent employmentApprenticeshipWork at officeLocal areaFlexible hoursDay shift
- ...leur conception ( safe-by-design ). Nous développons « Scientist AI », un système d'IA de pointe conçu dès le départ pour être à la fois... ...les modèles de langage de pointe (LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante chaque affirmation concernant...ApprenticeshipWork at officeFlexible hoursDay shift
- ...What is the opportunity? RBC's AI Group is building the future... ...for AI in these domains. Evaluate new areas for AI investment, complete... ...proof of concept testing and evaluation. Applied Research &... ...technologies (e.g., foundation models, multimodal AI, reinforcement learning)....WorldwideFlexible hours
$69.45k - $119.45k per year
...reinvent their business with Data & Advanced AI — backed by a $3B investment and... ...knowledge integration, workflow automation, evaluation, observability and AI Ops. You will integrate... ..., embedding, retrieval, reasoning and multimodal model capabilities to optimize solution performance...Full timeManual laborWork at officeLocal area- ...as we help shape a brighter way forward. Conseiller principal, Évaluation - JLL En quoi consiste cet emploi : Joignez-vous à l'équipe d’Évaluation... ...table! At JLL, we harness the power of artificial intelligence (AI) to efficiently accelerate meaningful connections between...Remote workDaily paidFull timeTemporary workWork at office
- Votre opportunité Axés sur la santé, la sécurité, la qualité et l’éthique, nos experts dirigent la réalisation de projets avec de la détermination, un esprit créatif et une vision de croissance. Présents partout dans le monde et comptant des professionnels dans plus de 20...Full timeContract workTemporary workPart timeWork at office
- ...Description: Design and architect end to end artificial intelligence (AI) and machine learning (ML) solutions, aligned with clients'... ...AI/ML and integrate the latest advancements (generative AI, LLM, multimodal) into architecture recommendations. Act as a technical reference...Full time
- ...Évaluateur(trice) en santé et sécurité – Bilingue Department: Operations Employment Type: Permanent Location: Greater Montreal Metropolitan Area, Canada Reporting To: Chef de l'accréditation en santé et sécurité Description Créer des solutions innovantes...Permanent employmentApprenticeshipWork at office
$60 - $120 per hour
...AI & Software Engineers – Remote Opportunities Full-Time & Flexible Contract Options | Remote $60 - $120 per hour We are recruiting for multiple opportunities with a fast-growing AI technology business working on advanced AI systems and software engineering projects...Remote jobHourly payFull timeContract workFlexible hours- ...Description École de technologie supérieure – ETS Conseillère ou Conseiller en gestion et en évaluation de programmes d’études NUMÉRO D'AFFICHAGE: 26-27/176 CATÉGORIE D'EMPLOI: Professionnel STATUT D'EMPLOI: Remplacement- 12 mois avec possibilité de prolongation...Daily paidRemplacementMonday to friday
- ...Job Description Job Description Job Title: AI/ML Architect Location: Montreal, QC Duration: 12 Months Responsibilities... ...software architecture of new analytical and AI tools; · Evaluate in a structured manner technological components or libraries...
Adient One LLC.
Montréal, QC2 days ago - ...Localisation: Partout au Québec Nous recherchons un(e) spécialiste en milieux humides et végétation, possédant une expertise en évaluation environnementale. La personne retenue apportera un soutien technique pour les études environnementales, les évaluations d'impact et...Full timeFlexible hours
- ...autonomous robots that deliver healthcare. Our AI sensing platform enables existing robotic... ...knows the model landscape cold, treats evaluation as a first-class engineering problem, and... ...edge stack: embedded AI, robotics, LLMs, multimodal sensing Transparent, mission-driven...
- ...Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain... ...observability, monitoring, telemetry, and evaluation platforms. ~ Strong knowledge of... ...the most of the flexibility that comes with remote work. Growth Mindset : reap the benefits...Remote workFull timeInternshipRelocation
- ...quotidien sera de gérer et de coordonner la production tant des études d’impact sur l’environnement (ÉIE), que des autres types d’évaluations environnementales et de demandes d’autorisation et de permis. Vous devrez être familier avec les législations, réglementations et...Daily paidWork at office
- ...consiste principalement à prendre des décisions judicieuses en tirant parti d’informations exactes. En tant que membre de l’équipe Évaluation, voilà ce que vous contribuerez à rendre possible. Vous serez un membre important de notre équipe diversifiée et hautement expérimentée...Daily paidWeekend work
$180k - $230k per year
...AI Engineer (Portless) Location : Remote, North America (~6h overlap ET) Engagement : Full-time, remote Salary : $180,000 – $230,000 (EUR 155,615... ...features Own the full ML lifecycle: data, training, evaluation, deployment Monitor and improve model performance in...Remote jobFull time- ...Responsibilities: Design, develop, and deploy autonomous and semi autonomous AI agents to automate complex tasks across the software development... ...of AI agents in production (monitoring, tracing, output evaluation). Actively monitor technological developments in LLMs, agent...Full time
- ...efficient and enjoyable world. Role overview As an Applied AI Scientist, you design, build, and ship AI solutions that solve real... ...) Turn experiments into production-ready components (evaluation, monitoring, iteration) Coach colleagues on applied AI best practices...Work at officeFlexible hours
- ...Responsibilities Build and deploy AI solutions that create measurable business impact. Identify high-value opportunities for applying... ...Convert experiments into production-ready components through evaluation, monitoring, and iteration. Research, test, and implement new...Flexible hours
- ...Position Title: Senior AI Analyst (T & I) (Telework/Hybrid) Status of Employment:... ...hybrid position with a mix of in-office and remote work. Work arrangements will be discussed... ...on cloud architectures. Help fine-tune, evaluate and integrate large language models (LLMs)...Remote workLong term contractFull timeInternshipWork at officeImmediate start
- ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- ...· Establish best practices for experimentation, reproducibility, evaluation, and deployment. · Define and execute the technical roadmap for... ...and research standards. · Passion for advancing structured-data AI and building platforms that deliver real-world impact. Meet...Long term contractPermanent employmentFull timeLocal areaWorldwideFlexible hours
$140k - $160k per year
...Artefact is a next-generation data and AI consulting firm dedicated to accelerating the adoption of data and AI to create measurable... ...decks, and client behavior. Set SMART objectives, run proper evaluations, and keep the team engaged. Coach consultants on AI-native ways...Full time$131.7k - $278.1k per year
...seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our... ...retrieval, orchestration, policy-based routing, tool invocation, evaluation harnesses, and lifecycle observability. Architect AI-native solutions...Full timeWork at officeLocal area3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Multimodal AI Evaluator. Be the first to apply!
Related searches
- admissions evaluator Montréal, QC
- évaluateur-estimateur Montréal, QC
- remote social media evaluator Montréal, QC
- estimateur - dessinateur Montréal, QC
- test evaluator Montréal, QC
- estimateur automobile Montréal, QC
- estimateur en bâtiment Montréal, QC
- estimateur structure Montréal, QC
- estimateur industriel Montréal, QC
- chargé de projet estimateur Montréal, QC