Generative AI Model Evaluator
Scale AI
Evaluate generative AI models remotely with fluent English, strong communication, and careful attention to detail. Choose flexible freelance hours that suit your schedule.
Outlier seeks detail-oriented English speakers to help train voice, image, and video models. You will assess outputs across adherence, quality, and realism. The work includes live conversations, comparisons, close inspection, and evidence-based explanations.
Key Responsibilities:
- Hold scenario-based English conversations with AI voice models
- Rank voice responses for naturalness, usefulness, and clarity
- Compare AI-generated images and videos against prompts
- Inspect outputs for visual, motion, text, and audio issues
- Explain ratings with specific evidence in English
Requirements:
- Fluent English with clear written communication
- Strong attention to detail and patience
- Comfort with natural conversational speech
- Computer, reliable internet connection, and headphones
- Independent ratings and explanations without AI writing tools
Apply your English communication, observation, and evaluation skills to improve generative AI voice, image, and video models.
#J-18808-LjbffrVacancy posted 6 hours ago
Similar jobs that could be interesting for youBased on the Generative AI Model Evaluator in Montréal, QC vacancy
- ...Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with... ...for talented, detail-oriented English speakers to help train generative AI voice, image, and video models This freelance opportunity...SuggestedHourly payContract workFreelanceInternshipRemote workFlexible hours
- ...for the use of various types of models and, accordingly, is in charge... ...quantitative reviews of the AI models used within BNP Paribas... ...the sales team. Identify and evaluate model risks (including... ...~ Experience in integrating Generative AI into practical use cases, including...SuggestedLong term contractWork at officeMonday to fridayFlexible hours3 days per week1 day per week
- ...award. Job Description The Generative AI Artist creates images and sequences that... ...workflows in ComfyUI, combining multiple models based on the needs of each shot. Train... .... We expect you to know how to test, evaluate, choose the right tool, and move on when...SuggestedFull timeInternshipLocal area
$80k - $155k per year
Senior Cloud Architect – Cloud & Generative AI Position Description Help clients optimize... ...cloud platforms for AI solutions, including model hosting, retrieval-augmented generation (... ...code (IaC) et des pipelines CI/CD. • Évaluer les environnements et applications existants...SuggestedApprenticeshipLocal area$90k - $175k per year
Generative AI and Agentic Solutions Architect Position Description Senior · Defines architecture... ...reference architectures encompassing models, data, knowledge bases, tools, APIs and... ...and traceability. • Define solution evaluation and acceptance criteria: response...Suggested$70k - $135k per year
Intermediate Cloud Architect – Powered by Generative AI Position Description Help optimize... ...and costs) using team reference models, with AWS or GCP equivalents when needed... ...coding assistants or agents, with critical evaluation of outputs. • Basic understanding of security...Apprenticeship- ...AI SUPPORT ANALYST – GENERATIVE AI, M365 & TECHNICAL SUPPORT ROLE SUMMARY We are seeking a Level 2.5 AI Support Analyst to act as the front line for end-user AI, answering user questions across the firm's AI portfolio and capturing every query in a structured way...Permanent employmentShift work
- ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking... ...an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues,...Remote jobFor contractors
$100 per hour
...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is... ...evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our...Hourly payPermanent employmentPart time10 hours per week- ...Botpress is the AI agent platform for customer support. We build AI agents that resolve tickets instead of just answering them, for support teams carrying real conversation volume. Our mission is to make AI work for the people doing the work. About the Role We are anchoring...Full timeFreelanceManual laborWork at office
- ...Evaluate generative AI voice models remotely with fluent English, clear communication, and careful attention to conversational quality. Outlier seeks detail-oriented English speakers for freelance work training generative AI voice, image, and video models. You will assess...FreelanceRemote workFlexible hours
Scale AI
Montréal, QC6 hours ago - ...re seeking someone to join our team as an AI Patterns and Controls Monitoring Professional... ...and ongoing monitoring of AI and Gen AI models. Help establish a risk-based framework... ...de surveillance et de vérification afin d’évaluer le respect, par la première et la deuxième...Full timeApprenticeshipWork at officeRemote work
- ...Use fluent English and careful judgment to evaluate AI voice, image, and video models remotely with flexible freelance hours. Outlier needs clear communicators who can assess generated content with precision. As an English AI Model Evaluator, you will provide human feedback...FreelanceRemote workFlexible hours
Scale AI
Montréal, QC6 hours ago - ...Use fluent English and careful judgment to evaluate AI voice, image, and video models for Outlier. Work remotely as a flexible freelance contributor. Outlier... ...English speakers to provide human feedback for generative AI models. You will assess natural conversations, compare...FreelanceRemote workFlexible hours
Scale AI
Montréal, QC6 hours ago - ...Director to act as a Subject Matter Expert (SME) in Hydro Turbines-Generators Systems, supporting some of the largest and most technically... ..., including: Selection of turbine-generator technology. Evaluation of refurbishment, power-increase (uprating), or replacement options...Long term contractRemplacementFull timeInternshipFlexible hours
- .... Nous développons « Scientist AI », un système d'IA de pointe conçu... ...au développement de nos modèles généraux Scientist AI et de garde... ...(LLM frontier ), nous devons évaluer de manière rigoureuse et indépendante... ...fiches de modèles/systèmes — model cards , les rapports...ApprenticeshipWork at officeFlexible hoursDay shift
- ...AI Project Manager / Product Owner – Enterprise AI, Microsoft Copilot, ChatGPT & Generative AI We are seeking a seasoned Project Manager / Product Owner to lead cross-functional... ...adherence to governance, data privacy and model-usage guidelines. Define adoption and enablement...Permanent employmentShift work
- ...department provides second line of defense for the use of various types of models and, accordingly, is in charge of model risk management. RISK IRC... ...and Excel. Programming skills (Python). Knowledge of AI models governance or validation. Knowledge of regulatory...Permanent employmentFull timeBank staffWork at officeMonday to fridayFlexible hours3 days per week
- ...work to be considered for the role. The Modeling Artist is responsible for creating high-... ...and technical robustness of the delivered models. They produce optimized assets that meet Rodeo... ...for progress. Explore new tools (e.g., AI, procedural modeling, photogrammetry) to...Permanent employmentFull time
$90k - $175k per year
...Data Architect – Enterprise Data Modeling & Governance Position... ...independent conceptual and logical data models. Working with business data... ...support our recruitment team, AI tools may be used to help assess... ...approvisionnement et analytique. Évaluer les conceptions, participer aux...- ...looking for a skilled Senior AI Engineer with Python, LangGraph... ...memory, tool-calling, and response-generation capabilities. Integrate AI... ..., monitoring, telemetry, and evaluation platforms. ~ Strong... ...Have Hands-on experience with Model Context Protocol (MCP) and Agent...Full timeInternshipRemote workRelocation
- ...industrial world, with industrial AI inside the shift, not on top... ...stack of the Smart Factory, generating the right data and insights that... ...: defining the touchpoint model, aligning with RevOps on methodology... ...for the next campaign. Evaluate new martech and AI tools with...Work at officeRemote workHome officeFlexible hoursShift work2 days per week
$75.4k - $125.4k per year
...Regulatory (FS R&R) Credit Risk Modelling practice will provide you with... ...with credit risk modeling, model risk management as well as climate... ...and validation processes AI and machine learning model... ...helps ensure we combat bias by evaluating candidates equally and fairly,...- ...revenue-focused marketing leader who can build and own the demand-generation engine — generating and converting leads, managing the sales... ...marketing/demand-generation function from the ground up • Skill using AI to accelerate productivity (campaign build, reporting, research)...For contractorsFreelanceInternshipRemote work
EERS
Montréal, QC3 days ago $120k - $150k per year
...built on a single conviction: AI does not transform businesses.... ...redesign, adoption roadmap, and KPI model. Your focus is connecting... ...AI adoption. • Identify, evaluate, and prioritize AI use cases... ...technology programs before the current generation of AI capabilities. •...Long term contractPermanent employmentFull timeContract workWork at office2 days per week- ...opportunity The Decision Modelling team sits at the intersection... ...develop integrated financial models and decision tools that support... ...Transaction and investment evaluation (buy-side, sell-side, infrastructure... .... Enabled by data, AI and advanced technology, EY teams...Weekend work
- ...challenge consensus. The Team: As AI tools drive immense value across the firm,... ...safely route users to the most cost-effective models. The Role: We are looking for a... ...instances, model deployments, and API key generation). Write robust Go and Python code to support...
- ...releases, and rollouts; Research, evaluate, and validate new product... ...hands-on experience using AI tools as part of day-to-day product... ...and modern product operating model ~ Comfortable working in AI-... ...where prototypes, AI-generated specifications, and rapid experimentation...Full timeRemote work
- ...healthcare organizations depend on. AI is now at the heart of that... ...as the engine behind our next generation of mission-critical solutions... ...application development and model integration, data architecture... ...existing product workflows while evaluating and optimizing cost, quality,...Full time
usd16 - usd50 per hour
...We are looking for AI Data Specialists to support the improvement of AI-generated content in French from Canada. Job Type: Freelance... ...and safety of today’s AI models? What You’ll Do The role involves... ..., including: - Data collection, evaluation, and annotation. - Pairwise comparisons...Hourly payFull timePart timeFreelanceImmediate startRemote workWork from home10 hours per weekFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Generative AI Model Evaluator. Be the first to apply!
