Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Response Evaluator & Feedback Analyst

Scale AI

Scale AI, through Outlier, seeks detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with AI voice models, rank naturalness and usefulness, and write concise explanations in English, on your own schedule.

Responsibilities include comparing AI-generated images and videos, inspecting outputs for issues, and rating across adherence, quality, and realism. Prior experience with evidence-based writing is helpful.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the AI Response Evaluator & Feedback Analyst in Ottawa, ON vacancy
  •  ...Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. This is a task-based...  ...clinical EHR vignettes for a medical AI evaluation project. General and internal medicine are the... 
    Suggested
    Part time
    For contractors
    Remote work
    Flexible hours

    Mindrift

    Ottawa, ON
    4 days ago
  • $100 per hour

     ...developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The project...  ...AI coding tools by gathering feedback from developers as they work on their...  ...versions of the AI assistant's response and asked to select the one that... 
    Suggested
    Hourly pay
    Contract work
    Freelance
    Remote work
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    1 day ago
  •  ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...Through Outlier’s evaluation and feedback loop, your work helps turn...  ...better in the real world. Responsibilities: Holding a live, scenario-... 
    Suggested
    Hourly pay
    Contract work
    For contractors
    Freelance
    Internship
    Remote work
    Night shift

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...define and drive Fullscript's defensive threat detection, incident response, and AI-assisted SecOps capability across our cloud infrastructure,...  ...adversarial validation exercises to test alert fidelity and evaluate detection resilience against AI-driven threats. Partner with... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Fullscript

    Ottawa, ON
    1 day ago
  •  ...client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business...  ...while creating software that changes the world. Your Role and Responsibilities Confluent Cloud processes millions of events per second across... 
    Suggested
    Full time

    IBM

    Ottawa, ON
    1 day ago
  •  ...Scale AI’s Outlier platform invites detail-oriented English speakers to review AI-produced media. You will engage in live conversations...  ...exchanges for naturalness and clarity, and outline why a given response met or missed the prompt, all on your own schedule. You’ll compare... 
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  • About Fullscript We’re an industry-leading health technology company on a mission to help people get better. We started in 2011 with one simple idea. Make it easier for practitioners to access the products they trust so they can deliver better care. That simple idea grew into...
    Full time

    Fullscript

    Ottawa, ON
    26 days ago
  •  ...Outlier, an AI training platform backed by Scale AI, seeks detail-oriented English speakers to review AI-generated media...  ...observations in writing from anywhere with flexible hours. Responsibilities include evaluating images, videos, and audio against prompts, and providing... 
    Weekly pay
    Contract work
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier is an AI training platform owned and operated by Scale AI. We seek detail-oriented English speakers to review AI-generated media, roleplay live conversations with an AI voice model, and score exchanges, all remotely and on your own schedule. You will write concise... 
    Weekly pay
    Contract work
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier, an AI training platform owned by Scale AI, is seeking detail-oriented English speakers to review AI-generated media. You will roleplay live conversations with an AI voice model, rank outputs, and explain your judgments in writing. Work remotely on your own schedule... 
    Weekly pay
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier is seeking fluent English speakers to help train AI models from a remote location. You’ll participate in live conversations, rate output quality, and provide concise explanations in English. Projects cover voice, image, and video AI tasks. Flexible hours and freelance... 
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  • $18 per hour

     ...Outlier is seeking freelance English-speaking contributors to help train AI models by evaluating live conversations, ranking how natural and clear each utterance sounds, and judging AI-generated images and videos for adherence to prompts. You’ll need a quiet workspace,... 
    Hourly pay
    Freelance
    Remote work
    Flexible hours

    Scale AI

    Ottawa, ON
    5 hours ago
  •  ...Evaluate large language model responses remotely with careful judgment, clear writing, and professional-level prompt development. Work flexible hours as an...  ...English-speaking freelance contractor. Outlier is a Scale AI-operated platform seeking contributors to train and refine... 
    Part time
    For contractors
    Freelance
    Remote work
    Flexible hours

    Outlier

    Ottawa, ON
    3 hours ago
  •  ...les services en français ; renforcer sa responsabilité sociale ; accroitre l’impact de l’enseignement...  ...une approche terrain, le titulaire est responsable de faire évoluer et d’enrichir les...  ...habiletés du personnel. Surveiller et évaluer l’efficacité du travail quotidien des membres... 
    Daily paid
    Internship
    Work at office
    Day shift

    Hôpital Montfort

    Ottawa, ON
    18 hours ago
  • $107.5k - $134.38k per year

     ...UGME Accreditation and Program Evaluation Campus: Roger Guindon...  ...uOttawa MD training program. Responsible for generating programmatic and...  ...site visits, status reports, response letters, mini-database,...  ...Accept and give constructive feedback. Able to adjust own behaviour... 
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    1 day ago
  •  ...plus intelligentes pour relier les villes, réduire l’empreinte carbone et remplacer la voiture.     Pourriez-vous être le/la Responsable Finance projet à temps plein à Saint-Bruno que nous recherchons ? Votre futur rôle Relevez un nouveau défi et mettez à profit... 
    Daily paid
    Full time
    Apprenticeship
    Flexible hours

    Alstom

    Ottawa, ON
    19 hours ago
  • $250k - $300k per year

     ...mais le candidat doit être basé à Toronto. À propos du rôle de Responsable du développement des ventes Tout ce qui nous a amenés à notre...  ...sommes à distance, mais restons proches grâce à un bureau virtuel AI et nous nous réunissons en personne au moins une fois par an pour... 
    Permanent employment
    Full time
    Work at office
    Work from home

    Motion

    Ottawa, ON
    5 days ago
  • $58k - $102k per year

     ...de conseiller ou conseillère, analyste d’affaires soutenant des...  ...collaborant étroitement avec les responsables de produits, les spécialistes...  ...analyses des lacunes et des évaluations des répercussions pour déterminer...  ...screening combined with AI technology to help identify the... 
    Permanent employment
    Apprenticeship
    Work at office
    Flexible hours
    Day shift

    Deloitte

    Ottawa, ON
    1 day ago
  • $96.37k - $113.48k per year

     ...Audit, the Risk Management Analyst supports the development, implementation...  ...across OPS.  Major Responsibilities Support the...  ...Internal Audit.  Assist in evaluating current practices, identifying...  ...the organization.  Gather feedback, track performance, and assist... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Monday to friday
    Shift work

    City of Ottawa

    Ottawa, ON
    1 day ago
  • usd15 per hour

     ...you want to influence the future of global AI search? If so, we want you on board! Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds to...  ...to enhance search engine results. Provide feedback on text, audio, images, and videos to refine... 
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Remote work
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    a month ago
  • Job Responsibility: Description Building Energy AnalystLocation: This position...  ...are hiring for senior energy analyst/project manager positions to...  ...proposals Assist with the evaluation and benchmarking of program...  ...shape the future. Candidate AI Usage Policy At ICF, we are... 
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    ICF

    Ottawa, ON
    4 hours ago
  • $85k - $111.3k per year

     ...maintained through Generative AI and agentic software engineering...  ...cases, prototype solutions, evaluate their impact on development efficiency...  .... Quality, Security and Responsible AI Engineering Develop...  ...developer experience. Gather feedback from users and continuously... 
    Long term contract
    Full time
    Temporary work
    Manual labor

    Ericsson

    Ottawa, ON
    5 days ago
  • $50k - $90k per year

     ...experience in government IT projects as a business analyst or related duties • 3-6 years of...  ...degree is a strong asset • Knowledge of AI tools for the purpose design analysis...  ...while safeguarding your privacy and using AI responsibly. Deloitte Canada has 20 offices with representation... 
    Permanent employment
    Flexible hours

    Deloitte

    Ottawa, ON
    1 day ago
  •  ...reconstruire ici — un reflet de la confiance, de la culture et de la conviction derrière ce que nous construisons. À propos du rôle de Responsable Senior de la Réussite Client  La plupart des emplois en CS consistent à favoriser l'adoption d'un outil. Celui-ci est différent.... 
    Permanent employment
    Full time
    Summer work
    Work at office
    Remote work
    Work from home
    Day shift

    Motion

    Ottawa, ON
    5 days ago
  •  ...contribuer à l'élaboration d'une stratégie de marketing efficace Aider au recrutement du personnel pour le département sous sa responsabilité Déterminer l'horaire de travail tout en respectant le budget de main-d'œuvre établi et en veillant à ce que les besoins des clients... 

    Rona+

    Ottawa, ON
    8 days ago
  • $65.17k - $86.9k per year

     ...marchés émergents ? Nous recherchons d'analystes pour se joindre à nos équipes d'...  ...équipes d’investissement, notamment celles responsables du financement mixte et de la mobilisation...  ...du cycle de vie des transactions, de l'évaluation des occasions et de l'origination jusqu'... 
    Permanent employment
    Contract work
    Work at office
    Worldwide
    Day shift

    FinDev Canada

    Ottawa, ON
    25 days ago
  •  ...About the Role: As a luxury brand evaluator, you will step into the world of luxury...  ...customer experiences, providing critical feedback that helps brands refine their services....  ...market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity.... 
    Contract work
    Worldwide
    Flexible hours

    CXG

    Ottawa, ON
    more than 2 months ago
  • $75k - $125k per year

     ...seeking Intermediate Agentic AI Developers / AI Engineers to...  ...years Your future duties and responsibilities: Design, develop, test, and...  ...capabilities. Evaluate, troubleshoot, and optimize AI...  ...applications, including testing, evaluation, monitoring, and responsible... 
    Full time

    CGI

    Ottawa, ON
    4 days ago
  • $107k - $114k per year

     ...OPPORTUNITY:   In the role of Process Analyst, you will participate in technical content...  ...based on the approved scope of work, and evaluate lab results Perform technical analysis...  ...all aspects of the selection process. AI technology may be used to assist in the screening... 
    Permanent employment
    Internship
    Work at office
    Flexible hours

    TechInsights

    Ottawa, ON
    7 days ago
  •  ...This role is Hybrid Ottawa AI Solutions Engineer Position...  ...for such access. Key Areas of Responsibility System Architecture: Review...  ...analysis, specifically evaluating the performance and reliability...  ...decisions, including candidate evaluation, selection, and disposition,... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Response Evaluator & Feedback Analyst. Be the first to apply!