Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Response Evaluator Canada

OpenTrain AI, Inc.

Evaluate large language model responses remotely from Canada, using academic knowledge, careful reasoning, and strong writing skills. Work part time asynchronously.

As an AI Evaluation Specialist, you will support AI training by reviewing model performance across assigned fields and topics. Use critical thinking to identify strengths, weaknesses, and improvement areas. Follow detailed written instructions while assessing AI systems closely and independently.

Key Responsibilities:

  • Evaluate large language model responses across assigned topics
  • Identify model strengths, weaknesses, and improvement opportunities
  • Follow detailed written instructions accurately
  • Review AI systems with close attention to detail

Requirements:

  • Professional English fluency and strong written communication
  • Current or completed bachelor's, master's, or PhD program
  • Academic institution located in Canada, United States, Australia, or United Kingdom
  • Careful reasoning and reliable instruction following
  • Comfort evaluating AI systems independently

Apply academic reasoning and precise writing to evaluate AI responses in a remote, part time Canadian project.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Response Evaluator Canada in Ottawa, ON vacancy
  •  ...specialists with project-based AI opportunities for leading tech...  ..., focused on testing, evaluating, and improving AI systems. This...  ...which tasks to take and when ~ Remote: open to US-licensed physicians...  ...EHR vignettes for a medical AI evaluation project. General and internal... 
    Remote work
    Part time
    For contractors
    Flexible hours

    Mindrift

    Ottawa, ON
    4 days ago
  • usd15 per hour

     ...influence the future of global AI search? If so, we want you on board...  ...of RWS, you will test and evaluate how our clients’ search engine...  ...French proficiency. Location: Canada (Work from Home). Schedule: E....  ...parents, or anyone seeking flexible remote work to improve AI models. No... 
    Remote work
    Weekly pay
    Full time
    Part time
    Freelance
    Second job
    Work from home
    Home office
    Flexible hours

    Rws

    Ottawa, ON
    a month ago
  • $100 per hour

     ...software developers to participate in an AI training project focused on testing and evaluating AI coding assistants. The...  ...versions of the AI assistant's response and asked to select the one that works...  ...Additional Information Fully remote freelance opportunity.... 
    Remote work
    Hourly pay
    Contract work
    Freelance
    Worldwide
    10 hours per week

    Lifted, an Upwork Company™

    Ottawa, ON
    1 day ago
  •  ...'s defensive threat detection, incident response, and AI-assisted SecOps capability across our cloud...  ...exercises to test alert fidelity and evaluate detection resilience against AI-driven threats...  ...privacy and employment laws in Canada and the U.S.   Learn More   @fullscriptHQ... 
    Suggested
    Full time
    Work at office
    Work from home
    Flexible hours

    Fullscript

    Ottawa, ON
    1 day ago
  •  ...crucial, client-facing role that is responsible for day-to-day client...  ...including actively learning how AI and automation can enhance marketing...  ...Requirements As a remote-first company, you’ll have the...  ...established businesses, including Canada, Mexico, and the UK. For global... 
    Remote work
    Work at office
    Work from home
    Home office

    Directive

    Ottawa, ON
    8 days ago
  • $175k - $200k per year

     ...different “hats”. You'll be equally responsible for the strategic & financial...  ...and direct margin goals. AI & Technology Integration -...  ...WORK ENVIRONMENT Directive is a remote-first company. This role...  ...business operations, including Canada, Mexico, and the UK. Current,... 
    Remote work
    Permanent employment
    Full time
    For contractors
    Home office

    Directive

    Ottawa, ON
    12 days ago
  •  ...About FullStack FullStack is your AI-native engineering partner, built to turn AI capability...  ..., driving technical best practices, and evaluating trade-offs for org-wide initiatives. ~...  ...We Offer ~ Competitive pay. ~100% remote work. ~ The ability to work with leading... 
    Remote work
    Full time
    Flexible hours

    FullStack

    Ottawa, ON
    25 days ago
  •  ...solutions. Building the world's leading AI-powered, cloud-native products that shape...  ...software that changes the world. Your Role and Responsibilities Confluent Cloud processes millions of...  ...Details Must have the ability to work in Canada without sponsorship. This role will... 
    Full time

    IBM

    Ottawa, ON
    1 day ago
  • $55k per year

     ...we will teach you how to identify potential homeowner challenges for which Leaf Home has the solution. Primary Responsibilities Generate sales leads for our outside sales team by covering an assigned territory each day, canvassing and engaging prospective... 
    Remplacement
    Work from home
    Weekend work
    Afternoon shift

    LeafHome

    Ottawa, ON
    3 days ago
  • About Fullscript We’re an industry-leading health technology company on a mission to help people get better. We started in 2011 with one simple idea. Make it easier for practitioners to access the products they trust so they can deliver better care. That simple idea grew into...
    Full time

    Fullscript

    Ottawa, ON
    26 days ago
  •  ...Tenstorrent is leading the industry on cutting-edge AI technology, revolutionizing performance expectations, ease of use, and cost efficiency...  ...fits best. What each team does:  Architecture: We define and evaluate the system, CPU, memory, fabric, and chiplet-level decisions that... 
    Permanent employment
    Internship

    Tenstorrent University Jobs

    Ottawa, ON
    a month ago
  • $200k - $245k per year

     ...leading security-first enterprise AI company. We build cutting-edge...  ...we build. Each one of us is responsible for contributing to increasing...  ...organizations procure, evaluate, and deploy technology Familiarity...  .... You'll work on some of Canada's most sensitive and impactful... 
    Remote work
    Full time
    For contractors
    Work at office
    Local area
    Immediate start
    Home office

    Cohere

    Ottawa, ON
    1 day ago
  •  ...est l’un de six hôpitaux au Canada qui : sont des hôpitaux universitaires...  ...en français ; renforcer sa responsabilité sociale ; accroitre l’impact...  ...terrain, le titulaire est responsable de faire évoluer et d’...  ...personnel. Surveiller et évaluer l’efficacité du travail quotidien... 
    Daily paid
    Internship
    Work at office
    Day shift

    Hôpital Montfort

    Ottawa, ON
    18 hours ago
  •  ...Strategist is a crucial, client-facing role responsible for day-to-day client deliverables,...  ...Work Environment Requirements As a remote-first company, you’ll have the ability to...  ...we have established businesses, including Canada, the UK, and Australia. For global locations... 
    Remote work
    Work at office
    Home office

    Directive

    Ottawa, ON
    1 day ago
  •  ...Evaluate large language model responses remotely with careful judgment, clear writing, and professional-level prompt development. Work flexible hours as an English...  ...-speaking freelance contractor. Outlier is a Scale AI-operated platform seeking contributors to train and... 
    Remote work
    Part time
    For contractors
    Freelance
    Flexible hours

    Outlier

    Ottawa, ON
    3 hours ago
  •  ...Evaluate large language model responses remotely with Outlier while using analytical judgment and precise writing. Choose flexible hours in a freelance contract. Outlier, a Scale AI platform, is seeking entry-level English speakers to refine cutting-edge AI systems. This... 
    Remote work
    Contract work
    Freelance
    Work at office
    Flexible hours

    Outlier

    Ottawa, ON
    3 hours ago
  •  ...plus intelligentes pour relier les villes, réduire l’empreinte carbone et remplacer la voiture.     Pourriez-vous être le/la Responsable Finance projet à temps plein à Saint-Bruno que nous recherchons ? Votre futur rôle Relevez un nouveau défi et mettez à profit... 
    Daily paid
    Full time
    Apprenticeship
    Flexible hours

    Alstom

    Ottawa, ON
    19 hours ago
  • $110k - $145k per year

     ...transformation initiatives for customers in Canada, the United States, and other...  ...organizations, time zones, and stakeholders. Key Responsibilities • Lead full-cycle ERP implementation,...  ...management. Work Environment Remote position requiring Canadian residency, with... 
    Remote job
    Full time

    Tsunami Tsolutions

    Ottawa, ON
    10 days ago
  • $107.5k - $134.38k per year

     ...UGME Accreditation and Program Evaluation Campus: Roger Guindon...  ...bilingual medical faculty in Canada. Our learners have access to...  ...uOttawa MD training program. Responsible for generating programmatic and...  ...site visits, status reports, response letters, mini-database,... 
    Permanent employment
    Temporary work
    For contractors
    Interim role
    Work at office

    University of Ottawa

    Ottawa, ON
    1 day ago
  • $250k - $300k per year

     ...être basé à Toronto. À propos du rôle de Responsable du développement des ventes Tout ce qui...  ...hybride : Notre équipe s'étend au Canada, aux États-Unis et au-delà, avec des espaces...  ...restons proches grâce à un bureau virtuel AI et nous nous réunissons en personne au moins... 
    Permanent employment
    Full time
    Work at office
    Work from home

    Motion

    Ottawa, ON
    5 days ago
  •  ...Outlier is an AI training platform owned and operated by Scale...  ...generating training data to evaluating the performance of models....  ...looked or sounded wrong, all remotely and on your own schedule....  ...better in the real world. Responsibilities: Holding a live, scenario-... 
    Remote work
    Hourly pay
    Contract work
    For contractors
    Freelance
    Internship
    Night shift

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier, an AI evaluation platform owned by Scale AI, seeks detail-oriented English speakers to review AI-generated media, engage in live conversations...  ...and quality. You’ll provide written explanations and operate remotely with flexible hours. Typical tasks include image and video... 
    Remote work
    For contractors
    Freelance
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier is an AI evaluation platform operated by Scale AI. We hire detail-oriented English speakers to review AI-generated media, roleplay...  ...model, and score outputs for adherence to prompts. You work remotely on your own schedule, with pay per hour and additional incentives... 
    Remote work
    Hourly pay
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier, an AI training platform owned by Scale AI, seeks detail‑oriented English speakers to review AI-generated media. You will roleplay...  ...and able to make clear decisions when faced with imperfect options. Remote, freelance opportunities with flexible hours. #J-18808-Ljbffr
    Remote work
    Freelance
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Scale AI, via Outlier, is seeking detail-oriented English speakers to review AI-generated media by engaging in live conversations with...  ...fidelity to prompts and explain what looked or sounded off, remotely and on your own schedule. Ideal candidates are fluent in English... 
    Remote work

    Scale AI

    Ottawa, ON
    3 hours ago
  •  ...Outlier is seeking detail-oriented English speakers to review AI-generated media remotely on a flexible schedule. You will role-play live...  ..., score exchanges, and compare AI outputs to prompts. Responsibilities include inspecting outputs for distortions, flickering, or... 
    Remote work
    Weekly pay
    For contractors
    Freelance
    Flexible hours

    Scale AI

    Ottawa, ON
    3 hours ago
  • $75k - $125k per year

     ...seeking Intermediate Agentic AI Developers / AI Engineers to...  ...initiative with a major Government of Canada department. The successful...  ...Your future duties and responsibilities: Design, develop, test, and...  ...orchestration capabilities. Evaluate, troubleshoot, and optimize... 
    Full time

    CGI

    Ottawa, ON
    4 days ago
  •  ...Location: Ottawa, Canada In fast changing markets, customers worldwide...  ...This role is Hybrid Ottawa AI Solutions Engineer Position...  ...such access. Key Areas of Responsibility System Architecture:...  ...options analysis, specifically evaluating the performance and reliability... 
    Long term contract
    Full time
    Temporary work
    Local area
    Worldwide

    Thales

    Ottawa, ON
    4 days ago
  •  ...conviction derrière ce que nous construisons. À propos du rôle de Responsable Senior de la Réussite Client  La plupart des emplois en CS...  ...d'abord, hybride optionnel : Membres de l'équipe à travers le Canada, les États-Unis et au-delà, avec des bureaux à Toronto, Montréal... 
    Remote work
    Permanent employment
    Full time
    Summer work
    Work at office
    Work from home
    Day shift

    Motion

    Ottawa, ON
    5 days ago
  •  ...looking for a skilled Senior AI Engineer with Python, LangGraph...  ...and business impact. Responsibilities   Develop and enhance...  ..., monitoring, telemetry, and evaluation platforms. Strong knowledge...  ...flexibility that comes with remote work. Growth Mindset: reap... 
    Remote work
    Internship
    Relocation

    Miratech

    Ottawa, ON
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Response Evaluator Canada. Be the first to apply!