Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Instructor - Response evaluation

$10 - $24 per hour
Temporary

YPAI

Teach live online classes on grading one AI response against written criteria: accuracy, instruction following and safety, with a justification behind every rating. You teach in English from a ready class kit, remotely, and you are paid for each class you teach.

What the work is for

YPAI Learn trains people for AI evaluation work in live classes. Your classes take learners from a gut feeling about one AI response to a rating they can back with evidence, and teach them to check each factual claim, each instruction in the prompt and each safety concern before they score.

The work

  • Teach the live class “Grade an AI response for accuracy and instruction following”, 90 minutes, from the class kit.
  • Teach the live class “Rate a response for safety and write the justification”, 90 minutes, from the class kit.
  • Show live how you split a prompt into its explicit instructions, check the response against each one and look up its factual claims in a reliable source.
  • Walk learners through a justification that names the exact error, quotes the sentence it sits in and explains how much it lowers the rating.
  • Help learners who rate on impressions, miss a false claim stated with confidence, or mark a harmless answer as unsafe.

What to expect

  • Each class runs live online in English, with learners joining from around the world; the application also asks what other languages you teach in.
  • Each class kit gives you a minute-by-minute plan, slides, speaker notes, a demo of grading a sample response and a backup recording of that demo.
  • You teach from your own computer, remotely, with a stable connection, a camera, a microphone and a browser for the grading exercise.
  • You take and pass the instructor test for a class before you teach it for the first time.
  • Before a teaching assignment starts, you sign an instructor agreement. It covers pay, confidentiality and how class material may be used.
  • Each invitation states the class times and the price learners pay, and you see both before you accept.

What you bring

  • A sample evaluation you wrote on a public or made-up prompt, with ratings and justifications you can show and explain.
  • Experience teaching, coaching new evaluators, reviewing other people's ratings or running training sessions.
  • Patience with learners who have never had to defend a rating in writing.

You need

  • Hands-on experience evaluating AI responses in real work, on AI training projects or for a team that ships AI features.
  • Careful fact-checking against reliable sources, and precise writing when you explain a rating.
  • Fluent spoken English, the language the classes are taught in.
  • 18 years or older.

Good to know

  • Where your employment contract asks for approval of outside work, get it in place before you accept an assignment.
  • How often you are invited depends on demand for the classes, and each invitation says how much time it is expected to take.
  • It is free to apply, and you do not have to buy or take any YPAI Learn course.

Pay

$10–$24/hr. Rate shown is for your country.

YPAI pays every two weeks for approved work via PayPal, Wise or bank transfer. Work is by invitation after your profile is reviewed.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Instructor - Response evaluation in Remote vacancy
  •  ...Teach live online classes on grading one AI response against written criteria: accuracy,...  ...for YPAI Learn trains people for AI evaluation work in live classes. Your classes take...  ...grading exercise. You take and pass the instructor test for a class before you teach it for... 
    Suggested
    Contract work
    Remote work

    YPAI

    Remote
    4 hours ago
  • $10 - $24 per hour

     ...Teach live online classes on ordering several AI responses from best to worst against written guidelines, the same way every time, and on...  ...Before you teach a class for the first time, you pass its instructor test. Before a teaching assignment starts, you sign an instructor... 
    Suggested
    Contract work
    Remote work

    YPAI

    Remote
    4 hours ago
  •  ...Project Are you fluent in French (FR) and interested in working on AI-related projects? We're currently looking for detail-oriented individuals to join our talent pool for an upcoming AI Response Evaluation and Fact-Checking project . This freelance, remote opportunity... 
    Suggested
    Contract work
    Freelance
    Remote work
    Flexible hours

    e2f

    Remote
    10 days ago
  • $10 - $30 per hour

     ...feedback digital delivery platforms ai-driven tools familiarity independent...  ...foundational models and agents. We provide frontier evaluations and reinforcement learning environments...  .... Role Title: Food Delivery AI Response Evaluator Role Type: Contractor... 
    Suggested
    Part time
    For contractors
    Remote work
    Shift work

    micro1

    Remote
    17 days ago
  •  ...AI Fact-Checking & Response Evaluation Reviewer (German) Mission of the Role Apply independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps. Successful reviewers do not simply validate AI-generated... 
    Suggested
    Long term contract
    Contract work
    Freelance
    Remote work
    Flexible hours

    e2f

    Remote
    1 day ago
  • $55 - $100 per hour

     ...Pay: $55–100/hour You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural questions, and litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate... 
    Contract work

    Claru

    Remote
    a month ago
  • $10 - $24 per hour

     ...live online classes for developers on building AI agents in code: tool definitions, the agent loop, planning, memory, evaluation and guardrails. You teach in English,...  ...You teach a class once you have passed the instructor test for that class. Before a teaching assignment... 
    Contract work
    Manual labor
    Remote work

    YPAI

    Remote
    1 day ago
  • $10 - $24 per hour

     ...gives developers live classes in building AI that answers from their own documents....  ...notebook or service. Each class has an instructor test, and you pass it before your first time...  ...real documents, with its repository, evaluation results or a write-up you can walk through... 
    Contract work
    Manual labor
    Remote work

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...Show live how a JSON schema and a tool definition shape the response, how to validate it in code, and what to do when the output is...  ...demo service. Ahead of your first class, you pass that class's instructor test. Before a teaching assignment starts, you sign an instructor... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  • $10 - $24 per hour

     ...Teach live online classes on AI governance for managers and executives: writing a policy...  ...YPAI Learn teaches leaders to run AI responsibly in live classes. Your classes take a leadership...  ...camera and a microphone. There is an instructor test for each class, and you pass it... 
    Contract work
    Manual labor
    Remote work

    YPAI

    Remote
    1 day ago
  •  ...rubrics and criteria that other people grade AI responses with, from a first draft to criteria...  ...the rubric takes shape. Passing the instructor test for a class comes before your first...  ...criteria or guidelines that others used to evaluate AI output. ~ Precise written English... 
    Contract work
    Remote work

    YPAI

    Remote
    4 hours ago
  •  ...editing skills in your native language. Strong attention to detail and ability to follow written guidelines. Comfortable working with AI-generated content. Reliable internet connection. Ability to work remotely using a client-provided laptop. French (France)... 
    Remote work

    OneForma

    Remote
    a month ago
  •  ...What the work is for YPAI Learn teaches people to build with AI tools in live classes. Your classes take learners from an idea to...  ...fast, stable connection. Both Lovable classes have their own instructor test, and you need to pass it ahead of your first time leading that... 
    Contract work
    Live In
    Remote work

    YPAI

    Remote
    4 hours ago
  • $10 - $24 per hour

     ...What the work is for YPAI Learn teaches people to build with AI tools in live classes. Your classes take learners from a first app...  ...rely on. To teach a Replit class, you first pass that class's instructor test, ahead of your first session. Before a teaching assignment... 
    Contract work
    Live In
    Remote work

    YPAI

    Remote
    4 hours ago
  •  ...teach. What the work is for YPAI Learn teaches research with AI tools in live classes for people at work. Your classes take...  ...from. Before you teach a class for the first time, you pass its instructor test. Before a teaching assignment starts, you sign an instructor... 
    Contract work
    Remote work

    YPAI

    Remote
    4 hours ago
  •  ...What the work is for YPAI Learn teaches people to create with AI tools in live classes. Your classes take learners from a first four...  ...Midjourney account to demo from in the web app. You pass the instructor test for a class before you teach it for the first time.... 
    Contract work
    Remote work

    YPAI

    Remote
    4 hours ago
  •  ...visual automation with Make: scenarios, routers, data mapping and AI modules that read and sort incoming data. You teach in English,...  ...account you can build and run scenarios in during class. The instructor test for each class comes first: you pass it before you teach that... 
    Contract work
    Remote work

    YPAI

    Remote
    4 hours ago
  • $10 - $24 per hour

     ...prepare medication reviews and answer drug information questions with AI, and to verify each answer in their own references. You teach in...  ...drug references open for the demo. Each class has its own instructor test, and passing it comes before your first time teaching that class... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  • $10 - $24 per hour

     ...work is for YPAI Learn runs live classes on researching with AI for people who work with many documents. Your classes take learners...  ...NotebookLM account you can demo from. Each class has its own instructor test; you pass it before your first class of that kind. Before... 
    Contract work
    Remote work
    Worldwide

    YPAI

    Remote
    1 day ago
  • $10 - $24 per hour

     ...YPAI Learn runs live classes where people learn to work well with AI assistants. Your classes take learners from pasting a single file...  ...Claude account with projects to demo from. Each class has an instructor test, and you pass it before you teach that class the first time.... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  • $10 - $24 per hour

     ...Teach live online classes on creating content with AI: clear briefs, drafts in a consistent voice, careful editing, fact checks and...  ...and an AI writing assistant ready for the demo. You pass the instructor test for each class before the first time you teach it. Before... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  •  ...Teach live online classes for journalists on using AI in reporting without giving up verification or sourcing. You teach in English...  ...microphone and audio good enough to play back a recording. You pass an instructor test for each class ahead of teaching it. Before a teaching... 
    Contract work
    Remote work
    Worldwide

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...What the work is for YPAI Learn teaches people to build with AI tools in live classes. Your classes take learners from a live app...  ...connection, a camera and a microphone. Each Cursor class comes with an instructor test. Passing it is the step before you teach that class for the... 
    Contract work
    Second job
    Live In
    Remote work

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...lessons at several levels and to draft feedback on student work with AI, while the judgment stays theirs. You teach in English from a...  ...and an AI assistant to plan the demo lesson in. You pass the instructor test for each class before teaching it. Before a teaching assignment... 
    Contract work
    Local area
    Remote work
    Work from home

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...Teach live online classes for product and UX designers on using AI in research synthesis, exploring directions and reviewing finished...  ...you will share on screen. To teach a class, you first pass its instructor test. Before a teaching assignment starts, you sign an... 
    Contract work
    Local area
    Remote work

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...Teach live online classes on AI prospecting for salespeople and founders: researching accounts, building prospect lists within data...  ...plus an AI assistant with web search to demo from. Passing the instructor test for a class comes before you teach it for the first time.... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  •  ...Teach live online classes on AI strategy for managers and executives: finding where AI fits in the work, ranking use cases and writing...  ...you fill in the use-case map on a shared screen. You pass the instructor test for a class before you teach it for the first time.... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  •  ...Teach doctors to use AI for clinical letters and literature searches, and to check every line before it goes into a record. You teach...  ...AI assistant account that holds no patient data. You take the instructor test for a class, and pass it, before you teach that class for the... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...What the work is for YPAI Learn teaches people at work to use AI assistants well in live classes. Your classes take learners from...  ...microphone and a ChatGPT account you can demo from. You pass the instructor test for a class before you teach it for the first time.... 
    Contract work
    Work at office
    Remote work

    YPAI

    Remote
    1 day ago
  • $26 - $99 per hour

     ...structured records and to explain treatment plans in plain words with AI, checking each note before it is saved. You teach in English from...  ...tool for the record demo. For every class there is an instructor test, which you pass before you teach the class. Before a teaching... 
    Contract work
    Remote work

    YPAI

    Remote
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Instructor - Response evaluation. Be the first to apply!