Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Everyday AI Agent Tester

$25 - $45 per hour
Part-time

micro1

pay

Required Skills
ChatGPT
Muse
AI agents
Attention to Detail
Following Instructions
Screen Recording
About micro1
micro1 is a data lab that helps AI labs & Enterprises train foundational models and agents. We provide frontier evaluations and reinforcement learning environments to improve LLM capabilities, as well as contextual evaluations to monitor and improve AI agents in enterprise settings.

Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-quality training data. Our research spans high-value, specialized domains (legal, medical, finance, coding, etc.), where expert-level data is the hardest to produce and most valuable for advanced model performance. Our pipeline performance system ensures both quality and velocity.

Role Title: Everyday AI Agent Tester

Role Type: Contractor

Location: U.S based

Opportunity Snapshot

Pay: $25-45/hour

Time per task: ~1.5 hours per run (evidence and scoring included)

Project kickoff: Monday, October 12

Onboarding: Today (Fri), Saturday, or Sunday, so you’re ready to start Monday

You’ll need: An active personal popular AI account (Free, Go, or Plus; not Pro), an active personal and a smartphone that can screen record

Your tasks: Run everyday errands with two AI agents, approve key steps, screen record, and score the results

About the role

AI agents are starting to handle real-life errands: paying bills, booking trips, doing the groceries. We want to know how well they actually do it, from the point of view of a real user. That’s you.

You’ll test two AI agents side by side, using your own accounts on your phone, and tell us what worked, what didn’t, and how it felt.

What you’ll do
Run real-life scenarios: bills, returns, email follow-ups, bookings, shopping, groceries, travel, family logistics, outings, and forms
Approve or stop the agent at key steps
Screen record every attempt
Score each run on
completion, quality, control issues, satisfaction, and time
Share clear written feedback on the agent experience
Who we’re looking for
US-based
, with a Bachelor’s degree
Someone who already uses
AI in daily life
2-3 years
of experience, preferably in engineering, business management, or office/operations
Detail-oriented, great at following instructions and documenting each step
Clear written communication
Generalists welcome, domain experts preferred
No coding or AI background needed

Why you’ll like it
Get paid to use the AI tools you already use
Work entirely from your phone, on your schedule
Have a direct say in how next-generation AI agents get built and improved

How the selection process works
Complete the screening questions
Interview
: 15-30 minutes max
Profile review:
if everything looks good, we present you to the client
Onboarding:
our Talent Ops team will contact you to get you started

Email

By clicking any of the "Continue" buttons below, you acknowledge and agree to our Terms and Privacy Policy for candidates.

Continue
or
Continue with Google
Continue with LinkedIn

Have any questions? See FAQs

Refer and Earn
$100

Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Everyday AI Agent Tester in Remote vacancy
  •  ...What You'll Do Complete a short series of simple tasks related to consumer choices Chat openly with an AI moderator about your experiences and preferences Provide honest and detailed feedback on the questions presented during the session Who Should Apply Regular consumer... 
    Suggested
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    10 days ago
  •  ...Nibiru is seeking a skilled AI Agent Launchpad Builder to develop a robust launchpad platform capable of integrating the Eliza framework, among other frameworks for agent builders to use and facilitate a launch of a native Nibiru token. This third-party role is ideal for... 
    Suggested

    Nibiru

    Remote
    5 days ago
  •  ...We are looking for an experienced Test Lead to drive the Quality and Validation strategy for...  ...in a highly regulated industry, involving AI components and Salesforce integration. In this...  ...the gap between newly developed AI Agents components and the client’s Salesforce environment... 
    Suggested
    Full time
    Contract work

    Digital Forms

    Remote
    3 days ago
  •  .... Provide open, constructive feedback on how the overall experience could be improved. Who Should Apply Comfortable navigating everyday digital platforms and basic online interfaces. Ability to clearly articulate your thought process while completing tasks. Willingness... 
    Suggested
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    10 days ago
  •  ...their campaigns and helping them stay on brand. Oh, and we have a bit of fun while doing it, too! The Role: Senior Software Developer, AI Agents We’re looking for an experienced software developer to build and scale the AI agents behind Knak’s platform. In this role you'll... 
    Suggested
    Full time

    Knak

    Remote
    a month ago
  •  ...leveling up. Now we’re looking for an AI Engineer to build AI agents and solutions that transform...  ...tasks (requirements refinement, coding, testing). Improve team velocity and reduce...  ...support for initiatives are part of our everyday culture. Support for sports events.... 
    Work at office
    Remote work
    Flexible hours

    Betterme

    Remote
    12 days ago
  •  ...What You'll Do Review realistic programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while... 
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    12 days ago
  •  ...leveling up. Now we’re looking for an AI Engineer to build AI agents and solutions that transform...  ...the SDLC, including implementation, testing, code review, and CI/CD. Build quality...  ...support for initiatives are part of our everyday culture. Support for sports events.... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Betterme

    Remote
    1 day ago
  •  ...where your audience isn't only human. Its agents too. As AI agents become active participants in...  ...version management, and dataset-driven testing, whatever the tooling. ~ Cloud deployment...  ...tools (Claude, Cursor, Copilot) as everyday accelerators, and MCP or similar for connecting... 
    Full time
    Local area

    Acquia

    Remote
    1 day ago
  •  ...You'll Do Participate in a remote intro call to discuss your technical background. Share your experience building workflows with AI agents. Discuss potential ideas for open-source agent cookbook examples. Review a follow-up proposal for repository contributions. Who Should... 
    Contract work
    For contractors
    Remote work

    Terac

    Remote
    12 days ago
  •  ...applications and next steps. Our partner is looking for a Software Test Automation Engineer based in Canada. This remote contract...  ...You will also explore emerging technologies, including Generative AI-assisted test generation, to improve testing efficiency and coverage... 
    Full time
    Contract work
    Remote work
    Shift work

    Jobgether

    Remote
    2 days ago
  •  ...reflected in how our team works: we embrace AI as a core productivity multiplier, with all...  ...of this role As Staff Product Manager, Test & Code Coverage, you'll build product capabilities...  ...Engineering and Design, you'll explore how agents can diagnose failures, recommend next steps... 
    Full time

    Gitlab

    Remote
    1 day ago
  •  ...culture. Senior Engineer - Penetration Testing  Department: Services Location: Remote...  ...hands-on hardware and software penetration tests of connected devices, embedded systems,...  ...in the customer's supply chain. Leverage AI-powered security tooling and LLM-assisted workflows... 
    Full time
    Remote work
    Relocation

    Finite State

    Remote
    4 days ago
  • $1 350 per unit

     ...more Bring your expertise to the problems today’s most advanced AI agents still struggle to solve. We’re looking for experienced...  ...challenges that expose limitations in advanced AI agents. Each task is tested against three leading models, with three attempts per model, and... 
    Contract work

    Braintrust

    Remote
    12 days ago
  •  ...THE ROLE We are looking for applied AI engineers to build AI-native systems for BJAK...  ...teams. WHAT YOU WILL BUILD – Build AI agents, workflows, tools and automations that solve...  ...should not. – Able to ship working systems, test quality and improve reliability over time.... 
    Full time
    Remote work

    Bjak

    Remote
    7 days ago
  •  ...person, we’d love to talk to you. THE ROLE Secure BJAK’s AI-enabled products and agent workflows using third-party models. Focus on customer data...  ...privilege and explicit authorization. – Implement and test tenant and user data isolation across prompts, conversation... 
    Full time
    Remote work

    Bjak

    Remote
    11 days ago
  • $137.6k - $172k per year

     ...customers build the skills they need for a world being reshaped by AI. Read more about the combined company by visiting our  blog ....  ...difference at global scale. Job Overview: As a Senior Software Test Engineer (Test Infrastructure and Tooling) at Coursera, you’ll play... 

    Coursera

    Remote
    11 days ago
  • $140k - $180k per year

     ...Responsibilities Design and build Sierra Agent Studio journeys for chat, voice, and email...  ...experience in Solutions Engineering, Conversational AI, or Technical Product roles. ~ Working...  ...for non-deterministic systems, including test sets, simulations, LLM-as-judge systems,... 
    Full time
    Internship
    Flexible hours

    Upgrade

    Remote
    1 day ago
  •  ...About the Role: An AI Experience Engineer owns the full lifecycle of the journeys our customers have with Upgrade's AI agent on chat, voice and email: creation, optimization, edge case...  ...set the standards for how Upgrade builds, tests and ships AI experiences. Our Core Technologies... 
    Internship

    Upgrade

    Remote
    1 day ago
  •  ...Evaluate AI personalization quality using your personal experiences...  ..., multimodality, and agents; and second, by applying that expertise...  ...personal Google account (not a testing account) and enable personal data...  ...personal context to thoroughly test the model's capabilities.... 
    Full time
    Part time
    For contractors
    Local area
    Remote work

    Turing

    Remote
    6 days ago
  •  ...USPTO registered patent agents to build the claim drafting and prosecution scenarios frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring USPTO registered patent... 
    Weekly pay
    Ongoing contract
    Contract work
    For contractors
    Work at office
    Remote work
    10 hours per week

    AfterQuery

    Remote
    12 days ago
  •  ...details Write product and technical specifications together with AI agents, and take full responsibility for every line of them Delegate...  ...and integrations; you won’t be writing code by hand Test the features you deliver and ensure the reliability of code that... 
    Full time
    Manual labor
    Work at office
    Remote work
    Work from home

    Social Discovery Group

    Remote
    6 days ago
  •  ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California, Turing is the world...  ..., reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help... 
    Ongoing contract
    Part time
    For contractors

    Turing

    Remote
    6 days ago
  •  ...Our partner is looking for an AI-Directed Software Engineer based...  ...concept through implementation, testing, deployment, and production...  ...will also develop intelligent agent workflows using Amazon Bedrock,...  ...efficiently and consistently. - Review, test, debug, and harden AI-generated... 
    Full time

    Jobgether

    Remote
    2 days ago
  •  ...innovative connectivity solutions. As a testament to our success, we're proud to stand as a...  ...changing. Telnyx is increasingly building AI agents and automation that interact directly with...  ...Design and run experiments (A/B tests, prompt variations, model comparisons) with... 

    Telnyx

    Remote
    2 days ago
  • $128.5k - $160.6k per year

     ...Software Engineer for the Automation team to use AI to solve and automate manual work across...  ...engineering role: authoring skills, wiring agents to our systems of record through MCP,...  ...together. We want someone who will pressure test those hypotheses against their own experience... 
    Full time
    Fixed term contract
    Live In
    Work at office
    Remote work
    Home office
    Flexible hours

    Coalition, Inc.

    Remote
    7 days ago
  •  ...looking for a Product Engineer (AI-Native) based in Canada. Own...  ...software development, using AI agents as your primary development partners...  ...statement through development, testing, deployment, and production. -...  ...technical solution. - Test and validate delivered features... 
    Full time
    Remote work

    Jobgether

    Remote
    8 days ago
  •  ...Our partner is looking for a Staff Engineer, AI Productivity based in Canada. This is a...  ...integrations, and documentation that enable AI coding agents to work effectively across a large codebase...  ...environments and execute comprehensive test suites. - Build and maintain integrations... 
    Full time

    Jobgether

    Remote
    8 days ago
  •  ...Our work focuses on diverse areas including AI, social media, security and more. And we’...  ...implementation of our next-generation AI agent frameworks and workflows. This is a 'ground...  ...execution. AI-Native Workflow: Deep, everyday proficiency building software with advanced... 
    Long term contract
    Full time
    Internship
    Immediate start
    Home office

    Mozilla

    Remote
    4 days ago
  •  ...applications and next steps. Our partner is looking for a Director AI - AdFarm based in Canada. As Director of AI & Innovation, you...  ...stakeholders understand their benefits and integrate them effectively into everyday workflows. - Performance Measurement and Reporting: Define... 
    Long term contract
    Full time
    Internship

    Jobgether

    Remote
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Everyday AI Agent Tester. Be the first to apply!