Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Agent Power User - Remote

YO AI Labs

AI Agent Power User

Role Type: Contractor
Location: Remote - US, Canada, UK, Ireland, Australia, New Zealand

We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.

You'll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.

Scope of Work

  • Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
  • Document workflows and identify where AI performance meets or falls short of real business requirements.
  • Evaluate AI-generated outputs using defined rubrics and quality criteria.
  • Provide clear, actionable feedback to AI research and product teams.
  • Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
  • Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
  • Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Preferred Qualifications

  • 5+ years of professional experience in any business function involving technology and operational problem-solving.
  • Bachelor's degree or higher in any discipline.
  • Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
  • Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
  • Comfortable working with AI tools and common workplace productivity platforms.
  • Excellent written English and strong documentation skills.
  • Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand .
#J-18808-Ljbffr
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the AI Agent Power User - Remote in Toronto, ON vacancy
  • $60 - $70 per hour

     ...technical talent with leading AI research labs. Headquartered in...  .... Position: Application Users - macOS Sonoma 14.5 Expert - Professionals...  ...–$70/hour Location: Remote Role Responsibilities...  .... Collaborate with Mac power users , Apple-platform administrators... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $30 - $35 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...Dorsey . Position: AI Assistant User – Weekly Feedback Study Type: Contract...  ...: $30–$35/hour Location: Remote Role Responsibilities Use Meta... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    8 days ago
  •  ...center. Our platform combines the best of AI and human intelligence to help...  ...developer who loves building beautiful user experiences and harnessing the power of cutting-edge AI? We're looking for...  ...join us at Cresta and help take our AI Agent Builder platform to the next level.... 
    Remote work
    Full time
    Work at office
    Local area
    Work from home
    Home office

    Cresta Intelligence

    Toronto, ON
    4 days ago
  •  ...center. Our platform combines the best of AI and human intelligence to help contact centers...  .... About the role: At Cresta, the AI Agent team is on a mission to create state-of-the...  ...office stipend to help you succeed in a remote environment Lunch reimbursement for in-office... 
    Remote work
    Full time
    Manual labor
    Work at office
    Local area
    Work from home
    Home office

    Cresta Intelligence

    Toronto, ON
    4 days ago
  •  ...connected future through world-class networks, AI-powered solutions, and digital experiences that...  ...will drive end-to-end design across full user journeys, from early concept through to...  ...feedback from both customers and internal agent-facing users. ~Contribute to design system... 
    Suggested
    Full time
    Work at office
    3 days per week

    Bell

    Toronto, ON
    10 days ago
  • $50 - $60 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Contract Compensation: $50–$60/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities... 
    Remote job
    Contract work
    Summer work
    Freelance
    Immediate start

    Mercor

    Toronto, ON
    8 days ago
  • $51.45k per year

     ...approximately 40 related vendor and specialized web applications; and central Business Intelligence. Your opportunity: Reporting to the Manager, User Experience & Process Design, or their designate, you will be part of a dynamic, collaborative and innovative team focused on delivering... 
    Full time

    University of Toronto

    Toronto, ON
    1 day ago
  • $30 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$30/hour Location: Remote Duration: 4.5 hours total...  ...inbound calls to test the CX agent's responses and behavior....  ...feedback on conversation flow and user experience to enhance AI model... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    a month ago
  • $185k - $231.5k per year

     ...natural and frictionless. Join us in our mission to activate new users and convert first-time visitors into loyal customers through innovation...  ..., focusing on building high-performance, scalable systems that power a frictionless early-user experience from intent to long-term... 
    Long term contract
    Full time
    Manual labor
    Local area

    DoorDash Canada

    Toronto, ON
    12 days ago
  •  ...Mercata is looking for a few experienced buy-side equity analysts to participate in early user testing of our new AI-native Research OS for hedge funds and alternative asset managers. We are not looking for financial analysts, or investment bankers, quants or macros... 
    Contract work

    Mercata

    Toronto, ON
    more than 2 months ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ..., and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator...  ...: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    a month ago
  • $30 - $50 per hour

     ...conversation into a competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation, and comprehensive...  ..., Cox Communications, and Marriott, use Cresta to power world-class customer experiences every day.  Born from... 
    Internship
    Work at office

    Cresta

    Toronto, ON
    a month ago
  • $30 - $50 per hour

     ...competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation,...  ..., and Marriott, use Cresta to power world-class customer experiences every...  ...responsibilities will include designing the end-user experiences and the tools and... 
    Hourly pay
    Internship
    Work at office
    Local area

    Cresta

    Toronto, ON
    a month ago
  • $80 - $120 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ..., and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator...  ...: $80–$120/hour Location: Remote Role Responsibilities Evaluate... 
    Remote job
    Contract work
    Summer work
    Work at office

    Mercor

    Toronto, ON
    more than 2 months ago
  • $72k - $138k per year

     ...-focused Senior Consultant to join our team as a Data Scientist / Power Systems Analyst. This role is ideal for a professional who brings...  ...• Stay informed on trends in power systems, utility analytics, AI/ML, energy markets, and grid modernization. • Support proposal development... 
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    10 hours ago
  • $22 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: $16–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents to identify jailbreaks, prompt injections, misuse... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    11 days ago
  • $22 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: $16–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents. Perform jailbreaks, prompt injections, misuse... 
    Remote job
    Contract work
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    13 days ago
  • $140.6k - $190.6k per year

     ...future of legal research with AI? Join our Global Westlaw Engineering...  ...operates the technology that powers Westlaw, the world's leading...  ...Oversee the development of scalable user interfaces, backend services,...  ...Model AI-assisted and agent-driven development as a team norm... 
    Full time
    Internship
    Work at office
    Local area
    Worldwide
    Flexible hours
    Shift work

    Thomson Reuters

    Toronto, ON
    22 hours ago
  •  ...Commission-based Experience Level: New Agents, Experienced Agents, or Those Planning to...  ...Licensed Grow your real estate career with powerful tools, proven support, and a trusted brand...  ...Tech Ecosystem Work smarter with AI-powered rlpSPHERE’s built-in ecosystem with... 
    Full time
    Part time
    Local area
    Shift work

    Royal LePage Real Estate

    Toronto, ON
    17 hours ago
  • $500 per unit

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $500 per task Location: Remote Commitment: Flexible schedule...  ...project (side project, startup, app, or LLM-powered feature ). Uses AI tools to build,... 
    Remote job
    Contract work
    Summer work
    Immediate start
    Flexible hours

    Mercor

    Toronto, ON
    16 days ago
  •  ...R2868511  Position title : AI Engineer Department:  Commercial...  ...We’re an R&D-driven, AI-powered biopharma company committed to...  ...Generation (RAG) solutions, multi-agent systems, and AI copilots leveraging...  ...of sales, marketers and MSL users powered by multi-agent systems... 
    Work at office
    Work from home
    Home office
    Flexible hours
    Toronto, ON
    22 hours ago
  •  ...We’re seeking a Demand & Community Manager to grow an affiliated AI best-practices community focused on AI in commerce. You will own the...  ...eCommerce, B2B Commerce, B2B Technology, Marketplace, Full-time, Remote, Canada, LATAM McFadyen’s goal is to ensure that our clients... 
    Remote job
    Full time
    Local area

    McFadyen Digital

    Toronto, ON
    4 days ago
  • $45 per hour

     ...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...: $29–$45/hour Location: Remote Role Responsibilities Red team conversational AI models and agents. Focus on jailbreaks, prompt injections, misuse... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    13 days ago
  •  ...clients in their end-to-end Data & AI transformation by combining...  ..., models, and decisioning into user journeys. Implement document...  ...Conditions : Canada-based remote role; occasional travel across...  ...Management, ABAP AI SDK, MCP, or agent frameworks. SAP Business AI,... 
    Remote work
    Long term contract
    Flexible hours

    Talan

    Toronto, ON
    13 hours ago
  • $150 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Compensation: $150–$200/hour Location: Remote Role Responsibilities Develop challenging machine learning... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    5 days ago
  • $160k - $260k per year

     ...the leading security-first enterprise AI company. We build cutting-edge foundation...  ...experience, creating the platform that powers autonomous AI agents at scale. You’ll work on hard,...  ...traveling to other offices if you are remote, plus an annual company offsite. How... 
    Remote work
    Full time
    Manual labor
    Work at office
    Local area
    Home office

    Cohere

    Toronto, ON
    5 days ago
  • $175k - $240k per year

     ...shared values, and collaborative approach has set us apart for over 75 years, guiding how we shape a better world. We are seeking a Power Transmission Engineering Leader to join a nationally recognized engineering and design firm supporting major utility, Data Centers and... 
    Remote work
    Work at office
    Flexible hours

    Arup

    Toronto, ON
    8 days ago
  • $140k - $240k per year

     ...open-source infrastructure provider dedicated to the advancement of AI agents and web-based applications. By developing sophisticated browser...  ...-quality, production-grade code. AI-Native Workflow: A heavy user of AI agents within a day-to-day coding environment. Full-... 
    Full time
    Internship
    Work at office

    MLabs

    Toronto, ON
    28 days ago
  • $45 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Contract Compensation: $40–$45/hour Location: Remote Role Responsibilities Review short English-language... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    9 days ago
  • $175k - $210k per year

     ...Guidepoint is investing in applied AI across its research platform....  ...AI: voice- and chat-based agents with low-latency requirements,...  ...session management: stateful user interactions that move seamlessly...  ...engineering, with 2+ years building LLM-powered products in production (not... 
    Full time
    Internship
    Work at office

    Guidepoint

    Toronto, ON
    21 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Agent Power User - Remote. Be the first to apply!