AI Agent Power User - Remote
YO AI Labs
Toronto, ON
- Remote job
AI Agent Power User
Role Type: Contractor
Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand
We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.
You'll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.
Scope of Work
- Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
- Document workflows and identify where AI performance meets or falls short of real business requirements.
- Evaluate AI-generated outputs using defined rubrics and quality criteria.
- Provide clear, actionable feedback to AI research and product teams.
- Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
- Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
- Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.
Preferred Qualifications
- 5+ years of professional experience in any business function involving technology and operational problem-solving.
- Bachelor's degree or higher in any discipline.
- Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
- Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
- Comfortable working with AI tools and common workplace productivity platforms.
- Excellent written English and strong documentation skills.
- Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand .
Vacancy posted 22 hours ago
Similar jobs that could be interesting for youBased on the AI Agent Power User - Remote in Toronto, ON vacancy
$60 - $70 per hour
...technical talent with leading AI research labs. Headquartered in... .... Position: Application Users - macOS Sonoma 14.5 Expert - Professionals... ...–$70/hour Location: Remote Role Responsibilities... .... Collaborate with Mac power users , Apple-platform administrators...Remote jobContract workSummer work- ...leading security-first enterprise AI company. We build cutting-edge... ...platform that connects AI agents with workplace tools and applications... ...is making the agents and AI-powered experiences inside North genuinely... ...systems become valuable when users can build with them, steer them...Remote workFull timeWork at officeLocal areaHome office
- ...Contractor (~15 hours/week) Location: Remote Job Summary We are seeking experienced... ...Senior Software Engineers to support an AI training project by creating reinforcement... ...golden reference solutions. Evaluate AI agents' ability to reason through complex codebases...Remote jobFor contractors
- ...possibilities. As a Senior Data Engineer, AI & Agents, you will prepare enterprise domain data... ...generating the catalogue metadata that powers downstream automation and data-contract... ...reliable, domain-grounded agents that business users can query with confidence. Quality-...SuggestedFull timeContract work
- ...collaboration with other disciplines - all foundational ingredients in successful digital experiences and client partnerships. As an AI / Agent Engineer — an “AI Builder” — you will join a highly motivated and experienced team at the core of every pod, building and evolving...SuggestedFull timeImmediate start
- ...Canadians and the businesses that power our economy, this could be your... ...Work The Senior CRM & AI Solutions Developer is a hands-... ...such as Microsoft Copilot Studio agents and workflow automation. The... ...test strategies, scenarios and user validation, and provide post-deployment...Hourly payPermanent employmentFull timeInternshipWork at office
$150k - $180k per year
...collaborating with clients and suppliers seamlessly through the power of the Connected Workflow. We’re a remote-first, community-driven team obsessed with elevating... ...reading. About the Role: Staff Product Manager, AI Agents We’re growing — and we’re hiring a Staff Product...Remote workShift work- ...looking for a strategic, data-driven Head of User Acquisition to own how Phoenix acquires... ...across both traditional search and generative/AI-driven search surfaces. Set organic... ...package includes standard healthcare coverage, a remote-first holiday season, and holistic...Remote workFull timeInternshipWork at officeFlexible hoursShift work
$60k per year
...Director, IT Experience, we are hiring an IT User Training Coordinator to support the... ...orientation-related technology sessions, support remote users, answer questions, and help users... ...conversation will be recorded using BrightHire, an AI-powered video interview tool. More details will be...Remote workFull timeFlexible hours- ...close the justice gap using technology and AI. We empower personal injury lawyers and victims... ...sharp, operationally scrappy Mixed Methods User Researcher to be the engine that connects... ...writing SQL and standing up an AI-powered feedback pipeline as you are running a user...Long term contractPermanent employmentFull timeTemporary workLocal areaHome officeFlexible hoursEarly shift
- ...n\nWe are currently seeking a Agentic AI Systems Developer - Remote to join our team in Toronto, Ontario (... ...Responsibilities\n\n\u2022 Design and implement agent-based AI workflows for healthcare use... ...RCM automation) \n\n\u2022 Build LLM-powered systems (RAG, tool-calling agents,...Remote workFull timeWork at officeFlexible hours
$76.8k per year
...than 3 years Hybrid Work must be completed both in person and remotely. Work setting Financial technology (FinTech) Financial... ...Report on the performance of computer systems and networks Consult user guides, technical manuals and other documents to research and...Remote workPermanent employmentFull time$85 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... .... Position: Backend Engineer (Coding Agent Experience) Type: Contract... ...Compensation: $85/hour Location: Remote Role Responsibilities Use frontier...Remote workFull timeContract workSummer work$16 - $22 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: $16–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents to identify jailbreaks, prompt injections, and...Remote workFull timeContract workSummer work$20 - $22 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco,... ...: $20–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents. Conduct jailbreaks, prompt injections, misuse...Remote workFull timeContract workSummer work$30 - $55 per hour
...check your spam folder. This is a fully remote position open to candidates based in Canada... ...Pay: $30$55/hr Role Title: Computer User Support Specialists Role Type: Contractor... ...your expertise to help train next-generation AI systems. Your work will shape how models...Remote workFull timeFor contractors$30 per hour
...technical talent with leading AI research labs. Headquartered in... ...$30/hour Location: Remote Duration: 4.5 hours total... ...inbound calls to test the CX agent's responses and behavior.... ...feedback on conversation flow and user experience to enhance AI model...Remote jobContract workSummer workImmediate start$30 - $50 per hour
...center. Our platform combines the best of AI and human intelligence to help contact... ...the future of Cresta’s human + AI agents platform, which powers AI-powered business workflows and automations... ...will include designing the end-user experiences and the tools and workflows...Hourly payInternshipWork at officeLocal area$30 - $50 per hour
...conversation into a competitive advantage. Cresta’s unified AI platform combines conversational AI agents, real-time human agent augmentation, and comprehensive... ..., Cox Communications, and Marriott, use Cresta to power world-class customer experiences every day. Born from...InternshipWork at office$76k - $105k per year
...billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly... ...is looking for a Video Creator, User Generated Content (UGC) and Social to build... ...To learn more about our privacy practices, please see our Privacy Policy . #LI-REMOTERemote workFull timeLocal areaWork from homeHome office- ...Purpose of the Job We are looking for a Staff AI Platform & Agent Runtime Engineer to build the foundation for enterprise-scale AI and agent... ...In this role, you will architect and operate the platform that powers our next generation of AI agents from experimentation through...Full time
- ...Founder & CEO to lead HawkAI , an enterprise AI venture for US logistics brokerages,... ...engineering team to ship V1 and iterate on user feedback, with a focus on TMS and load board... ...serving these industries, with familiarity in AI agents/LLMs How to Apply Please submit your...Internship
- ...Were seeking a Computer User Support Specialist to provide technical support and troubleshooting... ...Walk users through step-by-step solutions remotely Document support tickets and... ...with non-technical users Familiar with remote support tools Reliable internet for remote...Remote workFull time
- ...scalability. The teams that ship credible AI workers into finance-sensitive functions in... ...Venture Argentl delivers an AI collections agent that handles outbound debtor follow-up... ...Founder Profile Must Have: Shipped LLM-powered and voice systems into production environments...Day shift
- ...We're looking for a passionate and data-driven User Acquisition Manager to join our fast-growing mobile gaming company. In this role, you will be responsible for managing and optimizing marketing campaigns to drive profitable user growth for our portfolio of games. You...Full time
$100 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: Agent Engineer Type: Contract Compensation... ...: $100–$500/hour Location: Remote Role Responsibilities Build and...Remote workFull timeContract workSummer work$180k - $210k per year
...We’re looking for a Staff Engineer - User Experience (Backend) to join our Patient Platform team and shape the systems that power patient-facing experiences across our health... ...and technical leadership. This is a fully remote role, open to candidates based in Ontario,...Remote workFull timeContract workInternshipLocal areaImmediate startFlexible hours- ...you as a partner \?\\\ \ \ UX Designer \\\\\(Contract, Hybrid Remote/Onsite "Toronto") \\\ \ The UX Designer’s responsibilities... ...space/statement, the long and short -term business goals, and the user and business needs. \\ \\ \ \ o \ \\\\ Facilitate the...Remote workLong term contractFull timeContract workTemporary work
$80 - $120 per hour
...creative and technical talent with leading AI research labs. Headquartered in San Francisco... ..., and Jack Dorsey . Position: User/customer research and feedback synthesis Evaluator... ...: $80–$120/hour Location: Remote Role Responsibilities Evaluate...Remote jobContract workSummer workWork at office$20 - $22 per hour
...elite creative and technical talent with leading AI research labs. Headquartered in San Francisco... ...: $20–$22/hour Location: Remote Role Responsibilities Red team conversational AI models and agents to identify jailbreaks, prompt injections, and...Remote workFull timeContract workSummer work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Agent Power User - Remote. Be the first to apply!
Related searches
- représentant médical Toronto, ON
- vendeur représentant Toronto, ON
- représentant pharmaceutique Toronto, ON
- représentant industriel Toronto, ON
- représentant représentante en assurances Toronto, ON
- agent de liaison Toronto, ON
- agent de recherche Toronto, ON
- work from home chat agent Toronto, ON
- agent d entretien Toronto, ON
- signing agent Toronto, ON