Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Agent Power User - Remote

YO AI Labs

Montréal, QC
  • Remote job

AI Agent Power User

Role Type: Contractor
Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand

We are seeking experienced AI Agent Power Users to contribute to an enterprise AI training project focused on evaluating and improving AI assistants in real-world business workflows.

You'll use your professional experience and hands-on knowledge of AI tools to test complex scenarios, evaluate outputs, and provide actionable feedback. No formal AI background is required.

Scope of Work

  • Run complex, multi-step business workflows using AI assistants such as ChatGPT and Claude.
  • Document workflows and identify where AI performance meets or falls short of real business requirements.
  • Evaluate AI-generated outputs using defined rubrics and quality criteria.
  • Provide clear, actionable feedback to AI research and product teams.
  • Identify recurring AI strengths, weaknesses, and opportunities for process improvement.
  • Connect AI tools with workplace platforms such as Google Drive, Gmail, Slack, and Notion.
  • Maintain detailed documentation to ensure findings are clear, consistent, and reproducible.

Preferred Qualifications

  • 5+ years of professional experience in any business function involving technology and operational problem-solving.
  • Bachelor's degree or higher in any discipline.
  • Daily, hands-on experience using ChatGPT and/or Claude for real professional work.
  • Experience creating or applying evaluation rubrics, QA scorecards, content review guidelines, or similar frameworks.
  • Comfortable working with AI tools and common workplace productivity platforms.
  • Excellent written English and strong documentation skills.
  • Authorized for contract work and located in the US, Canada, UK, Ireland, Australia, or New Zealand .
Vacancy posted 11 days ago
Similar jobs that could be interesting for youBased on the AI Agent Power User - Remote in Montréal, QC vacancy
  •  ...numériques et des partenariats clients. En tant qu'ingénieur IA / Agent — un « Constructeur IA » — vous rejoindrez une équipe dynamique et...  ...successful digital experiences and client partnerships. As an AI / Agent Engineer — an “AI Builder” — you will join a highly... 
    Suggested
    Full time
    Apprenticeship
    Immediate start

    Appnovation Technologies

    Montréal, QC
    a month ago
  • ServiceNow recherche un chercheur principal en IA pour diriger des travaux sur l'agentique d'entreprise et les questions de sûreté et de confidentialité. Vous publierez et validerez vos hypothèses contre des déploiements réels, tout en collaborant avec des ingénieurs et des...
    Remote work

    ServiceNow

    Montréal, QC
    1 day ago
  •  ...Eli Health is making continuous hormone monitoring possible so users can support their daily and long-term health. No more waiting days...  ...optimize campaign performance and creative production Leverage AI tools (including Claude, generative creative tools, and analytics... 
    Suggested
    Long term contract
    Full time
    Internship
    Work at office

    Eli Health

    Montréal, QC
    more than 2 months ago
  •  ...Contractor (~15 hours/week) Location: Remote Job Summary We are seeking experienced...  ...Senior Software Engineers to support an AI training project by creating reinforcement...  ...golden reference solutions. Evaluate AI agents' ability to reason through complex codebases... 
    Remote job
    For contractors

    YO AI Labs

    Montréal, QC
    a month ago
  •  ...About the Role   What if your users could simply ask? We’re building TSIQ , an AI-powered analytics and intelligence platform that answers questions, recommends...  ...layers that make our data trustworthy, and the AI agents that turn it into answers. You'll be part of our dynamic... 
    Suggested
    Full time
    Work at office
    Worldwide

    Ts Imagine

    Montréal, QC
    a month ago
  • $100k - $160k per year

     ...Leading Product Review Company as a  AI Developer ! This is your opportunity...  ...focus on building and maintaining the AI agents, workflows, and pipelines that power member-facing features and internal...  ...on what will bring the most value to users Qualification/Experience ~... 
    Full time
    Work at office
    Flexible hours

    Rtings.com

    Montréal, QC
    more than 2 months ago
  •  ...Power BI Developer Outstanding opportunity to join a new Global data innovation and infrastructure lab at a global banking organisation...  ...integral member of the team responsible for: Building comprehensive, user-friendly dashboards using Power BI Perform development... 
    Full time

    Mthree Recruiting Portal

    Montréal, QC
    more than 2 months ago
  •  ...The Mission  We’re building AI startups inside an established...  ...existing businesses to create new AI-powered products and sell them into...  ...located there. Otherwise, it is remote. The Mindset We’re Hiring...  ...agentic workflows: multi-step AI agents using function calling, tool... 
    Remote work
    Long term contract
    Full time
    Internship
    Work at office
    Immediate start

    Valsoft

    Montréal, QC
    more than 2 months ago
  • $150k - $160k per year

     ...Requisition Number: 106471 AI Engineer Location You will...  ...the flexibility to work fully remotely. Insight at a Glance ~14,000+...  ...implement production-grade AI agents and multi-agent systems that use...  ...-ON) || Canada (CA) || Data & AI || None || Remote - Canada ||... 
    Remote work
    Full time
    Local area

    Insight

    Montréal, QC
    9 days ago
  • $130k - $220k per year

     ...class engineering, best-in-class user experience, and features that...  ...team. We’re looking for an AI/ML Engineer who will develop,...  ...machine learning models that power our next generation of user experiences...  ...Deploy Conversational / Multi-Agent LLM Solutions Craft multi-... 
    Full time
    Work from home
    Flexible hours

    Us Mobile

    Montréal, QC
    more than 2 months ago
  •  ...look to strengthen our Digital Solutions practice as a Consultant, Power Platform & D365 (AMS). This diverse team of professionals are...  ...skills Strong practical knowledge of SharePoint Search Service, User Profile Service and other Service Applications Experience Integrating... 
    Remote work
    Full time
    Work at office
    Flexible hours

    Experienced Career

    Montréal, QC
    a month ago
  •  ...architectural ownership of the agent-readable Shop Builder platform....  ...contributor role on the DevX and AI team, and the decisions you...  ...LLMs and humans as first-class users, maintained from single canonical...  ...collaboration, and the transformative power of play.    Equal Employment... 
    Full time
    Local area
    Worldwide

    Xsolla

    Montréal, QC
    more than 2 months ago
  • $115k - $130k per year

     ...built on a single conviction: AI does not transform businesses....  ...environments using feedback from users and domain experts. Work...  ...embeddings, vector search, AI agents, and agentic workflows. Familiarity...  ...intelligence . Powered by our proprietary Human Orchestrated... 
    Permanent employment
    Full time
    Contract work
    Work at office
    Immediate start
    Work from home
    Flexible hours
    2 days per week

    Keyrus Canada

    Montréal, QC
    more than 2 months ago
  •  ...Kake is a remote-first company and a people-first global community...  ...love eating kake!). Senior AI/LLM Engineers with strong Python...  ...building, and productionizing LLM-powered applications and AI systems at...  ...test, and iterate on prompts, agents, and orchestration flows using... 
    Remote work
    Flexible hours

    Kake

    Montréal, QC
    3 days ago
  •  ...grid technologies. We apply cutting-edge technologies to the digital power industry. The lab has developed into a research organization with...  ...Develop documents for the algorithms of the models. Develop user manuals for component models. Build and document demo cases for... 
    Long term contract
    Full time
    Contract work
    Internship
    Immediate start

    Huawei Technologies Canada Co.,

    Montréal, QC
    a month ago
  •  ...Kouvre Inc. is seeking a Founding AI Engineer to own the brain of our AI agent for restaurants. You will partner closely with the Founding CTO to turn plain-text messages into the right actions, building the reasoning, agents, and evals that make Kouvre feel like a sharp... 

    Kouvre Inc.

    Montréal, QC
    20 hours ago
  •  ...to be at the forefront of how AI is reshaping an entire industry...  ...car dealerships operate. Our AI-powered virtual receptionist is designed...  .../tech teams, advocating for user needs. • Conduct training sessions...  ...just getting started. • Work remotely with a collaborative,... 
    Remote work
    Long term contract
    Full time

    Valsoft

    Montréal, QC
    more than 2 months ago
  •  ...apply as well. About the role Help shape how Intact uses AI and automation across Risk Management, creating more capacity for...  ...required. Solid knowledge of large language models, AI assistants, agent-based workflows, search-based applications, APIs, and enterprise... 
    Long term contract
    Full time
    Flexible hours

    Intact Financial

    Montréal, QC
    3 days ago
  •  ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project... 
    Remote job
    For contractors

    YO AI Labs

    Montréal, QC
    10 days ago
  • $50k - $70k per year

     ...develop full-stack applications that power GenAI applications and...  ...visually appealing and responsive user interfaces using Tailwind CSS /...  ...date with latest happenings in AI and Associated AI tools, technologies...  ...LLM-based features, tools, and agent workflows. Collaborate with... 
    Full time

    Xsolla

    Montréal, QC
    more than 2 months ago
  •  ...Job Responsibility: A career as a User experience copywriter in the UX Writing team at National Bank means inspiring our clients and non-clients to achieve their projects and contribute to their success by providing them with the inspiration, knowledge, and tools necessary... 
    Full time
    Flexible hours

    National Bank of Canada

    Montréal, QC
    20 hours ago
  •  ...Generalist Job Type: Contractor Location: Remote Role Overview We are looking for Generalists with strong analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information... 
    Remote job
    For contractors

    YO AI Labs

    Montréal, QC
    23 days ago
  •  ...Canada has an immediate permanent opening for a Developer. About the team: The Smart Grid Technology Lab’s research focuses on Power electronics, Energy Management Systems and other Smart Grid Technologies, applying the latest technology to the digital power industry... 
    Permanent employment
    Full time
    Immediate start

    Huawei Technologies Canada Co.,

    Montréal, QC
    more than 2 months ago
  •  ...software that healthcare organizations depend on. AI is now at the heart of that work — not as a...  ...new features, modernization, improved user experience, and system integration....  ...models, pipelines, and architectures that power our solutions.  Design and deploy data pipelines... 
    Full time

    Lgi Healthcare Solutions Santé Inc.

    Montréal, QC
    more than 2 months ago
  •  ...innovators, we are on a mission to enable safe user experiences and empower our communities by...  ...of a hybrid work environment, while remote team members play an integral role in shaping...  ...seeking a creative and technically skilled AI Artist to join our team. The primary responsibility... 
    Remote work
    Full time
    Work at office
    Local area

    Aylo Careers

    Montréal, QC
    more than 2 months ago
  •  ...Having recognized the advantages of remote work, including employee morale...  ...Manager, Data Platform & AI Platform to define the strategy...  ...key domains: A data platform powering ingestion, streaming, integration...  ...the future of AI-driven user experiences for our customers.... 
    Remote work
    Long term contract
    Permanent employment
    Full time
    Temporary work

    Tecsys Inc.

    Montréal, QC
    more than 2 months ago
  •  ...the healthcare sector. Today, AI is at the core of how we build...  ...as an end in itself, but as a powerful enabler of our mission: helping...  ...powered tools. Keep the end user in mind: what you build is used...  ...your financial health: Work remotely, from the office, or in a hybrid... 
    Remote work
    Full time
    Work at office
    Flexible hours

    Lgi Healthcare Solutions Santé Inc.

    Montréal, QC
    more than 2 months ago
  •  ...coordination for the Shop Builder DevX and AI team. You are the bridge between architecture...  ...AI features that give developers — and AI agents — the full surface they need to customize...  ...creativity, collaboration, and the transformative power of play.    Equal Employment Opportunity... 
    Full time
    Local area
    Worldwide

    Xsolla

    Montréal, QC
    more than 2 months ago
  • $25 per hour

     ...Description Casual Independent Contractor | Remote, Canada | $25 CAD/hour | Minimum 4 paid...  ...While a test is happening, our Test Support Agents are behind the scenes making sure things...  .... Before You Apply Thoughtful use of AI is welcome. If you use AI to help with your... 
    Remote job
    Full time
    Contract work
    Part time
    For contractors
    Casual work
    Live In
    Flexible hours
    Weekend work
    Afternoon shift
    Early shift

    Acuity Insights

    Montréal, QC
    20 days ago
  •  ...Senior AI Trainer Role Type: Contractor, Remote Location: North America, Latin America, Europe, UK, Oceania We're seeking Senior AI Trainers to support a customer project focused on improving AI systems through expert-level video annotation and data labeling.... 
    Remote job
    For contractors

    YO AI Labs

    Montréal, QC
    23 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Agent Power User - Remote. Be the first to apply!