Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Remote AI Output Quality Analyst

Alignerr

Review AI-generated outputs remotely with analytical thinking and meticulous attention to detail. Provide structured feedback that improves accuracy and reliability.

Alignerr seeks an AI Data Quality Analyst for a fully remote, flexible hourly contract. You will evaluate text, images, and structured data for factual accuracy and relevance. No prior AI, technical, or data experience is required.

Key Responsibilities:

  • Review AI-generated responses across multiple content formats
  • Rate content quality using structured rubrics
  • Identify output errors and inconsistencies
  • Write actionable feedback guiding model improvement
  • Evaluate varied topics and content types

Requirements:

  • Strong attention to detail and analytical thinking
  • Comfort evaluating and critiquing written content
  • Ability to manage time independently
  • Clear, precise written English communication
  • No prior AI experience required

Apply analytical judgment, accurate evaluation, and precise writing to help Alignerr improve AI-generated content remotely.

#J-18808-Ljbffr
Vacancy posted 9 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Output Quality Analyst in Toronto, ON vacancy
  • $30 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $30/hour Location: Remote Role Responsibilities Evaluate...  ...images based on prompt alignment, visual quality, anatomy, structure, rendered text, and artifacts... 
    Remote job
    Hourly pay
    Weekly pay
    Contract work
    For contractors
    Summer work

    Mercor

    Toronto, ON
    28 days ago
  • $15 - $30 per hour

     ...explore, design, and implement AI strategies that are secure, scalable...  ...the person who keeps product quality tight so leadership can stay...  ...Strong judgment and consistent output can open the door to more: building...  ...$15-30/hr. Work is fully remote; US or Canada-based candidates... 
    Remote work
    Hourly pay
    Full time
    Contract work
    For contractors
    Manual labor
    Immediate start
    Flexible hours

    Human Agency

    Toronto, ON
    25 days ago
  • $20 - $50 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Summers , and Jack Dorsey . Position: Quality Analyst Type: Contract Compensation: $20–$50/hour Location: Remote Role Responsibilities Review work... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    a month ago
  • $80k - $95k per year

    Job Title:Analyst, Business Intelligence Department: Sales Operations & AnalyticsMaster Department...  ...about producing innovative, high-quality products, delivering exceptional customer...  ...The Business Intelligence Analyst leverages AI-powered tools such as ChatGPT, Claude, Copilot... 
    Remote work
    Full time
    Internship
    Work at office

    Jeeter

    Toronto, ON
    5 days ago
  • $58k - $96k per year

     ...Type:  Permanent   Work Model:  Remote   Reference code: 134544...  ..., and communities to enjoy the quality of life that comes with a sustainable...  ...? The “IDPS Cyber Automation Analyst” is to support and enhance our...  ...development of automation and AI-driven capabilities. This role... 
    Remote work
    Remplacement
    Permanent employment
    Flexible hours

    Deloitte

    Toronto, ON
    21 hours ago
  • $85 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...$85/hour Location: Remote Commitment: 10–20 hours...  ...decision-making. Clearly explain output superiority, citing correctness...  ...( GAAP/IFRS ), and reasoning quality. Provide written feedback... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    5 days ago
  • $30 - $50 per hour

     ...a competitive advantage. Cresta’s unified AI platform combines conversational AI agents...  ...students to join our  AI Delivery team as  AI Quality Assurance Interns . This is a hands-on...  ...Conversation quality assessment Model output auditing Light prompt testing and... 
    Hourly pay
    Internship
    Work at office

    Cresta

    Toronto, ON
    a month ago
  • $66k - $79.5k per year

     ...in the office, connecting, collaborating, and enjoying quality time with your amazing colleagues! Our Values: Be better...  ...goals.    Overall Job Purpose   We are hiring an AI Automation & Platform Engineer/Analyst to design and build the next generation of agent-driven... 
    Long term contract
    Temporary work
    Internship
    Work at office
    Flexible hours
    3 days per week

    Mackenzie Investments

    Toronto, ON
    2 days ago
  • $90 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco...  ...: $90/hour Location: Remote Commitment: 10–20 hours/week Role...  ...to legal prompts and determine the superior output. Analyze model reasoning to ensure legal... 
    Remote job
    Contract work
    Summer work
    Immediate start

    Mercor

    Toronto, ON
    1 day ago
  • $55k - $105k per year

    Junior Quality Assurance Automation Analyst Position Description This role is hybrid and requires working from our client's office in downtown Toronto...  ...how we use technology. To support our recruitment team, AI tools may be used to help assess applications though they... 
    Work at office
    2 days per week
    Toronto, ON
    6 days ago
  •  ...Quality Engineer (QE) / SDET – AI Chatbot Validation Job Description: We are looking for a seasoned AI first Senior Quality Engineer who is empowered to help the DevOps enablement team deliver highest level quality and is responsible for ensuring the team live quality... 
    Contract work

    Astra North Infoteck Inc.

    Toronto, ON
    12 hours ago
  • $85 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $85/hour Location: Remote Commitment: Flexible hours Role...  ...recommendations. Evaluate AI-generated finance outputs against professional standards.... 
    Remote job
    Hourly pay
    Contract work
    For contractors
    Summer work
    Flexible hours

    Mercor

    Toronto, ON
    18 days ago
  •  ...growing, customer-focused company, we'd love to hear from you! Our Quality Control Manager is key to Zensurance's success and responsible...  ...collaboration, and impactful work, we'd love to meet you! Work Your Way Remote-first setup for added flexibility Home office allowance to... 
    Remote work
    Full time
    Work at office
    Home office
    Flexible hours
    Weekend work

    Zensurance

    Toronto, ON
    6 days ago
  •  ...AI Agent Power User Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are...  ...test complex scenarios, evaluate outputs, and provide actionable...  ...outputs using defined rubrics and quality criteria. Provide clear, actionable... 
    Remote job
    Contract work
    For contractors

    YO AI Labs

    Toronto, ON
    29 days ago
  • $150k - $200k per year

     ...others. About the Role: We are looking for someone to join our AI Strategy team to drive the adoption of AI and automation across...  ...functions, and delivering measurable improvements in productivity, quality, reliability, and operational risk. Responsibilities: Define... 

    AppLovin

    Toronto, ON
    a month ago
  •  ...execution, and continuous learning. If you thrive in fast-paced environments, enjoy tackling open-ended problems, and care deeply about the quality and impact of your work, we’d love to connect. Qualifications Must have : Expertise in LLM engineering, including... 
    Remote work
    Contract work

    Ample Insight Inc.

    Toronto, ON
    4 days ago
  • $124k - $186k per year

     ...Secure Every Identity, from AI to Human Identity is the key to...  ...experienced AI Trainer and Optimization Analyst to take full ownership of our...  ...: Own Conversational Quality & Tone: Act as the primary owner for the AI agent's output, managing the content, tone, and... 
    Local area
    Worldwide

    Okta

    Toronto, ON
    4 days ago
  • $3610.06 - $4847.8 per week

     ...revised systems. Assist in defining requirements and evaluating output produced each year with the objective of providing a clearer...  ...This posting is for an existing vacancy.  Hydro One uses AI tools to assist in the screening and assessing candidates for this... 
    Ongoing contract
    Temporary work

    Hydro One Networks Inc

    Toronto, ON
    21 hours ago
  •  ...To Join Us ~ Competitive salary ~100% Remote ~ Insurtech industry leader worldwide...  ...enhancement Lead (direct report) Business Analysts to grow and continuously improve their...  ...document lifecycle to ensure consistent quality work from the process creation to consumption... 
    Remote work
    Work at office
    Local area
    Worldwide

    CoverGo

    Toronto, ON
    a month ago
  • $120k - $140k per year

     ...Position: Software Engineer: Product Quality Salary: $120,000 to $140,000 CAD Location: Canada based. About Fiscal.ai Fiscal.ai is a leading research and data platform...  .... This is an engineering role, not a QA analyst role. You will find bugs, reproduce them, trace... 
    Immediate start
    Shift work

    Fiscal.ai

    Toronto, ON
    a month ago
  • $70 per hour

     ...Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include...  ...Contract Compensation: $60–$70/hour Location: Remote Role Responsibilities Utilize Excel for... 
    Remote job
    Contract work
    Summer work

    Mercor

    Toronto, ON
    11 days ago
  • $70k - $80k per year

     ...Data Analyst Role : Full-time, on-site 4 days/week (1 day remote) Location : Etobicoke, Ontario (Airport area) Comp : $...  ...through validation, cleansing, and quality checks Strong SQL skills for...  ...is for an existing vacancy. AI-assisted tools support our sourcing... 
    Remote work
    Full time

    acquird

    Toronto, ON
    5 hours ago
  • $75k - $115k per year

     ...We're seeking a talented Risk Analyst to join our growing, dynamic team...  ...skills, communication skills, quality discipline, workload awareness,...  ...Artificial Intelligence (“AI”) tools to enhance delivery and...  ...between Jacobs offices/projects and remote locations enabling them to... 
    Remote work
    Work at office
    2 days per week
    Toronto, ON
    1 day ago
  • $50 - $60 per hour

     ...technical talent with leading AI research labs. Headquartered in...  ...Dorsey . Position: Data Analysts & Spreadsheet Specialists (Must...  ...50–$60/hour Location: Remote Commitment: 10–20 hours...  ...on your Mac to create high-quality training data for advanced AI... 
    Remote job
    Full time
    Contract work
    Summer work
    Internship
    Immediate start

    Mercor

    Toronto, ON
    12 days ago
  • $90k - $110k per year

     ...Description The Business Analyst, Omnichannel Enablement...  ...in this role is measured by the quality of requirements, clarity of solution...  ...stakeholder feedback, and final outputs. Review requirements with clients...  ...requirements.  Use AI-enabled tools responsibly to improve... 
    Full time
    Shift work

    Klick Health

    Toronto, ON
    4 days ago
  •  ...& Community Manager to grow an affiliated AI best-practices community focused on AI in...  ...channels, and events, and manage a Research Analyst. You will also pass McFadyen-fit leads to...  ..., B2B Technology, Marketplace, Full-time, Remote, Canada, LATAM McFadyen’s goal is to... 
    Remote job
    Full time
    Local area

    McFadyen Digital

    Toronto, ON
    11 days ago
  • $100 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San...  ...Compensation: $100–$200/hour Location: Remote Role Responsibilities Author...  ...Must-Have ~ Local political analysts with hands-on experience on specific races... 
    Remote job
    Contract work
    Summer work
    Local area

    Mercor

    Toronto, ON
    17 days ago
  • $55k - $95k per year

     ...employees, and communities. The Role We're hiring Associate Quality Engineers to work at Veeva, working on various products in the...  ...to base salary, such as variable bonus and/or stock bonus. #LI-Remote #LI-Associate Veeva’s headquarters is located in the San Francisco... 
    Remote work
    Internship
    Work at office
    Local area
    Work from home

    Veeva Systems

    Toronto, ON
    9 hours ago
  • $55k - $105k per year

    Quality Engineering Position Description This role is hybrid and requires you to be at...  ...in collaboration with developers, business analysts, and delivery teams. Prepare and...  ...technology. To support our recruitment team, AI tools may be used to help assess applications... 
    Work at office
    2 days per week
    Toronto, ON
    a month ago
  • $55k - $65k per year

     ...environment (a combination of on-site & remote work) supporting our employees...  ...Opportunity: The Account Analyst is responsible for supporting...  ...instructions to maintain quality control and compliance across all...  ...hiring process. We do not use AI‑based screening tools in our hiring... 
    Remote work
    Permanent employment
    Full time
    Temporary work
    Internship
    Work at office
    Flexible hours

    Liberty Mutual Canada

    Toronto, ON
    10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Output Quality Analyst. Be the first to apply!