Remote AI Evaluation Specialist: Quality Feedback
YO AI Labs
YO AI Labs is seeking an AI Evaluation Specialist to assess and improve AI assistant outputs for an enterprise training project. This remote contractor role focuses on applying rubrics for accuracy, relevance, and adherence to guidelines, with feedback that informs system improvements.
You will work independently on large datasets, identify gaps, document findings, and participate in rubric refinement to ensure fair and consistent evaluations across languages and use cases.
#J-18808-LjbffrVacancy posted 12 hours ago
Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist: Quality Feedback in Montréal, QC vacancy
- ...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project...Remote jobQualityFor contractors
- Enhance AI accuracy in accounting with DataAnnotation as an Accountant AI Evaluation Specialist. This remote role focuses on grading AI outputs and ensuring they meet professional standards. As an AI Evaluation Specialist, you will assess AI-generated accounting answers, ensuring...Remote work
- ...partenariats clients. En tant qu'ingénieur QA / Évaluation IA, vous rejoindrez une équipe dynamique... ...and client partnerships. As a QA / AI Evaluation Engineer, you will join a highly... ...the platform actually improves answer quality. You will run evaluations at scale — from...QualityFull timeApprenticeshipImmediate start
Appnovation Technologies
Montréal, QCa month ago - ...the role Help shape how Intact uses AI and automation across Risk Management, creating... ...results through time saved, improved quality, faster turnaround and sustained adoption.... ...continuous improvement. Experience in evaluating the reliability of AI results and in implementing...QualityLong term contractFull timeFlexible hours
Intact Financial
Montréal, QC22 minutes ago - ...RBC's AI Group is seeking a Staff Data Scientist to lead evaluation of model and agent quality, safety and performance. You will define standards, own datasets and scorecards, and mentor junior data scientists. Location: Montréal, QC; Hours: 37.5 per week; Employment type...QualityFull timeInternship
- ...in the right place! As the Team Lead, Quality Specialist , you will reinforce quality standards... ...the growth of your team through regular feedback, career development planning, hiring and... ...fulfilled. Flexible paid time off and remote work policies Equity options, because...Remote workQualityFull timeWork at officeFlexible hours
Lightspeed Commerce
Montréal, QCmore than 2 months ago - ...hybrid work environment, while remote team members play an integral role... ...and technically skilled AI Artist to join our team. The primary... ...teams to ensure the highest quality and creativity in AI-generated... ...iterate on AI outputs, providing feedback and making prompt adjustments to...Remote workQualityFull timeWork at officeLocal area
Aylo Careers
Montréal, QCmore than 2 months ago - ...simple des changements par le biais « Action Items » (AI). Toute autre tâche nécessaire au sein du département... ..., and societal impact. The main purpose of the QA Specialist - level I position is to create Quality controlled documents through MEDISCA’s Quality Management...QualityFull timeApprenticeshipWork at office
Medisca Inc.
Montréal, QC14 days ago $70 per hour
...English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.... ...systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and...QualityHourly payPermanent employmentPart time10 hours per week- ...(~15 hours/week) Location: Remote Job Summary We are seeking... ...Engineers to support an AI training project by creating... ...reinforcement learning environments that evaluate AI models on complex software... ...and provide clear technical feedback. Required Skills...Remote jobFor contractors
- ...form the Spherea Group. A global Test & Quality Solution leader, Averna Powered by Spherea... ...The Product Quality & Customer Support Specialist in a few words We are looking for a technically... ...test scenarios. Translate customer feedback and recurring support trends into...QualityFull time
Averna
Montréal, QC23 days ago - ...Job Description RBC’s AI Group is building trusted AI capabilities for the enterprise, and evaluation is one of the core controls that makes that possible. As Staff Data... ...responsible for how RBC measures model and agent quality, safety, risk, and performance. You will...QualityFull timeWorldwideFlexible hours
- Lead the charge in AI evaluation as a Senior Data Scientist for RBC's AI Group. You will facilitate trusted AI capabilities through innovative... ...will take on a senior role in shaping how RBC evaluates model quality and performance. You will design and improve evaluation...Quality
- ...About the opportunity RBC's AI Group is building trusted AI capabilities for the enterprise. The Staff Data Scientist, AI Evaluations will lead the data science work for measuring model and agent quality, safety, risk, and performance. This includes developing evaluation...QualityFull time
- ...that healthcare organizations depend on. AI is now at the heart of that work, not as a... ...Healthcare Solutions, we believe the future of quality assurance lies in combining robust... ...investigation, and results synthesis; Critically evaluate AI-generated outputs, exercise appropriate...QualityFull time
$222.2k - $412.7k per year
...Veeam is the Data and AI Trust Company, specializing in helping organizations ensure their data and AI are fully understood, secured... ...security posture management (DSPM) - is seeking experienced Sales Specialists to drive growth in this innovative business. In this role, you...Long term contractFull timeLocal areaWorldwideVeeam Software
Montréal, QCmore than 2 months ago$25 - $45 per hour
...work. We design and conduct In-Home Usage Testing (IHUT) locally and nationally to provide actual user feedback in real-time to companies and market research firms to evaluate products to ensure proper product certification and greater market access. It is important to note...Remote workHourly payWeekly payExtra incomeTemporary workPart timeFor contractorsSeasonal workWork from homeFlexible hours$60k - $100k per year
...qualité pour la gouvernance du projet. Évaluer la readiness de la solution avant les... ...(TI) et en management au monde. SAP Quality Assurance Specialist Position Description We are currently... .... To support our recruitment team, AI tools may be used to help assess applications...Quality- ...improvement. Design and produce quality content Write, simplify,... .... Develop digital and AI usage Quickly familiarize yourself... ...applications; Test and evaluate new features to deduce the uses... ...training in person, remotely, or in self-directed mode;...Remote workQualitySummer workWork at officeMonday to fridayFlexible hours
- ...The role of the Quality Systems Specialist (QSS) is to actively contribute to the maintenance of compliant quality system. The QSS also conducts internal audits and can assist in regulatory inspections, and client audits. Additional activities in the sector of computerized...QualityPermanent employmentFull timeContract workWork at officeFlexible hours
Indero
Montréal, QCmore than 2 months ago - ...Type: Contractor Location: Remote Role Overview We are... ...critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information... ...maintaining high accuracy and quality. Key Responsibilities...Remote jobQualityFor contractors
$10k per year
...Description Senior Quality Assurance Engineer Location: Montreal... ...force multiplier by leveraging AI-driven automation to replace manual... ...and maintain credible feedback loops A proactive approach to... ...supporting new parents and families Remote work: Ability to enjoy the best...Remote workQualityFull timeSummer workWork from homeFlexible hoursVia Science
Montréal, QCmore than 2 months ago- ...Faites votre marque au sein du groupe Fiscalité foncière à titre d'Évaluateur Agrée, Evaluation valeur foncière. Cette équipe diversifiée de professionnels élabore des stratégies fiscales sur mesure dans un contexte réglementaire complexe et dynamique. En tant que conseiller...QualityFull timeWork at officeLocal area
Postes Avec Expérience
Montréal, QCmore than 2 months ago - ...AI Agent Power User Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are... ...AI training project focused on evaluating and improving AI assistants in... ...outputs, and provide actionable feedback. No formal AI background is required...Remote jobQualityContract workFor contractors
- ...computer vision–powered experiences. As a Senior Quality Engineer on the Computer Vision User... ...Health Hybrid Model. We believe that remote work and in-person work have their own advantages... ...1.7 billion people worldwide. With an AI-powered human-centered care model, Hinge Health...Remote workQualityFull timeApprenticeshipWork at officeLocal areaWorldwide3 days per week
Hinge Health, Inc.
Montréal, QCmore than 2 months ago $100k - $160k per year
...Product Review Company as a AI Developer ! This is your opportunity... ...cost, reliability, and output quality of agents and pipelines in... ...and existing systems Evaluate and select AI tools, models, and... ...push projects forward, seeking feedback and focusing on what will bring...QualityFull timeWork at officeFlexible hoursRtings.com
Montréal, QCmore than 2 months ago- ...une vocation à votre passion en rejoignant une culture qui s’épanouit face au changement. Faites votre marque au sein du groupe Évaluation d’entreprises à titre de conseiller(ère). Cette équipe diversifiée de professionnels travaille avec nos clients sur une panoplie de...QualityFull timeWork at office
Postes Avec Expérience
Montréal, QC9 days ago - ...Senior AI Trainer Role Type: Contractor, Remote Location: North America, Latin America, Europe, UK, Oceania... ...precise annotations, and provide high-quality data to support AI model training.... ...in quality reviews and incorporate feedback to maintain standards....Remote jobQualityFor contractors
$150k - $160k per year
...Requisition Number: 106471 AI Engineer Location You will... ...the flexibility to work fully remotely. Insight at a Glance ~14,... ...strategies, guardrails, and evaluation loops to improve reliability,... ...ON) || Canada (CA) || Data & AI || None || Remote - Canada ||...Remote workQualityFull timeLocal areaInsight
Montréal, QC11 days ago- ...grid. The opportunity dcbel is looking for an Embedded Quality Developer to join our Firmware/OS team, responsible for designing,... ...compliance-oriented product development. Demonstrated ability to use AI tools effectively to accelerate test development, increase...QualityFull timeFlexible hours
Dcbel
Montréal, QCmore than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote AI Evaluation Specialist: Quality Feedback. Be the first to apply!
Related searches
- remote steel estimator Montréal, QC
- data analyst remote working Montréal, QC
- teletravail infographie Montréal, QC
- remote nonprofit Montréal, QC
- software development remote Montréal, QC
- remote copywriter Montréal, QC
- remote web designer Montréal, QC
- remote quality assurance Montréal, QC
- remote software Montréal, QC
- remote marketing manager Montréal, QC