Remote AI Evaluation Specialist: Quality Feedback

YO AI Labs

YO AI Labs is seeking an AI Evaluation Specialist to assess and improve AI assistant outputs for an enterprise training project. This remote contractor role focuses on applying rubrics for accuracy, relevance, and adherence to guidelines, with feedback that informs system improvements.

You will work independently on large datasets, identify gaps, document findings, and participate in rubric refinement to ensure fair and consistent evaluations across languages and use cases.

#J-18808-Ljbffr

Apply

Vacancy posted 9 hours ago

Similar jobs that could be interesting for youBased on the Remote AI Evaluation Specialist: Quality Feedback in Ottawa, ON vacancy

Quality Control Specialist
$45k - $75k per year
...newly created position. Quality Control Technician personnel executes... ...procedures that include evaluation of raw materials, finished products... ...a hybrid environment or fully remotely - Free Onsite Parking... ...use artificial intelligence (AI) tools to support parts of the...
Remote work
Quality
Long term contract
Permanent employment
Full time
Contract work
Local area
Worldwide
OraSure Technologies, Inc.
Ottawa, ON
1 day ago
AI Evaluation Specialist - Remote
...AI Evaluation Specialist Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project...
Remote job
Quality
For contractors
YO AI Labs
Ottawa, ON
12 days ago
Senior Quality Assurance Specialist
...desktop training tool; and Providing Quality Assurance Support to the client by:... ...implementation. ~ Any other QA Specialist related tasks requested by the client... ...–enabled tools; however, AI is not used to screen, evaluate, or make decisions about applicants...
Quality
Full time
Temporary work
Part time
Internship
Flexible hours
Adga Group Consultants Inc
Ottawa, ON
more than 2 months ago
Quality Assurance Specialist
...Quality Assurance Specialist: Job ID#: DSEFQA001 Job Title : Quality Assurance Specialist Mandatory Skills : 2-3+ Yearsâ experience Start Date: Immediate Duration : Full Time Position Location : Ottawa Security Clearance Required...
Quality
Full time
Immediate start
Symbiotic Digital
Ottawa, ON
more than 2 months ago
Physician (MD/DO) - Medical AI Evaluation
$70 per hour
...English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems.... ...systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and...
Quality
Hourly pay
Permanent employment
Part time
10 hours per week
Mindrift
Ottawa, ON
1 day ago
Obsolescence Specialist (remote or hybrid Ottawa)
...Obsolescence Specialist (ILS - remote or hybrid - Kanata) SECRET Cleared FULL-TIME PERMANENT, W/ BENEFITS HYBRID, REMOTE or On-Site (West end Ottawa) Job Description: Our client is seeking an Obsolescence Specialist to join our team. The Obsolescence...
Remote work
Permanent employment
Full time
Work at office
Source Staffing, Llc.
Ottawa, ON
3 days ago
AI Agent Evaluation Engineer - Remote
...(~15 hours/week) Location: Remote Job Summary We are seeking... ...Engineers to support an AI training project by creating... ...reinforcement learning environments that evaluate AI models on complex software... ...and provide clear technical feedback. Required Skills...
Remote job
For contractors
YO AI Labs
Ottawa, ON
a month ago
Bilingual Communication Specialist (Hybrid/Remote)
$60.84k - $68.85k per year
...This Role Involves: The Communication Specialist is the ‘voice’ of CCS, putting into words... ...day. Our team has the opportunity to work remotely on a hybrid basis, but even though we... ...Environment: ~ Full-time, predominately remote position (within Canada). ~ If located...
Remote work
Bi-weekly pay
Long term contract
Full time
Work at office
2 days per week
Credit Counselling Society
Ottawa, ON
12 days ago
Monitoring and Evaluation Officer
$70k - $80k per year
...Position: Monitoring and Evaluation Officer Location: Remote with Hybrid Option (Ottawa) Salary Range: $70,000 - $80,000 Summary CODE is seeking... ..., evaluation, and learning systems to ensure program quality, accountability, and impact. Working closely with the...
Remote work
Quality
Temporary work
Local area
Flexible hours
Codengo
Ottawa, ON
a month ago
Quality Control Specialist
...provides proven performance for those requiring high-quality biological samples for nucleic acid testing. Our... ...for an existing vacancy. Quality Control Specialist personnel executes written procedures that include evaluation of raw materials, finished products, equipment...
Quality
Contract work
Worldwide
dnagenotek
Ottawa, ON
4 days ago
Deployment Specialist
$47.86k - $60k per year
...Deployment Specialist Location: Ottawa, ON Department Leader: Victoria... ...so we do too. Deliver with QUALITY – We sweat the details and... ...: Clear expectations, honest feedback, and no politics. Social... ...uses artificial intelligence (AI) to screen, assess, and/or select...
Quality
Permanent employment
Full time
For subcontractor
Sol Ink
Ottawa, ON
9 days ago
Food Service & Product Specialist
$75k - $90k per year
...teams, the Foodservice & Project Specialist will translate new concepts... .... Conduct store visits to evaluate execution, identify barriers... ...merchandising, food safety, quality standards and program execution... ...experience goals. Gather feedback from Store Operators and...
Quality
Long term contract
Full time
Work at office
Local area
Macewen Petroleum Inc.
Ottawa, ON
8 days ago
Senior Quality Engineer/Lead - EN 323
$96.56k - $128.74k per year
...making Canada and the world better through trade. Position: Senior Quality Engineer/Lead Employment Type: Permanent Compensation... ...group is seeking a Senior Quality Engineer/Lead with specialized AI expertise to help build and evolve EDC's AI-enabled quality...
Quality
Permanent employment
Full time
Summer work
Relocation package
Export Development Canada
Ottawa, ON
9 days ago
Remote Consumer Feedback Participant
$25 - $45 per hour
...work. We design and conduct In-Home Usage Testing (IHUT) locally and nationally to provide actual user feedback in real-time to companies and market research firms to evaluate products to ensure proper product certification and greater market access. It is important to note...
Remote work
Hourly pay
Weekly pay
Extra income
Temporary work
Part time
For contractors
Seasonal work
Work from home
Flexible hours
GL Inc
Ottawa, ON
more than 2 months ago
AI Trainer - Remote
...Type: Contractor Location: Remote Role Overview We are... ...critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information... ...maintaining high accuracy and quality. Key Responsibilities...
Remote job
Quality
For contractors
YO AI Labs
Ottawa, ON
25 days ago
Quality Assurance Analyst
$57k - $62k per year
...posting is for an existing vacancy Scope of Position The Quality Assurance Analyst (QA Analyst) role is to develop and establish quality... ...how we can accommodate you. * Alterna does not currently use Artificial Intelligence (AI) to screen, assess, or select applicants....
Quality
Full time
Flexible hours
Alterna Savings
Ottawa, ON
more than 2 months ago
Purchasing Specialist
...with integrity and collaboration to bring quality and innovation to our work every day,... ...bonus program The Role The Purchasing Specialist supports successful project delivery by... .... Experience obtaining and evaluating competitive supplier pricing and negotiating...
Quality
Full time
Work at office
Local area
Night shift
Dilfo
Ottawa, ON
7 days ago
AI Agent Power User - Remote
...AI Agent Power User Role Type: Contractor Location: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are... ...AI training project focused on evaluating and improving AI assistants in... ...outputs, and provide actionable feedback. No formal AI background is required...
Remote job
Quality
Contract work
For contractors
YO AI Labs
Ottawa, ON
13 days ago
Tournament Specialist, Sensplex Facilities
$43.5k - $66.6k per year
...Opportunity The Tournament Specialist supports the planning,... ...run to the highest possible quality. This includes identifying areas... ...Provide day-to-day leadership, feedback, and support to event staff,... ...customer service issues on-site and remotely, including dealing with...
Remote work
Quality
Full time
Part time
Flexible hours
Weekend work
Afternoon shift
Ottawa Senators
Ottawa, ON
a month ago
Grants Specialist
...to help make that happen. As Grants Specialist, you will be responsible for the day-to-... ...! CIRA embraces a blend of remote and IRL in-office work to keep our team... .... All applicant screenings, interviews, evaluations and selection decisions are conducted by...
Remote work
Full time
Work at office
Cira
Ottawa, ON
15 days ago
Software Development Specialist
...knowledge to build practical AI-enabled tools and workflows that... ...throughput, baseline quality, and decision velocity—directly... ...group, and iterating based on feedback. If you are a strong software... ...structured outputs), implementing evaluation/validation approaches for model...
Quality
Full time
Internship
Work at office
Worldwide
Telesat Corporation
Ottawa, ON
more than 2 months ago
Bilingual Employer Engagement Specialist
...offer? The Employer Engagement Specialist will work as part of the team... ...that enhance work quality. Compassion : Involves warmth... ...use artificial intelligence (AI) to screen, assess, or select... ...ensuring that each candidate is evaluated on an individual basis with the...
Quality
Long term contract
Full time
Work at office
Immediate start
Ymca Of The National Capital Region
Ottawa, ON
14 days ago
Senior Procurement Specialist
...Description Senior Procurement Specialist March Networks is an established global leader... ...schedules, cost, and margin objectives. Evaluate supplier capability, reliability, capacity... ...application. Please note March Networks uses AI as part of the recruitment process....
Long term contract
Full time
Contract work
Immediate start
March Networks
Ottawa, ON
8 days ago
AI Data Trainer - Remote
...Senior AI Trainer Role Type: Contractor, Remote Location: North America, Latin America, Europe, UK, Oceania... ...precise annotations, and provide high-quality data to support AI model training.... ...in quality reviews and incorporate feedback to maintain standards....
Remote job
Quality
For contractors
YO AI Labs
Ottawa, ON
25 days ago
Senior Specialist Partner Relations, CCS - ON
$79k - $89k per year
...Collection Systems (CCS), the Senior Specialist, CCS is responsible for... ...Post Collection and Material Quality and Innovation teams as needed... ...employees work 40 hours per week, remotely from a home office environment... ...Intelligence ~ AI is not used during our hiring...
Remote job
Quality
Remplacement
Full time
Contract work
Work at office
Home office
Circular Materials
Ottawa, ON
5 days ago
Revenue Enablement Specialist
...looking for a Revenue Enablement Specialist to lead the end-to-end... ...and Marketing to produce high-quality, compliant, and competitive proposals... ...for the global Sales team Evaluate opportunity fit in partnership... ...will be expected to work in a remote/hybrid environment reporting...
Remote work
Quality
Full time
Shift work
Jsi
Ottawa, ON
more than 2 months ago
Senior Proposal Specialist
$75k - $95k per year
...Sr Proposal Specialist Proposals Group Remote (within reasonable distance of any Pinchin office location... ...the development of compelling, high-quality proposal submissions across Canada.... ...complex procurement requirements and evaluation criteria Manage large, complex, and...
Remote job
Quality
Full time
Contract work
Work at office
Flexible hours
Pinchin Canada Career
Ottawa, ON
more than 2 months ago
Field Services Specialist
...%). While supporting the Service Delivery Team, you will provide remote service assistance using various web-based remote support tools when... ...by the Service Desk Manager. Follow all other processes and quality standards as assigned by the Service Desk Manager....
Remote work
Quality
Full time
Work at office
Worldwide
Rotating shift
Jolera
Ottawa, ON
8 days ago
Customer Success and Solutions Specialist, Software
...Customer Success and Solutions Specialist to strengthen the software... ...software troubleshooting, and AI-driven problem solving, with direct... ...training sessions, both remote and on-site, to ensure technical... ...Systematically synthesize customer feedback, feature requests, and...
Remote work
Quality
Full time
Manual labor
Immediate start
Worldwide
Flexible hours
Giatec Scientific Inc.
Ottawa, ON
more than 2 months ago
Customer Operations Specialist
$60k - $65k per year
...Customer Operations, the Customer Operations Specialist will assist with the achievement of... ...Attention to detail, investigative, committed to quality · Resilient, ability to maintain... ...application. Please note March Networks uses AI as part of the recruitment process....
Quality
Full time
Immediate start
March Networks
Ottawa, ON
10 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Evaluation Specialist: Quality Feedback. Be the first to apply!