Remote LLM & GenAI Quality Evaluator
Lifted (an Upwork Company)
Lifted (an Upwork Company) is seeking experienced evaluators to assess model-generated content across text, images, audio, video, and HTML widgets. You will use defined rubrics to judge factuality, consistency, and aesthetics, working with detailed project guidelines.
The role is flexible and remote, with workload varying weekly. A Bachelor's degree and 3+ years of hands-on LLM/GenAI data evaluation are required, and independent research using trusted sources is expected.
#J-18808-LjbffrVacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Remote LLM & GenAI Quality Evaluator in Ottawa, ON vacancy
$45k - $75k per year
...newly created position. Quality Control Technician personnel executes... ...procedures that include evaluation of raw materials, finished products... ...a hybrid environment or fully remotely - Free Onsite Parking... ...organize and run events for both remote and onsite employees, to...Remote workQualityLong term contractPermanent employmentFull timeContract workLocal areaWorldwideOraSure Technologies, Inc.
Ottawa, ON2 days ago$70k - $80k per year
...Position: Monitoring and Evaluation Officer Location: Remote with Hybrid Option (Ottawa) Salary Range: $70,000 - $80,000 Summary CODE is seeking... ..., evaluation, and learning systems to ensure program quality, accountability, and impact. Working closely with the...Remote workQualityTemporary workLocal areaFlexible hoursCodengo
Ottawa, ONa month ago- ...Engineer Job Type: Contractor (~15 hours/week) Location: Remote Job Summary We are seeking experienced Senior... ...training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context...Remote jobFor contractors
$96.56k - $128.74k per year
...to explore new markets, reduce risks, all towards the goal of making Canada and the world better through trade. Position: Senior Quality Engineer/Lead Employment Type: Permanent Compensation Details: ~ Senior Software Engineer 18: Salaries typically range...QualityPermanent employmentFull timeSummer workRelocation packageExport Development Canada
Ottawa, ON10 days ago- ...using TACTIC or client desktop training tool; and Providing Quality Assurance Support to the client by: Preparing QA plans and procedures... ...–enabled tools; however, AI is not used to screen, evaluate, or make decisions about applicants for this role. *Unless otherwise...QualityFull timeTemporary workPart timeInternshipFlexible hours
Adga Group Consultants Inc
Ottawa, ONmore than 2 months ago - ...Workada is seeking a detail-oriented evaluator to review AI outputs across text, images, video and documents, applying detailed criteria... ...well, think critically, and follow guidelines independently. This remote, full-time role offers training, feedback, and opportunities to...Remote workQualityFull time
Bedard Human Resources
Ottawa, ON11 hours ago - ...Quality Assurance Specialist: Job ID#: DSEFQA001 Job Title : Quality Assurance Specialist Mandatory Skills : 2-3+ Yearsâ experience Start Date: Immediate Duration : Full Time Position Location : Ottawa Security Clearance Required...QualityFull timeImmediate start
Symbiotic Digital
Ottawa, ONmore than 2 months ago usd15 per hour
...Working on behalf of RWS, you will test and evaluate how our clients’ search engine responds... ...environment. - Continually maintain quality and accuracy SLAs. - Have the self-discipline... ...home parents, or anyone seeking flexible remote work to improve AI models. No previous experience...Remote workQualityWeekly payFull timePart timeFreelanceSecond jobWork from homeHome officeFlexible hours$70 per hour
...leading tech companies, focused on testing, evaluating, and improving AI systems.... ...clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are... ...systems; Score the clinical reasoning quality of benchmark items: vignette accuracy and...QualityHourly payPermanent employmentPart time10 hours per week$57k - $62k per year
...rewards package during the hiring process. Vacancy Status: This job posting is for an existing vacancy Scope of Position The Quality Assurance Analyst (QA Analyst) role is to develop and establish quality assurance standards and measures for the IT services within...QualityFull timeFlexible hoursAlterna Savings
Ottawa, ONmore than 2 months ago- ...Mercor is seeking expert Evaluators in Healthcare operations to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. This is a remote, hourly engagement. You will apply deep subject-matter expertise...Remote workQualityHourly pay
Mercor
Ottawa, ON16 hours ago usd16 per hour
...RWS Group is seeking a native Malayalam speaker to remotely evaluate AI-generated content. You will translate prompts from English into Malayalam... ...10–15 hours total (about 5 hours per day) at 16 USD per hour with flexible scheduling, remote from Canada. #J-18808-LjbffrRemote workQualityHourly payFreelanceFlexible hoursRWS Group
Ottawa, ON16 hours ago- ...samples. DNA provides proven performance for those requiring high-quality biological samples for nucleic acid testing. Our ability to... ...Control Specialist personnel executes written procedures that include evaluation of raw materials, finished products, equipment and product...QualityContract workWorldwide
$25 per hour
Hello! We are a warm and welcoming family in Ottawa, Ontario, seeking a dedicated and caring nanny for our infant. This is a full-time position that offers flexibility with the option to live in or live out. Our top priority is finding someone who can provide gentle and attentive...QualityHourly payFull timeLive outLive InNight shiftCanadianNanny.ca
Ottawa, ON7 days ago- ...Workada is seeking a remote, full-time AI evaluator to review outputs from models across text, images, and video for a 3 to 6 month period. You will... ..., who can follow strict guidelines independently and contribute to a mission-driven team focused on quality. #J-18808-LjbffrRemote workQualityFull time
Workada
Ottawa, ON16 hours ago - ...YO AI Labs is seeking an AI Evaluation Specialist to assess and improve AI assistant outputs for an enterprise training project. This remote contractor role focuses on applying rubrics for accuracy, relevance, and adherence to guidelines, with feedback that informs system improvements...Remote workQualityFor contractors
YO AI Labs
Ottawa, ON16 hours ago $85k - $225k per year
...experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and...Remote workQualityFull timeFlexible hoursVeeva Systems
Ottawa, ON16 hours ago- ...Workada is seeking a detail-oriented evaluator to improve AI systems by reviewing outputs from text, images, video, and documents against... ...identifying gaps, and writing clear, well-reasoned judgments. In a remote, full-time role, you’ll follow documented guidelines, maintain...Remote workQualityFull time
Saskdocs
Ottawa, ON11 hours ago - ...Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in relevant fields,...Remote workQualityHourly pay
Mercor
Ottawa, ON16 hours ago - ...Mercor is seeking expert Evaluators in Legal/compliance to review AI... ...decks for accuracy and domain quality. You will apply deep subject-... ...written feedback. This is a remote, hourly engagement in Canada.... ...focuses on ensuring rigorous evaluation of artifacts and adherence to...Remote workQualityHourly pay
Mercor
Ottawa, ON16 hours ago $72.32k - $90.61k per year
...BWXT Medical Ltd. is seeking a detail-oriented and driven R5 Quality Control Technician - 12 month-term to join our dynamic team at... ...accurate and detailed records of observations, test results, and data evaluations for regulatory and internal review Ensuring production...QualityInternshipImmediate startFlexible hoursShift work- ...Job Description Position Summary The Director, Quality Assurance is accountable for defining and advancing Assent’s quality... ...test data in partnership with Engineering and Platform teams. Evaluate and responsibly adopt emerging capabilities, including AI-assisted...QualityFull timeWorldwideFlexible hoursShift work
- ...Obsidian is seeking expert Evaluators in Finance to review AI-generated slides, spreadsheets, and documents. Apply deep subject-matter knowledge to grade outputs and provide structured feedback in a remote, hourly engagement. The role requires 5+ years of finance experience...Remote workQualityHourly payWork at office
Mercor
Ottawa, ON16 hours ago - ...Workada is seeking detail-oriented evaluators to assess AI outputs across text, images, video... ...independently are essential. The role offers remote, full-time work with training, feedback,... ...for growth within a mission-driven team focused on quality. #J-18808-LjbffrRemote workQualityFull time
Bel-Air Laurentien Aviation Inc
Ottawa, ON11 hours ago $55k - $60k per year
...Le français suit... Join Our Team as a Quality Auditor! Job Type : Permanent Full-Time Expected Compensation: $55000- $60000... ...des tendances relatives aux réclamations ainsi que de mener des évaluations de qualité afin de garantir que la CPRST dispense ses services...QualityPermanent employmentFull timeContract work1 day per week- ...About the Role: As a luxury brand evaluator, you will step into the world of luxury... ...carefully - check the ambiance, service quality, and overall customer experience. 4. Provide... .... Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity....QualityContract workWorldwideFlexible hours
usd59.25k - usd86.9k per year
...Abbott seeks an Associate Quality Engineer for its Point of Care Diagnostics division in Ottawa. The role focuses on evaluating change controls, investigating quality variations, and ensuring equipment and processes maintain validated states. Four days on-site weekly required...QualityInternship- ...growing technology and ERP implementation company. This is a 100% remote opportunity for a developer based in Canada who will work on... ...with project managers, consultants, and clients to deliver high-quality solutions Follow Salesforce best practices and development standards...Remote jobQualityFull time
Ensiti
Ottawa, ON24 days ago $15 - $18 per hour
...Join to apply for the Content Evaluator (Remote) role at Work Vista Location: Remote within United States, United Kingdom, Canada, Ireland... ...remote, part‑time contract role is centered on assessing the quality and relevance of AI‑generated content. You will act as a...Remote workQualityHourly payContract workPart time10 hours per weekWork Vista
Ottawa, ON16 hours ago- ...Mercor is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. You will define what excellent work looks like: designing task-specific grading criteria...Quality
Mercor
Ottawa, ON16 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote LLM & GenAI Quality Evaluator. Be the first to apply!
Related searches
- chargé de projet estimateur Ottawa, ON
- estimateur en bâtiment Ottawa, ON
- estimateur industriel Ottawa, ON
- estimateur structure Ottawa, ON
- estimateur - dessinateur Ottawa, ON
- test evaluator Ottawa, ON
- remote social media evaluator Ottawa, ON
- admissions evaluator Ottawa, ON
- évaluateur-estimateur Ottawa, ON
- estimateur automobile Ottawa, ON