Copy of LLM Model Response Evaluation
Temporary
Lifted, an Upwork Company™
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
Job Description
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
Qualifications
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelor's Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Additional Information
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Vacancy posted 23 days ago
Similar jobs that could be interesting for youBased on the Copy of LLM Model Response Evaluation in Ottawa, ON vacancy
- ...project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using Model Context... .... No prior AI experience is required. Key Responsibilities Create reinforcement learning environments for software...SuggestedRemote jobFor contractors
$96.56k - $160.93k per year
...marchés émergents ? Nous recherchons un(e) Responsable des investissements, Fonds !... ...avec la possibilité de travailler selon un modèle hybride, l’exigence actuelle étant de trois... ...investissement, la clôture et le suivi. Évaluer les risques liés aux transactions et...SuggestedPermanent employmentFull timeContract workSummer workWork at officeWorldwideDay shift$36.07 per hour
...les services en français ; renforcer sa responsabilité sociale ; accroitre l’impact de l’enseignement... ...continue au sein des employés. Le responsable des opérations participe aux prises de... ...du personnel. Surveiller et évaluer l’efficacité du travail quotidien des membres...SuggestedDaily paidInternshipWork at officeDay shift- ...Sensor Modeling & Simulation Engineer (M&S) Preferred Location:... ...sensor and electronic-warfare models end to end — RF/radar, EW, multi... ...from day one with equity, responsibility, and direct access to leadership... ...screening and reviewing responses. Final hiring decisions are always...SuggestedFull time
$108.8k - $220.4k per year
...an experienced and senior AI/LLM Architect, you will play a pivotal... ...and knowledge engineering, or model platforms and inference –... ...across the practice. You will evaluate, select, and apply the right... ...solutions using techniques like response caching and request batching....SuggestedFull timeWork at officeLocal areaAccenture
Ottawa, ON1 day ago$18 - $22.5 per hour
...Job Responsibility: Valeurs & Innovation At Under Armour, we are committed to empowering... ...L'associé principal des chaussures est responsable de la réalisation des ventes de chaussures... ...athlètes les messages de la marque selon le modèle de service d'Under ArmourIntégrer la...Hourly payTemporary workPart timeFlexible hoursNight shiftWeekend workDay shiftAfternoon shift- ...reconstruire ici — un reflet de la confiance, de la culture et de la conviction derrière ce que nous construisons. À propos du rôle de Responsable Senior de la Réussite Client La plupart des emplois en CS consistent à favoriser l'adoption d'un outil. Celui-ci est différent....Daily paidPermanent employmentFull timeSummer workWork at officeRemote workWork from homeDay shift
Motion
Ottawa, ON3 days ago - ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- ...construire. Nous pensons que les processus d’admission aux études supérieures ont un mandat d’aller au-delà des notes académiques, et d’évaluer le potentiel du candidat en considérant la personne dans son entièreté : son expérience personnelle, ses forces et ses qualités...Contract workApprenticeshipCasual workWork at officeFlexible hoursDay shift
$93k - $124k per year
...résider dans le même pays que celui où le poste est situé. Responsable local(e) des essais cliniques (dédié(e) au promoteur) Le ou... ...établissement des priorités. Capacité démontrée à identifier, évaluer et gérer les risques et les enjeux liés aux études cliniques....Full timeContract workPart timeWork at officeLocal areaImmediate startWorldwide- ...et plus intelligentes pour relier les villes, réduire l’empreinte carbone et remplacer la voiture. Pourriez-vous être le/la Responsable Finance projet à temps plein à Saint-Bruno que nous recherchons ? Votre futur rôle Relevez un nouveau défi et mettez à profit...Daily paidFull timeApprenticeshipFlexible hours
- ...TEHORA est présentement à la recherche d’ un Responsable de programme TI – Sénior – Volet clinique afin de participer à la planification, à la gouvernance et à la réalisation de programmes technologiques d’envergure liés aux systèmes d’information cliniques et à la transformation...Hourly payContract workApprenticeshipRemote workFlexible hours
$87.5k per year
...recherchons des personnes talentueuses pour nous aider à façonner l'avenir du marketing alimenté par l'IA ! À propos du rôle de Responsable de compte Motion vient de lancer Runneth , un agent marketing IA, et la demande a explosé alors que les entreprises repensent...Permanent employmentFull timeWork at officeWork from homeMotion
Ottawa, ON3 days ago$106k - $156k per year
...About the Job: You will bridge the gap between theoretical modeling and hands-on experimental validation to advance the next generation... ..., and modulators). Develop and maintain accurate numerical models of optical transmission systems, accounting for linear/nonlinear...Permanent employmentFull timeInternshipImmediate start$73.24k - $89.12k per year
...Job Responsibility: Requisition ID: 13783 Department: Finance and Corporate... ..., accounting, financial modelling, etc. KNOWLEDGE Knowledge... ...Able to research, analyze and evaluate financial/budgetary issues,... ...requirements. Please save a copy of the job poster. Once the...Permanent employmentFull timeTemporary workFlexible hoursShift work$80k - $100k per year
...role As Civil Estimator, you will be responsible for preparing accurate and competitive cost... ...detailed cost estimates Obtaining and evaluating subcontractor and supplier quotations... ...click 'apply now' to forward an up-to-date copy of your CV, or call us now. If this job...Long term contractPermanent employmentFor contractorsFor subcontractorFlexible hours$138.45k per year
...teams. You will have direct access to the latest AI models and tooling, with the autonomy to evaluate emerging technologies and apply them pragmatically where... ...Establish patterns and frameworks for integrating LLM/VLM systems with internal tools, permissions, and data...Permanent employmentFull time$118k per year
...natural language processing and generative AI models to develop solutions which deliver value... ...language models and deploying models. Responsibilities Focus on a variety of content... ...Neural Networks in PyTorch to third party LLM APIs Process massive amounts of data with...Long term contractFor contractorsLocal areaHome officeFlexible hours- ...WebAuthn/FIDO2) Deploy, maintain, and tune endpoint detection & response (EDR) across the device fleet Design and maintain secure MDM... .../collaboration suite, security tooling, and custom GenAI/LLM models (managed/self-hosted inference) Deploy and continuously refine...Full time
- ...ChatGPT) in their day-to-day workflows, able to evaluate AI-generated outputs critically, and open... ...Expand platform integrations across major LLM ecosystems including OpenAI, Claude, and... ...Preferred Skills Familiarity with Model Context Protocol (MCP) or similar tool-calling...
$84.1k - $108.79k per year
...within Ottawa contributes to our team: Responsibilities Translates a proposal “vision” into a... ...and brand compliant style. Evaluates narratives for relevance, comprehension... ...developments (construction process, delivery models, contract types). ~ Advanced knowledge...Long term contractContract workWork at officeLocal areaRemote workFlexible hours$105.16k - $136.79k per year
...based on your interests and strengths. Responsibilities Design Automation & Tool Development... ...and automate simulation flows for: -EM modeling (2.5D/3D)-Circuit-level simulations (... ..., and lab debug. Assist in lab evaluation and characterization of RF modules....Long term contract- ...and the House Administration. This role is responsible for overseeing tenant service operations... ...organization continues to refine its operating model and service delivery approach the... ...conducted in August. We invite you to save a copy of the notice of job opportunity. Once the...Full timeContract workFixed term contractRemote workRelocation
$131.67k - $171.33k per year
...Engineer is part of the Test Engineering team responsible for developing test solutions for high-... ...and QFN products. Design, develop, evaluate, and optimize test fixtures.Troubleshoot... ...and manufacturing readiness. Design, model, simulate and measure test vehicles for high...- ...security, scalability, and adaptability. Responsibilities: • Drive long-term business value... ...c) Create target-state architecture models that support scalability, agility, and... ...to support strategic decisions. h) Evaluations of proposed projects or changes against...Long term contract
CONFIGURETEK
Ottawa, ON16 days ago - ...intersection. You'll select the engine, model its performance across the... ...and trade studies — evaluate candidate platforms against mission... ...from day one with equity, responsibility, and direct access to... ...including screening and reviewing responses. Final hiring decisions are always...Full time
$98k - $130k per year
...tools (SAST, SCA, Secrets Scanning, etc.) ~AI security controls and LLM risk management What you’ll be working on ~Embed security... ...guardrail-driven programs ~Facilitate lightweight, feature-level threat models and drive risk-based discussions ~Perform hands-on application...Long term contractInternshipWorldwideFlexible hours- ...Job Responsibility: Harnessing the Power of Data, Together. Solace stands at the forefront... ...an application/service. Experience in evaluating designs/solutions using various front-end... ...you do We have adopted a hybrid work model to create an inclusive working...Full time
$58k - $102k per year
...Job Type: Permanent Work Model: Hybride Reference code: 133913 Primary Location... .... En collaborant étroitement avec les responsables de produits, les spécialistes, les... ...Effectuer des analyses des lacunes et des évaluations des répercussions pour déterminer les besoins...Permanent employmentApprenticeshipWork at officeFlexible hoursDay shift- ...processes, and executive-level financial reporting. Strong financial modeling, forecasting, and analytical capabilities. Exceptional... ...in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now. If this job isn't quite right for...Long term contractContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Copy of LLM Model Response Evaluation. Be the first to apply!
