Copy of LLM Model Response Evaluation
Temporary
Lifted, an Upwork Company™
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
Job Description
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
Qualifications
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelor's Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Additional Information
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Copy of LLM Model Response Evaluation in Ottawa, ON vacancy
- ...Aerodynamic Engineers to help train and evaluate next-generation AI systems by contributing... ...and aerodynamics tasks that evaluate AI models' engineering reasoning. Create clear and... ...that objectively evaluate AI-generated responses. Produce verified reference solutions...SuggestedHourly payContract workFor contractorsRemote work10 hours per weekFlexible hours
$60 per hour
...An enterprise client is seeking experienced Lua Developers to support AI model training through technical evaluations, scripting tasks, and code quality reviews. This opportunity is ideal for developers who have strong Lua programming skills and experience building or...SuggestedWeekly payContract workFreelanceRemote work10 hours per week- ...Engineers to help train and evaluate next-generation AI systems. This... ...focused on improving how AI models solve complex structural... ...criteria to evaluate AI-generated responses. Build engineering tasks... ...engineering methodologies. Create evaluation scenarios involving topics...SuggestedHourly payContract workRemote work10 hours per weekFlexible hours
$96.56k - $160.93k per year
...marchés émergents ? Nous recherchons un(e) Responsable des investissements, Fonds ! Rejoignez... ...la possibilité de travailler selon un modèle hybride, l’exigence actuelle étant de... ...investissement, la clôture et le suivi. Évaluer les risques liés aux transactions et...SuggestedPermanent employmentFull timeContract workSummer workWork at officeWorldwideDay shift- ...Location: Ottawa, ON (Hybrid) Duration: 20 weeks Security Clearance: Secret Language: Bilingual (English and French) Responsibilities Develop a workplan and methodology for assessing the implementation and effectiveness of the Protocol during the general election...SuggestedFor contractorsInternship
$68k - $98k per year
...to build a pipeline of Water/Wastewater Modeller talent to join our Water team in either... ..., the successful candidate will be responsible for the following: Conducts strategic... ...and storage to conduct system capacity evaluations Interacts with project clients to understand...Full timeWork at officeLocal areaRelocation- ...alongside iconic brand names. About the Role: As a luxury brand evaluator, you will step into the world of luxury to discreetly assess... ...in the luxury market. Compensation: • Non-Purchase Evaluations: Earn a fee based on mission complexity. • Purchase-Based Evaluations...Contract workWorldwideFlexible hours
- ...construire. Nous pensons que les processus d’admission aux études supérieures ont un mandat d’aller au-delà des notes académiques, et d’évaluer le potentiel du candidat en considérant la personne dans son entièreté : son expérience personnelle, ses forces et ses qualités...Contract workApprenticeshipCasual workWork at officeFlexible hoursDay shift
- ...Sensor Modeling & Simulation Engineer (M&S) Preferred Location:... ...sensor and electronic-warfare models end to end — RF/radar, EW, multi... ...from day one with equity, responsibility, and direct access to leadership... ...screening and reviewing responses. Final hiring decisions are always...Full time
- ...operational readiness. We are seeking a Modelling & Simulation Software Developer to develop... ...sensors, aircraft, weapons systems, etc. to model them using software with high fidelity.... ...software applications. ~ Experience evaluating and integrating software products into Modelling...Full timeTemporary workPart timeInternshipFlexible hours
$96.56k - $128.74k per year
...meilleurs grâce au commerce. Poste : Responsable des services techniques, Plateformes d'... ...en matière de technologie intégrée, le modèle de données cible et les activités technologiques... ...les demandes de modifications, l’évaluation des risques, les approbations et les lancements...Permanent employmentFull timeApprenticeshipSummer workWork at officeDay shift- ...ont choisi de reconstruire ici — un reflet de la confiance, de la culture et de la conviction derrière ce que nous construisons. Responsable du succès client le rôle en un paragraphe La plupart des emplois en CS consistent à favoriser l'adoption d'un outil. Celui-ci...Summer workWork at officeRemote workWork from homeDay shift
Motion
Ottawa, ON5 days ago - ...TEHORA est présentement à la recherche d’ un Responsable de programme TI – Sénior – Volet clinique afin de participer à la planification, à la gouvernance et à la réalisation de programmes technologiques d’envergure liés aux systèmes d’information cliniques et à la transformation...Hourly payContract workApprenticeshipRemote workFlexible hours
$96.56k - $128.74k per year
...meilleurs grâce au commerce. Poste : Responsable de plateformes, Plateformes d’automatisation... ...en matière de technologie intégrée, le modèle de données cible et les activités... ...de l’excellence de l’automatisation pour évaluer et façonner les possibilités d’automatisation...Permanent employmentFull timeContract workApprenticeshipSummer workWork at officeDay shift$87.5k per year
...recherchons des personnes talentueuses pour nous aider à façonner l'avenir du marketing alimenté par l'IA ! À propos du rôle de Responsable de compte Motion vient de lancer Runneth , un agent marketing IA, et la demande a explosé alors que les entreprises repensent...Permanent employmentFull timeWork at officeWork from homeMotion
Ottawa, ON5 days ago$112.01k - $149.34k per year
...un Canada et un monde meilleurs grâce au commerce. Poste : Responsable principal(e) de l’innovation financière Type d’emploi : Affectation... ...internes et externes afin d’assurer le suivi, l’analyse et l’évaluation du rendement, de l’efficacité, de la pertinence et de l’...Permanent employmentApprenticeshipSummer workWork at officeDay shift$106k - $156k per year
...About the Job: You will bridge the gap between theoretical modeling and hands-on experimental validation to advance the next generation... ..., and modulators). Develop and maintain accurate numerical models of optical transmission systems, accounting for linear/nonlinear...Permanent employmentFull timeInternshipImmediate start$93.76k - $114.1k per year
...Technology and Solutions unit is responsible for Geographic Information... ...management practices Data analytic models and frameworks Geospatial (... ...Requests for Proposal and the evaluation of resultant submissions... .... Please save a copy of the job poster. Once the closing...Permanent employmentFull timeTemporary work- ...AI systems, agentic workflows, evaluation, and observability - not an... ...reliability, latency, cost, and model quality are core to the job. Your... ...hooks Integrate agents and LLM-powered workflows into... ...company location. Cloudbeds is not responsible for any fees related to unsolicited...Full timeWork at officeLocal areaRemote workWork from homeHome officeFlexible hoursWeekend work
$74.22k - $86.84k per year
...solid waste programs. You are responsible for providing technical... ...infrastructure deterioration models, material performance characterization... ...in gathering, analyzing and evaluating operational systems or... ...requirements. Please save a copy of the job poster. Once the closing...Long term contractRemplacementPermanent employmentFull time$65k - $75k per year
...TypeScript, agent frameworks, LLM integrations) You will... ...innovation. What You’ll Do Key Responsibilities Develop code using an... ...including: Large Language Models (LLMs) Agentic frameworks (... ...Exposure to prompt engineering and evaluation techniques Understanding...Full timeSummer workInternshipRemote work$93.76k - $114.1k per year
...techncial skills in hydrologic and hydraulic modeling, municipal infrastructure planning and... ...for Proposal preparation, proposal evaluation and selection techniques Project management... ...oral, reading, writing Please save a copy of the job poster. Once the closing date...Permanent employmentFull timeFlexible hours$30 - $50 per hour
...training workflows. You will create and evaluate high-quality training data for large language models and computer vision systems, improving... ...comparisons, and rubric-based scoring for LLM outputs. Perform prompt evaluation and response grading for helpfulness, correctness,...Full timeRemote work$105k - $130k per year
...Trend Vision One Platform — from model training to GenAI system design and deployment. Key Responsibilities Architecting Autonomous... ...engineering to model training, rigorous evaluation, and production deployment.... ...success in developing LLM-powered applications or autonomous...Long term contractFull timeTemporary workWork at officeWorldwide3 days per week$74.65k - $87.33k per year
...mobile, and virtual channels. You are responsible for planning, coordinating, and implementing... ...and City of Ottawa. Library program evaluation principles and practices Project... ...academic requirements. Please save a copy of the job poster. Once the closing date...Ongoing contractPermanent employmentFull timeContract workFlexible hours$177k per year
...Goals, achieve Results within their job responsibilities, contribute Innovative ideas and... ...scale products ~ Experience designing LLM- and GenAI-enhanced user experiences that... ...proficiency with prototyping tools, and model evaluation ~ Deep familiarity with retrieval and...Long term contractFull timeTemporary workFor contractorsLocal areaHome officeFlexible hours$85.95k - $104.58k per year
...Summary The Financial Services Branch is responsible for the overall delivery of financial... ...guidance Able to research, analyze and evaluate financial/budgetary issues, interpret data... ...academic requirements. Please save a copy of the job poster. Once the closing date...Permanent employmentFull timeTemporary workFlexible hoursShift work$95.13k - $120.31k per year
...senior legal counsel, you are responsible for providing a wide range of... ...manner of various enquiries/responses, and making final determinations... ...of diverse issues, analyze/evaluate/interpret information,... ...requirements. Please save a copy of the job poster. Once the closing...Full timeContract workTemporary workLocal area$93.76k - $114.1k per year
...Job Summary The Road Safety Unit is responsible for developing the strategic direction for... ...lead the development, implementation and evaluation of engineering-based road safety initiatives... ...own transportation. Please save a copy of the job poster. Once the closing date...Permanent employmentFull timeTemporary work$58k - $104k per year
...disaggregated databases, pay-by-query user models, and optimizing low-level data transfers... ...LLMs, Agentic Workflows, Memory, Planning, Evaluation, and Multi-Agent systems. The total... ...open source. Experience with AI Agent, LLM, RAG, MCP, or Workflow projects is an asset...InternshipImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Copy of LLM Model Response Evaluation. Be the first to apply!
