Assessment Expert
$190 per hourTemporary
Alpheva
Bring senior assessment expertise to AI evaluation projects focused on item quality, rubrics, validity, fairness, and score interpretation.
Review model responses and worked examples for misaligned learning objectives, invalid assessment assumptions, and unsupported pedagogical claims. Assess whether the reasoning meets professional standards for the stated task.
Write reference answers and scoring criteria grounded in item quality, rubrics, validity, fairness, and score interpretation. Explain consequential errors, evidence gaps, and the reasoning behind your corrections.
This is remote, project-based contract work. Scope, hours, and assignments depend on project matching; the listed hourly range applies to matched work.
Requirements
- 7+ years of substantive experience in educational assessment or psychometrics.
- Demonstrated senior-level judgment in item quality, rubrics, validity, fairness, and score interpretation, with substantial responsibility for reviewing or delivering this work.
- Ability to write precise reference answers, assess competing approaches, and justify corrections with traceable evidence.
Pay
$190–$240/hr
Alpheva is a new expert network (launched September 2026); payout methods are not published yet, so confirm your first payment before scaling up.
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Assessment Expert in Remote vacancy
- What You'll Do Translate a familiar, complex workflow into a demanding prompt for an AI model Test your prompt using ChatGPT to identify where the model fails to produce a complete file Record your screen, camera, and microphone while thinking through the task Write a clear...SuggestedContract workFor contractorsRemote work
- ...communication attention to detail structured assessment objective evaluation process... ...recruiting agent sources and vets domain experts for our data platform that enables rapid... ...Create detailed, objective rubrics to assess the quality, accuracy, and completeness of...SuggestedFor contractorsRemote work
$90 per hour
...enterprise settings. Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-... ...process documentation, service level definitions, or training assessments. Strong Excel capability and comfort reasoning across...SuggestedPart timeFor contractorsRemote work$25 - $50 per hour
...enterprise settings. Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-... ...in English, in writing. Experience writing exam questions, assessments, or analytical exercises is a plus, but not required. How...SuggestedPart timeFor contractorsRemote workFlexible hours$80 per hour
...Generalist Lecturer Expert Ethos ⢠Remote Education Not stated Type Hourly Pay Rate $80/hr Listed 40d... ...presentations, visual explanation of complex concepts, assessment rubrics, and seminar materials. Compensation $80/hour Commitment...SuggestedHourly payContract workManual laborImmediate startRemote workFlexible hours$40 - $125 per hour
...actual defense, and that someone is you. As a Cybersecurity Expert you'll probe frontier models for unsafe code and exploit paths,... ...project-available. How it works Apply, pass the qualification assessment, then pick up paid projects whenever you want and get paid...Weekly payFull timeContract workFor contractorsRemote workFlexible hours$90 per hour
...enterprise settings. Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-... ...compliance work — contract review, due diligence, regulatory assessment, risk analysis — with realistic reference files and clear...Contract workPart timeFor contractorsRemote work- ...About the Role We are seeking Life Sciences Subject Matter Experts to design advanced scientific-reasoning tasks for LifeSciBench.... ...Qualifications Experience designing graduate-level problems, assessments, or research exercises. Experience reviewing scientific...Contract workPart timeFor contractorsFreelanceRemote workFlexible hours
- ...military intelligence combat operations assessment About micro1 micro1 is a data lab... ...recruiting agent sources and vets domain experts for our data platform that enables rapid... ...targeting, and weapons employment scenarios. Assess the application of Rules of Engagement (...Part timeFor contractorsRemote work
- ...applications and next steps. Our partner is looking for an App Security Expert based in Canada. As an App Security Expert, you will help... ...vulnerable versus secure code by AI systems and security scanners. - Assess and refine testing pipelines, ensuring synthetic security tasks...Full timeRemote work
$80 per hour
...Humanities Professor Expert Ethos ⢠Remote Education Not stated Type Hourly Pay Rate $80/hr Listed... ...conference presentations, visual explanation of complex concepts, assessment rubrics, and seminar materials. Compensation $80/hour Commitment...Hourly payContract workManual laborImmediate startRemote workFlexible hours$40 - $125 per hour
...plausible wrong answer in law has real consequences. As a legal expert you'll grade AI legal reasoning against the standard of a... ...project-available. How it works Apply, pass the qualification assessment, then pick up paid projects whenever you want and get paid weekly...Weekly payFull timeContract workFor contractorsRemote workFlexible hours$90 per hour
...enterprise settings. Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-... ...checklists, close checklists, grading rubrics, or training assessments. Strong Excel capability and comfort reasoning across...Part timeFor contractorsRemote work$40 - $125 per hour
...back through the logic, and that someone is you. As a Finance Expert you'll evaluate AI-built financial analyses on real corporate... ...project-available. How it works Apply, pass the qualification assessment, then pick up paid projects whenever you want and get paid...Weekly payFull timeContract workFor contractorsRemote workFlexible hours$50 per hour
...foundation model labs. Your expertise as an Chinese-Speaking Python Expert will directly help improve the world's premier AI models. Your... ...step-by-step problem-solving for correctness and clarity. You will assess solutions for accuracy, completeness, and adherence to the prompt...Hourly payFull timeContract workFor contractorsRemote workFlexible hours$115 per hour
...role, you will review AI-generated legal analyses and/or generate expert legal content, evaluating reasoning quality and step-by-step issue-spotting while providing precise written feedback. You will assess answers for accuracy, clarity, and adherence to the prompt; identify...Hourly payContract workFor contractorsImmediate startRemote work$50 per hour
...remote contractor role, you will work as a Paralegal Subject Matter Expert (SME) to review AI-generated legal support responses and/or... ...task execution while providing precise written feedback. You will assess solutions for accuracy, clarity, completeness, and adherence to the...Hourly payContract workFor contractorsImmediate startRemote work$70 per hour
...remote contractor role, you will work as an Insurance Subject Matter Expert (SME) to review AI-generated insurance responses and/or create... ...-making while providing precise written feedback. You will assess solutions for accuracy, clarity, regulatory/compliance awareness,...Hourly payContract workFor contractorsImmediate startRemote work- ...enterprise settings. Our AI recruiting agent sources and vets domain experts for our data platform that enables rapid production of high-... ...test cases and security-context manifests to robustly assess application security posture. Create detailed hidden answer keys...Part timeFor contractorsRemote work
$70 per hour
...contractor role, you will work as an Advertising Subject Matter Expert (SME) to review AI-generated advertising outputs and/or create expert... ...-making while providing precise written feedback. You will assess solutions for clarity, persuasion, brand fit, platform fit, and adherence...Hourly payContract workFor contractorsImmediate startRemote work- ...frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- ...Practitioner finance experts to write and review real world finance scenarios and grade how AI models handle them. AfterQuery works with... ...financial plan, prepare an individual return, restructure debt, or assess a retirement position, and then review how an AI model handles the...Contract workRemote work
- ...equivalent position Strong working knowledge of construction documents, drawings, and specifications Demonstrated ability to independently assess and resolve technical questions on active projects Solid understanding of construction fundamentals including sequencing, scheduling,...Full timeContract workInternshipWork at officeRemote work10 hours per weekFlexible hours
- ...AfterQuery is seeking a Chemistry PhD Expert to help design, create and evaluate challenging chemistry problems that train and refine our... ...real-world chemical principles and apply your deep expertise to assess model responses. You'll play a vital role in bridging the gap between...Contract workRemote workFlexible hours
- ...AfterQuery is seeking Pharmaceutical Experts to create and refine pharmaceutical reasoning challenges for our AI training modules. In this... ...read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement...Contract workFor contractorsRemote workFlexible hours
- ...frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...realistic teaching scenarios from lesson planning through assessment Write reference answers with the pedagogical reasoning behind each...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- ...to test model judgment on real trade work. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- ...judgment on syntax, semantics, and phonology. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- ...frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- ...frontier AI labs use to test model judgment. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve... ...read against a published rubric and gets a decision. Written assessment. You may be asked to take a written assessment for further placement...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Assessment Expert. Be the first to apply!
