Physics Problem Evaluator
$55 - $100 per hourTemporary
Claru
Pay: $55–100/hour
You'll review AI-generated solutions to university-level and graduate physics problems — mechanics, electromagnetism, thermodynamics, quantum mechanics, and beyond. Each task involves reading a model's step-by-step response, identifying errors in reasoning or calculation, and rating the output on correctness, logical coherence, and depth of explanation. You won't just flag wrong answers; you'll articulate precisely where the model's reasoning broke down and, where asked, provide a corrected reference solution.
Your work spans three main workflows: ambiguous-case judgment (deciding when a non-standard approach is still valid), written technical feedback (annotating specific failure modes in a model's derivation), and problem-solving depth review (assessing whether a solution demonstrates genuine physical intuition or is just symbol-shuffling). Tasks arrive in batches via a structured web interface; you log in, claim a batch, complete it, and submit — no scheduling calls, no meetings.
The role requires at minimum a graduate-level background in physics or a closely related field. Professor- or PI-level experience is strongly preferred because many tasks involve research-adjacent material: statistical mechanics, condensed matter, or computational physics at the level of a first-year PhD course. You'll be compensated at the Expert tier and are expected to maintain accuracy above the project's threshold, which will be shared during onboarding.
Skills & requirements
- Physics problem solving
- Graduate-level mechanics and electromagnetism
- Technical written communication
- Critical evaluation of mathematical derivations
- Meta-level scientific reasoning
Category: RLHF
Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the Physics Problem Evaluator in Remote vacancy
- ...subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-... ...Master's degree required; PhD strongly preferred in Physics, Chemistry, or a closely related scientific discipline...SuggestedContract workImmediate startRemote workFlexible hours
- ...About the Role We are looking for physicists to help train and evaluate AI models on physics content. You will analyse physics documents, create and review problems, validate analytical solutions and correct model errors in physical reasoning. Key Responsibilities...SuggestedHourly payFor contractorsRemote work
- ...AfterQuery is searching for Physics PhD Experts to craft, review, and enhance physics-related reasoning problems to advance our AI labs. In this remote, flexible position, you will develop high-quality, real-world physics questions and verify the logical consistency of model...SuggestedContract workRemote workFlexible hours
- ...global community of experts to evaluate, challenge and improve... ...Scientific and quantitative problem solving AI Safety & Red Teaming... ...behaviour Domain-Specific AI Evaluation Healthcare & Medicine... ...Engineering & Robotics Physics & Science Business Humanities...SuggestedPart time
$70 - $100 per hour
...~40 h/week Field: Life, Physical, and Social Science The research... ...AI models come to Mercor for physics judgment they can't generate... ...who want AI training and evaluation work, not a specific job opening... ...projects like: Writing a problem from your own area, with the...SuggestedPart time- ...tasks that are used to train and evaluate frontier AI models. As a... ...reviewing complex scientific problems across core STEM disciplines.... ...on QC feedback to meet ****@*****.*** evaluation criteria across multiple LLM... ...Qualifications: ~Master's or PhD in Physics. Strong Python programming...Contract workPart timeFor contractorsFreelance
- ...pay Required Skills Physics Mastery Written Technical Communication Technical Problem-Solving Depth Mathematical & Computational... ...training frontier models and evaluating AI agents. Experts contribute... ...high-quality training data, evaluations, and feedback loops that...Part timeFor contractorsInternshipRemote workWorldwideFlexible hoursWeekend work
- ...Design and solve complex Physics problems for evaluating language models. About Turing: Based in San Francisco, California, Turing is the world... ...Collaborate with LLM researchers to align problems with evaluation goals, especially in areas where models typically struggle...Contract workPart timeFor contractorsFreelanceRemote work
- ...Skills Computational rigor Complex problem solving - Research Problem framing... ...foundational models and agents. We provide frontier evaluations and reinforcement learning environments... ...- Computer Science & Computational Physics Role Type: Contractor (flexible, Part-...Full timePart timeFor contractorsInternshipRemote workFlexible hours
- ...About the Role We’re looking for contract, remote Italian-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs make sense, are consistent, and reflect real-world expectations in Italian. What...Contract workTemporary workFreelanceImmediate startRemote work
- ...Staff Research Scientist – Reconstruction Physics based in Canada. We are seeking an... ...Technical Innovation: Design, prototype, and evaluate novel image reconstruction algorithms and... ...Apply advanced numerical modeling, inverse problem techniques, optimization, and statistical...Long term contractFull time
- ...micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject matter... ...transforms that real-world expertise into high-quality training data, evaluations, and feedback loops that improve how AI systems learn, reason,...Part timeFor contractorsRemote work
- ...About the Role We’re looking for contract, remote Swedish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs are coherent, consistent, and aligned with real-world expectations in Swedish....Contract workTemporary workImmediate startRemote work
- ..., or application migration. Each task should include a clear problem statement, a reproducible repository or environment, a working reference... ..., concurrency, retries, and regressions where relevant. Evaluate performance measures such as latency, throughput, and memory use...Contract workImmediate start
- ...’re looking for contract, remote French-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance... ...: This is a short-term engagement that starts ASAP Rôle : Évaluateur(trice) de langue française À propos du poste Nous...Contract workTemporary workFreelanceImmediate startRemote work
- ...About the Role We’re looking for contract, remote Japanese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll assess whether outputs are natural, consistent, and aligned with real-world expectations in Japanese....Contract workTemporary workImmediate startRemote work
- ...About the Role We’re looking for contract, remote Spanish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs actually make sense, stay consistent, and reflect real-world...Contract workTemporary workImmediate startRemote work
- ...About the Role We’re looking for contract, remote Turkish-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll evaluate whether outputs are coherent, consistent, and aligned with real-world expectations in Turkish....Contract workTemporary workFreelanceImmediate startRemote work
- ...contractor Remote · Contract · Radiological Science · Health Physics · AI Safety · CBRN What this pays Rates are set by the client... ...a figure we cannot stand behind. About the Role AI Safety Evaluation Project | Remote | Contract Locations: US, Canada, UK, Europe,...Hourly payContract workFor contractorsRemote work
- ...Evaluate AI models against real-world materials discovery challenges... ...high-quality training data, evaluations, and engineering talent. We are... ...Science or Semiconductor Physics Expert to evaluate and benchmark... ..., kMC)—into structured test problems, define scientific grading criteria...Part timeRemote workFlexible hours
- ...About the Role We’re looking for contract, remote Portuguese-speaking annotators to evaluate AI-generated content with a sharp eye for detail and cultural nuance. You’ll be making judgment calls on whether outputs make sense and reflect real-world expectations in Portuguese...Contract workTemporary workFreelanceImmediate startRemote work
- © 2026 Smart Ecosystems. All rights reserved.Full time
$80 - $110 per hour
...~10 h/week Field: Life, Physical, and Social Science About... ...benchmark of research-level physics challenges, built to test whether... ...rather than textbook problem solving. The benchmark paper... ...boundary conditions, exact lattice evaluation of Ising partition functions,...Hourly payContract workImmediate startRemote work10 hours per week- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California... .... Project Description: This project supports the evaluation and improvement of safety behavior in large language model systems...Ongoing contractPart timeFor contractors
$13 per hour
...years Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps... .... • Follow project guidelines for consistent, confidential evaluation work. Important account-access requirement • This...Hourly payContract workFor contractorsRemote work- ...Lead teams to create and evaluate realistic LLM conversational data. About Turing Turing is a leading AI company accelerating the... ...operations, and review teams to deliver reliable training and evaluation datasets. What You’ll Do ~Lead and manage teams responsible...Contract workPart timeFreelanceRemote work
$85 per hour
...Do Review pairs of images presented on our digital platform. Evaluate each image against a specific set of brand guidelines. Select... ...applying written brand guidelines Ability to make clear, decisive evaluations between similar visual assets Access to a reliable computer and...Ongoing contractContract workFor contractorsRemote work- ...We are seeking candidates to develop evaluation scenarios that test cutting-edge autonomous AI systems across multiple domains. You'll create complex research tasks that challenge AI capabilities in sports analytics, financial analysis, patent research, academic planning, and...Contract workFor contractors10 hours per weekFlexible hours
usd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job... ..., and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality standards...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Physics Problem Evaluator. Be the first to apply!
