Chemical Engineer, AI Model Evaluation
$35 - $49 per hourSovrano AI
Put frontier AI models through real process engineering problems and mark where their reasoning breaks. Remote, hourly, first batch about 10 hours. For chemical engineers with four or more years of hands-on industry work.
About the role
Sovrano AI builds evaluation and training data for frontier AI labs, and this project tests how well those models actually reason about chemical engineering. You give them realistic scenarios, calculations and process problems, then judge what comes back: whether the material and energy balances close, whether the assumptions were stated and defensible, whether the separations logic is feasible, whether the safety reasoning would survive contact with a real plant. Where the model is wrong you write down why, in the terms a colleague would use. Part of the work is also shaping how these models talk about engineering at all, including when they should stop and tell the user to bring in a licensed engineer. The work is remote and hourly, and the first batch runs about ten hours. This is the process engineering panel. If your ground is toxicology, hazard classification and chemical security rather than plant reasoning, apply to CBRN Specialist, AI Safety Review instead.
What you'll do
- Evaluate AI answers across chemical engineering topics for technical accuracy, logical soundness and completeness.
- Push models with realistic scenarios: plant troubleshooting, scale-up questions, sizing logic, process control reasoning.
- Mark up model output where assumptions are missing, constraints are ignored, units are inconsistent or the recommendation is unsafe.
- Review and refine prompts, step-by-step solutions and the explanations attached to them.
- Cover material and energy balances, phase behavior and thermodynamic property use, unit operations and sizing, distillation and separations feasibility, process control, process safety, and operability at scale.
- Set the standard for how models state assumptions, limitations and professional judgment.
- Say clearly when the right answer is to escalate to a licensed engineer or a site expert.
Requirements
- Bachelor's degree in chemical engineering or closely related, Master's/PhD or PE/Chartered strongly preferred
- Minimum 4 years of professional chemical engineering experience, hands-on rather than purely academic
- Based in the US, UK, Canada, Australia, New Zealand or the European Union
- English at C1 or above, written and verbal
- Passes the expert survey before a bootcamp seat is allocated
- Available for the paid bootcamp on Monday and production from Tuesday
- Able to commit roughly 10 hours inside the first batch window, closing Sunday
- Joins the Sovrano Discord before the bootcamp
- Independent contractor, invoices Sovrano directly
Ideal qualifications
- Bachelor's degree in chemical engineering or a closely related field. A Master's or PhD, or PE or Chartered status, is strongly preferred.
- Four or more years of professional chemical engineering experience with real hands-on work: process design, plant and operations engineering, process safety, scale-up, manufacturing, utilities, EHS, quality, R&D, or controls and automation interfaces.
- Deep command of the fundamentals: material and energy balances, thermodynamics, fluid mechanics, heat and mass transfer, reaction engineering, separations and process control.
- Comfort with engineering calculations and with defending them, including uncertainty, safety factors and where a method stops applying.
- English at C1 or above, since the rubric and all written feedback are in English.
- Based in the US, UK, Canada, Australia, New Zealand or the European Union.
Nice to have
- Working familiarity with PFDs and P&IDs, Aspen Plus or HYSYS, CHEMCAD, PSM documentation, HAZOP or LOPA.
- PE or Chartered Engineer status.
- Prior AI data training, red-teaming or technical content evaluation.
What success looks like
- You clear the bootcamp on your own merit and start producing on day one of the batch.
- Your judgment on what is safe to answer, and what is not, matches a senior reviewer's without needing a second opinion.
- Your written reasoning tells a reviewer why an answer is wrong, not just that it is.
- You catch the ordinary professional question the model refused for no good reason, as reliably as you catch the dangerous one it answered.
- You hold the quality bar across the whole batch, including the last task on Sunday.
- You are reachable on Discord during the batch and flag ambiguous cases instead of guessing.
Pay and contract
$35 to $49 per hour, based on your background. Your exact rate is confirmed in writing before you start the bootcamp. Paid hourly for time worked, as an independent contractor.
The first batch is roughly 10 hours of work. A paid bootcamp runs on Monday, production opens Tuesday, and the batch closes Sunday. There is a good chance the work is extended beyond the first batch, and the people who deliver well on it are the ones we go back to.
Payment runs through Sovrano directly. You invoice us, we do not file or submit tax forms on your behalf.
Fully remote, on your own schedule inside the batch window. No fixed shifts and no standing meetings.
How to apply: apply here with your CV or LinkedIn profile, then complete the short expert survey we send you. Shortlisted applicants get the bootcamp invitation and the project guidelines by email.
Skills
Chemical engineering, Process design, Process safety, Thermodynamics, Heat & mass transfer, Separations, Process control, Scale-up, Technical review, Professional English
$100 per hour
...## Description SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task... ...toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors actually ask....SuggestedPermanent employmentFull time- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios... ...for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements • Document findings and...SuggestedContract work
- ...position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Canada. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability...SuggestedFull timeRemote work
- ...optimization About micro1 micro1 is the leading AI data lab for training frontier models and evaluating AI agents. Experts contribute their diverse subject... ...across domains such as finance, healthcare, STEM engineering, and more. micro1 transforms that real-world expertise...SuggestedPart timeFor contractorsRemote work
$100 per hour
...Pay: up to $100/hour If you are a chemical engineer who thrives on technical precision, applied... ...directly to how the next generation of AI systems understand and communicate complex... ...engineering specialists who can evaluate, challenge, and refine advanced language...SuggestedContract workManual labor$125 per hour
...experience Demonstrated expertise in Software Engineering How long hiring takes Across the... ...for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the...Hourly payContract workRemote work- ...Chemical engineers to build the process design and safety scenarios frontier AI labs use to test model judgment. Remote, async, paid weekly. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring chemical engineers...Weekly payOngoing contractContract workFor contractorsRemote work10 hours per week
$40 per hour
...experience About the Role Pasiflora AI has immediate openings for Chemical AI Safety Annotators & Subject Matter Experts to evaluate AI-generated responses in chemistry and... ...Chemistry Analytical Chemistry Chemical Engineering Toxicology Pharmacology Biochemistry Pharmaceutical...Contract workFor contractorsImmediate startRemote work$75 - $90 per hour
...: 5 - 10 years Location: United States | Canada + 21 more Help a top AI lab evaluate and improve large language models through security-focused coding tasks. Bring your software-engineering judgment and hands-on security experience to work involving vulnerabilities,...Long term contractContract workRemote work- ...requirements Help Shape the Future of AI in Government What if your clinical... ...complex medical information, evaluate healthcare scenarios, and deliver more... ...to contribute to the development and evaluation of advanced AI models. We’re seeking physicians, nurse practitioners...Hourly payExtra incomeContract workFor contractorsFreelanceRemote workWeekday work
- ...Radiological Science · Health Physics · AI Safety · CBRN What this... ...About the Role AI Safety Evaluation Project | Remote | Contract... ...may include Physics, Nuclear Engineering, Nuclear Physics, Radiological... ...Physics, Health Physics, Chemistry, Chemical Engineering, Materials Science...Hourly payContract workFor contractorsRemote work
- ...ready deliverable should include Grade AI-generated deliverables (often Word... ...part in calibration sessions with other evaluators to align scoring standards Preferred... ...review skills Prior experience with AI model training, evaluation, or benchmark development is a plus...Contract workFlexible hours
- ...and develop systems to enhance frontier AI capabilities. About Turing:... ...labs and enterprises. Our environments evaluate and improve AI models on complex, long-range, multi-step workflows... .... Our work includes: Software engineering environments for coding agents UI environments...Contract workPart timeFor contractors
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California,... ...and adversarial approach: experience in red teaming, prompt engineering, or designing challenge prompts intended to test and bypass AI...Ongoing contractPart timeFor contractors
- ...a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for... ...Learning, LLMs, Mathematics, Science, Engineering, Linguistics, Cybersecurity,... ...concepts and technical outputs Model reasoning and performance Data and...Part time
- ...Lead a team to develop and review chemical engineering training tasks. About Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment... ...’s leading AI labs to advance frontier model capabilities in thinking, reasoning,...Contract workPart timeFor contractors
$40 per hour
...All Employers Job seekers Career centers Handshake AI Enterprise AI Research Log in Sign up FRENCH AI EVALUATION SPECIALIST (CANADA) Sign up now Up to $40/hr Depending... ...to help evaluate and rank AI responses so future models can better tailor their answers to individual users...Part timeRemote workFlexible hours$20 - $25 per hour
...Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our... ...intelligence by providing the data, evaluation frameworks, and human... ...evaluate the performance of AI models through real-time, voice-based...Hourly payPart timeFixed term contract- ...programming tasks for accuracy and difficulty Verify the logic and test cases within provided evaluation harnesses Assess whether coding environments effectively measure software engineering skills Walk us through your thought process while analyzing complex code structures...Contract workFor contractorsRemote work
usd16 per hour
...We are looking for AI Linguistic Evaluators to assess how effectively an AI application performs in Marathi for a short collaboration. Job Type... ...naturalness, and cultural appropriateness. - Providing structured evaluations and feedback following the project instructions and quality...Hourly payDaily paidFull timeFreelanceImmediate startRemote workFlexible hours- © 2026 Smart Ecosystems. All rights reserved.Full time
$55 - $100 per hour
...Pay: $55–100/hour You'll evaluate AI-generated responses to legal questions — covering case analysis, statutory interpretation, procedural... ...litigation strategy. Your primary task is assessing whether a model's answer reflects sound legal reasoning, accurate doctrinal knowledge...Contract work$13 per hour
...Location: Argentina | Belize | Bolivia + 15 more Help evaluate how an AI assistant uses information from connected Google apps to respond... .... • Follow project guidelines for consistent, confidential evaluation work. Important account-access requirement • This project...Hourly payContract workFor contractorsRemote work$35 - $49 per hour
...Audit how frontier AI models answer nuclear and radiological questions: classify the request... ...About the role Sovrano AI builds evaluation and training data for frontier AI labs,... ...requests are the real ones: what reactor engineers, health physicists, regulators and students...Hourly payContract workPart timeFor contractorsManual laborRemote workShift work- ...Provide technical feedback on the structure and difficulty of evaluation harnesses Walk us through your approach to verifying complex code... ...more robust Who Should Apply Professional software engineer based in South Asia Experience building or reviewing realistic...Contract workFor contractorsRemote work
$50 - $150 per hour
...more We're hiring PhD-level experts to help train and evaluate advanced AI models. This is remote, flexible contract work where your academic... ...following fields: Machine Learning / AI, Computer Science, Engineering, Statistics, or a closely related quantitative subdomain...Contract workTemporary workInternshipRemote workFlexible hours$30 - $90 per hour
...to support quality control on AI reasoning datasets. This role... ...detailed feedback to improve model performance Collaborate with... ...STEM field (Science, Technology, Engineering, or Mathematics)... ...Have Experience with AI/ML evaluation or data annotation Background...Contract workRemote work10 hours per weekFlexible hours- ...What You'll Do Apply your subject-matter expertise to advanced AI training and evaluation work Develop or evaluate challenging problems within your area of expertise Assess AI-generated reasoning for technical accuracy and identify subtle errors or failure modes...Contract workImmediate startRemote workFlexible hours
- ...Evaluate and refine AI-generated code for efficiency and reliability. About Turing Based in... ...L Role Overview As a Software Engineering evaluator, you will create cutting-edge... ...benchmarking, and advancing large language models, collaborating closely with...Full timePart timeFor contractorsFlexible hours
- ...What You'll Do Review real user interaction traces with an AI shopping assistant Identify logical failures, inaccuracies, or poor... ...verifiers to judge response quality Commit to 20+ hours per week of evaluation work on our internal platform Who Should Apply Experience...Contract workFor contractorsRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Chemical Engineer, AI Model Evaluation. Be the first to apply!
