Chemical Safety Expert for AI Model Safety Audit
$100 per hourSuperAnnotate
Pay: up to $100/hour
## Description
SME Careers is hiring chemists and chemical safety professionals to audit how AI models respond to sensitive questions in the field. Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer.
The requests are realistic: what synthetic and analytical chemists, toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones.
## Who we're looking for
Synthetic and analytical chemists; toxicologists and pharmacologists; industrial hygienists and chemical safety/process safety professionals; CWC or chemical-security specialists; hazmat, poison-control or chemical incident responders; and chemical regulators (EPA, OSHA, HSE, OPCW-adjacent, or equivalent). Usually a relevant degree plus five or more years of professional experience. Experience with safety data sheets, exposure assessment, incident reports or regulatory review is a strong plus.
## Before you apply
Open only to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand and the European Union.
Responsibilities
- Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
- Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
- Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.
Requirements
- Bachelor’s degree or higher in Chemistry, Chemical Engineering, Toxicology, Environmental Health & Safety, Industrial Hygiene, Hazardous Materials Management, or a closely related field; advanced degree or professional safety certification is a strong plus.
- 3+ years of professional experience in chemical safety, laboratory safety, hazardous materials handling, EHS, toxicology, industrial hygiene, chemical risk assessment, regulatory compliance, or related technical safety work.
- Strong understanding of chemical hazards, including toxicity, corrosivity, flammability, reactivity, incompatibilities, exposure routes, storage risks, spill response principles, PPE, ventilation, and safe handling practices.
- Familiarity with chemical safety documentation and frameworks such as Safety Data Sheets, GHS hazard communication, labeling, exposure limits, risk assessments, SOPs, and incident escalation procedures.
- Ability to review AI-generated chemical safety content for technical accuracy, safety alignment, misuse risk, hallucinated claims, inappropriate specificity, and potentially dangerous procedural guidance.
- Strong judgment in distinguishing between safe educational content and content that could enable unsafe chemical handling, synthesis, misuse, evasion, or harmful experimentation.
- Excellent written English skills, with the ability to provide clear, structured feedback explaining why a response is safe, unsafe, incomplete, misleading, or technically incorrect.
- High attention to detail when reviewing chemical terminology, units, concentrations, exposure assumptions, hazard classifications, safety controls, and emergency-response guidance.
- Comfortable applying detailed project rubrics consistently across ambiguous or sensitive chemical safety scenarios.
- Prior experience with AI safety, red-team review, model evaluation, content moderation, data annotation, technical QA, scientific review, or rubric-based evaluation is preferred.
Open to candidates in: Australia, Austria, Belgium, Bulgaria, Canada, Croatia, Cyprus, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, New Zealand, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, The Czech Republic, the Netherlands, The United Kingdom, The United States
Interview language: English
$90 per hour
...assembling a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives... ...control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government...SuggestedContract work$40 per hour
...Type: Independent contractor · Experience: 3+ years experience About the Role Pasiflora AI has immediate openings for Chemical AI Safety Annotators & Subject Matter Experts to evaluate AI-generated responses in chemistry and chemical-safety scenarios. We're looking...ChemicalContract workFor contractorsImmediate startRemote work$50 - $70 per hour
...assembling a small panel of nuclear and radiological professionals to audit how AI models respond to sensitive questions in the field. Each task gives... ...control, national labs), health physicists and radiation safety officers, radiochemists, and former military or government...SuggestedContract workTemporary workRemote work- ...is hiring explosives and energetic materials professionals to audit how AI models respond to sensitive questions in the field. Each task gives you... ...; post-blast investigators and forensic examiners; explosives safety officers and regulators (ATF, HSE, DoD explosives safety, or...ChemicalPermanent employmentFull time
- ...Chemical engineers to build the process design and safety scenarios frontier AI labs use to test model judgment. Remote, async, paid weekly. AfterQuery builds the expert evaluation data that frontier AI labs use to measure and improve their models. We're hiring chemical engineers...ChemicalWeekly payOngoing contractContract workFor contractorsRemote work10 hours per week
- ...Exists At Mercor, we believe the safest AI is the one that’s already been attacked... ...red team for this project - human data experts who probe AI models with adversarial inputs, surface... ...production Mercor customers trust the safety of their AI because you’ve already probed...Part timeRemote work
- ...Key Responsibilities Train and improve AI models through effective data annotation and labeling. Review and validate AI-generated content for accuracy and relevance. Utilize Bash scripting to automate data processing tasks and improve efficiency. Provide domain...Hourly payContract workFlexible hours
$80 per hour
...hourly, remote contractor role, you will work as a Tax & Audit Subject Matter Expert (SME) to review AI-generated tax and audit responses and/or create expert... ...technical claims; write high-quality explanations and model solutions that demonstrate correct methods; and rate and...Hourly payPermanent employmentContract workFor contractorsLocal areaImmediate startRemote work$84 per hour
...Mercor is recruiting Atomistic Materials Modelling Experts with strong backgrounds in computational... ...molecular modelling to support advanced AI research. Experts will evaluate... ...adsorption energies, defect formation, and chemical reaction pathways. Develop high-quality...ChemicalHourly payContract work10 hours per week- ...the Role: At TELUS Digital , we know that as AI becomes more powerful, the need for robust safety guardrails is paramount. We view you as our strategic... ...critical thinking and cultural depth to stress-test models, uncovering vulnerabilities that could lead to biased...Part time
- ...About The Role We are seeking AI Training Experts – Climate Science & Carbon Modeling with deep expertise in environmental science and climate data to help... ...content related to greenhouse gas emissions, climate models, carbon accounting, and mitigation strategies. Your...Contract work
- ...AfterQuery is seeking Audit Accountant Experts to create and refine auditing challenges for training AI models. In this remote, flexible role, you will design and evaluate audit scenarios that test the AI's ability to interpret and apply complex auditing principles, ensuring...Contract workRemote workFlexible hours
- ...Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your... ...fuels the development of the most advanced AI models. # Overview We are hiring a senior accounting and audit domain expert to work directly with a leading AI lab's research...Full timeContract workPart timeFreelanceLive InManual laborRelocationRelocation package
- ...Nuclear Engineering · Reactor Systems · AI Safety · Nuclear Physics What this pays Rates... ..., Physics, Mechanical Engineering, Chemical Engineering, Materials Science, or related... ...Responsibilities •Tier 1: review AI prompts and model responses •Tier 1: classify content as...ChemicalHourly payContract workFor contractorsRemote work
$100 per hour
...up to $100/hour If you are a chemical engineer who thrives on... ...to how the next generation of AI systems understand and communicate... ..., and refine advanced language models on domain-specific topics. Your... ...Process control reasoning, Process safety, Scale-up/manufacturability, operability...ChemicalContract workManual labor- ...Key Responsibilities • Design and implement evaluation metrics for AI models • Conduct thorough testing of model performance across different scenarios • Analyze model outputs for bias, fairness, and accuracy • Collaborate with ML engineers to implement improvements...Contract work
- ...Evaluate AI model safety by designing adversarial test prompts and classifications. About Turing: Based in San Francisco, California, Turing is the world's leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced...Ongoing contractPart timeFor contractors
- ...About the work Mercor is assembling a panel of chemistry and chemical safety experts to red-team frontier AI models. The goal is to test whether a model can correctly judge the misuse potential of a technical request — answering legitimate questions fully while refusing...ChemicalPart time
- ...Digital , we believe that when AI enters the healthcare space,... ...death. As a Clinical & Medical AI Expert , you are the guardian of... ...tasked with training Large Language Models (LLMs) on complex diagnostics,... ...Reasoning Validation: Audit AI "Chain-of-Thought" reasoning...Part time
- ...is building a global community of experts to evaluate, challenge and improve advanced AI systems . We are looking for... ...concepts and technical outputs Model reasoning and performance Data... ...quantitative problem solving AI Safety & Red Teaming AI failure modes...Part time
$40 - $45 per hour
...: Hourly, ~40 h/week Field: Miscellaneous Project overview Review short English-language conversations and evaluate how well AI responses address user requests. You’ll follow a set of written guidelines to assess each conversation and submit structured feedback....Hourly payRemote work- ...Learning from Human Feedback (RLHF) to align AI with human values, and in this role, you... ...instructional following. Lead quality-assurance audits for large-scale annotation projects,... ...ensuring the human-feedback loop is optimized for model learning. Investigate complex "...Part time
- ...believe Python is the language of the AI revolution. As a Python AI Logic Expert in our Global Community, you are... ...mission is to train Large Language Models (LLMs) to master Python—not just... ...and algorithms. Logic & Security Auditing: Perform rigorous code reviews on...Part time
- ...As a Thai Linguist in our Global AI Community, you evaluate and validate speech AI systems from a linguistic perspective—ensuring machine... ...captures intent with linguistic accuracy, and voice AI models are trained on linguistically sound datasets. Your work directly impacts...Part time
- ...a safer place. You don't need to be a tech expert or a computer scientist. Your job is to use... ...human behavior and mental health to check if AI-generated content is safe, helpful, and... ...better. What You’ll Do (Simple Tasks): Safety Reviews: Review content that has been...Contract workFreelance
$22 per hour
...Job Application for 3D Modeling & Python Specialist - Freelance AI Trainer Project at Meridial Back to jobs... ...accuracy relies entirely on robust, expert-crafted training data. The objective... ...Assurance & Workflow Adherence: Auditing all assets against strict quality checklists...Hourly payPart timeFor contractorsFreelanceRemote work- ...impact team of Machine Learning Experts working alongside Policy... ...provide actionable insights on AI decision-making. As a Machine... ...and optimizing machine learning models for content moderation and policy... ...-thought) for nuanced Trust & Safety cases. Perform high-quality...Part time
$30 per hour
...work as a Customer Service Subject Matter Expert (SME) to support the creation of a custom dataset... ...used to train and improve speech-to-speech AI agents. You will participate in realistic... ...’s largest AI companies and foundation-model labs. Important There is no immediate...Hourly payContract workFor contractorsImmediate startRemote work- ...you have a background in Chemistry or Chemical Engineering ? AI is currently learning how to help scientists... ...understands molecules, formulas, and safety rules correctly. You don’t need to be a... ...concepts and help the AI explain them in simple terms for students or non-experts....ChemicalPart time
- ...future of software development. As a expert in our Core Engineering & AI Development Community , you are the... ...the boundaries of how Large Language Models (LLMs) understand logic, syntax, and... ...Algorithmic Reasoning Validation: Audit and refine "Chain-of-Thought" (CoT) reasoning...Part time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Chemical Safety Expert for AI Model Safety Audit. Be the first to apply!
