Chemical Safety Expert for AI Model Safety Audit

Xperteez Technology
Contract type
Ongoing
Work mode
Remote · Europe, Australia, Canada, Li
Experience
Mid-level · 3+ years

Job description

A role for chemists and chemical safety professionals to audit and evaluate how AI models respond to sensitive chemistry-related questions, classifying requests and ranking model answers against safety criteria.

At a glance

Work mode
Remote · Europe, Australia, Canada, Li
Languages
English – fluent

What you'll do

  • Classify each user request as benign, dual-use or adversarial
  • Mark each model answer as safe or unsafe and explain why
  • Rank the three model answers against each other
  • Write the answer the model should have given
  • For dual-use requests, note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer
  • Create detailed prompts in various topics and responses to guide AI learning
  • Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance
  • Test AI models for potential inaccuracies or biases, validating their reliability across use cases

What we're looking for

  • Bachelor's degree or higher in Chemistry, Chemical Engineering, Toxicology, Environmental Health & Safety, Industrial Hygiene, Hazardous Materials Management, or a closely related field
  • 3+ years of professional experience in chemical safety, laboratory safety, hazardous materials handling, EHS, toxicology, industrial hygiene, chemical risk assessment, regulatory compliance, or related technical safety work
  • Familiarity with chemical safety documentation and frameworks such as Safety Data Sheets, GHS hazard communication, labeling, exposure limits, risk assessments, SOPs, and incident escalation procedures
  • Ability to review AI-generated chemical safety content for technical accuracy, safety alignment, misuse risk, hallucinated claims, inappropriate specificity, and potentially dangerous procedural guidance
  • Strong judgment in distinguishing between safe educational content and content that could enable unsafe chemical handling, synthesis, misuse, evasion, or harmful experimentation
  • Excellent written English skills, with the ability to provide clear, structured feedback explaining why a response is safe, unsafe, incomplete, misleading, or technically incorrect
  • High attention to detail when reviewing chemical terminology, units, concentrations, exposure assumptions, hazard classifications, safety controls, and emergency-response guidance
  • Comfortable applying detailed project rubrics consistently across ambiguous or sensitive chemical safety scenarios

Nice to have

  • Advanced degree or professional safety certification
  • Experience with safety data sheets, exposure assessment, incident reports or regulatory review
  • Prior experience with AI safety, red-team review, model evaluation, content moderation, data annotation, technical QA, scientific review, or rubric-based evaluation

Apply