NIST CAISSI

NIST CAISSI refers to the Center for AI Standards and Innovation, an office within the U.S. National Institute of Standards and Technology (NIST) that develops voluntary technical standards, evaluation methods, and guidance for AI systems. Its work covers testing how advanced AI models perform and where they fail, which helps organizations judge whether a vendor's claims about safety or reliability hold up. For compliance and risk teams, its outputs often become the reference points that auditors, procurement staff, and regulators cite when asking what "good" AI governance looks like.

1 item

Research2026-10-28

DualChem Benchmark Exposes a Gap Between AI Risk Recognition and Model Behavior

Scale AI, working with NIST's Center for Advancing Innovation and Standards for Super Intelligence (CAISSI), has published DualChem. It is a 600-question benchmark testing how frontier AI models handle ambiguous chemistry queries with dual-use potential. Testing across roughly 30 frontier models found that models frequently answer queries they simultaneously flag as potentially dangerous. The benchmark gives government agencies and enterprises a new tool for assessing AI risk in chemistry and related sensitive domains.

Scale AI NIST CAISSI DualChem dual-use risk AI benchmarking AI safety evaluation export controls