AI Governance Institute logo
AI Governance Institute

Practical Governance for Enterprise AI

Not sure where to start? Answer 3 questions and get a tailored compliance action plan.

What applies to me? →
VoluntaryFrameworkUS

NIST AI 600-1 Generative AI Profile

Issued by

National Institute of Standards and Technology (NIST), U.S. Department of Commerce

liveEffective 2024-07-26NIST AI 600-1Verified April 2026
Official document →

A companion resource to the NIST AI RMF 1.0 that provides structured guidance for managing the unique risks presented by generative AI systems, including large language models and multimodal foundation models.

Applies To

U.S. federal agencies subject to EO 14110 and OMB AI guidanceFederal contractors and vendors providing generative AI solutions to U.S. government agenciesEnterprises developing or fine-tuning large language models or multimodal foundation modelsOrganisations deploying generative AI in customer-facing, employee-facing, or decision-support rolesAI risk, compliance, and legal functions responsible for model governance and documentationCybersecurity teams managing prompt injection, adversarial attack, and model integrity risksProcurement and third-party risk teams evaluating generative AI vendor risk

Overview

NIST AI 600-1, formally titled 'Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile,' was published in final form on July 26, 2024, in response to Executive Order 14110 on Safe, Secure, and Trustworthy Development and Use of Artificial Intelligence (October 2023). The profile extends the NIST AI Risk Management Framework (AI RMF 1.0, January 2023) by mapping its GOVERN, MAP, MEASURE, and MANAGE functions to twelve generative-AI-specific risk categories. These categories reflect emergent risks that were not fully addressed by the base AI RMF, including data provenance challenges, hallucination and confabulation, intellectual property concerns, homogenization of outputs, and risks arising from the dual-use nature of generative AI capabilities. NIST AI 600-1 is structured as a profile-a prioritised set of outcomes drawn from the AI RMF Core-rather than a standalone standard or regulation. It is intended for use by AI developers, deployers, and operators and is explicitly technology-stack-neutral. The document was developed through an open public comment process and reflects input from industry, academia, civil society, and international partners. Federal agencies are expected to use the profile as part of their implementation of the requirements under EO 14110 and subsequent OMB guidance. While voluntary for private-sector organisations, the profile is increasingly referenced in federal procurement solicitations, sector-specific regulatory guidance, and enterprise AI governance programmes. Enterprises building, fine-tuning, or deploying generative AI systems-including retrieval-augmented generation (RAG) architectures, copilot tools, and AI-assisted decision systems-should map internal controls to the twelve risk categories and associated suggested actions.

Key Requirements

  • Governance: Establish organisational policies, accountability structures, and workforce competencies specific to generative AI risk.
  • CBRN Information: Implement controls to prevent generative AI from providing serious uplift to those seeking to create chemical, biological, radiological, or nuclear threats.
  • Confabulation (Hallucination): Measure, monitor, and disclose rates of confabulation; implement output validation controls.
  • Data Privacy: Address privacy risks inherent in training data ingestion, memorisation, and inference outputs.
  • Data Provenance: Maintain records of training data lineage and apply provenance verification mechanisms where feasible.
  • Harmful Bias and Homogenization: Evaluate and mitigate bias amplification and the societal risk of large-scale output homogenization.
  • Human-AI Configuration: Ensure appropriate human oversight mechanisms are calibrated to the risk level of generative AI applications.
  • Information Integrity: Address the potential for generative AI to produce or amplify disinformation, synthetic media, and influence operations.
  • Information Security: Manage risks of adversarial prompt injection, data poisoning, model extraction, and evasion attacks.
  • Intellectual Property: Assess and manage risks of training data copyright infringement and IP exposure in model outputs.
  • Obscene or Abusive Content: Implement content moderation controls for sexual, violent, or abusive content generation.
  • Transparency and Documentation: Maintain model cards, system cards, and disclosure documentation appropriate to the deployment context.
  • Value Chain and Component Integration: Assess third-party model and component risks across the generative AI supply chain.

What Your Organization Must Do

  • Map all generative AI systems currently in development or deployment to the twelve NIST AI 600-1 risk categories by assigning a responsible owner (e.g., AI risk lead or product owner) for each category and documenting gaps against the suggested actions in the profile.
  • Update the enterprise AI governance policy to explicitly address generative AI risks, including hallucination thresholds, CBRN safeguards, and content moderation standards, and present the revised policy to the board or risk committee for approval within 90 days of system deployment or profile adoption.
  • Establish a confabulation and output quality monitoring programme with defined measurement cadences (at minimum quarterly), documented acceptable error rate thresholds, and a disclosure protocol for material confabulation incidents affecting end users or regulated decisions.
  • Require all third-party generative AI vendors and foundation model providers to supply model cards, system cards, and training data provenance documentation as a contractual condition of procurement; assign third-party risk management to review these against profile requirements before contract execution.
  • Conduct a training data and output intellectual property review for any model being fine-tuned or deployed, engaging legal counsel to assess copyright exposure, and implement output filtering or attribution controls where infringement risk is identified.
  • Align internal generative AI security controls with the profile's information security requirements by tasking the cybersecurity team to test for prompt injection, data poisoning, and model extraction vulnerabilities on a defined schedule (at minimum annually or after significant model updates), and report findings to the AI risk governance function.

Playbook Guidance

Step-by-step implementation guidance for compliance teams.

Governance Controls

Operational controls that implement requirements from this regulation.

AGT-001Agent Permission BoundariesAGT-002Agent Prompt Injection DefenseAGT-004Multi-Agent Trust HierarchyAGT-007Agent Scope and Task BoundariesAGT-009Agent and Non-Human Identity ManagementAGT-010Agent Knowledge Source IntegrityAGT-011Agent Behavior Monitoring and Anomaly DetectionAGT-012Agent Kill Switch and Emergency StopAGT-016Agentic AI Deployment Readiness AssessmentAGT-017Agentic Autonomy Expansion CriteriaAGT-018Agent Data Modification Blast-Radius ContainmentAGT-019AI Tool and Plugin Supply Chain Risk AssessmentAGT-020RAG Retrieval Boundary Controls for Regulated DataAGT-021Human Oversight Classification Rationale LogAGT-022Agentic AI Governance Tooling AttestationAGT-023Agentic AI Security Assessment — CBRN and Cyber EspionageAGT-024AI Permission Escalation Tabletop Exercise ProgramBRD-001Director AI Literacy and Competency AssessmentBRD-002AI Governance Committee Charter and Decision RightsBRD-005AI Governance Maturity AssessmentBRD-006AI Risk Tolerance and Appetite DocumentationBRD-008Voluntary AI Governance Adequacy StandardBRD-009Unified Multi-Framework AI Risk RegisterCMP-001Multi-Jurisdiction AI Regulatory Compliance MappingCMP-002International AI Standards Monitoring WorkflowCMP-008Federal AI Regulatory Monitoring and Pre-Deployment VettingHOC-001AI System Risk ClassificationHOC-002Human Approval Gate for Consequential AI DecisionsHOC-004Automation Bias PreventionMGV-001AI Model Preview and Staged Release PolicyMGV-002AI System Intake and Approval WorkflowMGV-003AI Governance Program Milestone FrameworkMGV-004Continuous AI Assurance Function DesignMGV-005Generative AI Input Data ClassificationMGV-006RAI Benchmark-Aligned Evaluation FrameworkMGV-007Emerging AI Modality Classification and Governance ExtensionMGV-008AI-Generated Deliverable Disclosure and Citation StandardsMGV-009AI Capability Claim Substantiation StandardMON-003AI Bias and Fairness MonitoringPRC-003Third-Party AI Model EvaluationPRC-008Vendor Model Update Disclosure and Re-Assessment ProtocolPRC-009AI Vendor Concentration Risk AssessmentPRC-010AI Vendor Financial Stability AssessmentPRC-011Federal AI Procurement Submission and Review ProcessPRC-012AI Safety Index and Benchmark MonitoringPRC-013AI Platform Conflict-of-Interest AssessmentPRC-014Shadow AI and Third-Party Widget Inventory and ClassificationPRC-015Procurement-Stage AI Governance ConditionsSAF-001Hallucination Detection and MitigationSCT-001Anthropomorphic and Companion AI SafeguardsSCT-002Clinical AI Governance Committee CharterSCT-004Insurance Sector AI Documentation StandardsSCT-006Self-Hosted Open-Weight AI Model GovernanceSCT-007Consumer and External AI Tool Acceptable Use PolicySCT-009AI System Algorithm RegisterSEC-001Prompt Injection PreventionSEC-005Adversarial Robustness Testing

Frequently Asked Questions

Is NIST AI 600-1 mandatory for private companies?
No. NIST AI 600-1 is voluntary for private-sector organizations. However, it is increasingly referenced in federal procurement solicitations, so companies selling generative AI solutions to U.S. government agencies may face contractual pressure to align with its requirements.
How does NIST AI 600-1 differ from the NIST AI RMF 1.0?
The AI RMF 1.0 is a general-purpose AI risk management framework. NIST AI 600-1 is a companion profile that extends it by mapping the same GOVERN, MAP, MEASURE, and MANAGE functions to twelve risk categories specific to generative AI systems, such as hallucination, data provenance, and prompt injection.
Which twelve risk categories does NIST AI 600-1 address?
The profile covers CBRN information risks, confabulation, data privacy, data provenance, harmful bias and homogenization, human-AI configuration, information integrity, information security, intellectual property, obscene or abusive content, transparency and documentation, and value chain and component integration.
Do federal agencies have to comply with NIST AI 600-1?
Federal agencies are expected to use NIST AI 600-1 as part of their implementation of Executive Order 14110 and subsequent OMB guidance on AI governance. It carries a stronger compliance expectation for agencies than for private-sector organizations.
What does NIST AI 600-1 require for third-party generative AI vendors?
The profile calls for organizations to assess third-party model and component risks across the generative AI supply chain. In practice, this means requiring vendors to provide model cards, system cards, and training data provenance documentation, and reviewing those materials against profile requirements before contract execution.
How should a compliance team handle hallucination risk under NIST AI 600-1?
The profile requires organizations to measure and monitor confabulation rates, set acceptable error thresholds, implement output validation controls, and establish a disclosure protocol for material confabulation incidents. A minimum quarterly measurement cadence is a practical baseline for most deployment contexts.