AI Governance Institute logo
AI Governance Institute

Practical Governance for Enterprise AI

Procurement
PRC · ProcurementPRC-011Medium effort

Federal AI Procurement Submission and Review Process

Establish an internal process for meeting AI vendor submission requirements under federal procurement rules, and monitor the transition of voluntary pre-deployment evaluation commitments to mandatory requirements so that procurement workflows remain compliant as the regulatory baseline shifts.

Objective

Ensure the organization meets current and emerging federal AI procurement requirements by maintaining a structured submission and review process, and proactively tracking the regulatory transition from voluntary to mandatory pre-deployment evaluation standards.

Maturity Levels

1

Initial

Federal AI procurement requirements are addressed reactively, if at all. The organization is not tracking the transition from voluntary to mandatory evaluation requirements.

2

Developing

Legal or procurement teams are aware of federal AI requirements at a general level but there is no structured process for tracking specific submission requirements or evaluating vendor compliance.

3

Defined

A documented federal AI procurement process covers: identifying which procurements are subject to federal AI requirements, what vendor submission obligations apply, and how the organization validates vendor compliance. A monitoring function tracks regulatory updates affecting procurement requirements.

4

Managed

The procurement process is updated when new federal AI requirements take effect. Vendor submissions are retained as procurement records. The monitoring function provides advance notice of upcoming requirement changes that affect the procurement pipeline.

5

Optimizing

The organization participates in relevant federal procurement working groups or public comment processes to shape requirement development. Procurement templates are pre-cleared against current federal AI requirements. Legal and compliance teams have a joint cadence for reviewing regulatory developments affecting AI procurement.

Evidence Requirements

What an auditor or assessor would expect to see for this control.

  • Documented federal AI procurement process covering requirement identification, vendor submission standards, and record retention.
  • Regulatory monitoring log tracking federal AI procurement requirement developments and their estimated effective dates.
  • Vendor submission packages for all AI procurements subject to federal requirements in the past 24 months.
  • Evidence of process updates when new federal requirements took effect.

Implementation Notes

The evolving federal AI procurement landscape

Federal AI procurement requirements are evolving rapidly, with the pace accelerating following the 2025 White House AI Action Plan and Executive Order 14179. Key developments that organizations procuring AI for federal use or supplying AI to federal customers must track:

Voluntary pre-deployment evaluation commitments: In 2023-2024, leading AI developers made voluntary commitments to the White House covering pre-deployment safety testing, red-teaming, and transparency reporting. These commitments apply to the developers themselves and do not directly bind enterprise customers, but they establish norms and reference standards that federal procurement is beginning to codify.

Transition to mandatory requirements: Executive Order 14179 directed federal agencies to develop mandatory AI safety and testing requirements. The transition from voluntary commitments to mandatory standards varies by agency and use case. Organizations procuring AI for federal customers, or federal agencies procuring commercial AI, should track agency-specific rulemaking for the domains in which they operate.

NIST AI RMF as procurement standard: Several federal agencies have begun incorporating NIST AI RMF alignment as a procurement requirement. The NIST AI 600-1 Generative AI Profile adds more specific requirements for generative AI. Vendors should be prepared to demonstrate alignment, not just awareness, of these frameworks.

National AI Initiative and sector-specific requirements: Sector agencies (HHS for healthcare AI, DOD for defense AI, FTC for consumer AI) have issued AI-specific guidance that affects procurement in their respective sectors. The national AI strategy and AI Action Plan create umbrella priorities that agency requirements are being aligned to.

Key elements of a federal AI procurement process

Requirement identification:

  • Is this procurement covered by a federal contract or involves use of AI in a federal context?
  • Which agency's requirements apply?
  • Is the procurement subject to current mandatory requirements or voluntary standards? (These differ.)
  • Has the relevant agency issued AI-specific acquisition guidance (e.g., FAR/DFARS clauses)?

Vendor submission requirements:

  • What documentation must the vendor provide? Common requirements include: AI system documentation (purpose, training data description, capability scope), safety evaluation results or red-team summaries, NIST AI RMF self-assessment, data privacy and security documentation.
  • Are there format or completeness standards for submissions?
  • How are submissions retained and who has access?

Ongoing monitoring:

  • Which regulatory updates affect the procurement program?
  • What is the process for re-evaluating existing vendor relationships when requirements change?

The voluntary-to-mandatory transition

Organizations should map current voluntary commitments from their AI vendors to the mandatory requirements emerging from federal rulemaking. Where a vendor's voluntary commitment covers a specific evaluation (e.g., red-teaming before deployment of frontier models), assess whether the mandatory requirement imposes additional specificity (e.g., a required third-party evaluator, a specific test set, a minimum disclosure format). The voluntary-to-mandatory gap is where compliance risk accumulates.

Example Implementation

Federal AI Procurement Checklist (excerpt)

Procurement: [Description] | Contracting agency: [Agency] | Procurement date: [Date]

Step 1: Applicability screening

QuestionAnswerAction
Is this procurement for use in a federal context or under a federal contract?YesProceed to requirement identification
Is the AI system classified as high-risk under the relevant agency's AI policy?Under reviewRequest agency AI policy from contracting officer
Does the procurement fall under DOD DFARS 252.204-7024 (AI transparency)?No — civilian agencyN/A
Has the agency issued AI-specific acquisition guidance?Yes — NIST AI RMF alignment requiredVendor must provide NIST AI RMF self-assessment

Step 2: Vendor submission requirements

Required documents:

  • AI System Card (purpose, capability scope, known limitations)
  • Training data description (sources, date range, third-party data usage)
  • Safety evaluation summary (red-team results or third-party evaluation)
  • NIST AI RMF self-assessment (or equivalent)
  • Data handling and security documentation

Step 3: Regulatory monitoring update (current quarter)

RequirementCurrent statusEst. mandatory dateImpact
NIST AI RMF alignmentVoluntary (agencies adopting by policy)2026-Q4 (estimated)Update vendor questionnaire to require structured self-assessment
Pre-deployment red-team disclosureVoluntary commitment (frontier model vendors)Mandatory rulemaking in progressMonitor NIST and OMB guidance
AI incident reporting to CISAPilot program2027 (estimated)Begin tracking AI incidents in format compatible with CISA reporting