AI Governance Institute logo
AI Governance Institute

Practical Governance for Enterprise AI

Procurement
PRC · ProcurementPRC-005Medium effort

AI Procurement Risk Assessment

Assess and document the risks of procuring an AI system or service before approval, including technical, legal, privacy, and operational risks.

Objective

Prevent high-risk AI procurement decisions by requiring a structured risk assessment before purchase approval.

Maturity Levels

1

Initial

AI systems are procured without formal risk assessment.

2

Developing

Risk considerations are raised informally during procurement but no structured assessment exists.

3

Defined

A documented risk assessment template is completed for every AI procurement, covering technology, legal, privacy, and operational dimensions.

4

Managed

Risk assessments are reviewed by relevant stakeholders; high-risk procurements require executive or governance committee approval.

5

Optimizing

Risk assessment methodology is continuously refined; assessment quality is audited and improved.

Evidence Requirements

What an auditor or assessor would expect to see for this control.

  • Completed procurement risk assessment for each AI system acquired, covering intended use, risk tier, data sensitivity, and regulatory exposure
  • Risk assessment review and approval records showing the AI Governance function was consulted before procurement decisions
  • Rejected or deferred procurement records showing the process identified and acted on unacceptable risks
  • Risk register entries for accepted procurement risks, with named owner and review cadence
  • Post-deployment review records confirming actual risk profile matched pre-procurement assessment, or documenting deviations

Implementation Notes

Key steps

  • Build an AI procurement risk assessment template that covers: intended use and risk classification, data flows and privacy implications, regulatory compliance implications, security posture, vendor stability, and exit/transition risk.
  • Require sign-off from legal, privacy, and security on all AI procurements above a defined value or risk threshold.
  • Include total cost of ownership in the risk assessment — AI systems often have hidden costs in data preparation, integration, monitoring, and governance.
  • Maintain a registry of all procured AI systems with their risk assessment outcomes — this becomes the foundation of your AI system inventory.

Example Implementation

Procurement team evaluating an AI-powered workforce analytics platform

AI Procurement Risk Assessment — WorkforceAI Analytics

Procurement details: $180K/year · Risk tier: Critical (processes employee personal data; influences compensation recommendations)

Risk assessment summary:

DimensionKey FindingsRisk LevelRequired Actions
Use case / intended purposeCompensation benchmarking + performance analyticsCritical — HR decisionsHuman approval gate required for all compensation outputs
Data flowsEmployee PII, performance data, salary data sent to vendorHighDPA required; data residency EU; zero-retention API
Regulatory complianceGDPR Art. 22; EU AI Act High-Risk (employment context)HighDPIA required before go-live; human oversight documented
Security postureSOC 2 Type II (2025); ISO 27001MediumAnnual report review required
Vendor stabilitySeries C, $85M raised, 5 years operatingMediumFinancial viability review at renewal
Model transparencyProprietary model; discloses feature categories not weightsMediumContractual obligation to disclose material changes
Exit / transition riskData export in standard CSV; 90-day transition supportLowExport tested in POC

Overall risk: High — approved with conditions

Approval required: AI Governance Committee (Critical tier procurement) Conditions: DPIA completed before go-live · Human review SOP documented · Annual vendor reassessment

Control Details

Control ID
PRC-005
Typical owner
Procurement / AI Governance Team / Legal
Implementation effort
Medium effort
Agent-relevant
No

Tags

procurement riskrisk assessmentAI buyingvendor risk