AI Governance Institute
← Model & Program Governance
MGV · Model & Program GovernanceMGV-005Medium effortAgent-relevant

Generative AI Input Data Classification

Added June 2026 · Last verified September 9, 2026

Classify data entering generative AI through prompts, background material, retrieved documents, results from connected tools, and conversation history. Address privacy, confidentiality, and regulatory risks absent from general data classification rules.

Objective

Prevent regulated, privileged, or sensitive data from entering generative AI systems without appropriate controls, by extending data classification to the AI input surface (every route by which data reaches an AI system) and establishing handling requirements for each classification level.

▸Editorial status
AI Governance Institute recommendationVerified by Cody MaxwellNext review March 8, 2027
  • September 9, 2026 · Source update — Reviewed against source (regulation-change); no change required. (Cody Maxwell)

How we verify and maintain this

Maturity Levels

1

Initial

The organization has a general data classification policy, but it does not address data entering generative AI systems as inputs. Employees may include regulated or confidential data in prompts without guidance.

2

Developing

Acceptable use policy for AI tools includes general guidance (e.g., do not enter client data into AI systems) but the classification criteria and handling requirements are not defined precisely, and coverage is inconsistent across AI tools in use.

3

Defined

An AI input data classification policy defines categories of data, handling requirements for each category when used as AI input, and the AI systems for which each category is permitted. The policy covers prompts, context, retrieved documents, tool call inputs and outputs, and conversation history for all AI systems in the inventory.

4

Managed

Classification requirements are implemented through a combination of policy, training, and technical controls (e.g., system prompt instructions prohibiting certain data types, DLP tools configured to detect regulated data sent to AI services). Exceptions requiring use of restricted data are documented and approved.

5

Optimizing

Input data classification is reviewed when new AI capabilities (multimodal inputs, agentic tool use, ambient data collection by AI that captures data in the background) expand the input surface. Classification is enforced by technical controls that minimize reliance on employee judgment for high-risk data types. Classification evidence is produced as part of the continuous assurance function.

Get the free AI Governance Control Tracker

Get the free Excel tracker for all 136 governance controls. Score your maturity on Generative AI Input Data Classification and every other control, assign owners, and set deadlines.

  • 136 controls in Excel
  • Score maturity and assign owners
  • Track deadlines and regulation coverage

Includes AI Governance Weekly every Thursday. Unsubscribe anytime.

Evidence Requirements

What an auditor or assessor would expect to see for this control.

  • —AI input data classification policy defining categories, handling requirements, and permitted AI systems for each category.
  • —Training records showing employees using AI systems have completed AI input data classification training.
  • —Technical control evidence (data loss prevention (DLP) tool configuration, system prompt instructions (standing instructions built into the AI), or equivalent) enforcing classification limits for high-risk categories.
  • —Exception log documenting approved uses of Category 4 or 5 data as AI inputs, with legal basis and approval.

Implementation Notes

Why generative AI requires its own input classification

General data classification policies were designed for data at rest and in transit (stored or being sent) in traditional systems: files, databases, email, and network communication. They were not designed for the generative AI input surface, which has characteristics that make standard classification insufficient:

The context window as a data aggregator: A generative AI prompt or context window (the full body of text the AI reads when producing an answer) may aggregate data from multiple classification levels in a single input. A RAG system (one that looks up documents to answer questions) might pull a public document, an internal policy, and a client contract into the same context window. Standard classification policies do not address how to handle aggregated inputs where components have different classification levels.

Implicit data entry: Users routinely enter data into AI systems that they would not consciously classify as regulated or sensitive: vendor names in contract summaries, employee feedback in performance review drafts, patient symptoms in medical documentation assistance. The classification policy must address this implicit data entry, not just intentional data uploads.

Conversation history as a data store: Back-and-forth AI conversations accumulate a conversation history that may grow to contain sensitive data entered in earlier turns. This history may be retained by the vendor or accessible to other users on shared AI platforms.

Agentic tool call inputs and outputs: AI agents (AI systems that take actions on their own) calling tools (web search, database queries, email drafts, calendar access) produce input and output data that is not visible in the prompt but is processed by the AI model and may contain regulated data.

Multimodal inputs: AI systems that accept images, audio, or documents as inputs create input classification challenges not addressed by text-focused policies.

Classification categories for AI inputs

Category 1, Public: Data that is publicly available or approved for public disclosure. No restrictions on use as AI input. Examples: public regulatory text, published research, marketing materials.

Category 2, Internal: Non-public organizational data without specific regulatory classification. Permitted as input only in AI systems hosted by approved vendors with an adequate data processing agreement (DPA). Examples: internal policies, project documentation, meeting notes not containing personally identifiable information (PII).

Category 3, Confidential: Organizational data with heightened sensitivity: trade secrets, M&A (mergers and acquisitions) information, strategic plans, competitive intelligence. Permitted as input only in AI systems with specific approval and, where possible, hosted on the organization's own servers or a dedicated private cloud. Examples: acquisition targets, pricing strategies, unpublished financial projections.

Category 4, Regulated: Data subject to specific legal obligations: PII (GDPR/CCPA), protected health information or PHI (HIPAA), financial records (GLBA, SOX), attorney-client privileged communications. Permitted as AI input only with specific use case approval, documented legal basis, DPIA (data protection impact assessment) completion, and vendor DPA covering AI-specific processing.

Category 5, Restricted: Data that should not enter AI systems under most circumstances: biometric data without explicit consent, data subject to active litigation hold, classified government information, data with contractual prohibitions on AI processing. Prohibited as AI input except with executive approval and documented exceptional justification.

Applying classification to the full input surface

For each AI system in the inventory, document:

  • Which input types are in use: direct prompts, context injection (background material added automatically), RAG retrieval, tool call inputs and outputs, file uploads, multimodal inputs.
  • The maximum classification level permitted for each input type.
  • Technical or procedural controls enforcing classification limits.
  • Any exceptions approved and their expiry.

Example Implementation

AI Input Data Classification: Quick Reference Card

CategoryExamplesPermitted AI systemsRequires
1, PublicPublic regulatory text, published standards, marketing copyAll approved AI toolsNothing additional
2, InternalInternal policies, project plans, meeting notes (no PII)Approved vendor AI tools with DPAStandard employee attestation
3, ConfidentialM&A targets, pricing, strategic plansOn-premises or private cloud AI only; no public SaaS LLMsManager approval; log the session
4, RegulatedPII, PHI, financial records, privileged communicationsOnly AI systems with specific use case approval + DPIA + AI DPAUse case approval + privacy counsel sign-off
5, RestrictedBiometric data, litigation hold, contractual AI-prohibited dataProhibitedExecutive approval required for exceptions

Common questions:

Can I paste a client contract into an AI writing assistant? Client contracts typically contain Category 4 data (PII, confidential business terms). Check whether the AI system has an approved use case for contract review and an adequate DPA. If not, summarize manually first.

Can I use AI to help write an employee performance review? Performance data is Category 4 (PII). Only permitted in AI systems approved for HR use with DPIA complete. Check the approved AI tools list for HR.

The RAG system pulls documents automatically, how do I classify the inputs? RAG inputs are classified by the highest-category document that could be retrieved. If your retrieval corpus contains Category 4 documents, the RAG system operates under Category 4 restrictions.