Question 38 of 45
How do we govern AI models from preview release through retirement?
Published by AI Governance Institute · Practical Governance for Enterprise AI
A lifecycle governance framework covering every stage of an AI model's production life — from evaluating preview releases, through controlled promotion to general availability, to scheduled re-assessment triggers and formal retirement.
If you only do 3 things, do this:
- 1.The governance gap most organizations have is not at deployment — it is at the transitions: preview to GA, capability update to re-assessment, and end-of-life to decommission. Define what happens at each transition before you face it.
- 2.Preview and GA models are categorically different from a governance standpoint. Preview models may change behavior without notice, lack audit histories, and carry no SLA commitments. Treat them as research tools, not production dependencies, until you have explicitly promoted them.
- 3.A model that was safe to deploy six months ago may not be safe today if it has received capability updates, if new attack techniques have been published, or if its use case has expanded. Re-assessment triggers must be defined and enforced.
The Situation
Who this is for: AI Engineering, GRC, and Procurement teams managing production AI systems that receive ongoing updates from vendors or are internally fine-tuned
When you need this: When a vendor announces a model update, when a preview model is being considered for production use, or when establishing an AI model registry
The Decision
What governance gates apply at each lifecycle stage, and what events trigger mandatory re-assessment of a deployed model?
The Steps
- 1Define the lifecycle stages that apply to your organization: Preview, Approved for Testing, Production (GA), Under Re-assessment, Deprecated, Retired
- 2Document the promotion criteria for each stage transition — what evidence is required to move a model from Preview to Production
- 3Define re-assessment triggers: events that require a model to be evaluated before continuing in production
- 4Assign lifecycle ownership to a named person for each production model
- 5Build lifecycle stages into your model registry so every model has a current lifecycle status
- 6Define the retirement process: weight deletion, documentation archival, dependent system migration
- 7Test the full lifecycle for at least one model before institutionalizing the framework
The Artifacts
- —AI Model Lifecycle Policy defining stages, promotion criteria, and re-assessment triggers
- —Model registry with lifecycle status field for every production model
- —Promotion gate checklist (what must be completed before a model advances to the next stage)
- —Retirement checklist (weight deletion, log archival, dependent system migration, sign-off)
The Output
Every production AI model has a documented lifecycle status, a named owner, and a defined set of events that would trigger re-assessment before the next scheduled review.
Preview vs. GA: a governance boundary that matters
Many organizations deploy vendor AI capabilities in "preview" or "beta" without recognizing that preview models carry governance risks that GA models do not. Preview models may change their behavior between invocations without notice, lack the audit history of established production models, and are typically excluded from vendor SLAs and security commitments. Using a preview model in a production workflow is a governance decision, not a technical one.
Establish a clear policy for preview model use. The most defensible position is that preview models may be used in internal research and evaluation environments, but must not process regulated data, influence consequential decisions, or be exposed to external users until they have been explicitly promoted to production status through the governance process. Any exception requires written approval from the AI governance function.
The promotion process from Preview to Production should require at minimum: a risk classification, a pre-deployment adversarial test, documentation in the model registry, and sign-off from the system owner and a compliance representative. This process is not bureaucracy — it is the evidentiary record that demonstrates due diligence if a model incident later occurs.
Re-assessment triggers
Models do not remain safe to deploy indefinitely. A model that met your governance standards at deployment may need re-assessment if its capabilities change, if its use case expands, or if new risks emerge. Defining re-assessment triggers in advance — rather than relying on periodic reviews alone — is one of the most important things a lifecycle policy can do.
Common re-assessment triggers include: a vendor announcing a capability-significant model update (defined as a change to the model's training, fine-tuning, or safety configuration, not just infrastructure changes); a new attack technique published that specifically targets the model or architecture in use; a production incident classified as Significant or Critical; an expansion of the model's use case beyond what was evaluated at deployment; and any change to the regulatory obligations applicable to the deployment.
Re-assessment does not always mean taking the model offline. It means evaluating the changed risk profile against current controls and documenting the conclusion. In many cases, existing controls are sufficient and the re-assessment produces a record confirming continued production approval. The record is the point — it demonstrates that someone reviewed the change and made a considered decision.
Retirement and decommissioning
AI model retirement is the stage governance programs most frequently neglect. When a model is replaced or discontinued, the governance obligations do not end — they conclude with a formal decommissioning process that creates an auditable record of the model's production life.
The retirement process should include: migrating or decommissioning all systems that depend on the model; deleting model weights from all environments and logging the deletion; archiving the model's governance documentation (risk classification, incident records, re-assessment history) for the retention period required by applicable regulations; and notifying any downstream data processors or vendors whose systems depended on the model.
Decommissioning records matter because auditors and regulators may ask, after the fact, about AI systems that are no longer in production. If a decision influenced by a deprecated model becomes the subject of an adverse action challenge or regulatory inquiry, you need the documentation to demonstrate the oversight that was in place while the model was running.
Governance Controls
Operational controls that implement the guidance in this playbook.
Related frameworks
Not sure where to start? Answer 3 questions and get a tailored compliance action plan.
What applies to me? →