AI Governance Institute logo
AI Governance Institute

Practical Governance for Enterprise AI

← News

Delegated Authority in Agentic AI Requires Formal Runtime Boundaries, Palo Alto Networks Guidance Argues

What happened

Palo Alto Networks published A Complete Guide to Agentic AI Governance, a global-scope guidance document positioning agentic AI governance as a delegated authority problem rather than a conventional model risk problem. The guide argues that when an AI agent is granted the ability to take autonomous actions, enterprises are effectively delegating institutional authority to a non-human actor, which creates obligations around how that authority is scoped, monitored, and revoked. It defines two oversight postures: human-in-the-loop, where human approval is required before consequential actions proceed, and human-on-the-loop, where humans monitor in real time but do not pre-approve each action. The guide recommends that the choice between these models be driven by task criticality and action reversibility, and it calls for pre-deployment impact assessments to establish baseline risk levels before any agent is given access to tools or external systems. Specific controls recommended include scoped tool permissions, defined runtime objectives, and clear thresholds that trigger escalation or halt.

Why it matters

  • ·Regulatory exposure: Regulators across the EU AI Act, Singapore's IMDA Agentic AI Framework, and emerging U.S. state AI laws are converging on human oversight requirements for high-risk automated actions, and enterprises without documented oversight tier models may struggle to demonstrate compliance during audits or incident reviews.
  • ·Operational impact: Without formal permission boundaries and autonomy limits, AI agents can accumulate effective access far beyond their intended scope at runtime, creating a class of security and liability exposure that existing access management programs were not designed to catch.
  • ·Organizational risk: The human-in-the-loop versus human-on-the-loop distinction is not merely architectural but carries accountability implications; if a consequential action is taken by an agent under a human-on-the-loop model, the organization may bear full liability in the absence of documentation showing the oversight posture was deliberately chosen and appropriate to the risk level.

Governance controls affected

What to do now

  • Audit all deployed and pipeline AI agents to document what tools, APIs, and data sources each agent can access at runtime, and flag any cases where permissions exceed the minimum required for the defined task scope.
  • Map each agentic system to either a human-in-the-loop or human-on-the-loop oversight model based on task criticality and action reversibility, and record the rationale for each classification in your AI risk register.
  • Establish or update your pre-deployment impact assessment template to include agentic-specific fields: tool access scope, maximum autonomy window, escalation triggers, and kill-switch procedures.
  • Review HOC-004 (Meaningful Human Review Standard) and AGT-005 (Human-in-the-Loop Gates for Irreversible Actions) controls to confirm they distinguish between the two oversight postures and specify minimum reviewer competency requirements for each.
  • Schedule a tabletop exercise simulating an agent that exceeds its intended scope or takes an irreversible action, and use the results to pressure-test your escalation path and emergency halt procedures.

What to watch next

Compliance teams should track whether the EU AI Office issues technical guidance on human oversight adequacy for agentic systems under the EU AI Act, as the current text leaves room for interpretation on what constitutes meaningful oversight for autonomous pipelines. Singapore's IMDA has already published a dedicated agentic AI governance framework and may issue updated assurance sandbox criteria that operationalize similar delegated authority concepts. In the United States, state-level bills in Texas and Colorado that touch automated decision-making could be extended or interpreted to cover agentic actions, particularly in high-stakes domains such as financial services and healthcare, making it worth monitoring enforcement guidance from state attorneys general as agent deployments scale.