AI Governance Institute logo
AI Governance Institute

Practical Governance for Enterprise AI

← News
Corporate Policy2026-06-02

Delegated Authority in Agentic AI Requires Formal Runtime Boundaries, Palo Alto Networks Guidance Argues

What happened

Palo Alto Networks published A Complete Guide to Agentic AI Governance, a global-scope guidance document positioning agentic AI governance as a delegated authority problem rather than a conventional model risk problem. The guide argues that when an AI agent is granted the ability to take autonomous actions, enterprises are effectively delegating institutional authority to a non-human actor, which creates obligations around how that authority is scoped, monitored, and revoked. It defines two oversight postures: human-in-the-loop, where human approval is required before consequential actions proceed, and human-on-the-loop, where humans monitor in real time but do not pre-approve each action. The guide recommends that the choice between these models be driven by task criticality and action reversibility, and it calls for pre-deployment impact assessments to establish baseline risk levels before any agent is given access to tools or external systems. Specific controls recommended include scoped tool permissions, defined runtime objectives, and clear thresholds that trigger escalation or halt.

Why it matters

  • ·Regulatory exposure: Regulators across the EU AI Act, Singapore's IMDA Agentic AI Framework, and emerging U.S. state AI laws are converging on human oversight requirements for high-risk automated actions, and enterprises without documented oversight tier models may struggle to demonstrate compliance during audits or incident reviews.
  • ·Operational impact: Without formal permission boundaries and autonomy limits, AI agents can accumulate effective access far beyond their intended scope at runtime, creating a class of security and liability exposure that existing access management programs were not designed to catch.
  • ·Organizational risk: The human-in-the-loop versus human-on-the-loop distinction is not merely architectural but carries accountability implications; if a consequential action is taken by an agent under a human-on-the-loop model, the organization may bear full liability in the absence of documentation showing the oversight posture was deliberately chosen and appropriate to the risk level.

Governance controls affected

AGT-001Agent Permission BoundariesAGT-004Agent Task Scope and Autonomy LimitsAGT-005Human-in-the-Loop Gates for Irreversible ActionsBRD-006AI Risk Tolerance and Appetite DocumentationCMP-007EU AI Act Conformity Assessment and FRIA ProcessHOC-004Meaningful Human Review StandardMON-006Behavioral Anomaly Detection for Agentic Systems

What to do now

  • ☐Audit all deployed and pipeline AI agents to document what tools, APIs, and data sources each agent can access at runtime, and flag any cases where permissions exceed the minimum required for the defined task scope.
  • ☐Map each agentic system to either a human-in-the-loop or human-on-the-loop oversight model based on task criticality and action reversibility, and record the rationale for each classification in your AI risk register.
  • ☐Establish or update your pre-deployment impact assessment template to include agentic-specific fields: tool access scope, maximum autonomy window, escalation triggers, and kill-switch procedures.
  • ☐Review HOC-004 (Meaningful Human Review Standard) and AGT-005 (Human-in-the-Loop Gates for Irreversible Actions) controls to confirm they distinguish between the two oversight postures and specify minimum reviewer competency requirements for each.
  • ☐Schedule a tabletop exercise simulating an agent that exceeds its intended scope or takes an irreversible action, and use the results to pressure-test your escalation path and emergency halt procedures.

What to watch next

Compliance teams should track whether the EU AI Office issues technical guidance on human oversight adequacy for agentic systems under the EU AI Act, as the current text leaves room for interpretation on what constitutes meaningful oversight for autonomous pipelines. Singapore's IMDA has already published a dedicated agentic AI governance framework and may issue updated assurance sandbox criteria that operationalize similar delegated authority concepts. In the United States, state-level bills in Texas and Colorado that touch automated decision-making could be extended or interpreted to cover agentic actions, particularly in high-stakes domains such as financial services and healthcare, making it worth monitoring enforcement guidance from state attorneys general as agent deployments scale.

Related Coverage

Corporate Policy2026-06-22

Palo Alto Networks Frames Delegated Authority as the Core Risk in Agentic AI Governance

Palo Alto Networks has published a practitioner guide defining agentic AI governance around the structured management of delegated authority, runtime access boundaries, and human oversight thresholds. The guide specifies key steps including agent scope definition, pre-deployment impact assessments, and explicit accountability mapping. It positions these controls as essential to preventing agents from exceeding their intended operational boundaries.

Standards2026-07-05

Agentic AI Governance Demands Dedicated Controls, Mayer Brown Guidance Finds: Least Privilege and Human Checkpoints Are the Core Requirements

Mayer Brown published practitioner guidance titled 'Governance of Agentic Artificial Intelligence Systems' on February 5, 2026, outlining how enterprises should adapt existing AI governance programs to address the distinct risks posed by autonomous agent systems. The guidance recommends pre-deployment testing across task execution, policy compliance, and tool usage robustness, alongside post-deployment behavioral monitoring. It emphasizes least-privilege technical controls and structured human oversight checkpoints as the foundational safeguards for agentic AI.

Research2026-06-18

Agentic AI Demands Permission Systems and Accountability Structures That Most Enterprises Have Not Built Yet, MIT Sloan Warns

MIT Sloan's Management Review published an explainer on agentic AI that highlights the governance gap most enterprises face as AI systems shift from reactive tools to semi- and fully autonomous agents. The piece recommends establishing a dedicated governance board to oversee accountability and delegating safety enforcement to named individuals. It identifies permission-based access control and clear responsibility delineation as the two foundational requirements for safe agentic deployment.