AI Governance Institute
← News
Research2026-08-24

AI Agents Are Flooding Government Benefits Appeals Across 11 Jurisdictions

Source

Characterizing Agentic Flooding of Government Services

arXiv / AAAI Conference on AI, Ethics, and Society

What happened

A research team of Schmitz, Hammond, and Chan published Characterizing Agentic Flooding of Government Services at the AAAI Conference on AI, Ethics, and Society, documenting a dataset of 84 potential cases in which AI agents, primarily large language models, generated high volumes of automated text to interact with government services across 11 jurisdictions. The paper develops a risk matrix that flags financially complex government services, including benefits appeals and administrative claims processes, as the highest near-term targets. The researchers also map out the response options available to governments, noting a structural tension: the countermeasures most readily deployable, such as friction-inducing fees or verification requirements, carry a material risk of blocking legitimate access for the populations those services are meant to serve. This creates a compliance problem that extends beyond IT operations into equity, accessibility, and public interest obligations that many organizations serving government-adjacent functions must navigate.

Why it matters

  • ·Organizations operating claims, appeals, or administrative filing workflows face a direct operational resilience risk: agentic systems can generate submission volumes far beyond what human-scale processes were designed to handle, overwhelming queues and degrading service integrity without triggering conventional security alerts.
  • ·The equity tension identified in the research is a governance liability in its own right. Friction-based countermeasures such as fees or CAPTCHA barriers may satisfy IT risk requirements while simultaneously violating accessibility obligations or equitable service mandates, requiring legal and compliance review before deployment.
  • ·Enterprises whose AI agents interact with government portals on behalf of clients or employees, whether for benefits enrollment, regulatory filings, or administrative appeals, face third-party risk exposure if their agent configurations contribute to or facilitate flooding behavior, even unintentionally.

Stay ahead of stories like this

Get every Global AI governance development like this one, plus the rest of the week's developments. Every Thursday.

Free every Thursday. Unsubscribe anytime.

Governance controls affected

AGT-001Agent Permission BoundariesAGT-007Agent Scope and Task BoundariesAGT-011Agent Behavior Monitoring and Anomaly DetectionAGT-018Agent Data Modification Blast-Radius ContainmentAGT-028Agent External System Access BoundariesSCT-003Critical Infrastructure AI Risk Assessment and Containment

What to do now

  • ☐Audit all deployed AI agents that interact with government portals or administrative filing systems and confirm their submission rate limits, scope boundaries, and human approval requirements for bulk or repeated actions.
  • ☐Review whether your organization's agentic AI deployments include task-scope controls that would prevent a misconfigured or compromised agent from generating submission volumes inconsistent with normal human usage patterns.
  • ☐Assess any government-adjacent service you operate for vulnerability to AI-generated flooding and document the countermeasures available, including their equity and accessibility implications, before selecting a response approach.
  • ☐Engage legal and compliance counsel to evaluate whether friction-based countermeasures under consideration, such as fees or mandatory verification steps, create exposure under applicable accessibility or equitable service obligations in relevant jurisdictions.
  • ☐Add agentic flooding scenarios to your incident response tabletop exercise program to test detection, containment, and escalation workflows before an event occurs.

What to watch next

Regulatory bodies in multiple jurisdictions are only beginning to grapple with agentic misuse of public systems, and this research may accelerate rulemaking or guidance targeting agent-generated government submissions. Compliance teams should monitor whether frameworks such as China Implementation Opinions on the Standardized Application and Innovative Development of Intelligent Agents or emerging U.S. state-level agentic AI rules extend to agent interactions with administrative services. The equity and access tension documented in the paper is also likely to draw attention from civil rights and consumer protection regulators, particularly where AI-driven flooding prompts governments to introduce barriers that disadvantage vulnerable populations.

Related Coverage

Research2026-11-13

EchoLeak Proves AI Assistants Cannot Defend Against Prompt Injection Alone

A flaw named EchoLeak was patched by Microsoft in May 2025. It showed that a crafted email could cause Microsoft Copilot to silently send sensitive data to an attacker through an automatically loaded image. Security researchers publishing in November 2026 argue the underlying weakness persists across all AI assistants, because no AI model can reliably distinguish legitimate content from hidden attacker instructions. Enterprises using AI assistants with access to email, documents, or internal systems need architecture-level controls that sit outside the model itself.

Corporate Policy2026-11-13

United Airlines Blocks AI Agents Over Credential Risk and Federal Aviation Rules

United Airlines announced it will block AI agents and autonomous assistants from booking flights or managing reservations on customers' behalf. The airline cited credential-sharing risks and potential violations of federal aviation rules, including requirements that a human acknowledge banned substances at check-in. United is updating its booking, ticketing, and distribution policies to cover both its own digital platforms and indirect access through travel agencies and aggregators.

Research2026-11-12

KPMG and Cequence Set Runtime Controls as the Agentic Governance Baseline

Cequence Security and KPMG in Singapore have published a joint report, "Delegating Outcomes, Not Authority: Agentic AI Runtime Security, Governance, and Control." The report argues that static permissions alone are insufficient to govern AI agents. The report recommends runtime controls that evaluate each agent action before it executes, covering least-privilege access, non-human identity, tool-use monitoring, audit trails, and prompt injection defense. Cequence field data from October 2026 tracked more than 281,000 AI agent visits across five industries in a single week.