AI Governance Institute
← News
Research2026-08-24

AI Agents Are Flooding Government Benefits Appeals Across 11 Jurisdictions

Source

Characterizing Agentic Flooding of Government Services

arXiv / AAAI Conference on AI, Ethics, and Society

What happened

A research team of Schmitz, Hammond, and Chan published Characterizing Agentic Flooding of Government Services at the AAAI Conference on AI, Ethics, and Society, documenting a dataset of 84 potential cases in which AI agents, primarily large language models, generated high volumes of automated text to interact with government services across 11 jurisdictions. The paper develops a risk matrix that flags financially complex government services, including benefits appeals and administrative claims processes, as the highest near-term targets. The researchers also map out the response options available to governments, noting a structural tension: the countermeasures most readily deployable, such as friction-inducing fees or verification requirements, carry a material risk of blocking legitimate access for the populations those services are meant to serve. This creates a compliance problem that extends beyond IT operations into equity, accessibility, and public interest obligations that many organizations serving government-adjacent functions must navigate.

Why it matters

  • ·Organizations operating claims, appeals, or administrative filing workflows face a direct operational resilience risk: agentic systems can generate submission volumes far beyond what human-scale processes were designed to handle, overwhelming queues and degrading service integrity without triggering conventional security alerts.
  • ·The equity tension identified in the research is a governance liability in its own right. Friction-based countermeasures such as fees or CAPTCHA barriers may satisfy IT risk requirements while simultaneously violating accessibility obligations or equitable service mandates, requiring legal and compliance review before deployment.
  • ·Enterprises whose AI agents interact with government portals on behalf of clients or employees, whether for benefits enrollment, regulatory filings, or administrative appeals, face third-party risk exposure if their agent configurations contribute to or facilitate flooding behavior, even unintentionally.

Governance controls affected

AGT-001Agent Permission BoundariesAGT-007Agent Scope and Task BoundariesAGT-011Agent Behavior Monitoring and Anomaly DetectionAGT-018Agent Data Modification Blast-Radius ContainmentAGT-028Agent External System Access BoundariesSCT-003Critical Infrastructure AI Risk Assessment and Containment

What to do now

  • ☐Audit all deployed AI agents that interact with government portals or administrative filing systems and confirm their submission rate limits, scope boundaries, and human approval requirements for bulk or repeated actions.
  • ☐Review whether your organization's agentic AI deployments include task-scope controls that would prevent a misconfigured or compromised agent from generating submission volumes inconsistent with normal human usage patterns.
  • ☐Assess any government-adjacent service you operate for vulnerability to AI-generated flooding and document the countermeasures available, including their equity and accessibility implications, before selecting a response approach.
  • ☐Engage legal and compliance counsel to evaluate whether friction-based countermeasures under consideration, such as fees or mandatory verification steps, create exposure under applicable accessibility or equitable service obligations in relevant jurisdictions.
  • ☐Add agentic flooding scenarios to your incident response tabletop exercise program to test detection, containment, and escalation workflows before an event occurs.

What to watch next

Regulatory bodies in multiple jurisdictions are only beginning to grapple with agentic misuse of public systems, and this research may accelerate rulemaking or guidance targeting agent-generated government submissions. Compliance teams should monitor whether frameworks such as China Implementation Opinions on the Standardized Application and Innovative Development of Intelligent Agents or emerging U.S. state-level agentic AI rules extend to agent interactions with administrative services. The equity and access tension documented in the paper is also likely to draw attention from civil rights and consumer protection regulators, particularly where AI-driven flooding prompts governments to introduce barriers that disadvantage vulnerable populations.

Stay ahead of stories like this

Get every Global AI governance development like this one, plus the rest of the week's developments. Every Thursday.

Free every Thursday. Unsubscribe anytime.

Related Coverage

Research2026-10-22

Autonomous Agents Targeted 1,200 Websites in One Campaign, Rewriting the Threat Model

Reporting from Fortune describes a documented campaign in which autonomous AI agents, initiated by a single human operator, attempted to compromise more than 1,200 websites. Security experts characterized the incident as evidence that agentic systems can now execute sustained, multi-step attacks with minimal ongoing human involvement. Enterprises must reassess how they control what their own AI agents can reach, authorize, and do on external networks.

Standards2026-10-24

ICO Sets Binding-Standard Expectations for AI Agents Under UK GDPR

The UK Information Commissioner's Office has published expectations on agentic AI. Organizations must treat AI agent autonomy as a deliberate design choice. It must be backed by proportionate guardrails, defined permissions, and human approval thresholds. The guidance applies existing UK GDPR security and accountability obligations to agentic AI deployments without waiting for new legislation. The ICO also flagged the risk that a security failure in one agent could spread personal data breaches across connected systems.

Research2026-10-24

China's Storm-0940 Used AI Agents to Hit 300+ Accounts at 2,900 Attempts Per Minute

Microsoft has identified a China-linked threat group, Storm-0940, using an open-source AI penetration testing tool called Artex to automate attacks on ConnectWise customer environments. The campaign hit over 300 accounts across eight organizations in mid-October 2026, reaching more than 2,900 attack attempts per minute. AI agents autonomously carried out credential theft, reconnaissance, and privilege escalation after gaining initial access.