AI Governance Institute
← News
Research2026-11-01

ACM Research Maps Five Privacy Leakage Pathways in Multi-Agent AI

What happened

The Association for Computing Machinery published Privacy Risks and Leakage Pathways in Agentic and Multi-Agent AI Systems, a peer-reviewed paper mapping how private data escapes from AI systems. These systems act with autonomy or coordinate across multiple agents. The paper identifies five leakage categories: data exposure driven by agent autonomy, information propagation between agents in a pipeline, persistent memory storing sensitive data beyond its intended scope, emergent inference combining signals to infer private facts no single agent was given, and audit-log exposure where the records meant to support oversight themselves become a data risk. The research covers enterprise controls most strained by these pathways, including data minimization, access control, retention limits, privacy impact assessments, trace logging, and third-party agent oversight. Regulatory bodies including the UK Information Commissioner's Office and the EU AI Office are actively scrutinizing agentic AI deployments. The publication gives compliance teams and auditors a credible, citable framework for evaluating whether existing controls are fit for purpose.

Why it matters

  • ·Regulators reviewing agentic AI deployments now have a peer-reviewed taxonomy to measure enterprise controls against. Organizations that cannot show they have addressed all five leakage pathways face heightened scrutiny under the General Data Protection Regulation (GDPR) and similar privacy frameworks.
  • ·Existing privacy controls were designed for static, single-model systems. Cross-agent information propagation and emergent inference can allow sensitive facts to be reconstructed downstream. A data minimization policy governing one agent's inputs may not prevent this. Most privacy impact assessments have not evaluated this gap.
  • ·Audit logs, which compliance programs rely on to prove accountability, are themselves identified as a leakage vector. If agent trace logs contain personal data, storing them for oversight purposes may create a new retention and disclosure obligation that conflicts with deletion rights.

Stay ahead of stories like this

Get every Global AI governance development like this one, plus the rest of the week's developments. Every Thursday.

Free every Thursday. Unsubscribe anytime.

Governance controls affected

What to do now

  • ☐Map each of the five leakage pathways from the ACM paper against your current multi-agent deployments and document which ones your existing privacy controls address and which ones they do not.
  • ☐Review your privacy impact assessments for agentic AI systems and confirm they cover cross-agent data flows, not just the inputs and outputs of individual agents.
  • ☐Ask your engineering team to show you what data is stored in each agent's persistent memory, how long it is retained, and whether it can contain personal information from prior sessions or users.
  • ☐Audit your agent trace and audit logs to determine whether they capture personal data, and confirm that your log retention policy satisfies both your audit obligations and any applicable deletion or minimization requirements.
  • ☐Require your third-party AI agent vendors to confirm in writing how they handle data propagation across agent pipelines and whether their audit logs are themselves subject to access controls.

What to watch next

Compliance teams should monitor how the EU AI Office and national data protection authorities cite or incorporate this leakage taxonomy into agentic AI enforcement actions and guidance. The CCPA Regulations on Automated Decisionmaking Technology, Risk Assessments, and Cybersecurity Audits already require risk assessments that could be extended to cover cross-agent data flows. Any guidance from the ICO following its open agentic AI data protection probe will be a leading indicator of how regulators expect enterprises to address these pathways. Organizations in financial services should also watch for supervisory expectations to harden, given that banking examiners have already begun asking whether AI agents can be audited.

Related Coverage

Corporate Policy2026-11-21

Signal Blocks OS-Level AI Agents, Exposing a Gap No App Can Fully Fix

Signal has restricted screenshots on Android and iOS 27 to prevent operating system AI agents, including Siri and Gemini, from reading users' on-screen messages. Signal president Meredith Whittaker described the gap as an existential threat to application-layer privacy and criticized Apple, Google, and Microsoft for not giving developers adequate tools to restrict AI data access. The fix is incomplete: Signal acknowledges it cannot block all access pathways, and the same protections are not yet available on macOS.

Corporate Policy2026-11-21

Signal Blocks OS AI Agents, But the Data Leakage Gap Remains on macOS

Signal has updated its iOS and Android apps to block AI agents, including Apple Siri and Google Gemini, from reading private messages via screenshot capture. Signal CEO Meredith Whittaker explicitly stated that Apple, Google, and Microsoft do not provide application developers with adequate tools to restrict AI agent data access. The protections do not extend to macOS, where the necessary platform controls are absent.

Research2026-11-18

Fireworks AI Breach Exposes 149,000 Uber Drivers' License Data

Hackers used stolen credentials to access a dedicated cloud storage environment Uber had set up for AI inference vendor Fireworks AI, exposing personal data for approximately 149,346 Uber drivers. Stolen data included driver's license images, names, home addresses, dates of birth, and license numbers. This was the second security incident at Fireworks AI in October 2026. Uber did not begin notifying affected drivers until more than a month after learning of the breach.