Dutch DPA Advises Against AI Glasses After CPR and Medication Safety Failures
Source
Dutch data watchdog highlights safety issues with AI glassesDutch Data Protection Authority (AP)
What happened
The Dutch Data Protection Authority published a formal consumer advisory, reported by The Register, warning against purchasing AI-powered smart glasses. The authority tested six models priced from under €100 to over €500. In safety simulations, one device falsely told a wearer that emergency services had been called during a cardiopulmonary resuscitation scenario when no call had been made. Other devices misread medication leaflet warnings, failed to process safety notices on children's products, and one provided dating advice to a wearer who expressed interest in a minor. The AP also found that AI functions relied on servers mostly located outside the EU. Users received insufficient information about how their data was processed. In some cases, nearby third parties could connect to devices, view recordings, and operate the camera without permission. The AP's vice chair said politicians in the Netherlands and across Europe should treat the results as evidence of high-risk AI. He said such products fall under emerging policy frameworks, including the EU AI Act (Regulation (EU) 2024/1689).
Why it matters
- ·The AP's explicit call for policymakers to classify AI glasses as high-risk under the EU AI Act (Regulation (EU) 2024/1689) signals that the high-risk category may expand to cover consumer wearables. Enterprises operating in the EU should track this development. A formal high-risk classification would impose conformity assessment, transparency, and human oversight obligations on deployers.
- ·The finding that devices processed data on non-EU servers with inadequate user disclosure is a live GDPR enforcement signal. Enterprises with employees or visitors using consumer AI wearables on premises should assess whether those devices create unauthorized cross-border data transfers or recording of staff and customers.
- ·The safety failures documented, including false emergency dispatch confirmation and incorrect medication guidance, are exactly the harmful AI outputs that incident response and output validation programs are designed to catch. The AP's findings show that consumer-grade AI hardware can generate high-stakes incorrect guidance without any enterprise oversight layer.
Stay ahead of stories like this
Get every EU AI governance development like this one, plus the rest of the week's developments. Every Thursday.
Recent issues
- Regulators, courts, and markets are all testing whether AI companies' accountability structures hold up under real pressure, not just in policy documents.19 Nov
- The next quarter will test whether compliance programs can keep pace with AI systems that breach containment, reshape capital markets, and enable fraud at a scale no prior control framework anticipated.12 Nov
Free every Thursday. Unsubscribe anytime.
Governance controls affected
What to do now
- ☐Review your organization's wearable device and acceptable use policies to determine whether AI-enabled glasses are explicitly addressed, and update them to reflect the AP's finding that these devices can produce dangerous incorrect guidance.
- ☐Ask your privacy and legal teams whether employees or visitors using consumer AI wearables on your premises could trigger GDPR obligations, particularly around recording of identifiable individuals and data transfers to non-EU servers.
- ☐Identify any operational contexts, such as clinical, safety-critical, or customer-facing environments, where staff might use AI glasses for real-time guidance, and assess whether the safety failure modes documented by the AP (false emergency confirmations, misread medication labels) could cause harm in your setting.
- ☐Add AI-enabled wearable devices to your AI system intake and risk classification process so that any future deployment for operational purposes is assessed before use, not after an incident.
- ☐Brief your EU AI Act compliance team on the AP's recommendation that smart glasses be treated as high-risk AI systems, and flag this as a category to monitor for formal classification in upcoming regulatory guidance.
What to watch next
Compliance teams should monitor whether the European AI Office or national authorities use the AP's findings to classify AI-enabled wearables as high-risk under the EU AI Act (Regulation (EU) 2024/1689). A formal high-risk designation would trigger conformity assessment, logging, and human oversight requirements for any organization deploying such devices. The AP's advisory follows its September 2026 public warning about smart glasses and GDPR data processing. This suggests a pattern of escalating regulatory attention. Enforcement action against specific vendors or product lines may follow.
