Web Scraping

Web scraping is the automated extraction of data from websites, typically through bots or scripts that collect publicly available information at scale. For AI governance, web scraping raises significant compliance concerns because it can violate terms of service, intellectual property rights, and data protection regulations like GDPR and CCPA. Organizations must establish clear policies on which data sources are legally permissible for training AI models and ensure proper consent mechanisms are in place before harvesting information from third-party websites.

1 item

ResearchGlobal2026-08-13

ShieldFont Corrupts 20% of Scraped Training Content, Exposing Data Integrity Gap

Designers Isaque Seneda and Gabriel Abrucio have published a white paper introducing ShieldFont, a typeface that uses font rendering to replace raw HTML text with semantically plausible but meaningless substitutes while displaying normally to human readers. In testing against six publicly available scraper pipelines, over 90 percent of affected pages were rejected by quality filters, and pages that passed carried nearly 20 percent corrupted training content. The research exposes a structural gap in how enterprises verify the integrity of web-scraped AI training data.

training data data provenance web scraping data poisoning supply chain risk AI integrity