Healthcare AI Risk

Healthcare AI risk covers the ways artificial intelligence used in clinical care, diagnosis, billing, and patient management can cause harm, such as misdiagnosis, biased treatment recommendations, or exposure of protected patient data. For compliance and risk teams, it sits at the intersection of medical device rules, privacy law such as the US Health Insurance Portability and Accountability Act (HIPAA), and emerging AI-specific regulation, so a single tool can trigger obligations under several regimes at once. Organizations deploying clinical AI need documented validation, ongoing performance monitoring, and clear accountability for when a system gets it wrong.

1 item

Corporate PolicyUS2026-10-22

Ad-Funded Clinical AI Used by 64% of US Physicians Raises Accuracy and Oversight Gaps

OpenEvidence, a Miami-based AI medical search platform valued at $15 billion, is now used by roughly two-thirds of US physicians. The platform is funded by pharmaceutical advertising and has withdrawn from the EU and UK citing the EU AI Act. Independent research found it underperformed general-purpose AI models on clinical benchmarks.

OpenEvidence clinical AI healthcare AI risk conflict of interest EU AI Act human oversight pharmaceutical advertising