Ad-Funded Clinical AI Used by 64% of US Physicians Raises Accuracy and Oversight Gaps
Source
The $15 billion ad-powered AI startup your doctor may already be usingFinancial Times / OpenEvidence
What happened
OpenEvidence, an AI-powered medical search platform, processed more than 42 million physician queries last month. It is now embedded in hospital electronic health record systems at NYU Langone and Mount Sinai, according to reporting by Ars Technica. The platform is funded by pharmaceutical and medical device advertisers, raising questions about whether the sources it surfaces to clinicians reflect advertiser priorities rather than clinical evidence. A June 2026 paper published in Nature found OpenEvidence underperformed general-purpose AI models on standard clinical benchmarks. The company withdrew from the EU and UK, citing the requirements of the EU AI Act (Regulation (EU) 2024/1689) as the reason. Clinicians and researchers have flagged concern that junior doctors may rely on the tool without sufficient foundational knowledge to recognize errors, compounding the risk from documented accuracy shortfalls.
Why it matters
- ·Healthcare organizations that deployed OpenEvidence through their electronic health record systems may face regulatory exposure under the EU AI Act (Regulation (EU) 2024/1689) if they operate in EU jurisdictions. The vendor's own withdrawal signals the platform was not built to meet high-risk AI requirements for clinical decision support.
- ·The ad-funded model creates a structural conflict of interest: the platform's revenue depends on pharmaceutical advertisers, yet it is positioned as a neutral clinical reference tool. This makes it difficult for compliance teams to verify whether outputs reflect medical evidence or commercial influence.
- ·Documented accuracy gaps, combined with evidence that junior clinicians may over-rely on the tool, shift liability risk onto hospitals and health systems that have integrated it. This risk is heightened where no formal clinical AI governance review or human oversight protocol was in place before deployment.
Stay ahead of stories like this
Get every US AI governance development like this one, plus the rest of the week's developments. Every Thursday.
Recent issues
- State-linked attackers and criminal operators are actively weaponizing AI tools as entry points into enterprise systems, turning internal platforms and open-source frameworks into live attack vectors.5 Nov
- Three separate incidents this week each created a new compliance action item: verify your AI vendors' data sourcing, demand agent monitoring coverage guarantees, and audit trusted app identities in your cloud environment.29 Oct
Free every Thursday. Unsubscribe anytime.
Governance controls affected
What to do now
- ☐Ask your clinical informatics and compliance teams whether OpenEvidence is integrated into any electronic health record system or clinical workflow, and document which departments are using it.
- ☐Commission a conflict-of-interest review of OpenEvidence's advertising model: determine whether pharmaceutical or device advertisers can influence which sources or treatments the tool surfaces to physicians.
- ☐Review whether a clinical AI governance review was conducted before deployment, including accuracy benchmarking against independent clinical standards and not just vendor-supplied performance claims.
- ☐Establish a human oversight protocol for any clinical AI tool used by junior staff, specifying when a second-opinion or supervisor review is required before acting on an AI-generated recommendation.
- ☐If your organization operates in the EU or UK, confirm whether any clinical AI vendors in your stack have withdrawn from those jurisdictions citing the EU AI Act, and treat withdrawal as a signal that the tool may not meet high-risk AI compliance requirements.
What to watch next
The EU AI Office has indicated that clinical decision support tools are a named inspection priority. Health systems operating in Europe should expect scrutiny of any AI tool used in diagnostic or treatment workflows. The EU AI Act (Regulation (EU) 2024/1689) classifies AI systems that influence clinical decisions as high-risk, meaning conformity assessments and human oversight documentation will be required. US regulators including the Federal Trade Commission and state attorneys general have begun examining AI tools that carry undisclosed commercial conflicts. This pattern appears in recent enforcement against AI billing tools flagged in the AI Billing Tools Added $942M in Unwarranted Healthcare Costs story. Health systems should also watch for FDA guidance updates on AI and software as a medical device, which will likely address ad-supported clinical AI platforms specifically.