AI Incidents Rising and Responsible AI Evals Still Rare Among Major Developers, Stanford HAI 2025 Index Finds

What happened

Why it matters

• ·Regulators across the EU, OECD, and UN are transitioning from principle-setting toward enforceable standards, meaning organizations that lack documented responsible AI evaluation processes face growing legal and audit exposure.
• ·The documented rise in AI incidents combined with the scarcity of standardized RAI evaluations signals that voluntary commitments have not consistently translated into operational practice, increasing the likelihood that regulators will mandate demonstrable safety evidence rather than accepting policy statements.
• ·Organizations that have not yet adopted structured benchmarking tools such as HELM Safety or AIR-Bench risk being unprepared for auditor and regulatory scrutiny that increasingly expects systematic, evidence-based governance rather than ad hoc or informal approaches.

Governance controls affected

What to do now

• ☐Assess the maturity of current responsible AI evaluation processes against named benchmarks including HELM Safety, AIR-Bench, and FACTS, and document gaps relative to internal governance standards.
• ☐Map existing AI governance documentation against OECD and EU AI Act transparency and trustworthiness requirements, prioritizing controls relevant to high-risk system classifications.
• ☐Establish or strengthen incident tracking mechanisms capable of capturing, classifying, and escalating AI-related failures in a format that satisfies anticipated regulatory disclosure and audit expectations.
• ☐Review and update the AI Incident Response Playbook to reflect the increased incident volume documented in the report and align severity classification with emerging regulatory disclosure thresholds.
• ☐Initiate a gap analysis comparing current model evaluation and pre-production approval processes against structured safety and factuality benchmarks to identify areas requiring remediation before near-term EU AI Act deadlines.

What to watch next

Compliance teams should monitor the progression of EU AI Act implementation deadlines, as obligations for high-risk AI systems are approaching enforcement phases that will require documented evidence of safety evaluations rather than policy-level commitments. Ongoing guidance from the OECD and United Nations on AI transparency requirements should be tracked for signals of convergence toward harmonized global standards that could affect organizations across multiple jurisdictions. The adoption trajectory of benchmarks such as HELM Safety and AIR-Bench should also be monitored, as broader industry uptake may lead regulators and auditors to treat these tools as de facto compliance reference points.