Anthropic Gives METR Researchers Full Internal Access With Veto-Free Publication Rights
What happened
Anthropic announced it is embedding six researchers from METR, an independent AI safety nonprofit, with employee-level access to internal tools, systems, and office space, as reported in Anthropic is letting METR researchers look under the hood with employee-level access. The arrangement introduces a three-tier evaluator structure, placing METR at the top level with the right to publish its safety assessments without Anthropic holding any veto. Anthropic may request only narrow, pre-defined redactions, not suppress findings wholesale. The arrangement is part of a White House accord also signed by OpenAI, Google, Meta, Nvidia, and xAI. This makes it one of the broadest voluntary frontier AI oversight commitments to date. This goes meaningfully further than Accenture's embedded evaluator role at Anthropic, which raised questions about evaluator independence. It also responds directly to research finding that deep access and independent evidence are prerequisites for credible frontier AI auditing.
Why it matters
- ·The veto-free publication right sets a new benchmark for what 'independent audit' means in frontier AI. Vendor due diligence programs built around vendor-controlled safety reports or marketing-level transparency documents will face growing scrutiny. Regulators and counterparties can now point to this model as the emerging standard.
- ·If METR publishes a material safety finding about a model that enterprises are already using, those enterprises may have no advance notice. Compliance teams need a monitoring process for third-party assessments of models in their AI inventory. They also need a defined response procedure if a published finding changes the risk profile of a system already in production.
- ·The White House accord covering OpenAI, Google, Meta, Nvidia, and xAI means this is not an Anthropic-specific arrangement. Procurement teams sourcing from any of these vendors should review what independent evaluation commitments each has made. Teams should also check whether existing contracts require disclosure of material safety findings from external assessors under FTC Enforcement on AI (Section 5 of the FTC Act).
Governance controls affected
What to do now
- ☐Identify which models from Anthropic, OpenAI, Google, Meta, Nvidia, and xAI are currently in production use and add METR and equivalent third-party safety assessment publications to your vendor monitoring feed for each.
- ☐Review your AI vendor contracts to determine whether vendors are required to notify you if a third-party safety assessor publishes material findings about a model you are licensed to use.
- ☐Ask your procurement or legal team whether your current vendor due diligence standard requires independent, veto-free assessment rights, or whether it accepts vendor-controlled safety documentation as sufficient.
- ☐Update your AI incident response procedure to include a step for evaluating published third-party safety findings and determining whether they require escalation, risk reclassification, or temporary suspension of a system.
- ☐Map the White House accord commitments made by each of your frontier AI vendors to determine what specific evaluation access and disclosure rights each has granted, so you can compare vendor claims against actual commitments.
What to watch next
Compliance teams should monitor whether METR publishes any safety assessments under this arrangement, and how much detail those reports contain about specific model behaviors. Regulators in the EU and UK have signaled interest in making independent model evaluation a formal requirement. Frameworks such as the EU AI Act (Regulation (EU) 2024/1689) could be used to enforce this. Published third-party findings could accelerate that push. The Embedded Assessments Paper flagged audit independence as the central unresolved problem in frontier AI oversight. Watch whether the White House accord signatories adopt comparable access terms or whether the METR arrangement remains an outlier. Any divergence between signatories will matter for procurement benchmarking.
Stay ahead of stories like this
Get every US AI governance development like this one, plus the rest of the week's developments. Every Thursday.
Recent issues
- Three separate incidents this week reveal that AI vendors cannot be trusted to self-police, and that harm from deployed agents can run unchecked for months before anyone inside the organization notices.15 Oct
- AI systems built to extend your reach are now extending attackers' reach too, and regulators in California and South Korea are making clear that containment failures belong to deployers, not just vendors.8 Oct
Free every Thursday. Unsubscribe anytime.
