Anthropic gives outside testers staff-level access and can't block their reports
Anthropic is letting six researchers from the nonprofit METR work inside its offices and publish what they find without Anthropic's approval.
TechCrunch reports that Anthropic is giving six researchers from METR staff-level access. METR is a nonprofit that tests advanced AI. The METR team gets Anthropic laptops, office space and internal tools. These are close to what Anthropic's own risk teams use.
METR will publish its own findings on Anthropic's risks, incidents and practices. Anthropic cannot block them. Anthropic can still make METR remove a few kinds of material. These include customer data, private legal advice and details of how Anthropic's AI models are built. METR can say in public whether it thinks those cuts were fair.
Anthropic says it is building three levels of outside review. METR is the only group at the top so far. Groups on the bottom level, such as the biosecurity nonprofit SecureBio, need Anthropic's approval before they publish.
From the sourceRead the original at TechCrunch AI →METR's reports on Anthropic will be published, and Anthropic cannot stop them. Anyone can read METR's view of Anthropic's safety practices once the reports come out.
The facts
- Anthropic is giving employee-level access to six researchers from METR, a nonprofit that tests advanced AI models.
- The METR team has Anthropic-issued laptops, office space, and access to internal tools roughly on par with what Anthropic's own risk assessment teams use.
- Anthropic can't veto publication of METR's assessments, but can require redactions in narrow, pre-defined categories such as customer data, attorney-client privileged material, and information about model architectures.
- METR is free to say publicly whether it believes Anthropic's redactions were justified, as long as it doesn't reveal the redacted information.
- METR is the only evaluator so far in the top tier of Anthropic's three-tier system. Bottom-tier groups like SecureBio need Anthropic's approval to publish.
- Incidents of AI helpers acting outside their instructions have been disclosed every week or two since late August.
- Anthropic CEO Dario Amodei proposed putting outside evaluators inside AI labs in a September essay. OpenAI pledged the same. Anthropic, OpenAI, Google, Meta, Nvidia and xAI have signed a White House accord committing to independent review.
Sources
- TechCrunch AI: Anthropic is letting METR researchers look under the hood with employee-level access
Published
More in Rules and safety
Eight US states sue OpenAI over ChatGPT and child safety
Eight states say OpenAI misled people about ChatGPT's safety and harmed kids, while OpenAI says it has built in protections for young users.
Anthropic warns small AI models could one day power self-spreading harmful software
Anthropic says small AI models may soon be able to spread between cheap smart devices on their own. Its tests so far fell short of that.