Anthropic’s METER proposal would give independent evaluators access to Slack and internal workspaces

Anthropic has announced immediate collaboration with METER, a proposed third-party evaluator. The initiative is described as going beyond ordinary model benchmarking: external evaluators could receive a badge, desk and access to Slack and other internal workspaces despite not being company employees.

The model is being characterized as unusual and potentially unprecedented for highly secretive AI organizations. Its supporters see it as a way for independent or nonprofit evaluators to observe processes and publicly report problems; its critics question whether outsiders can be trusted to protect confidential information and avoid leaks. The evidence suggests that government or nonprofit observers could eventually receive similarly broad access, but whether the model is workable remains uncertain.