analiza aiqbench
Anthropic and OpenAI are proposing a structural shift toward embedding third-party safety evaluators within their labs to monitor model alignment during training, addressing concerns that current self-reporting mechanisms are insufficient. However, the efficacy of this approach hinges on whether these embedded entities maintain genuine independence or merely operate as internal vendors subject to corporate oversight. This development marks a critical pivot in AI governance, moving from post-hoc auditing to continuous, transparent monitoring of model behavior throughout the training lifecycle.
Anthropic and OpenAI want to embed safety evaluators. Will they really be independent?
Anthropic and OpenAI want to embed independent safety evaluators inside their AI labs. Researchers welcome the unprecedented access, but warn meaningful oversight requires transparency, independence, and eventually regulation.
In a lengthy essay published over the weekend, Anthropic CEO Dario Amodei made a proposal that the AI industry would have rejected instantly even a year ago: embed third-party evaluators inside all frontier AI companies, giving them the power to report safety incidents, assess whether AI models are truly aligned, and share their unvarnished findings with the world. Amodei said Anthropic would commit to giving independent evaluators like METR and Redwood Research unprecedented access to the company’s systems. CEO Sam Altman said OpenAI also would commit to the practice, signalling a potentially profound change in how the industry works with outside research groups. Third-party evaluators who spoke to TechCrunch broadly welcomed the proposal, but said details need to be ironed out — and ideally backed by legislation — if they’re…
Extras afișat conform termenilor RSS ai publicației · 130 cuvinte · textul integral și figurile sunt pe site-ul publicației
Subiecte conexe
Why I Left Google DeepMind
LessWrong · 15 iul. 2026
Alignment Midtraining Cracks Under Pressure
LessWrong · 21 sept. 2026
AISN #82: The US and China Begin a Dialogue on AI
Center for AI Safety · 29 sept. 2026
Latent reasoning architectures would likely undermine CoT, our strongest oversight tool
AI Alignment Forum · 23 sept. 2026