aiqbench analysis
This article outlines METR's methodology for independently evaluating large-scale loss-of-control risks in AI agents and publishing transparent evidence to inform public and policy decisions. It emphasizes an open scientific approach to risk assessment rather than dictating specific development or deployment strategies for companies.
Our approach to working with AI companies

This blog post explains how we approach working with AI companies on projects that the public might rely on to understand risks. It was published on Oct 14, 2026, and we expect to update it over time. At METR, we gather and publish evidence about whether humans could lose control of AI agents on a large scale. We work with AI companies to conduct evaluations, assessments, and investigations,1 and to share this evidence publicly. As we have seen increasing expectations for these kinds of voluntary engagements to provide external ‘safety assurance’, we want to explain our perspective. In this post, we clarify our overall goals for this work, our approach, and what our approach looks like in practice. Our goal is to give the public accurate, timely, and independent evidence about AI loss-of-control risk, so that they (along with policymakers and developers) can make their own informed decisions. Our primary approach is collecting high-quality, concrete evidence and publishing what we find. Beyond this, we may also work with companies or regulators to share our comments on unpublished sensitive information,2 to review risk reports, or to provide an independent judgment on claims about risk. However, many of the relevant claims involve…
Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site
Related coverage

Chris Ballance, The British Quantum Entrepreneur Who Put Ion Traps On A Chip
Quantum Zeitgeist · Aug 5, 2026
Dyna-2: General Purpose Physical Agents with Hour-Long Autonomy — Jason Ma, Dyna Robotics
Latent Space · Oct 13, 2026

The basic argument for making AI better at moral philosophy
LessWrong · Oct 14, 2026

Runway’s WorldPrompt and the Engineering of Real-Time Worlds
Latent Space · Sep 25, 2026