Skip to content
aiqbench takeAI Products

aiqbench analysis

This note analyzes how Anthropic's coding agents have increased researcher output by more than 2x, using economic models to adjust for the fact that coding is only part of a researcher's job. The analysis highlights significant uncertainties regarding AI-generated code verbosity and the distinction between low-stakes versus high-stakes development tasks. Ultimately, it suggests that while coding efficiency has surged, total effective research uplift depends heavily on how these tools are applied across non-coding responsibilities.
Sources coveringMETR, LessWrong, Cybersecurity News, Fortune
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Because 8 ≈ e², Anthropic's researcher uplift is plausibly >2x

METR23 min read

Notes are unpolished research updates directly from METR researchers, and have gone through less review than our research posts. They do not necessarily reflect the views of METR as a whole. Note: the modeling assumptions and conclusion are Thomas Kwa’s opinion, and others at METR disagree.1 Also, the math was checked by Claude but not a second human. Anthropic’s RSI blog post reported that in Q2 2026, Anthropic contributors merged 8× as much code per day as in the 2021-2024 period. What does this imply about the factor by which a researcher’s total effective output increased — the (serial) researcher uplift2? Of course, 8× more code doesn’t mean 8× more research, as coding is only part of the job. However, if we assume each line of code (LoC) has equivalent quality and verbosity to pre-2025 code and make standard economic modeling assumptions, we can conclude a surprising amount: all models predict researcher uplift at Anthropic from coding agents alone is >2×. (Researcher uplift could be even higher, because these numbers assume no uplift on non-code tasks.) Cobb-Douglas predicts that if pre-AI time spent coding is \(\beta=50\%\) and code output increases by a factor \(M=8\), then researcher uplift is \(M^\beta =…

Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site

Related coverage