analiza aiqbench
This article analyzes the methodological complexities in measuring AI's impact on productivity, specifically addressing how task substitution and shifts in work allocation distort standard efficiency estimates. It draws parallels to economic price index theory to argue that simple time savings on existing tasks underestimate true value uplift while including new AI-enabled tasks overstates pre-AI baselines.
Task Substitution and Uplift

One complication in measuring AI’s effect on productivity is that it has different effects on different tasks, and this causes people to change how they allocate their time between tasks. This makes it more difficult to talk about the effect of AI on overall productivity. We use “old tasks” to mean the set of tasks you’d do in a typical day before AI is available – your average workday in 2021, say. “New tasks” means the set of tasks you’d do in a typical day after AI is available. Not all new tasks necessarily use AI; they’re just the tasks you choose knowing AI is an option. Uplift on old tasks: The factor by which pre-AI time exceeds post-AI time to complete the old tasks. Uplift on new tasks: The factor by which pre-AI time exceeds post-AI time to complete the new tasks. Uplift in value: The factor by which post-AI value exceeds pre-AI value, allowing for reshuffling of tasks between the pre-AI and post-AI cases. In some cases value has a natural definition; in others, it can be operationalized using related definitions discussed more in the accompanying note. This note discusses…
Extras afișat conform termenilor RSS ai publicației · 192 cuvinte · textul integral și figurile sunt pe site-ul publicației
Subiecte conexe

Measuring the Self-Reported Impact of Early-2026 AI on Technical Worker Productivity
METR · 11 mai 2026

Because 8 ≈ e², Anthropic's researcher uplift is plausibly >2x
METR · 8 iul. 2026
Multi-channel Uplift Policy Learning
arXiv · 31 iul. 2026

Examining AI Swarm Efficiency with the AI Futures Model
LessWrong · 19 oct. 2026