aiqbench analysis
This study highlights a fundamental asymmetry between AI's backward-looking probabilistic predictions and human forward-looking causal reasoning, suggesting that genuine innovation requires theory-building capabilities currently absent in data-driven models. While AI excels at pattern recognition for tasks like professional exams, it struggles to generate novel concepts without existing historical data, as illustrated by the conceptual leap required for heavier-than-air flight. This distinction implies that AI will likely complement rather than replace human roles that depend on speculative theorizing and creating new causal frameworks.
AI excels at exams, but lacks human theory-building skills

A new study challenges AI’s knowledge creation, arguing a disconnect exists between its data-based predictions and human theory-based reasoning.
A new study challenges the growing belief that artificial intelligence will ultimately replace human decision-making. Teppo Felin of Huntsman School of Business and Matthias Holweg of Saïd Business School, University of Oxford, argue that AI’s reliance on past data differs fundamentally from human theory-based causal reasoning. The researchers highlight a critical distinction, framing it as where AI predicts based on probability while humans employ forward-looking logic. They illustrate this with the example of heavier-than-air flight, an innovation unlikely to emerge from a purely data-driven system. Current AI models also outperform more than 90% of humans in various professional qualification exams, such as the bar exam in law and the certified public accountant exam in accounting (Achiam et al. 2023). Human cognition prioritizes forward-looking theorizing, a process fundamentally…
Excerpt shown under the publisher's RSS terms · 127 words · full text and figures are on the publisher's site
Related coverage
State of the Field: AI for Epistemics and Coordination
LessWrong · Oct 2, 2026
Links #3: 2026/06 Part 1
LessWrong · Jun 15, 2026
The Case Against Slowing Down AI
LessWrong · Sep 29, 2026
Assessing Information Ecosystems : How Governments Can Get Ahead of Hybrid Threats
carnegieendowment.org · Aug 5, 2026