aiqbench analysis
This study demonstrates that current large language models capture next-word prediction but fail to account for the structural integration effort humans experience during complex sentence processing. The findings highlight a significant gap between probabilistic word forecasting and the cognitive mechanisms required to resolve syntactic ambiguity, challenging existing frameworks in natural language understanding research. This dissociation suggests future AI systems must evolve beyond simple probability estimation to better model human-like comprehension of context-dependent meaning.
Eye movements separate prediction from structural difficulty

Researchers found that analyzing eye movements reveals how prediction differs from structural difficulty in reading, using data from hundreds of participants.
Recordings of eye movements from hundreds of participants are revealing a surprising disconnect between how easily we anticipate words while reading and the actual difficulty of understanding sentence structure. Researchers led by William Timkey of Dell, University of Illinois at Urbana-Champaign found that while language models accurately predict upcoming words, they fail to explain the increased effort, shown through backward eye movements and rereading, needed to integrate those words into…
Excerpt shown under the publisher's RSS terms · 70 words · full text and figures are on the publisher's site
Related coverage

The Entangled Dimensions of Decision Theory
LessWrong · Jul 30, 2026
The current bottleneck is political will, not research
AI Alignment Forum · Jul 11, 2026
What's Continual Learning, and Why Might We Expect To See It In Advanced LLM Agents?
LessWrong · Jun 12, 2026

Game Design Creativity evals
LessWrong · Oct 12, 2026