aiqbench analysis
This paper proposes a theoretical framework for "ontic state recovery," arguing that predicting system responses allows researchers to reconstruct the complete internal state of a model beyond immediate observations. By analyzing query ambiguity and state-space geometry, the study bridges abstract epistemology with practical applications in neural recordings and synthetic systems. It addresses a fundamental challenge in machine learning: defining what it means for a learned representation to truly preserve the underlying reality of the system being studied.
Ontic state recovery through prediction
arXiv:2610.27139v1 Announce Type: new Abstract: We encounter a system through its responses, yet its state concerns how the system is. Predicting further responses promises knowledge beyond what is immediately observed. What that knowledge tells us about the system's state depends on what we mean by a state in the first place. We give this notion a model-relative meaning: a state is the complete response profile over a specified query universe, and configurations agreeing on every query are regarded as the same state. From this perspective, a learned state is understood through the distinctions between these profiles that it retains. Prediction concerns selected observations; recovery concerns the profile as a whole. We examine their relationship through query ambiguity, state-space geometry, and the choice of prediction targets. Synthetic systems with known response laws and neural recordings provide complementary settings for this investigation. The aim is to clarify how prediction can become a way of knowing a system, and what it would mean for a learned state to preserve the state being studied.
Abstract:We encounter a system through its responses, yet its state concerns how the system is. Predicting further responses promises knowledge beyond what is immediately observed. What that knowledge tells us about the system's state depends on what we mean by a state in the first place. We give this notion a model-relative meaning: a state is the complete response profile over a specified query universe, and configurations agreeing on every query are regarded as the same state. From this perspective, a learned state is understood through the distinctions between these profiles that it retains. Prediction concerns selected observations; recovery concerns the profile as a whole. We examine their relationship through query ambiguity, state-space geometry, and the choice of prediction targets. Synthetic systems with known response laws and neural recordings provide complementary settings for this investigation. The aim is to clarify how prediction can become a way of knowing a system, and what it would mean for a learned state to preserve the state being studied.
Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Neurons and Cognition (q-bio.NC)
arXiv:2610.27139 [cs.LG]
(or arXiv:2610.27139v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.27139 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 266 words
Related coverage
Beyond Prediction: A Component-Level Study of Concept Recovery in In-Context Learning
arXiv · Oct 21, 2026
Can AI Scientists Change Their Minds? Prior-Evidence Conflict in Synthetic Universes
arXiv · Sep 30, 2026
Retracing Hodgkin and Huxley: State Recovery Does Not Certify Mechanism
arXiv · Sep 30, 2026
Predictive Assistance and the Temporal Dynamics of Exploratory Compression
arXiv · Jun 10, 2026