From Prediction to Self: Developmental Conditions for Agency in Minimal Neural Systems

arXiv:2606.05605v2 Announce Type: replace Abstract: How does a system that merely predicts the world come to distinguish its own causal influence from everything else? We trace this transition in a minimal 192-dimensional GRU through a developmental sequence -- 6 experimental stages, 12 falsified alternatives, and cross-signal validation. Starting with no action or self-representation, we add components one at a time, tracking whether the system distinguishes self-caused from world-caused changes. The central finding is the encoding gap: a system can perfectly compensate for its own actions in prediction while failing to encode "I am acting" as a readable state -- implicit causal use and explicit self-representation are dissociated capabilities. The developmental path crosses this gap when four conditions are jointly satisfied: (1) persistent state that forms stable attractors, (2) a causal action loop linking the system's output to its input, (3) proprioceptive feedback that makes implicit causal knowledge explicit, and (4) asynchronous awakening -- consolidating perceptual learning before action learning, which yields the only configuration robust to hyperparameter choice. We propose agency gain (A = Err_world - Err_self), the predictive advantage of knowing one's own action, as a continuous metric that generalizes across signal types. A decisive test confirms the causal grounding of the encoding: after the external training signal is removed, the causal agent retains its self-representation at 94.9% while a statistically-matched control collapses to 53.9%. Self-representation persists only when causally useful for prediction -- an intrinsic property of the causal loop, not a training artifact.

Abstract:How does a system that merely predicts the world come to distinguish its own causal influence from everything else? We trace this transition in a minimal 192-dimensional GRU through a developmental sequence -- 6 experimental stages, 12 falsified alternatives, and cross-signal validation. Starting with no action or self-representation, we add components one at a time, tracking whether the system distinguishes self-caused from world-caused changes. The central finding is the encoding gap: a system can perfectly compensate for its own actions in prediction while failing to encode "I am acting" as a readable state -- implicit causal use and explicit self-representation are dissociated capabilities. The developmental path crosses this gap when four conditions are jointly satisfied: (1) persistent state that forms stable attractors, (2) a causal action loop linking the system's output to its input, (3) proprioceptive feedback that makes implicit causal knowledge explicit, and (4) asynchronous awakening -- consolidating perceptual learning before action learning, which yields the only configuration robust to hyperparameter choice. We propose agency gain (A = Err_world - Err_self), the predictive advantage of knowing one's own action, as a continuous metric that generalizes across signal types. A decisive test confirms the causal grounding of the encoding: after the external training signal is removed, the causal agent retains its self-representation at 94.9% while a statistically-matched control collapses to 53.9%. Self-representation persists only when causally useful for prediction -- an intrinsic property of the causal loop, not a training artifact.

Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

arXiv:2606.05605 [cs.LG]

(or arXiv:2606.05605v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2606.05605 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

aiqbench analysis

From Prediction to Self: Developmental Conditions for Agency in Minimal Neural Systems

Related coverage