Depth or Description? When a One-Step Latent Score Replaces Lookahead in Proactive Information Acquisition

Title:Depth or Description? When a One-Step Latent Score Replaces Lookahead in Proactive Information Acquisition

Abstract:A proactive agent must decide what to ask before it acts. Exact lookahead values combinations of questions but is expensive and leans on a fitted model; a one-step score is cheap but can miss them. Our main finding: the need for depth often lies in how the hidden cause is described. A one-step score on the label can be blind to an interaction among answers. A score on a suitable latent cause is not, and where that latent encodes the decision it replaces most of depth at a fraction of the search. Described differently, the same problem can defeat the score while exact values do not move, so keep the latent small and check it against exact values. Probabilities learned from one language model's answers do not carry to another unless planning allows for both; those read from tokens are worth only a few labels.

Machine Learning (cs.LG); Artificial Intelligence (cs.AI)

arXiv:2611.07155 [cs.LG]

(or arXiv:2611.07155v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2611.07155 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.