aiqbench analysis
This research advances the Question Under Discussion framework by empirically testing how question salience predicts resolution in naturalistic dialogue, revealing a weaker correlation compared to monologic text. The study provides critical insights for improving conversational AI models, highlighting that conversational structure introduces significant unpredictability that current generation metrics may overlook. By analyzing 7,124 automatically generated questions from the British National Corpus, the authors offer a nuanced view of how dialogue organization impacts question-answering dynamics.
Do we need to answer that question? Salience and Answerability of Potential Questions in Naturalistic Dialogue
arXiv:2609.31130v1 Announce Type: new Abstract: We empirically investigate Question Under Discussion based modelling in naturalistic dialogue by studying whether the salience of generated potential questions predicts their subsequent resolution. Building on Wu et al. (2024), we construct a dataset of 7,124 questions automatically generated from utterances and preceding context from the British National Corpus, and annotated for salience and answerability. We find a robust but low positive correlation between salience and answerability in dialogue, indicating that more salient questions are more likely to be addressed. However, this effect is markedly weaker than in monologic text, suggesting that conversational structure is less predictable. We further observe that structured interactions exhibit stronger alignment between annotators than less organised dialogues.
Title:Do we need to answer that question? Salience and Answerability of Potential Questions in Naturalistic Dialogue
Abstract:We empirically investigate Question Under Discussion based modelling in naturalistic dialogue by studying whether the salience of generated potential questions predicts their subsequent resolution. Building on Wu et al. (2024), we construct a dataset of 7,124 questions automatically generated from utterances and preceding context from the British National Corpus, and annotated for salience and answerability. We find a robust but low positive correlation between salience and answerability in dialogue, indicating that more salient questions are more likely to be addressed. However, this effect is markedly weaker than in monologic text, suggesting that conversational structure is less predictable. We further observe that structured interactions exhibit stronger alignment between annotators than less organised dialogues.
Computation and Language (cs.CL)
arXiv:2609.31130 [cs.CL]
(or arXiv:2609.31130v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2609.31130 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 223 words
Related coverage

Why do models task game?
AI Alignment Forum · Aug 6, 2026

Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident
METR · Aug 26, 2026
Problems of Proliferation
LessWrong · Sep 29, 2026
The current bottleneck is political will, not research
AI Alignment Forum · Jul 11, 2026