Skip to content
aiqbench takeAI Research

aiqbench analysis

This research advances the Question Under Discussion framework by empirically testing how question salience predicts resolution in naturalistic dialogue, revealing a weaker correlation compared to monologic text. The study provides critical insights for improving conversational AI models, highlighting that conversational structure introduces significant unpredictability that current generation metrics may overlook. By analyzing 7,124 automatically generated questions from the British National Corpus, the authors offer a nuanced view of how dialogue organization impacts question-answering dynamics.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Do we need to answer that question? Salience and Answerability of Potential Questions in Naturalistic Dialogue

arXiv2 min read

arXiv:2609.31130v1 Announce Type: new Abstract: We empirically investigate Question Under Discussion based modelling in naturalistic dialogue by studying whether the salience of generated potential questions predicts their subsequent resolution. Building on Wu et al. (2024), we construct a dataset of 7,124 questions automatically generated from utterances and preceding context from the British National Corpus, and annotated for salience and answerability. We find a robust but low positive correlation between salience and answerability in dialogue, indicating that more salient questions are more likely to be addressed. However, this effect is markedly weaker than in monologic text, suggesting that conversational structure is less predictable. We further observe that structured interactions exhibit stronger alignment between annotators than less organised dialogues.

Title:Do we need to answer that question? Salience and Answerability of Potential Questions in Naturalistic Dialogue

Abstract:We empirically investigate Question Under Discussion based modelling in naturalistic dialogue by studying whether the salience of generated potential questions predicts their subsequent resolution. Building on Wu et al. (2024), we construct a dataset of 7,124 questions automatically generated from utterances and preceding context from the British National Corpus, and annotated for salience and answerability. We find a robust but low positive correlation between salience and answerability in dialogue, indicating that more salient questions are more likely to be addressed. However, this effect is markedly weaker than in monologic text, suggesting that conversational structure is less predictable. We further observe that structured interactions exhibit stronger alignment between annotators than less organised dialogues.

Computation and Language (cs.CL)

arXiv:2609.31130 [cs.CL]

(or arXiv:2609.31130v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2609.31130 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 223 words

Related coverage