All Learning Has an Emotional Basis, So Does Task-Oriented Dialogue

arXiv:2507.01594v2 Announce Type: replace Abstract: Task-oriented dialogue (ToD) systems aim to help users accomplish goals through natural language interaction. Beyond task success, effective ToD systems must also maintain positive emotional interaction and accurately convey information in inherently noisy and ambiguous conversational environments. Recent advances in large language models (LLMs) have substantially improved conversational fluency and contextual understanding. However, although emotion has been incorporated into existing ToD systems, its integration is typically confined to limited roles, restricting its influence on overall dialogue behaviour and user experience. To address this, we propose a novel end-to-end framework that combines fully lexicalised representations with an LLM backbone for improved semantic accuracy and employs online reinforcement learning with short-term emotional and long-term task-success rewards for joint optimisation of emotional interaction and task success. We further develop a challenging and realistic simulation environment that enables systematic evaluation across diverse ToD set-ups. Experiments show that incorporating coarse affective signals improves task success and sentiment rating in aggregate. Furthermore, integrating emotional interaction throughout the dialogue system using our proposed framework results in more pronounced improvements in both task success and user emotional experience.

Abstract:Task-oriented dialogue (ToD) systems aim to help users accomplish goals through natural language interaction. Beyond task success, effective ToD systems must also maintain positive emotional interaction and accurately convey information in inherently noisy and ambiguous conversational environments. Recent advances in large language models (LLMs) have substantially improved conversational fluency and contextual understanding. However, although emotion has been incorporated into existing ToD systems, its integration is typically confined to limited roles, restricting its influence on overall dialogue behaviour and user experience. To address this, we propose a novel end-to-end framework that combines fully lexicalised representations with an LLM backbone for improved semantic accuracy and employs online reinforcement learning with short-term emotional and long-term task-success rewards for joint optimisation of emotional interaction and task success. We further develop a challenging and realistic simulation environment that enables systematic evaluation across diverse ToD set-ups. Experiments show that incorporating coarse affective signals improves task success and sentiment rating in aggregate. Furthermore, integrating emotional interaction throughout the dialogue system using our proposed framework results in more pronounced improvements in both task success and user emotional experience.

Computation and Language (cs.CL)

arXiv:2507.01594 [cs.CL]

(or arXiv:2507.01594v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2507.01594 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

analiza aiqbench

All Learning Has an Emotional Basis, So Does Task-Oriented Dialogue

Subiecte conexe