Does Linguistic Structure Enrichment Enhance Coherence Assessment? Not With Current Architectures

Title:Does Linguistic Structure Enrichment Enhance Coherence Assessment? Not With Current Architectures

Abstract:Recent advances in large language models have transformed human-computer interaction. Despite their fluency, these models often produce texts that are grammatically correct but semantically incoherent, containing contradictions or disruptions in logical flow. This work investigates whether enriching text with syntactic and rhetorical information can improve incoherence prediction. Our experiments and analysis show that plain texts achieved higher accuracy because the added information was structurally and syntactically incompatible with the language model's architecture. Additionally, to demonstrate the practical importance of coherence assessment, we performed zero-shot experiments on a Brazilian disinformation dataset, suggesting that textual coherence can serve as a proxy for detecting misleading content. Code and models are available at this https URL.

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

arXiv:2609.10893 [cs.CL]

(or arXiv:2609.10893v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2609.10893 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.