LitSeg: Narrative-Aware Document Segmentation for Literary RAG

arXiv:2605.27156v2 Announce Type: replace Abstract: Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge, particularly for long-tail domains such as literary works. However, the critical step of document segmentation in RAG remains largely underexplored. Existing strategies typically either ignore semantics or overlook the complicated narrative structures of literary works, often resulting in chunks with fragmented plots and unclear references that hinder retrieval and generation performance. To address this, we propose LitSeg, a novel narrative-theory-guided segmentation framework. By employing multi-stage prompting, LitSeg explicitly extracts valid events, clarifies narrative structures, and locates turning points to inform segmentation. To alleviate the computational overhead of multi-stage inference with large-scale models, we further introduce LitSeg-Lite, a lightweight single-pass chunker fine-tuned on LitSeg-generated data via a two-stage training strategy, distilling the complex process into a single inference pass. Extensive experiments demonstrate that compared to baselines, our methods yield high-quality text chunks that are narratologically coherent and self-contained. This improved segmentation quality enhances retrieval accuracy and context relevance, and boosts downstream QA performance. Ablation studies validate the efficacy of narratological guidance and data distillation, and efficiency analysis shows that LitSeg-Lite matches the teacher at a substantially lower inference cost.

Abstract:Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by incorporating external knowledge, particularly for long-tail domains such as literary works. However, the critical step of document segmentation in RAG remains largely underexplored. Existing strategies typically either ignore semantics or overlook the complicated narrative structures of literary works, often resulting in chunks with fragmented plots and unclear references that hinder retrieval and generation performance. To address this, we propose LitSeg, a novel narrative-theory-guided segmentation framework. By employing multi-stage prompting, LitSeg explicitly extracts valid events, clarifies narrative structures, and locates turning points to inform segmentation. To alleviate the computational overhead of multi-stage inference with large-scale models, we further introduce LitSeg-Lite, a lightweight single-pass chunker fine-tuned on LitSeg-generated data via a two-stage training strategy, distilling the complex process into a single inference pass. Extensive experiments demonstrate that compared to baselines, our methods yield high-quality text chunks that are narratologically coherent and self-contained. This improved segmentation quality enhances retrieval accuracy and context relevance, and boosts downstream QA performance. Ablation studies validate the efficacy of narratological guidance and data distillation, and efficiency analysis shows that LitSeg-Lite matches the teacher at a substantially lower inference cost.

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

arXiv:2605.27156 [cs.CL]

(or arXiv:2605.27156v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2605.27156 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

analiza aiqbench

LitSeg: Narrative-Aware Document Segmentation for Literary RAG

Subiecte conexe