Skip to content
aiqbench takeAI Research

aiqbench analysis

FullCite addresses a critical gap in AI reliability by demonstrating that while large language models can locate relevant documents, they still struggle to pinpoint precise supporting evidence spans within those texts. This research highlights that achieving faithful, attributed question answering requires a specific focus on improving evidence span identification rather than relying solely on document-level retrieval. The findings underscore the necessity for more rigorous grounding mechanisms to ensure factual accuracy as AI systems are deployed in high-stakes environments.
Sources coveringarXiv, Fortune, AI Alignment Forum, LessWrong
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Explicit Evidence Grounding via Structured Inline Citation Generation

arXiv2 min read

arXiv:2606.07130v1 Announce Type: new Abstract: As AI systems become more widely adopted, the demand for factual and faithful generation grows. Properly attributing information through citations becomes, therefore, crucial. This work introduces FullCite, a framework that, in contrast to most previous works, generates structured inline citations linking each claim to both its source document and supporting evidence. FullCite proposes three strategies to inline citation generation: prompt-based generation, constrained decoding over a citation grammar, and posthoc span alignment. Using three question answering benchmarks, namely, ASQA, BioASQ, and ExpertQA, we assess citation quality and faithfulness along three dimensions: document-level correctness, evidence span identification, and claim-citation faithfulness. Our evaluation shows that while LLMs are generally effective at identifying relevant documents, they struggle to identify the precise supporting spans within them. This gap suggests that achieving faithful attributed QA will require research to place greater emphasis on precise evidence span identification.

Abstract:As AI systems become more widely adopted, the demand for factual and faithful generation grows. Properly attributing information through citations becomes, therefore, crucial. This work introduces FullCite, a framework that, in contrast to most previous works, generates structured inline citations linking each claim to both its source document and supporting evidence. FullCite proposes three strategies to inline citation generation: prompt-based generation, constrained decoding over a citation grammar, and posthoc span alignment. Using three question answering benchmarks, namely, ASQA, BioASQ, and ExpertQA, we assess citation quality and faithfulness along three dimensions: document-level correctness, evidence span identification, and claim-citation faithfulness. Our evaluation shows that while LLMs are generally effective at identifying relevant documents, they struggle to identify the precise supporting spans within them. This gap suggests that achieving faithful attributed QA will require research to place greater emphasis on precise evidence span identification.

Computation and Language (cs.CL)

arXiv:2606.07130 [cs.CL]

(or arXiv:2606.07130v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2606.07130 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 236 words

Related coverage