aiqbench analysis
This research paper investigates the intrinsic stylistic limitations of Large Language Models by analyzing n-gram distributions, arguing that style and semantics are inextricably linked rather than separable features. The study highlights a fundamental gap between human writing's semantic range and current LLM capabilities, offering critical insights into model deficiencies beyond mere output generation.
Literary Non-Style in LLM-Generated Text
arXiv:2607.17228v1 Announce Type: new Abstract: Prior work on LLM-generated text has demonstrated quantitative and qualitative departures from text produced by humans. LLM-generated texts differ from human writing in style, resulting in a characteristic textual "feel," while the semantic range of LLMs is much restricted compared to that of humans. In this contribution, I note simple but consistent patterns in the statistical distribution of n-grams within LLM-generated text. Via qualitative analysis of these n-grams, I reveal deficiencies in LLM style. Because higher-order n-grams correlate to semantic content, I conclude that questions of style and semantics are not cleanly separable.
Abstract:Prior work on LLM-generated text has demonstrated quantitative and qualitative departures from text produced by humans. LLM-generated texts differ from human writing in style, resulting in a characteristic textual "feel," while the semantic range of LLMs is much restricted compared to that of humans. In this contribution, I note simple but consistent patterns in the statistical distribution of n-grams within LLM-generated text. Via qualitative analysis of these n-grams, I reveal deficiencies in LLM style. Because higher-order n-grams correlate to semantic content, I conclude that questions of style and semantics are not cleanly separable.
Computation and Language (cs.CL)
arXiv:2607.17228 [cs.CL]
(or arXiv:2607.17228v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.17228 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 188 words
Related coverage
When Victorian Becomes a Prompt: Literary Periodization as a Generative Constraint in 100 AI-Generated Novels
arXiv · Sep 9, 2026
The human-authorship halo: attribution bias in literary style evaluation by humans and AI
arXiv · Sep 9, 2026
On Slop
LessWrong · Jun 9, 2026
The House with a Million Windows: Interactive Fiction for Narrative Restorying
arXiv · Sep 14, 2026