aiqbench analysis
This commentary proposes PEEL, a protocol that pairs deterministic text analysis tools with LLMs to detect systematic distortions in AI-generated research condensations. The work argues that fluency does not equate to fidelity, emphasizing that epistemic authority must be explicitly designed into AI workflows rather than assumed. For researchers and developers, the key takeaway is the necessity of integrating non-AI measurement instruments to maintain accountability in AI-enabled epistemic practices.
Thinking Through Signs: PEEL as a Semiotic Scaffolding for Epistemically Accountable AI-Enabled Research
arXiv:2606.04152v1 Announce Type: new Abstract: Large language models are reshaping research practice while quietly eroding researchers epistemic accountability. This commentary introduces PEEL - Protocols for Epistemically Engaged Literacy in AI, a working scaffolding that combines deterministic distant reading via Voyant Tools with LLM interpretation via Claude, grounded in Peircean semiotics and abductive reasoning. Applied to AI-generated condensations of three source texts, PEEL reveals systematic distortions in quantity, term frequency, and epistemic voice that are invisible without non-AI measurement -- and yields three design implications: deterministic instruments must accompany AI tools; fluency is not fidelity; epistemic authority must be designed in, not assumed.
Abstract:Large language models are reshaping research practice while quietly eroding researchers epistemic accountability. This commentary introduces PEEL - Protocols for Epistemically Engaged Literacy in AI, a working scaffolding that combines deterministic distant reading via Voyant Tools with LLM interpretation via Claude, grounded in Peircean semiotics and abductive reasoning. Applied to AI-generated condensations of three source texts, PEEL reveals systematic distortions in quantity, term frequency, and epistemic voice that are invisible without non-AI measurement -- and yields three design implications: deterministic instruments must accompany AI tools; fluency is not fidelity; epistemic authority must be designed in, not assumed.
Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
arXiv:2606.04152 [cs.AI]
(or arXiv:2606.04152v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2606.04152 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 195 words
Related coverage
Before Agents Decide: Epistemic Action in LLM-Based Systems
arXiv · Oct 2, 2026
AI Pluralism and the Worlds It Misses
arXiv · Jun 16, 2026
Verification Without Distrust: Reframing User-Side Oversight as Routine Epistemic Governance in Everyday Human-Chatbot Interaction
arXiv · Jul 29, 2026
Walking on the DARKSIDE
arXiv · Aug 25, 2026