aiqbench analysis
This study exposes a critical representational bias in LLM-driven employee feedback systems, demonstrating that summaries disproportionately filter out minority voices and isolated concerns regardless of sentiment. By introducing a new Voice Retention metric, the research reveals that current pipelines prioritize popularity over nuance, effectively silencing dissenting or linguistically diverse perspectives before leaders see them. These findings are essential for organizations relying on AI to aggregate internal feedback, highlighting the urgent need for bias-aware summarization techniques in workplace governance.
Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening
arXiv:2609.38818v1 Announce Type: new Abstract: Organizations increasingly route employee feedback to leaders through large language model (LLM) summaries, an unaudited layer that silences already-spoken voice. We introduce a Voice Retention / Representation Ratio metric for representational bias in summarization and apply it to a bilingual (English/German) corpus of 2,586 free-text responses from a global professional service company. First, employees supply criticism more reliably than praise (withholding praise is 82 times more common). Second, across 45 leader-summaries the pipeline filters by popularity, not sentiment: criticism survives, yet a concern voiced once is dropped 86% of the time, with short and German-only content lost on the same axis (theme retention 0.14 vs 0.74; German directional). Controlling for frequency, sentiment has no independent effect; the harm is prevalence-driven, which sentiment-only audits miss. A targeted prompt recovers only named themes. We contribute the metric, field evidence, and a disaggregated voice-retention card.
Title:Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening
Abstract:Organizations increasingly route employee feedback to leaders through large language model (LLM) summaries, an unaudited layer that silences already-spoken voice. We introduce a Voice Retention / Representation Ratio metric for representational bias in summarization and apply it to a bilingual (English/German) corpus of 2,586 free-text responses from a global professional service company. First, employees supply criticism more reliably than praise (withholding praise is 82 times more common). Second, across 45 leader-summaries the pipeline filters by popularity, not sentiment: criticism survives, yet a concern voiced once is dropped 86% of the time, with short and German-only content lost on the same axis (theme retention 0.14 vs 0.74; German directional). Controlling for frequency, sentiment has no independent effect; the harm is prevalence-driven, which sentiment-only audits miss. A targeted prompt recovers only named themes. We contribute the metric, field evidence, and a disaggregated voice-retention card.
10 pages, 3 figures, 3 tables. Accepted at the 60th Hawaii International Conference on System Sciences (HICSS 2027)
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
arXiv:2609.38818 [cs.AI]
(or arXiv:2609.38818v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.38818 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 277 words
Related coverage

Why I Left Google DeepMind
LessWrong · Jul 15, 2026
The J-Space Debate, Agent Swarms, and Pacing Frontier AI - Digital Minds Newsletter #4
LessWrong · Sep 18, 2026

Hegseth AutoWarCom: who builds it, what the money buys, and why its hardest problem after Minab is the record, not the model
livetradingnews.com · Oct 2, 2026

Thinking Machines, What Happened To The Connection Machine Company
Quantum Zeitgeist · Aug 5, 2026