analiza aiqbench
This research identifies "persona collapse," a fundamental limitation where LLMs fail to generate diverse population-level behaviors despite having detailed human profiles, instead clustering responses into narrow classes. The study quantifies this phenomenon using metrics like coverage and uniformity, revealing a tradeoff where higher fidelity per persona leads to more polarized populations that cannot be fixed by simple sampling or fine-tuning. For researchers building multi-agent simulations or synthetic data, these findings highlight critical structural constraints in current model architectures that affect the realism of emergent societal dynamics.
The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Models
arXiv:2604.24698v2 Announce Type: replace Abstract: Large language models (LLMs) have powered multi-agent simulations such as survey respondents or application users. However, LLMs lack the population-level diversity required by these simulations---responses from LLMs with detailed human profiles cluster into classes, unlike human responses that uniformly fill the entire space. In this paper, we formalize this as Persona Collapse and quantify its population-level structure with three diagnostic metrics: Coverage (how much of the persona space is occupied), Uniformity (how evenly agents spread across it), and Complexity (how rich the resulting behaviors are). Across eight LLMs on personality (BFI-44), moral reasoning, and self-introduction, persona collapse is universal but task-dependent: CoSER-Llama-8B collapses the most in personality while being the most diverse in moral reasoning. Moreover, sampling more personas cannot mitigate the collapse. We further show a fidelity--diversity tradeoff: the models with the highest per-persona fidelity produce the most polarized populations. Finally, persona-targeted fine-tuning further narrows the population instead of diversifying it.
Abstract:Large language models (LLMs) have powered multi-agent simulations such as survey respondents or application users. However, LLMs lack the population-level diversity required by these simulations---responses from LLMs with detailed human profiles cluster into classes, unlike human responses that uniformly fill the entire space. In this paper, we formalize this as Persona Collapse and quantify its population-level structure with three diagnostic metrics: Coverage (how much of the persona space is occupied), Uniformity (how evenly agents spread across it), and Complexity (how rich the resulting behaviors are). Across eight LLMs on personality (BFI-44), moral reasoning, and self-introduction, persona collapse is universal but task-dependent: CoSER-Llama-8B collapses the most in personality while being the most diverse in moral reasoning. Moreover, sampling more personas cannot mitigate the collapse. We further show a fidelity--diversity tradeoff: the models with the highest per-persona fidelity produce the most polarized populations. Finally, persona-targeted fine-tuning further narrows the population instead of diversifying it.
Computation and Language (cs.CL)
arXiv:2604.24698 [cs.CL]
(or arXiv:2604.24698v2 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2604.24698 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 245 cuvinte
Subiecte conexe

Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face
AI Alignment Forum · 3 aug. 2026
Building and evaluating model diffing agents
AI Alignment Forum · 12 iun. 2026
The Multilingual Artificial Hivemind: Do All LLMs Think Alike in Every Language?
arXiv · 14 oct. 2026
Beyond the Hivemind: Escaping LLM Homogeneity via Meta-Persona Anchoring and Sequential Temperature Scaling
arXiv · 6 aug. 2026