aiqbench analysis
This paper examines how LLM-generated personas in a Twitter-like social simulation produce polarized networks, and finds that small changes in how survey answers are converted into persona text can shift outcomes from near-total segregation to cross-party ties resembling real networks. The authors argue that matching one aggregate pattern does not establish behavioral validity, and they propose salience (surveys treat every question as equally important) as a possible explanation. For readers building or evaluating LLM-based social simulations, the practical takeaway is that persona construction choices can drive results, so validation needs multiple checks.
From Caricature to Collective Artifact: How Persona Construction Drives Polarization in Generative Social Simulations
arXiv:2610.16498v1 Announce Type: cross Abstract: Generative Social Simulation (GSS) leverages Large Language Models (LLMs) to create sophisticated personas that define agents with demographics, emotions, and political opinions. While prior work shows that personas compress outputs into stereotypical caricatures, there is no comprehensive study of how these caricatures evolve into collective artifacts when they interact. Using a Twitter-like GSS platform with personas derived from the American National Elections Study (ANES), we ablate three layers of partisan identity: affective polarization markers, party identification, and vote choice, while retaining demographics, ideological positioning and important issues. We find that collective outcomes depend heavily on how survey responses are translated into personas. Removing a few explicitly partisan statements moves the network from near-complete segregation to cross-party ties approaching those of real Twitter networks. We argue that matching one outcome is not evidence for behavioral validity and point to salience as a possible explanation. Surveys ask for a position on every question regardless of its importance to the respondent, and persona construction turns each answer into a direct behavioral instruction. We conclude with a checklist for more comprehensive evaluation of personas in future works.
Abstract:Generative Social Simulation (GSS) leverages Large Language Models (LLMs) to create sophisticated personas that define agents with demographics, emotions, and political opinions. While prior work shows that personas compress outputs into stereotypical caricatures, there is no comprehensive study of how these caricatures evolve into collective artifacts when they interact. Using a Twitter-like GSS platform with personas derived from the American National Elections Study (ANES), we ablate three layers of partisan identity: affective polarization markers, party identification, and vote choice, while retaining demographics, ideological positioning and important issues. We find that collective outcomes depend heavily on how survey responses are translated into personas. Removing a few explicitly partisan statements moves the network from near-complete segregation to cross-party ties approaching those of real Twitter networks. We argue that matching one outcome is not evidence for behavioral validity and point to salience as a possible explanation. Surveys ask for a position on every question regardless of its importance to the respondent, and persona construction turns each answer into a direct behavioral instruction. We conclude with a checklist for more comprehensive evaluation of personas in future works.
Social and Information Networks (cs.SI); Artificial Intelligence (cs.AI)
arXiv:2610.16498 [cs.SI]
(or arXiv:2610.16498v1 [cs.SI] for this version)
https://doi.org/10.48550/arXiv.2610.16498 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 282 words
Related coverage

The basic argument for making AI better at moral philosophy
LessWrong · Oct 14, 2026

Game-Theoretic Disempowerment: Loss of Control to Agencyless AI
LessWrong · Sep 27, 2026
Synthetic document finetuning for instilling positive traits
AI Alignment Forum · Jun 16, 2026
RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos
arXiv · Jun 16, 2026