aiqbench analysis
The paper studies whether LLMs that emulate voters represent different demographic groups with different accuracy, using three U.S. presidential elections and two models. Its findings are that removing gender or education from voter profiles reduces the worst-group error, while removing self-reported race increases it, and that common alignment fixes like repeated queries or fairness instructions fail or make errors worse. These are unreviewed preprint results, but they suggest that simple prompt-level mitigations may not deliver fairness in synthetic-electorate tools, so evaluation should be group-specific rather than based on aggregate accuracy.
AI Alignment for Digital Democracy: Fairer Voters Representation against LLM Biases
arXiv:2610.32780v1 Announce Type: cross Abstract: AI representation is emerging in digital democracy, assisting in voter emulation and decision-making. Large language models (LLMs) behave differently depending on the model, the prompt context, and the voter information they receive, representing some groups more accurately than others and potentially making the emulation unfair to certain groups. We investigate demographic biases in LLM-emulated electorates: how accurately LLMs represent individual votes, whether some voter groups are represented more accurately than others, and whether AI alignment can reduce these disparities without sacrificing overall accuracy. Using three U.S. presidential elections, we compare a closed-source and an open-source LLM across voters' demographic features and test AI alignment strategies toward fairer voter representation. Removing gender from the voter profile reduces the largest group error of the models by 22-42%, and removing education reduces it by 64%, whereas removing self-reported race increases the mean group error by over 40%, all without lowering accuracy. Common alignment strategies, such as repeated queries or fairness instructions, do not reduce these errors and can double them.
Abstract:AI representation is emerging in digital democracy, assisting in voter emulation and decision-making. Large language models (LLMs) behave differently depending on the model, the prompt context, and the voter information they receive, representing some groups more accurately than others and potentially making the emulation unfair to certain groups. We investigate demographic biases in LLM-emulated electorates: how accurately LLMs represent individual votes, whether some voter groups are represented more accurately than others, and whether AI alignment can reduce these disparities without sacrificing overall accuracy. Using three U.S. presidential elections, we compare a closed-source and an open-source LLM across voters' demographic features and test AI alignment strategies toward fairer voter representation. Removing gender from the voter profile reduces the largest group error of the models by 22-42%, and removing education reduces it by 64%, whereas removing self-reported race increases the mean group error by over 40%, all without lowering accuracy. Common alignment strategies, such as repeated queries or fairness instructions, do not reduce these errors and can double them.
Computers and Society (cs.CY); Artificial Intelligence (cs.AI)
arXiv:2610.32780 [cs.CY]
(or arXiv:2610.32780v1 [cs.CY] for this version)
https://doi.org/10.48550/arXiv.2610.32780 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 265 words
Related coverage
Cross-Lingual Representation Alignment by Token-Level Optimal Transport in a Language-Agnostic Space
arXiv · Sep 9, 2026
RouteREPA: Routed Representation Alignment for Just Image Transformers
arXiv · Nov 3, 2026
Bidirectional representational alignment between biological and artificial neural networks
arXiv · Aug 21, 2026
Geometric Alignment without Functional Equivalence: A Layer-wise Analysis of the Speech-Text Modality Gap
arXiv · Oct 15, 2026