aiqbench analysis
This research presents "Demographic Pluralism," an inference-time framework designed to improve LLM alignment by capturing within-group variation in diverse populations without requiring specific training data or fine-tuning. By generating multiple perspectives grounded in demographic attributes, the method significantly reduces distributional error compared to existing modular approaches, offering a practical solution for culturally sensitive applications.
Demographic Pluralism: Inference-Time Modeling of Pluralistic Human Preference Distributions
arXiv:2609.38555v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly used in culturally sensitive settings, where alignment requires representing diverse preferences within populations. Yet existing methods model populations at coarse demographic or community levels and overlook within-group variation. We introduce Demographic Pluralism, an inference-time framework that estimates population-level opinion distributions without opinion-distribution training data or task-specific fine-tuning by generating multiple perspectives within demographically grounded groups. Across four backbones on GlobalOpinionQA and VITAL, it reduces Jensen-Shannon distance by 8.4%-26.4% over Modular Pluralism. Among weighted, equal-weighted, and inverse-weighted aggregation, equal weighting performs best overall; group-level error also increases with group weight, helping explain weighted aggregation's weaker performance.
Abstract:Large language models (LLMs) are increasingly used in culturally sensitive settings, where alignment requires representing diverse preferences within populations. Yet existing methods model populations at coarse demographic or community levels and overlook within-group variation. We introduce Demographic Pluralism, an inference-time framework that estimates population-level opinion distributions without opinion-distribution training data or task-specific fine-tuning by generating multiple perspectives within demographically grounded groups. Across four backbones on GlobalOpinionQA and VITAL, it reduces Jensen-Shannon distance by 8.4%-26.4% over Modular Pluralism. Among weighted, equal-weighted, and inverse-weighted aggregation, equal weighting performs best overall; group-level error also increases with group weight, helping explain weighted aggregation's weaker performance.
Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
arXiv:2609.38555 [cs.AI]
(or arXiv:2609.38555v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2609.38555 Focus to learn more arXiv-issued DOI via DataCite (pending registration)
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 199 words
Related coverage

Hint-based CoT faithfulness evals still mostly work on Claude
LessWrong · Jul 30, 2026
Against Export Controls (and China Threat Models)
LessWrong · Sep 24, 2026

NVIDIA GTC Taipei at COMPUTEX: Live Updates on What’s Next in AI
NVIDIA · May 21, 2026
How robust are natural language autoencoders to initialization?
AI Alignment Forum · Jul 10, 2026