aiqbench analysis
This research demonstrates the application of Large Language Models and fine-tuned encoders to extract latent human values from unstructured social media text, validating a theoretical framework against survey data with high congruence. By leveraging massive datasets from VKontakte, the study establishes a scalable method for analyzing population-level motivations without relying solely on biased questionnaires. The work highlights how advanced NLP techniques can bridge the gap between spontaneous digital communication and established psychological theories of value expression.
Structure of Basic Human Values in Russian Social Media
arXiv:2603.18822v2 Announce Type: replace Abstract: What is known about the values of national populations rests almost entirely on questionnaires, which prompt respondents to rate researcher-supplied descriptions of each motivation. Social media instead records values as they are invoked spontaneously, in communication addressed to a real audience. We measure value expression in broadly sampled, heterogeneous Russian-language social-media data, where value-relevant content is sparse and often ambiguous, and read the result against the survey-based profile of the same population. To address subjectivity in value interpretation, we compare alternative LLM-prompt configurations against expert judgments and use error-driven calibration to select a theory-based operationalization. Using VKontakte data collected from one million randomly generated user IDs, comprising 7.5 million public text posts, we develop a multi-stage framework combining candidate selection, repeated LLM annotation, and transfer to an XLM-RoBERTa encoder for large-scale prediction (a macro PR-AUC of .60 on the expert benchmark, with continuous scores positively correlated with graded expert confidence across all ten values). The circular structure proposed by Schwartz is largely recovered (congruence .95 at the post level, .94 at the user level). The aggregate profile agrees with survey findings at the anchors - Benevolence highest and broadly distributed across users, Power lowest - but shows relatively elevated Hedonism and relatively low Universalism. Universalism is further displaced structurally, co-expressed with Security and Tradition and concentrated in the output of highly active users.
Abstract:What is known about the values of national populations rests almost entirely on questionnaires, which prompt respondents to rate researcher-supplied descriptions of each motivation. Social media instead records values as they are invoked spontaneously, in communication addressed to a real audience. We measure value expression in broadly sampled, heterogeneous Russian-language social-media data, where value-relevant content is sparse and often ambiguous, and read the result against the survey-based profile of the same population. To address subjectivity in value interpretation, we compare alternative LLM-prompt configurations against expert judgments and use error-driven calibration to select a theory-based operationalization. Using VKontakte data collected from one million randomly generated user IDs, comprising 7.5 million public text posts, we develop a multi-stage framework combining candidate selection, repeated LLM annotation, and transfer to an XLM-RoBERTa encoder for large-scale prediction (a macro PR-AUC of .60 on the expert benchmark, with continuous scores positively correlated with graded expert confidence across all ten values). The circular structure proposed by Schwartz is largely recovered (congruence .95 at the post level, .94 at the user level). The aggregate profile agrees with survey findings at the anchors - Benevolence highest and broadly distributed across users, Power lowest - but shows relatively elevated Hedonism and relatively low Universalism. Universalism is further displaced structurally, co-expressed with Security and Tradition and concentrated in the output of highly active users.
Computation and Language (cs.CL)
arXiv:2603.18822 [cs.CL]
(or arXiv:2603.18822v2 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2603.18822 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Full text under the publisher's open licence · 316 words
Related coverage
Links #3: 2026/06 Part 1
LessWrong · Jun 15, 2026

A Chinese Perspective on “On Social Reality in China”
LessWrong · Oct 15, 2026

Why the DOJ’s OpenAI copyright stance is the real threat to national security
ZDNet · Sep 15, 2026

Can Cloudflare CEO Matthew Prince save the web from AI?
The Verge · Sep 26, 2026