Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs

Title:Who Laughs with Whom? Disentangling Influential Factors in Humor Preferences across User Clusters and LLMs

Abstract:Humor preferences vary widely across individuals and cultures, complicating the evaluation of humor using large language models (LLMs). In this study, we model heterogeneity in humor preferences in Oogiri, a Japanese creative response game, by clustering users with voting logs and estimating cluster-specific weights over interpretable preference factors using Bradley-Terry-Luce models. We elicit preference judgments from LLMs by prompting them to select the funnier response and found that user clusters exhibit distinct preference patterns and that the LLM results can resemble those of particular clusters. Finally, we demonstrate that, by persona prompting, LLM preferences can be directed toward a specific cluster. The scripts for data collection and analysis are publicly available to support reproducibility.

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

arXiv:2601.03103 [cs.CL]

(or arXiv:2601.03103v2 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2601.03103 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.