Skip to content
aiqbench takeAI Products

aiqbench analysis

This research addresses the challenge of personalizing generative user interfaces (GenUIs) by leveraging sparse, subjective human feedback to weight prior user preferences rather than relying on fixed design rubrics. The proposed sample-efficient method successfully adapts generated screens to individual needs, outperforming both pretrained evaluators and larger multimodal models in offline benchmarks and online user studies. By effectively handling the inherent subjectivity of interface judgments, this work advances the practical deployment of adaptive GenUIs for diverse user populations.
Sources coveringarXiv, AI Alignment Forum, Fortune, Quantum Computing Report
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Efficient Personalization of Generative User Interfaces

arXiv2 min read

arXiv:2604.09876v2 Announce Type: replace-cross Abstract: Generative user interfaces (GenUIs) create new opportunities to adapt interfaces to individual users on demand. Yet personalization is difficult because it is not possible to provide settings for screens that have not yet been generated, making it necessary to learn preferences from users' feedback on generated interfaces. Such feedback is sparse, subjective, and often difficult to articulate. We study this problem through a new dataset in which 20 participants each judge the same 600 pairs of GenUIs. Their judgments differ substantially (Krippendorff's alpha = 0.25), and written rationales show that even when participants consider similar UI properties, such as color tone or hierarchy, they often make different choices and prioritize them differently. We develop a sample-efficient personalization method that uses a few pairwise judgments to weight prior users' preferences rather than relying on a fixed rubric of UI attributes. Our method outperforms a pretrained UI evaluator and a larger multimodal model offline. In an online study with 12 new users, participants preferred interfaces personalized by our method over all baselines, including shared guidelines and users' own written preferences.

Abstract:Generative user interfaces (GenUIs) create new opportunities to adapt interfaces to individual users on demand. Yet personalization is difficult because it is not possible to provide settings for screens that have not yet been generated, making it necessary to learn preferences from users' feedback on generated interfaces. Such feedback is sparse, subjective, and often difficult to articulate. We study this problem through a new dataset in which 20 participants each judge the same 600 pairs of GenUIs. Their judgments differ substantially (Krippendorff's alpha = 0.25), and written rationales show that even when participants consider similar UI properties, such as color tone or hierarchy, they often make different choices and prioritize them differently. We develop a sample-efficient personalization method that uses a few pairwise judgments to weight prior users' preferences rather than relying on a fixed rubric of UI attributes. Our method outperforms a pretrained UI evaluator and a larger multimodal model offline. In an online study with 12 new users, participants preferred interfaces personalized by our method over all baselines, including shared guidelines and users' own written preferences.

Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

arXiv:2604.09876 [cs.LG]

(or arXiv:2604.09876v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2604.09876 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 282 words

Related coverage