analiza aiqbench
This paper establishes the first comprehensive safety-aware review for personalized LLMs, addressing the critical gap where existing literature treats personalization and safety in isolation. By introducing a unified taxonomy that covers risks across user representations, fine-tuning methods, and agent frameworks, it highlights structural inadequacies in current evaluation metrics that fail to capture emergent long-term relational risks. The work provides a necessary framework for developers to systematically mitigate vulnerabilities inherent in diverse personalization paradigms before they scale within agent ecosystems.
Personalization Meets Safety:Mechanisms,Risks,and Mitigations in Personalized LLMs
arXiv:2606.09038v1 Announce Type: new Abstract: Large Language Models (LLMs) have enabled increasingly personalized interactions by adapting to users' preferences, contexts, and long-term histories. However, the mechanisms that enable personalization also expand the safety landscape in ways not systematically addressed by existing literature. Existing reviews typically focus either on personalization or safety, leaving their intersection largely unexplored. We present the first comprehensive, safety-aware review of personalized LLMs. We organize personalization along three dimensions-user representation, personalization paradigm, and evaluation-and introduce a unified taxonomy of safety risks. At the representation level, we analyze risks arising from diverse user representations. Across mainstream personalization paradigms, we delineate vulnerabilities inherent to prompting, retrieval augmentation, parameter fine-tuning, reinforcement learning, Mixture-of-Experts (MoE), pruning, agent frameworks, and multimodal personalization, and synthesize mitigation strategies across the model lifecycle. Beyond these fine-grained risks, we characterize paradigm-agnostic safety risks arising from personalized adaptation. We further summarize personalized datasets and evaluation methodologies. Through a case study of OpenClaw, we analyze deployment trends in personalized agent ecosystems. Our analysis reveals three structural inadequacies in existing research: safety is evaluated as user-invariant rather than relational, personalization techniques are analyzed in isolation rather than in composition, and evaluation frameworks cannot capture emergent long-term risks. By jointly examining personalized representations, personalization paradigms, safety risks, defenses, and evaluation methods, we provide a unified framework for developing safe personalized LLMs and highlight key directions for future research.
Abstract:Large Language Models (LLMs) have enabled increasingly personalized interactions by adapting to users' preferences, contexts, and long-term histories. However, the mechanisms that enable personalization also expand the safety landscape in ways not systematically addressed by existing literature. Existing reviews typically focus either on personalization or safety, leaving their intersection largely unexplored. We present the first comprehensive, safety-aware review of personalized LLMs. We organize personalization along three dimensions-user representation, personalization paradigm, and evaluation-and introduce a unified taxonomy of safety risks. At the representation level, we analyze risks arising from diverse user representations. Across mainstream personalization paradigms, we delineate vulnerabilities inherent to prompting, retrieval augmentation, parameter fine-tuning, reinforcement learning, Mixture-of-Experts (MoE), pruning, agent frameworks, and multimodal personalization, and synthesize mitigation strategies across the model lifecycle. Beyond these fine-grained risks, we characterize paradigm-agnostic safety risks arising from personalized adaptation. We further summarize personalized datasets and evaluation methodologies. Through a case study of OpenClaw, we analyze deployment trends in personalized agent ecosystems. Our analysis reveals three structural inadequacies in existing research: safety is evaluated as user-invariant rather than relational, personalization techniques are analyzed in isolation rather than in composition, and evaluation frameworks cannot capture emergent long-term risks. By jointly examining personalized representations, personalization paradigms, safety risks, defenses, and evaluation methods, we provide a unified framework for developing safe personalized LLMs and highlight key directions for future research.
Artificial Intelligence (cs.AI)
arXiv:2606.09038 [cs.AI]
(or arXiv:2606.09038v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2606.09038 arXiv-issued DOI via DataCite (pending registration)
Text integral sub licența deschisă a publicației · 241 cuvinte
Subiecte conexe

14 Human-in-the-Loop Patterns for AI Agents
Akka Blog · 4 nov. 2026

14 Human Oversight Patterns for AI Systems
Akka Blog · 1 nov. 2026
A Red Line and Oversight Framework for Government AI Contracts
AI Alignment Forum · 18 iul. 2026

Is your chatbot less helpful because it thinks you’re a bad person? — Replicating a blogpost
LessWrong · 1 nov. 2026