Improving Federated Graph Recommendation with Semantic Guidance

arXiv:2606.15277v2 Announce Type: replace-cross Abstract: Graph-based recommendation models effectively capture high-order collaborative signals from user--item interaction graphs. Federated learning (FL) enables privacy-preserving training across distributed clients. However, directly aggregating graph representations under FL is challenging: locally learned structural embeddings are not globally aligned under non-IID data distributions, and naive parameter averaging fails to recover cross-client relational structure. Existing federated graph-based approaches primarily rely on structural aggregation, yet overlook the global semantic knowledge encoded in large language models (LLMs). In this work, we propose a semantic--structural federated graph recommendation framework that leverages LLM embeddings to guide cross-client alignment. Each client learns user representations from its local interaction graph and summarizes typical interaction patterns into compact semantic vectors using a frozen LLM encoder. These vectors are sent to the server, which identifies semantically related patterns across different clients and combines their structural representations accordingly. The updated representations are then returned to clients to refine subsequent local training. This design enables collaboration guided by shared semantic understanding without exposing raw interaction data, preserving both recommendation accuracy and privacy. Experiments on benchmark datasets demonstrate consistent improvements over existing federated graph-based baselines.

Abstract:Graph-based recommendation models effectively capture high-order collaborative signals from user--item interaction graphs. Federated learning (FL) enables privacy-preserving training across distributed clients. However, directly aggregating graph representations under FL is challenging: locally learned structural embeddings are not globally aligned under non-IID data distributions, and naive parameter averaging fails to recover cross-client relational structure. Existing federated graph-based approaches primarily rely on structural aggregation, yet overlook the global semantic knowledge encoded in large language models (LLMs). In this work, we propose a semantic--structural federated graph recommendation framework that leverages LLM embeddings to guide cross-client alignment. Each client learns user representations from its local interaction graph and summarizes typical interaction patterns into compact semantic vectors using a frozen LLM encoder. These vectors are sent to the server, which identifies semantically related patterns across different clients and combines their structural representations accordingly. The updated representations are then returned to clients to refine subsequent local training. This design enables collaboration guided by shared semantic understanding without exposing raw interaction data, preserving both recommendation accuracy and privacy. Experiments on benchmark datasets demonstrate consistent improvements over existing federated graph-based baselines.

Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Databases (cs.DB); Emerging Technologies (cs.ET); Machine Learning (cs.LG)

arXiv:2606.15277 [cs.IR]

(or arXiv:2606.15277v2 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2606.15277 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

aiqbench analysis

Improving Federated Graph Recommendation with Semantic Guidance

Related coverage