Learning Robust Recommenders from Noisy Implicit Feedback via GMM-Weighted Bayesian Transition Matrix

Abstract:Label noise is a central challenge in learning from implicit feedback for recommendation. Conventional approaches discard noisy examples for robustness, but this sacrifices data efficiency. Unlike filtering approaches, Bayes-label transition matrix (BLTM) based methods keep all data, but their transition matrix estimates are skewed in practice. To reduce this skew, we introduce GMM-weighted Bayes-label Transition Matrix (RGBT), which augments BLTM with GMM-based instance weights. A GMM assigns each instance a reliability score, and these scores calibrate the BLTM to reduce bias. We show theoretically that RGBT retains all samples, yields consistent estimates, and provably reduces variance compared to CLTM, generalizing to any method with deterministic labels and non-negative weights. Experiments on real and synthetic datasets show that RGBT handles noisy samples more effectively than sample-selection methods, and calibrates the transition matrix more accurately than existing approaches.

Machine Learning (cs.LG)

arXiv:2605.20721 [cs.LG]

(or arXiv:2605.20721v3 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2605.20721 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.