Skip to content
aiqbench takeMachine Learning

aiqbench analysis

This research advances the scalability of Determinantal Point Processes (DPPs) by introducing a stochastic optimization framework that utilizes nonlinear kernels and latent features to bypass traditional low-rank constraints. The proposed method effectively balances expressive power with computational efficiency, demonstrating superior generalization on real-world datasets without sacrificing parameter economy. This work represents a significant step forward in handling full-rank interactions for large-scale probabilistic modeling tasks.
Source coveringarXiv
What this isA model's reading of the article and related coverage, written for aiqbench. Not the publisher's words.

Scalable Learning of Determinantal Point Processes with Kernel-Structured Interactions

arXiv2 min read

arXiv:2610.12829v1 Announce Type: cross Abstract: Determinantal point processes (DPPs) on a finite set are probability models that exhibit repulsion where inter-item similarities are encoded by a positive definite kernel matrix. Scaling DPP learning to large datasets typically requires imposing structural constraints on the kernel matrix, such as a low-rank-plus-diagonal form. However, structural assumptions introduce a severe trade-off between expressive power and computational scalability. Our study addresses this challenge by (a) modeling the full-rank interactions via a nonlinear kernel function and latent features, (b) designing a surrogate function for the maximum likelihood estimator, and (c) adopting stochastic optimization using random features of the nonlinear kernel. Numerical experiments on real-world datasets demonstrate that our method significantly improves this trade-off, achieving better generalization performance with remarkable parameter efficiency.

Abstract:Determinantal point processes (DPPs) on a finite set are probability models that exhibit repulsion where inter-item similarities are encoded by a positive definite kernel matrix. Scaling DPP learning to large datasets typically requires imposing structural constraints on the kernel matrix, such as a low-rank-plus-diagonal form. However, structural assumptions introduce a severe trade-off between expressive power and computational scalability. Our study addresses this challenge by (a) modeling the full-rank interactions via a nonlinear kernel function and latent features, (b) designing a surrogate function for the maximum likelihood estimator, and (c) adopting stochastic optimization using random features of the nonlinear kernel. Numerical experiments on real-world datasets demonstrate that our method significantly improves this trade-off, achieving better generalization performance with remarkable parameter efficiency.

Machine Learning (stat.ML); Machine Learning (cs.LG)

arXiv:2610.12829 [stat.ML]

(or arXiv:2610.12829v1 [stat.ML] for this version)

https://doi.org/10.48550/arXiv.2610.12829 Focus to learn more arXiv-issued DOI via DataCite (pending registration)

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Full text under the publisher's open licence · 217 words

Related coverage