analiza aiqbench
This research advances the theoretical foundations of constrained sampling by unifying analyses for overdamped and kinetic Langevin diffusions using a generalized proximal framework. The authors establish near-optimal convergence guarantees in Wasserstein distances for randomized midpoint discretizations, refining bounds for both vanilla and kinetic Monte Carlo methods under convex constraints. These results provide critical insights into improving the efficiency and accuracy of diffusion-based sampling algorithms used in high-dimensional machine learning applications.
Randomized Midpoint Method for Log-Concave Sampling under Constraints
arXiv:2405.15379v3 Announce Type: replace-cross Abstract: In this paper, we study the problem of sampling from log-concave distributions supported on convex and compact sets, with a particular focus on the randomized midpoint discretization of both overdamped and kinetic Langevin diffusions in constrained domains. We revisit the proximal framework for handling constraints through projection operators and develop a more general formulation that encompasses Euclidean, Bregman, and Gauge projections. The resulting smooth approximation allows a unified and tractable analysis of Langevin algorithms and their variants under constraints. Within this framework, we establish convergence guarantees in Wasserstein-$q$ $(q\geqslant 1)$ distances between the smooth surrogate and the target distribution. We further derive complementary lower bounds, showing that the results are near-optimal in order. Building upon this tight approximation analysis, we obtain new convergence guarantees for the randomized midpoint Langevin algorithms and refined bounds for both vanilla and kinetic Langevin Monte Carlo methods under constraints, thereby advancing the theoretical understanding of constrained diffusion-based sampling.
Abstract:In this paper, we study the problem of sampling from log-concave distributions supported on convex and compact sets, with a particular focus on the randomized midpoint discretization of both overdamped and kinetic Langevin diffusions in constrained domains. We revisit the proximal framework for handling constraints through projection operators and develop a more general formulation that encompasses Euclidean, Bregman, and Gauge projections. The resulting smooth approximation allows a unified and tractable analysis of Langevin algorithms and their variants under constraints. Within this framework, we establish convergence guarantees in Wasserstein-$q$ $(q\geqslant 1)$ distances between the smooth surrogate and the target distribution. We further derive complementary lower bounds, showing that the results are near-optimal in order. Building upon this tight approximation analysis, we obtain new convergence guarantees for the randomized midpoint Langevin algorithms and refined bounds for both vanilla and kinetic Langevin Monte Carlo methods under constraints, thereby advancing the theoretical understanding of constrained diffusion-based sampling.
Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR); Statistics Theory (math.ST)
arXiv:2405.15379 [stat.ML]
(or arXiv:2405.15379v3 [stat.ML] for this version)
Text integral sub licența deschisă a publicației · 172 cuvinte
Subiecte conexe
Building and evaluating model diffing agents
AI Alignment Forum · 12 iun. 2026
Exploding variance of means of exponentials: least-squares to the rescue – Machine Learning Research Blog
francisbach.com · 27 sept. 2026
Promptimus: Improving already good LLM prompts with zero manual engineering
Amazon Science · 14 mai 2026
Benchmarking Hybrid Quantum-Classical Algorithms for Power Grid Optimization Problems
arXiv · 20 iul. 2026