analiza aiqbench
EquiReg introduces a novel framework that regularizes diffusion model trajectories to stay on the data manifold, effectively addressing the limitations of Gaussian approximations in inverse problems. This approach significantly enhances reconstruction quality for image restoration and PDE solving, particularly when sampling steps are reduced. By leveraging symmetry-preserving functions, the method offers a practical improvement over standard likelihood-based solvers without requiring complex likelihood calculations.
EquiReg: Equivariance Regularized Diffusion for Inverse Problems
arXiv:2505.22973v3 Announce Type: replace-cross Abstract: Diffusion models represent the state-of-the-art for solving inverse problems such as image restoration tasks. Diffusion-based inverse solvers incorporate a likelihood term to guide prior sampling, generating data consistent with the posterior distribution. However, due to the intractability of the likelihood, most methods rely on isotropic Gaussian approximations, which can push estimates off the data manifold and produce inconsistent, poor reconstructions. We propose Equivariance Regularized (EquiReg) diffusion, a general plug-in framework that improves posterior sampling by penalizing trajectories that deviate from the data manifold. EquiReg formalizes manifold-preferential equivariant functions that exhibit low equivariance error for on-manifold samples and high error for off-manifold ones, thereby guiding sampling toward symmetry-preserving regions of the solution space. We highlight that such functions naturally emerge when training non-equivariant models with augmentation or on data with symmetries. EquiReg's largest gains are under reduced sampling and measurement consistency steps, where many methods suffer severe quality degradation. By regularizing trajectories toward the manifold, EquiReg implicitly accelerates convergence and enables high-quality reconstructions. EquiReg consistently improves performance in linear and nonlinear image restoration tasks and solving partial differential equations. Our code is available at https://github.com/Anima-Lab/EquiReg
Abstract:Diffusion models represent the state-of-the-art for solving inverse problems such as image restoration tasks. Diffusion-based inverse solvers incorporate a likelihood term to guide prior sampling, generating data consistent with the posterior distribution. However, due to the intractability of the likelihood, most methods rely on isotropic Gaussian approximations, which can push estimates off the data manifold and produce inconsistent, poor reconstructions. We propose Equivariance Regularized (EquiReg) diffusion, a general plug-in framework that improves posterior sampling by penalizing trajectories that deviate from the data manifold. EquiReg formalizes manifold-preferential equivariant functions that exhibit low equivariance error for on-manifold samples and high error for off-manifold ones, thereby guiding sampling toward symmetry-preserving regions of the solution space. We highlight that such functions naturally emerge when training non-equivariant models with augmentation or on data with symmetries. EquiReg's largest gains are under reduced sampling and measurement consistency steps, where many methods suffer severe quality degradation. By regularizing trajectories toward the manifold, EquiReg implicitly accelerates convergence and enables high-quality reconstructions. EquiReg consistently improves performance in linear and nonlinear image restoration tasks and solving partial differential equations. Our code is available at this https URL
Machine Learning (cs.LG); Artificial Intelligence (cs.AI)
arXiv:2505.22973 [cs.LG]
(or arXiv:2505.22973v3 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2505.22973 Focus to learn more arXiv-issued DOI via DataCite
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Text integral sub licența deschisă a publicației · 281 cuvinte
Subiecte conexe
Score-based diffusion models for severely ill-posed problems in diffuse optical tomography
arXiv · 18 sept. 2026
A Gradient Flow Approach to Solving Inverse Problems with Latent Diffusion Models
arXiv · 17 sept. 2026
EDISCO: Equivariant DIScrete Diffusion for Euclidean Combinatorial Optimization
arXiv · 7 oct. 2026
Perceptually Regularized Diffusion Model for Image Super-Resolution
arXiv · 3 sept. 2026