Exact Evaluation of the Accuracy of Diffusion Models for Inverse Problems with Gaussian Data Distributions

Abstract:Used as priors for Bayesian inverse problems, diffusion models have recently attracted considerable attention in the literature. Their flexibility and high variance enable them to generate multiple solutions for a given task, such as inpainting, super-resolution, and deblurring. However, there is still a lack of understanding about how accurately these conditional diffusion algorithms perform conditional sampling. In this article, we investigate the errors induced by these models when applied to a Gaussian data distribution for which the score function is exactly known. Within this constrained context, we are able to precisely analyze the discrepancy between the theoretical resolution of inverse problems via conditional sampling and the practical distributions generated by conditional diffusion models. This is done by characterizing all the involved iterative Gaussian processes and by computing the exact Wasserstein distance between the distributions of the diffusion model samplers and the ideal conditional distribution associated with the inverse problem. Our findings allow for the comparison of two major algorithms from the literature, Deep Posterior Sampling (DPS) and Pseudo-inverse Guided Diffusion Models ($\Pi$GDM), and the introduction of the new paradigm Conditional Gaussian Diffusion Models (CGDM) that is shown to be more accurate for Gaussian data distributions.

Machine Learning (cs.LG)

arXiv:2507.07008 [cs.LG]

(or arXiv:2507.07008v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2507.07008 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.