REVIEW 3 major objections 7 minor 31 references
Exact Evaluation of the Accuracy of Diffusion Models for Inverse Problems with Gaussian Data Distributions
T0 review · 3 major / 7 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read For Gaussian data, CGDM—which uses the exact noisy-likelihood covariance—produces conditional samples closest to the true posterior by exact 2-Wasserstein distance.
desk verdict Solid analytic benchmark for conditional diffusion samplers, with a real new covariance formula — but the printed recursions have typos that must be fixed before the W2 curves can be trusted. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the exact noisy-likelihood covariance $C^{\mathrm{CGDM}}_{v|t} = (1-\alpha_t)A\Sigma\Sigma_t^{-1}A^T + \sigma^2 I$ with $\Sigma_t = \alpha_t\Sigma + (1-\alpha_t)I$. This is the true covariance of $p_t(v|x_t)$ under the Gaussian prior; DPS and PiGDM replace it with $\sigma^2 I$ and $(1-\alpha_t)AA^T+\sigma^2 I$, respectively. The argument's engine is that with a Gaussian prior all forward and backward processes remain Gaussian, so Algorithm 5 recursively propagates exact covariance matrices and the 2-Wasserstein distance between two Gaussians has the closed form in Eq. (51)--(52). For deblurring Gaussian microtextures, Proposition 1 shows the three algorithms' backward covariances share a common Fourier eigenbasis with $\Sigma$, letting the Wasserstein calculation be done frequency by frequency.
What would settle it
Run the three algorithms on an exactly Gaussian prior with the exact score and a linear operator where $\Sigma$ and $A$ do not share an eigenbasis, computing the full-matrix 2-Wasserstein distance of the final backward samples to $p(x_0|v)$; any case where PiGDM or DPS beats CGDM would contradict the claimed ordering, as would a per-channel blur experiment in which the ranking changes.
Extended reading notes
Core claim
Under the Gaussian assumption, the noisy likelihood $p_t(v|x_t)$ is exactly Gaussian with covariance $C^{\mathrm{CGDM}}_{v|t} = (1-\alpha_t)A\Sigma\Sigma_t^{-1}A^T + \sigma^2 I$ (Eq. 32, 34), where $\Sigma_t = \alpha_t\Sigma + (1-\alpha_t)I$. The paper's central claim is that plugging this exact covariance into the conditional backward step defines a new algorithm, CGDM, whose final samples minimize the exact 2-Wasserstein distance to the true conditional distribution among CGDM, PiGDM, and DPS. DPS, which effectively fixes the covariance to $\sigma^2 I$, systematically underestimates it and produces biased, unstable posterior samples; PiGDM, which uses $(1-\alpha_t)AA^T + \sigma^2 I$, is closer but still omits the prior covariance structure. The exact recursive Gaussian characterizations of the backward processes make this ranking quantitative: DPS errors reach above $10^1$ in the toy example while CGDM stays in the $10^{-3}$--$10^{-2}$ range, and the same ordering persists in deblurring experiments on Gaussian microtextures. CGDM is not exactly equal to the ideal posterior sampler because the backward initialization and noise covariance remain approximate, but its error is far smaller than the alternatives.
Load-bearing premise
The ranking and bias magnitudes are only defined for exactly Gaussian priors with known covariance and exact scores, and the efficient deblurring recipe additionally requires the same blur kernel on every channel.
Editorial extensions
If this is right
- For Gaussian deblurring, the exact ordering of conditional-sampling accuracy is CGDM better than PiGDM better than DPS at essentially every diffusion time, across the tested bicubic and motion blur kernels.
- DPS's severe covariance underestimation explains its known instability: with $\alpha_{\mathrm{DPS}}=1$ the gradient is divided by an artificially small variance, so reducing it (here to 0.2) is needed for stability, and even then a final-time bias remains.
- PiGDM approaches the exact posterior near $t=0$ because its covariance model converges to the true one there, while CGDM remains the lowest-error choice throughout the diffusion path.
- PiGDM is the computationally efficient fallback when the full Gaussian covariance cannot be inverted quickly, whereas CGDM's exact Gaussian computations are significantly more expensive.
- For super-resolution with Gaussian microtextures, preliminary bias computations show the same ranking, but the full method requires approximations because the subsampling operator breaks simultaneous diagonalizability.
Reading between the lines
- If the Gaussian ranking reflects behavior beyond this toy regime, it suggests that covariance mismatch rather than score-estimation error is a primary source of posterior bias in conditional diffusion sampling; this is a hypothesis the paper does not test on natural images.
- A practical diagnostic for real-world use would be to estimate the noisy-likelihood covariance empirically and compare its spectrum with the constant $\sigma^2 I$ assumption of DPS; datasets where the ratio is large should show the largest DPS bias.
- Because the exact covariance requires $\Sigma$, CGDM is practical mainly when a structured prior covariance is known, such as texture models; extending it to learned priors would require approximating $\Sigma$, which is not analyzed.
- The final-time alignment of DPS and PiGDM with the true posterior hints that bias corrections matter most at intermediate diffusion steps, suggesting schedule-dependent tuning rather than uniform hyperparameter scaling.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper analyzes conditional DDPM-based samplers for linear inverse problems under the assumption that the prior p0 is Gaussian N(µ, Σ). The authors derive the exact noisy-likelihood covariance C_v|t = (1−α_t) AΣΣ_t^{-1}A^T + σ²I, introduce CGDM as the algorithm using this exact covariance, and derive closed-form recursions for the backward means and covariances of DPS, ΠGDM, and CGDM. They then compute exact 2-Wasserstein distances between the samplers' output distributions and the true conditional forward distribution, both in low-dimensional Gaussian examples and in deblurring experiments on Gaussian microtextures. The central claim is that, under the Gaussian assumption, CGDM achieves the smallest exact W2 error, ΠGDM is intermediate and computationally cheaper, and DPS severely underestimates the likelihood covariance and becomes unstable unless its α_DPS parameter is reduced. The paper is clearly structured and explicitly acknowledges the restrictiveness of its Gaussian assumption.
Significance. If the stated results hold, the paper provides a valuable controlled testbed for conditional diffusion sampling: closed-form expressions enable exact W2 evaluation, and the comparison exposes structural reasons for DPS's and ΠGDM's posterior bias. The strengths are the explicit derivations in Section 3, the exact formulas for noisy likelihoods, and the careful decomposition of the W2 error on ker Σ and its orthogonal complement. The limitations are the Gaussian prior assumption and the requirement that the blur kernel be identical across channels, both of which the authors acknowledge (Assumption 1 and Remark 4). However, the numerical support is compromised by an inconsistency in the backward-mean recursion (Eq. (49)), so the current version is not reproducible as printed.
major comments (3)
- [Section 3.3, Eq. (49)] The affine backward recursion printed in Eq. (49) does not follow from Algorithm 3 and Eq. (46). Substituting the exact Gaussian score and the likelihood gradient into Algorithm 3 gives b_t = β_t Σ_t^{-1} μ + β_t ΣΣ_t^{-1} A^T (C^{algo}_{v|t})^{-1} (v − Aμ + α_t AΣΣ_t^{-1} μ), not the printed expression with the extra factors β_t√α_t and β_t√α_{t−1} on the two terms. The matrix A_t in Eq. (48) is consistent with the corrected b_t, so the extra factors are not absorbed elsewhere. Since Algorithms 4 and 5, and therefore all reported W2 curves, depend on Eqs. (47)–(49), the numerical results in Figures 8–10 are not reproducible from the printed formulas. The same issue propagates into the ker Σ analysis in Section 4.3 (Eqs. (62)–(66)). Please correct Eq. (49) and re-derive the affected recursions, or provide the code used for the experiments.
- [Section 4.3, DPS hyperparameter] The DPS curves in Figures 8–10 are computed with 'the lowest stable value' of α_DPS, but no numerical values or a precise definition of stability are given. Because the DPS likelihood gradient scales linearly with α_DPS (Eq. (23)), the DPS contribution to the reported W2 distances and the relative ranking of DPS versus the other algorithms are functions of this free parameter. Please report the values used for each figure and include a sensitivity analysis over α_DPS.
- [Appendix B.2, Proposition 1 proof] The proof of Proposition 1 claims that the vectors bv2 and bv3 in Eq. (B86) form an orthogonal basis, but bv2^T bv3 = bt1 bt2, which is not zero in general. The vectors do lie in the kernel of bΣ(ξ) and are linearly independent in the generic case, so the statement of Proposition 1 may survive after orthogonalization, but the proof as printed is invalid. Since Proposition 1 underpins the simultaneous diagonalization used for the efficient W2 evaluation in Section 4, the proof must be corrected.
minor comments (7)
- [Eq. (14)] Eq. (14) writes E(Ax0 + σ²n | xt), but the forward model in Eq. (6) is v = Ax0 + σn; the mean is unaffected because E(n)=0, but the formula should be corrected.
- [Appendix A.3, Eq. (A32)] In the application of Lemma 1, M is written as AΣA + σ²I; it should be AΣA^T + σ²I. The general statement of Lemma 1 in Eq. (A7) is correct, so the typo is local.
- [Eq. (51)] The two Gaussian distributions are both written as N(µ1, Σ1); the second should be N(µ2, Σ2).
- [Appendix A.6, Eq. (A69)] Eq. (A69) has a minus sign before α_t AΣ²Σ_t^{-1}A^T inside the inverse, whereas Eqs. (A70)–(A74), which are the ones used in the paper, require a plus sign. The plus sign is the one consistent with the Woodbury derivation. Please correct Eq. (A69) to avoid ambiguity.
- [Figures 2–5] The legend label 'GDM' should be 'ΠGDM' for consistency with Table 1 and the main text.
- [Section 3.4] The text says that CGDM 'aligns perfectly' with the true theoretical distribution while the 2-Wasserstein distance is non-zero; please rephrase to avoid the apparent contradiction.
- [General] There are several typographical errors, including 'theoeretical', 'fisrt', 'biaised', and 'distrbution'; a careful copyedit is needed.
Circularity Check
No significant circularity: CGDM's exact-likelihood covariance is definitional and self-citations are minor, but the Wasserstein ranking is computed, not fitted.
full rationale
Walking the claimed derivation chain: Assumption 1 fixes p0 = N(µ,Σ) and provides the exact score (Eq. 29). Equation (32) then derives p_t(v|x_t) = N(A x̂0(x_t), (1−α_t)AΣΣ_t^{-1}A^T + σ²I), and Table 1/Eq. (34) define CGDM by fixing its likelihood covariance to exactly this expression. The later identity Eq. (45) — that CGDM's noisy posterior covariance equals the forward covariance of p_t(x_t|v) — is an algebraic rewriting of that defining choice, stated transparently by the authors ('which is the exact expression under the Gaussian assumption'). This is a definitional consequence, not a hidden prediction; more importantly, no constant is fitted to the W2 benchmark. The numerical ranking is obtained by iterating the Gaussian backward recurrences (Eqs. 47–50, Algorithms 4–5) and comparing the resulting distributions with the independently closed-formed forward distribution (Eq. 31), so the CGDM < ΠGDM < DPS ordering is a computed mathematical consequence. The self-citations [16] and [25] supply ADSN score-evaluation machinery and a kriging lemma, but the formulas needed here are rederived in Appendices A and B, so the citations are not load-bearing. Tuning αDPS to its 'lowest stable value' adjusts a baseline algorithm rather than fitting the CGDM result, and if anything favors DPS. The paper also explicitly delimits its scope (Remark 4; Section 5), and the reviewer-flagged issues with Eq. (49)'s √α factors, the Appendix A.6 sign, and the Proposition 1 basis orthogonality are internal correctness/reproducibility concerns rather than circularity: none exhibits a claimed result that is equivalent by definition to its own inputs. Score 2 reflects only the minor self-citation and the partly definitional character of the CGDM likelihood claim.
Assumptions & free parameters
free parameters (1)
- alpha_DPS (DPS stability hyperparameter) =
0.2 in toy examples; 'lowest stable value' in deblurring experiments (exact values not reported)
assumptions (6)
- domain assumption The data distribution p0 is Gaussian N(µ, Σ) with known µ and Σ (Assumption 1, Section 3).
- domain assumption The unconditional score ∇ log p_t is exactly known (Section 3.2).
- domain assumption The inverse problem is linear: v = Ax0 + σn with known A and σ, n ~ N(0,I) (Eq. 6).
- domain assumption DDPM forward and backward dynamics with diagonal backward noise β_t I (Eqs. 1, 5, Remark 1).
- domain assumption For ADSN microtextures, the covariance is the autocorrelation of a texton (Eq. 54) and diagonalizable in the Fourier basis; deblurring applies the same kernel to each channel so that A, Σ, and Σ_t share eigenvectors (Proposition 1).
- domain assumption 2-Wasserstein distance between Gaussians is the appropriate fidelity metric (Eq. 51).
Cite this review
Pith. "Pith review of Exact Evaluation of the Accuracy of Diffusion Models for Inverse Problems with Gaussian Data Distributions." pith.science (2026). https://pith.science/paper/RRP36XEJ
@misc{pith2026250707008,
author = {Pith},
title = {Pith review of: Exact Evaluation of the Accuracy of Diffusion Models for Inverse Problems with Gaussian Data Distributions},
year = {2026},
howpublished = {\url{https://pith.science/paper/RRP36XEJ}},
note = {Machine review of arXiv:2507.07008}
}
abstract
Used as priors for Bayesian inverse problems, diffusion models have recently attracted considerable attention in the literature. Their flexibility and high variance enable them to generate multiple solutions for a given task, such as inpainting, super-resolution, and deblurring. However, there is still a lack of understanding about how accurately these conditional diffusion algorithms perform conditional sampling. In this article, we investigate the errors induced by these models when applied to a Gaussian data distribution for which the score function is exactly known. Within this constrained context, we are able to precisely analyze the discrepancy between the theoretical resolution of inverse problems via conditional sampling and the practical distributions generated by conditional diffusion models. This is done by characterizing all the involved iterative Gaussian processes and by computing the exact Wasserstein distance between the distributions of the diffusion model samplers and the ideal conditional distribution associated with the inverse problem. Our findings allow for the comparison of two major algorithms from the literature, Deep Posterior Sampling (DPS) and Pseudo-inverse Guided Diffusion Models ($\Pi$GDM), and the introduction of the new paradigm Conditional Gaussian Diffusion Models (CGDM) that is shown to be more accurate for Gaussian data distributions.
Reference graph
Works this paper leans on
-
[1]
Foundations and Trends in Machine Learning 12(4), 307–392 (2019) https://doi.org/10.1561/2200000056
Kingma, D.P., Welling, M.: An introduction to variational autoencoders. Foundations and Trends in Machine Learning 12(4), 307–392 (2019) https://doi.org/10.1561/2200000056
-
[2]
In: 19th International Joint Conference on Com- puter Vision Theory and Applications
Prost, J., Houdard, A., Almansa, A., Papadakis, N.: Diverse super-resolution with pretrained deep hiererarchical vaes. In: 19th International Joint Conference on Com- puter Vision Theory and Applications. VIS- APP2024 (2024)
work page 2024
-
[3]
Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adver- sarial networks. Commun. ACM63(11), 139– 144 (2020) https://doi.org/10.1145/3422622
doi:10.1145/3422622 2020
-
[4]
Karras, T., Laine, S., Aila, T.: A style-based generator architecture for generative adver- sarial networks. IEEE Trans. Pattern Anal. Mach. Intell. 43(12), 4217–4228 (2021) https: //doi.org/10.1109/TPAMI.2020.2970919
-
[5]
Lugmayr, A., Danelljan, M., Van Gool, L., Timofte, R.: SRFlow: Learning the super- resolution space with normalizing flow. In: SRFlow, pp. 715–732 (2020)
work page 2020
-
[6]
In: Proceedings of the 35th International Conference on Neu- ral Information Processing Systems
Dhariwal, P., Nichol, A.: Diffusion models beat gans on image synthesis. In: Proceedings of the 35th International Conference on Neu- ral Information Processing Systems. NIPS ’21 (2021)
work page 2021
-
[7]
Daras, G., Chung, H., Lai, C.-H., Mitsufuji, Y., Milanfar, P., Dimakis, A.G., Ye, C., Del- bracio, M.: A survey on diffusion models for inverse problems (2024)
work page 2024
-
[8]
In: The Eleventh International Conference on Learn- ing Representations (2023)
Chung, H., Kim, J., Mccann, M.T., Klasky, M.L., Ye, J.C.: Diffusion posterior sampling for general noisy inverse problems. In: The Eleventh International Conference on Learn- ing Representations (2023)
2023
Show all 31 references
-
[9]
Chung, H., Sim, B., Ye, J.C.: Improving diffusion models for inverse problems using manifold constraints. (2022)
2022
-
[10]
In: International Confer- ence on Learning Representations (2023)
Song, J., Vahdat, A., Mardani, M., Kautz, J.: Pseudoinverse-guided diffusion models for inverse problems. In: International Confer- ence on Learning Representations (2023)
2023
-
[11]
In: ICLR Workshop on Deep Generative Models for Highly Structured Data (2022) 23
Kawar, B., Elad, M., Ermon, S., Song, J.: Denoising diffusion restoration models. In: ICLR Workshop on Deep Generative Models for Highly Structured Data (2022) 23
2022
-
[12]
https: //arxiv.org/abs/2410.21301
Moroy, L., Bourmaud, G., Champagnat, F., Giovannelli, J.-F.: Evaluating the Posterior Sampling Ability of Plug&Play Diffusion Methods in Sparse-View CT (2025). https: //arxiv.org/abs/2410.21301
2025 arXiv
-
[13]
In: The Thirty-eighth Annual Conference on Neural Information Processing Systems (2024)
Rozet, F., Andry, G., Lanusse, F., Louppe, G.: Learning diffusion priors from observa- tions by expectation maximization. In: The Thirty-eighth Annual Conference on Neural Information Processing Systems (2024)
2024
-
[14]
https://arxiv
Thong, D.Y.W., Mbakam, C.K., Pereyra, M.: Do Bayesian imaging methods report trust- worthy probabilities? (2024). https://arxiv. org/abs/2405.08179
2024 arXiv
-
[15]
In: Advances in Neural Information Processing Systems (2017)
Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., Hochreiter, S.: Gans trained by a two time-scale update rule converge to a local Nash equilibrium. In: Advances in Neural Information Processing Systems (2017)
2017
-
[16]
In: Forty-second Inter- national Conference on Machine Learning (2025)
Pierret, E., Galerne, B.: Diffusion models for gaussian distributions: Exact solutions and wasserstein errors. In: Forty-second Inter- national Conference on Machine Learning (2025)
2025
-
[17]
In: 9th Interna- tional Conference on Learning Representa- tions, ICLR (2021)
Song, Y., Sohl-Dickstein, J., Kingma, D.P., Kumar, A., Ermon, S., Poole, B.: Score- Based Generative Modeling through Stochas- tic Differential Equations. In: 9th Interna- tional Conference on Learning Representa- tions, ICLR (2021)
2021
-
[18]
Transactions on Machine Learning Research (2025)
Strasman, S., Ocello, A., Boyer, C., Corff, S.L., Lemaire, V.: An analysis of the noise schedule for score-based generative models. Transactions on Machine Learning Research (2025)
2025
-
[19]
https://arxiv.org/abs/2503
Hurault, S., Terris, M., Moreau, T., Peyr´ e, G.: From Score Matching to Diffusion: A Fine-Grained Error Analysis in the Gaussian Setting (2025). https://arxiv.org/abs/2503. 11615
2025
-
[20]
IEEE Transactions on Image Processing 20(1), 257–267 (2011)
Galerne, B., Gousseau, Y., Morel, J.-M.: Ran- dom Phase Textures: Theory and Synthe- sis. IEEE Transactions on Image Processing 20(1), 257–267 (2011)
2011
-
[21]
In: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Informa- tion Processing Systems 2020, NeurIPS 2020 (2020)
Ho, J., Jain, A., Abbeel, P.: Denoising dif- fusion probabilistic models. In: Advances in Neural Information Processing Systems 33: Annual Conference on Neural Informa- tion Processing Systems 2020, NeurIPS 2020 (2020)
2020
-
[22]
In: Proceedings of the 32nd International Conference on Machine Learning (2015)
Sohl-Dickstein, J., Weiss, E., Mah- eswaranathan, N., Ganguli, S.: Deep unsupervised learning using nonequilibrium thermodynamics. In: Proceedings of the 32nd International Conference on Machine Learning (2015)
2015
-
[23]
Commu- nication in Statistics- Theory and Methods (2002)
Manzano, E., Gomez-Villegas, M., Marin, J.: A matrix variate generalization of the power exponential family of distributions. Commu- nication in Statistics- Theory and Methods (2002)
2002
-
[24]
IEEE Transactions on Signal Process- ing (2013)
Pascal, F., Bombrun, L., Tourneret, J.-Y., Berthoumieu, Y.: Parameter estimation for multivariate generalized gaussian distribu- tions. IEEE Transactions on Signal Process- ing (2013)
2013
-
[25]
SIAM Journal on Imaging Sciences 18(2), 1176– 1207 (2025)
Pierret, E., Galerne, B.: Stochastic super- resolution for Gaussian microtextures. SIAM Journal on Imaging Sciences 18(2), 1176– 1207 (2025)
2025
- [26]
-
[27]
SIAM Journal on Imaging Sciences 7(1), 476–508 (2014) https: //doi.org/10.1137/130920562
Xia, G.-S., Ferradans, S., Peyr´ e, G., Aujol, J.-F.: Synthesizing and mixing stationary Gaussian texture models. SIAM Journal on Imaging Sciences 7(1), 476–508 (2014) https: //doi.org/10.1137/130920562
2014 doi
-
[28]
SIAM Journal on Imaging Sciences (2017)
Galerne, B., Leclaire, A.: Texture Inpainting Using Efficient Gaussian Conditional Simu- lation. SIAM Journal on Imaging Sciences (2017)
2017
-
[29]
Information science and statistics, vol
Bishop, C.M.: Pattern Recognition and Machine Learning. Information science and statistics, vol. 4. Springer, ??? (2006)
2006
-
[30]
Society for Industrial and Applied Mathematics, ??? 24 (2002)
Higham, N.J.: Accuracy and Stability of Numerical Algorithms, 2nd edn. Society for Industrial and Applied Mathematics, ??? 24 (2002)
2002
-
[31]
Golub, G.H., Loan, C.F.: Matrix Computa- tions, 4th edn. JHU Press, ??? (2013) 25 Appendix A Closed-form expressions for Gaussian diffusion models In this appendix, we provide closed-form expressions for Gaussian distributions in the context of diffusion models. We first prese...
2013
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.