REVIEW 2 major objections 5 minor 27 references
This paper claims that a mixed additive–multiplicative noise inverse problem can be rewritten exactly with an auxiliary variable u = ξ f(θ), giving a factorized likelihood that makes Bayesian inference tractable without approximate likeliho
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-01 05:05 UTC pith:HF65IAAX
load-bearing objection The exact auxiliary-variable likelihood reformulation is correct and worth having; the adaptive MCMC kernel's missing stationarity proof is the soft spot that keeps me from fully trusting the UQ claims. the 2 major comments →
A Hierarchical Likelihood Model for Non-linear Inverse Problems under Additive and Multiplicative Noise
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that model (1), despite its intractable likelihood, is statistically equivalent to the pair of equations (3), and that the auxiliary variable u decouples the nonlinear forward model from the mixture of noises. Concretely, the joint likelihood factorizes as π(Y, U | Θ) = ∏_{n,ℓ} π(y_{n,ℓ} | u_{n,ℓ}) π(u_{n,ℓ} | θ_n), where the first factor is a rectified Gaussian density accounting for censoring and the second is a lognormal density from the multiplicative noise. Inference can then target the joint posterior of (Θ, U), avoiding approximate likelihoods. The authors claim this formulation is exact, needs no calibration of transition hyperparameters in the likelihood, and ca
What carries the argument
The workhorse is the exact hierarchical reformulation (3): introducing the auxiliary variable u = ξ f(θ) splits the combined noise into a multiplicative stage (u given θ is lognormal) and an additive censored stage (y given u is Gaussian with rectification at the detection threshold). This turns the intractable likelihood into a product of two standard distributions. Around that identity, the sampler uses a checkerboard-style parallel update scheme, a local gradient-based proposal, a multiple-try global proposal for mode exploration, and—for non-censored pixels—a Gamma proposal for u whose parameters are matched to the conditional mode and curvature; censored pixels use ancestral sampling fr
Load-bearing premise
The load-bearing premise is that the adaptive MCMC kernel keeps the posterior as its stationary distribution, since the exact-likelihood reformulation alone does not guarantee that the sampler's samples are unbiased.
What would settle it
A concrete check: numerically integrate the original likelihood (1) over the multiplicative noise ξ for one pixel and band, and compare the result with the marginal likelihood of the hierarchical model (3) at the same parameter values; any difference beyond Monte Carlo error would falsify the exact-equivalence claim. A second, sampler-level check is to run the chain with adaptivity disabled and compare the resulting posterior samples; a shift in the empirical distribution would indicate that the adaptive proposal alters the stationary distribution.
If this is right
- If the equivalence is exact, the interpolated likelihood and its calibration step become unnecessary; practitioners can use the hierarchical model directly across noise levels.
- Uncertainty quantification, in the form of credible intervals, can be computed from posterior samples and mapped back to physical parameter space through the log-normalization.
- The checkerboard parallel updates allow pixels to be processed in batches, so the added latent dimension per pixel carries only modest computational overhead.
- The model's predictive performance, measured by expected log predictive density, is higher than that of additive, multiplicative, and interpolated likelihood approximations, with the gap widening as multiplicative noise increases.
- The hierarchical construction generalizes to other noise sources by inserting additional latent levels, making it a template for future mixed-noise inverse problems.
Where Pith is reading between the lines
- The exactness claim concerns the model, not the sampler: a natural check is whether the adaptive gradient-based proposal preserves the posterior as its stationary distribution, since the paper cites a reference rather than proving this.
- The same auxiliary-variable trick should extend to multiplicative noise laws beyond lognormal, provided the conditional distribution of u given θ remains tractable—an extension that could be tested on other heavy-tailed noise models.
- In censored regions, the proposal for u reduces to sampling from the lognormal prior π(u|θ), so uncertainty there is essentially prior-driven; an explicit study of how sensitive censored-region credible intervals are to that prior would sharpen the UQ guarantees.
- A concrete external test: for a fixed pixel and band, numerically marginalize the original likelihood over ξ and compare with the marginal of the hierarchical model; a mismatch beyond Monte Carlo error would refute the claimed statistical equivalence.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a hierarchical reformulation of the non-linear inverse problem (1), in which the latent multiplicative-noise variable u_{n,ℓ}=ξ_{n,ℓ} f_ℓ(θ_n) is introduced so that the observation model becomes y=max(ω, u+ε). The authors show that the hierarchical likelihood factorizes as π(Y,U|Θ)=∏π(y|u)π(u|θ) and that marginalizing over U recovers the original model (1). They argue that this exact reformulation avoids the need for the calibrated approximate likelihood of Palud et al. [8]. An MCMC sampler is then proposed, combining a PMALA local kernel and an I-MTM global kernel, with a Gamma-based proposal for the auxiliary variables. The method is evaluated on synthetic astronomical data under three multiplicative-noise levels and censoring, and compared with interpolated, additive, and multiplicative likelihood models using MAE, credible-interval sizes, ELPD, and wall-clock time. The main claims are that the hierarchical model is statistically equivalent to the original model, that it gives more reliable uncertainty quantification, and that it is competitive or better than the approximate baselines without requiring likelihood-hyperparameter tuning.
Significance. The exact-likelihood reformulation is a genuine and useful contribution. If the inference machinery is correct, the paper provides a principled way to handle mixed additive/multiplicative noise and censoring in non-linear inverse problems without approximating the likelihood or tuning interpolation hyperparameters. The experimental protocol is careful: multiple noise levels, five random seeds, Monte Carlo ELPD evaluation against the true generative model, and a pairwise model-comparison analysis. The ELPD comparison is a particularly valuable part of the study and goes beyond point-estimate comparisons. However, the uncertainty-quantification claims rest on the MCMC sampler being able to sample the target posterior, and the paper does not currently establish this for the adaptive PMALA kernel used in Algorithm 1. The exact reformulation is sound, but the inference guarantee is the load-bearing gap.
major comments (2)
- [Algorithm 1, line 12; Section III; Section IV-D] The validity of the reported credible intervals and ELPD comparisons depends on the MCMC samples being drawn from π(Θ,U|Y). Algorithm 1 line 12 says only 'Update PMALA kernel parameters (see [8])', and Section IV-D fixes the RMSProp decay rate at α=0.5 for the whole run, so the adaptation does not diminish. Section III asserts convergence by citing Jones et al. [15], but that reference concerns non-adaptive conditional Metropolis-Hastings and does not cover adaptive kernels. Without a proof of diminishing adaptation or another validity condition for the adaptive PMALA kernel, the sampler is not guaranteed to have π(Θ,U|Y) as its stationary distribution. This is not an objection to the exact hierarchical reformulation, but it directly undermines the uncertainty-quantification claims, including the 95% credible intervals and the ELPD-based conclusions.
- [Abstract; Section V; Table I; Section V computing time] The abstract claims 'state-of-the-art results in terms of point-wise estimates and computing costs'. Table I does not support superiority in point estimates: for example, at σ_m=log(1.5), the hierarchical MAE for Θ·,0 is 11.55±0.23 versus 11.07±0.30 for the multiplicative model; for Θ·,1, 8.61±0.07 versus 8.44±0.07; at σ_m=log(2.0), the interpolated model is often better. The median computing time per iteration is 8.26 s for the hierarchical model versus 5.34 s for the interpolated model. The results support comparable point estimates with better predictive performance, but not superior point estimates or computing costs. The abstract and conclusion should be amended to avoid overclaiming.
minor comments (5)
- [Figure 4 caption] The caption says 'From top to bottom: ground truth, hierarchical, interpolated, additive, multiplicative', but Figure 4 displays credible-interval sizes; ground truth has no credible interval. Please correct the caption or the figure rows.
- [Equation (14)] The mixture proposal q_θ in (14) is written without normalization constants. The constants cancel in the MH ratio, but this should be stated explicitly, especially because the text says 'contributions of the modes are reweighted to have equal probabilities'.
- [Section V, discussion of Table II] The phrase 'exp(0.182)≈1.2 times more likely' is imprecise. The reported quantity is a mean ΔELPD, i.e., a mean log predictive density ratio, not a posterior model probability. Please rephrase as 'on average exp(0.182)≈1.2 times higher predictive density'.
- [Code availability] The text says 'Codes to reproduce the experiments are part of a forthcoming update of the BEETROOTS library'. Since the experiments are central to the paper, please provide a stable DOI or repository link at submission time rather than a 'forthcoming' statement.
- [Section II-B] The lognormal notation LogN(·) is used before its parameterization is fully spelled out. Please state explicitly that the parameters are the mean and variance of the logarithm, to avoid ambiguity with alternative lognormal conventions.
Circularity Check
No significant circularity: the hierarchical likelihood is an exact variable transformation, and the reported comparisons are evaluated against external synthetic ground truth.
full rationale
The paper's central modeling claim is the equivalence between the original observation model (1) and the hierarchical reformulation (3)-(5). This is a direct variable transformation: defining u_{n,ell}=xi_{n,ell} f_ell(theta_n) and writing y_{n,ell}=max(omega_{n,ell}, u_{n,ell}+epsilon_{n,ell}) reproduces (1) exactly when the lognormal and Gaussian noise terms are substituted, and marginalizing the auxiliary variable recovers the original likelihood. No parameter is fitted to make this equivalence hold; it is a mathematical identity. The acceptance steps of the MCMC sampler use standard Metropolis-Hastings ratios, and the Gamma proposal in Appendix A is fitted only to the proposal distribution, not to any reported prediction or uncertainty claim, and is corrected by the accept/reject step. The ELPD comparisons are computed on synthetic data generated from the true model (1), which is an external benchmark rather than a quantity derived from the model's own fitted outputs. The paper does cite prior work for the reparameterization and for the PMALA design, but the exact-likelihood reformulation does not depend on the correctness of those citations, so no load-bearing self-citation chain is present. The adaptive PMALA stationarity issue identified by the skeptic is a genuine missing proof about the sampler's convergence, but it is a correctness risk, not a circularity: it does not make any claimed derivation reduce to its own inputs. Overall, the derivation chain is self-contained and non-circular.
Axiom & Free-Parameter Ledger
free parameters (3)
- spatial regularization hyperparameter τ_d =
20 (all d)
- validity-constraint hyperparameter δ =
10^4
- sampler tuning parameters (p, ε, η, α, M, M_NR, P) =
p=0.5, ε=1e-2, η=1e-5, α=0.5, M=50, M_NR=5, P=10
axioms (6)
- domain assumption Observation model (1): y = max(ω, ξ g(φ)+ε) with ξ ~ LogN(-σ_m²/2, σ_m²), ε ~ N(0,σ_a²), independent; thresholds ω fixed/known.
- domain assumption Conditional independence of observations across pixels n and bands ℓ given Θ.
- domain assumption Prior (8) with squared-gradient smoothness and smooth compact-support penalty, hyperparameters τ, δ.
- domain assumption The costly physical forward operator g can be replaced by a differentiable surrogate f = g∘ν^{-1} (neural network) that is sufficiently accurate.
- ad hoc to paper The mode u* of the conditional (15) lies between the modes of the lognormal and Gaussian factors.
- standard math Metropolis-within-Gibbs with block updates converges under mild conditions; the adaptive PMALA kernel maintains the correct stationary distribution.
invented entities (1)
-
Auxiliary latent variable u_{n,ℓ} = ξ_{n,ℓ} f_ℓ(θ_n)
no independent evidence
read the original abstract
Ill-posed inverse problems are encountered in numerous applications, possibly characterized by a highly non-linear forward model, both additive and multiplicative sources of noise, and censored data. In the absence of ground truth, uncertainty quantification is crucial to assess estimation reliability. This motivates the use of a Bayesian model and stochastic inference methods such as Markov Chain Monte Carlo algorithms. Problems combining all these challenges often lead to a complex and potentially multimodal posterior distribution, difficult to handle in practice. Approximate approaches have been proposed in the literature by either neglecting a source of noise or by using a tractable approximation of the likelihood function. These approaches either lead to an inaccurate model, or may require a complex calibration of the approximate likelihood. This paper proposes to tackle such problems with a general hierarchical Bayesian model and an efficient MCMC algorithm. The proposed formulation bypasses the need for calibrating the hyperparameters of an approximate model and is more versatile. The proposed method is assessed on a challenging scenario encountered in astronomy using synthetic data, in a variety of noise and censoring configurations. Comparisons are conducted against two baselines and a state-of-the-art method applicable in this context. The proposed approach is general and yields state-of-the-art results in terms of point-wise estimates and computing costs, with superior predictive performance. Results in the supplementary material further complete this comprehensive and rigorous model study. This work can serve as a guide for practitioners to select the best likelihood model according to their specific application.
Figures
Reference graph
Works this paper leans on
-
[1]
Dust spectral energy distribution in the era of Herschel and Planck: A hierarchical Bayesian-futting technique,
B. C. Kellyet al., “Dust spectral energy distribution in the era of Herschel and Planck: A hierarchical Bayesian-futting technique,”The Astrophysical Journal, vol. 752, no. 1, p. 55, May 2012
2012
-
[2]
Beetroots: Spatially regularized bayesian inference of physical parameter maps. application to orion,
Palud, Pierreet al., “Beetroots: Spatially regularized bayesian inference of physical parameter maps. application to orion,”A&A, vol. 698, p. A311, 2025
2025
-
[3]
Oriented speckle reducing anisotropic diffusion,
K. Krissian, C.-F. Westin, R. Kikinis, and K. G. V osburgh, “Oriented speckle reducing anisotropic diffusion,”IEEE Transactions on Image Processing, vol. 16, no. 5, pp. 1412–1424, May 2007
2007
-
[4]
Multiplicative noise removal using l1 fidelity on frame coefficients,
S. Durand, J. Fadili, and M. Nikolova, “Multiplicative noise removal using l1 fidelity on frame coefficients,”Journal of Mathematical Imaging and Vision, vol. 36, no. 3, pp. 201–226, Mar. 2010
2010
-
[5]
A nonlinear inverse scale space method for a convex multiplicative noise model,
J. Shi and S. Osher, “A nonlinear inverse scale space method for a convex multiplicative noise model,”SIAM Journal on Imaging Sciences, vol. 1, no. 3, pp. 294–321, Jan. 2008
2008
-
[6]
An additive approximation to multiplica- tive noise,
R. Nicholson and J. P. Kaipio, “An additive approximation to multiplica- tive noise,”Journal of Mathematical Imaging and Vision, vol. 62, pp. 1227–1237, Nov. 2020
2020
-
[7]
The convex relaxation method on deconvolution model with multiplicative noise,
Y . Huang, M. Ng, and T. Zeng, “The convex relaxation method on deconvolution model with multiplicative noise,”Communications in Computational Physics, vol. 13, pp. 1066–1092, Apr. 2013
2013
-
[8]
Efficient sampling of non log-concave posterior distribu- tions with mixture of noises,
P. Paludet al., “Efficient sampling of non log-concave posterior distribu- tions with mixture of noises,”IEEE Transactions on Signal Processing, vol. 71, pp. 2491–2501, 2023
2023
-
[9]
An algorithm for solving the inverse problem in total internal reflection microscopy,
A. Doicu, D. S. Efremenko, C. L. Wirth, and T. Wriedt, “An algorithm for solving the inverse problem in total internal reflection microscopy,” Journal of Quantitative Spectroscopy and Radiative Transfer, vol. 345, p. 109534, Nov. 2025
2025
-
[10]
M. Dinkelet al., “Solving bayesian inverse problems with expensive likelihoods using constrained gaussian processes and active learning,” no. arXiv:2312.08085, Dec. 2023
Pith/arXiv arXiv 2023
-
[11]
C. E. Rasmussen,Gaussian Processes to Speed up Hybrid Monte Carlo for Expensive Bayesian Integrals. Oxford University PressOxford, Jul. 2003, pp. 651–660
2003
-
[12]
An adaptive surrogate modeling based on deep neural networks for large-scale bayesian inverse problems,
L. Yan and T. Zhou, “An adaptive surrogate modeling based on deep neural networks for large-scale bayesian inverse problems,”Communi- cations in Computational Physics, vol. 28, no. 5, pp. 2180–2205, Nov. 2020
2020
-
[13]
Methods for stochastic col- lection and replenishment (scar) optimisation for persistent autonomy,
A. W. Palmer, A. J. Hill, and S. J. Scheding, “Methods for stochastic col- lection and replenishment (scar) optimisation for persistent autonomy,” Robotics and Autonomous Systems, vol. 87, pp. 51–65, Jan. 2017
2017
-
[14]
Inverse problems: From regularization to bayesian inference,
D. Calvetti and E. Somersalo, “Inverse problems: From regularization to bayesian inference,”WIREs Computational Statistics, vol. 10, no. 3, p. e1427, 2018
2018
-
[15]
Convergence of condi- tional metropolis-hastings samplers,
G. L. Jones, G. O. Roberts, and J. S. Rosenthal, “Convergence of condi- tional metropolis-hastings samplers,”Advances in Applied Probability, 2014
2014
-
[16]
Parallel gibbs sampling: From colored fields to thin junction trees,
J. Gonzalez, Y . Low, A. Gretton, and C. Guestrin, “Parallel gibbs sampling: From colored fields to thin junction trees,” inProceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics. JMLR Workshop and Conference Proceedings, Jun. 2011
2011
-
[17]
C. P. Robert and G. Casella,Monte Carlo Statistical Methods, ser. Springer Texts in Statistics. New York, NY: Springer, 2004
2004
-
[18]
The multiple-try method and local optimization in metropolis sampling,
J. S. Liu, F. Liang, and W. H. Wong, “The multiple-try method and local optimization in metropolis sampling,”Journal of the American Statistical Association, vol. 95, no. 449, pp. 121–134, 2000
2000
-
[19]
Langevin diffusions and the metropolis-adjusted langevin algorithm,
T. Xifaraet al., “Langevin diffusions and the metropolis-adjusted langevin algorithm,”Statistics & Probability Letters, vol. 91, pp. 14– 19, Aug. 2014
2014
-
[20]
Exponential convergence of langevin distributions and their discrete approximations,
G. O. Roberts and R. L. Tweedie, “Exponential convergence of langevin distributions and their discrete approximations,”Bernoulli, vol. 2, no. 4, pp. 341–363, 1996
1996
-
[21]
A review of multiple try mcmc algorithms for signal processing,
L. Martino, “A review of multiple try mcmc algorithms for signal processing,”Digital Signal Processing, vol. 75, pp. 134–152, Apr. 2018
2018
-
[22]
C. M. Bishop,Pattern recognition and machine learning, ser. Informa- tion science and statistics. New York: Springer, 2006
2006
-
[23]
A model for atomic and molecular interstellar gas: The meudon pdr code,
F. L. Petit, C. Nehm ´e, J. L. Bourlot, and E. Roueff, “A model for atomic and molecular interstellar gas: The meudon pdr code,”The Astrophysical Journal Supplement Series, vol. 164, no. 2, p. 506, Jun. 2006
2006
-
[24]
Neural network-based emulation of interstellar medium models,
P. Paludet al., “Neural network-based emulation of interstellar medium models,”Astronomy & Astrophysics, vol. 678, p. A198, Oct. 2023
2023
-
[25]
Bayes factors,
R. E. Kass and A. E. Raftery, “Bayes factors,”Journal of the American Statistical Association, vol. 90, no. 430, pp. 773–795, 1995
1995
-
[26]
Understanding predictive infor- mation criteria for bayesian models,
A. Gelman, J. Hwang, and A. Vehtari, “Understanding predictive infor- mation criteria for bayesian models,”Statistics and Computing, vol. 24, no. 6, pp. 997–1016, Nov. 2014
2014
-
[27]
Nocedal and S
J. Nocedal and S. J. Wright,Numerical optimization, second edition ed., ser. Springer series in operation research and financial engineering. New York, NY: Springer, 2006. APPENDIXA FITTEDGAMMA DISTRIBUTIONS FORq u At each iterationtof the sampler, the parameters of the Gamma proposal distributionq u used for non-censored ob- servations are adjusted to fi...
2006
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.