REVIEW 2 major objections 4 minor 42 references
Combining left preconditioning with multilevel V-cycle corrections accelerates both exact and inexact proximal methods for image deblurring without losing reconstruction quality.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-14 08:41 UTC pith:JI5V2XLI
load-bearing objection Solid engineering combination of existing preconditioned proximal schemes with multilevel V-cycles; clear early speed-up on deblurring, incremental but clean and usable. the 2 major comments →
Multilevel Preconditioning Strategies for Convex Optimization Methods in Image Deblurring
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
A left preconditioner P = AᵀA + νI, applied consistently at every level of a multilevel V-cycle hierarchy that also enforces first-order coherence via Moreau-envelope smoothing, yields a convergent and substantially faster acceleration of both exact (ITTA) and inexact (PNPD) forward-backward schemes for regularized convex image-deblurring problems.
What carries the argument
The multilevel-preconditioned V-cycle (Algorithms 5–8): a Galerkin coarse operator AH = I_H^h A_h I_h^H together with the linear correction term that enforces first-order coherence, so that a bounded coarse descent direction remains a useful fine-level descent direction after prolongation and an Armijo line search.
Load-bearing premise
The coarse model built by Galerkin restriction and Moreau smoothing must stay faithful enough that a coarse descent direction is still a useful fine-level correction after it is prolonged; if that fidelity is lost the multilevel speed-up disappears.
What would settle it
Run the same deblurring experiments with a non-convolutional forward operator (e.g., limited-angle tomography) or with a severe non-Gaussian blur for which the Galerkin coarse operator AH ceases to approximate the fine-level Hessian; if the multilevel-preconditioned methods no longer reduce relative reconstruction error faster than the single-level preconditioned baselines, the central claim fails.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper combines left preconditioning of the form P = AᵀA + νI (as in ITTA/PNPD) with a multilevel V-cycle framework (adapted from Lauga et al.) for both exact proximal gradient methods (FISTA/ITTA with framelet ℓ1) and inexact nested primal-dual methods (NPD/PNPD with TV) applied to regularized convex image deblurring. Coarse models are built via Galerkin restriction of the blur, Moreau-envelope smoothing of the nonsmooth term, and a first-order coherence correction; an Armijo line search controls the prolonged coarse correction, and an adaptive rule automatically selects the number of coarse iterations and V-cycles. Convergence is reduced to the type-2 approximation theory of the underlying multilevel framework via a dual-proximal argument (Proposition 11). Four IRtools deblurring examples (Gaussian, defocus, shake PSFs) with cost-normalized RRE/PSNR plots show that the multilevel-preconditioned variants (MITTA, MPNPD and their auto versions) produce substantially faster early error decrease than the corresponding non-multilevel or non-preconditioned schemes while preserving reconstruction quality.
Significance. If the claims hold, the work supplies a practical, largely automated acceleration recipe that unifies two previously separate lines of research (preconditioned proximal methods and multilevel forward-backward schemes) for a standard class of imaging problems. The reduction of convergence to existing type-2 theory is clean, the computational-cost accounting (Appendix B) is transparent, and the adaptive Armijo-based selection of m and p removes two free parameters that would otherwise require manual tuning. The numerical evidence on standard test problems is concrete and reproducible with IRtools. The contribution is incremental rather than foundational, but it is useful for large-scale deblurring and opens a clear path to other linear inverse problems once suitable coarse operators are available.
major comments (2)
- The numerical claims rest on four carefully chosen convolution examples with fixed ν = 0.1 and hand-tuned λ. While the early RRE drop is clear, the paper does not report results for non-convolution operators (e.g., tomography) or for a systematic sweep of ν and noise levels. Because the abstract and conclusion present the method as a “robust … acceleration framework,” at least one additional experiment outside pure deblurring, or a short sensitivity study of ν, is needed to support that breadth.
- Section 5 and Proposition 11 correctly identify the dual sequence as a type-2 approximation, yet the practical implementation freezes the number of inner dual iterations at one. The text asserts that more inner steps bring no improvement, but no supporting table or residual plot is given. A brief verification (even for a single example) that the type-2 residual remains controlled under this fixed budget would strengthen the link between the theory and the reported numerics.
minor comments (4)
- In Algorithm 8 the gradient of the fine-level objective appears without the Moreau smoothing parameter that is present in Algorithm 5; the notation should be made consistent.
- Figure 1 and the surrounding text describe a four-level scheme, yet all experiments use only two levels; a short remark clarifying that the theory extends while the reported timings are two-level would avoid confusion.
- Several typographical slips remain (e.g., “In subria”, “Techno logy”, missing spaces after commas in the author list). A careful proof-reading pass is needed.
- The choice γ = 1.1 for the Moreau parameter is stated without justification or sensitivity check; a one-sentence remark would be helpful.
Circularity Check
No significant circularity: the paper combines published preconditioning (own prior) and multilevel (external) techniques and validates the hybrid numerically on independent IRtools benchmarks; free parameters are acknowledged as such.
specific steps
-
self citation load bearing
[§3.2 (PNPD) and §1 / Algorithm 4]
"In [24], the authors prove that preconditioning strategies can be applied to the NPD framework to achieve faster convergence. … by applying the NPD algorithm to problem (13) instead of problem (3) under assumption (15), we obtain a two-step iterative scheme, called the Preconditioned Nested Primal-Dual (PNPD) [24]"
The PNPD baseline that is later multilevel-accelerated is imported wholesale from the authors’ own prior paper; the present work does not re-prove its convergence but treats it as given. This is ordinary self-citation of a published method, not a circular derivation of a new claim, and is therefore only a minor flag.
full rationale
The derivation chain is standard algorithmic construction plus numerical comparison, not a closed loop. Preconditioners P = AᵀA + νI and the PNPD scheme are taken from the authors’ prior work [23,24] and the multilevel V-cycle / first-order coherence / Moreau smoothing from Lauga et al. [26,28]; both are cited as established building blocks rather than re-derived. Convergence of the hybrid is referred to the external analysis of [28] after verifying that the dual nested iteration yields a type-2 proximal approximation (Proposition 11). The central claim—that the combination accelerates RRE decrease—is an empirical observation on four standard deblurring instances (Gaussian, defocus, shake PSFs) with openly chosen free parameters λ, ν, m, p; nothing is fitted on a subset and then reported as a forced prediction. Self-citations exist but are not load-bearing for an unverified uniqueness or uniqueness-forced ansatz; the numerical evidence stands independently. Hence circularity is negligible (score 1 only for the ordinary self-reference to the authors’ own PNPD baseline).
Axiom & Free-Parameter Ledger
free parameters (4)
- preconditioner shift ν =
0.1
- regularization parameter λ =
example-dependent
- Moreau smoothing parameter γ =
1.1
- coarse iterations m and V-cycles p =
m=8, p=8 (manual)
axioms (5)
- standard math f is convex with L-Lipschitz gradient; g is proper convex lsc; W satisfies the relative-interior qualification (Assumption 1).
- domain assumption The pair of restriction/prolongation operators are coherent information transfer (CIT) operators: I_h^H = ξ (I_H^h)^T (Definition 9).
- domain assumption The coarse solver Φ_H produces a bounded descent direction for the smoothed coarse model after a finite number of iterations (Assumption 2).
- standard math The dual nested iteration yields a type-2 approximation of the proximal operator (Proposition 11).
- ad hoc to paper The Galerkin coarse blur AH = I_H^h A_h I_h^H adequately represents the fine-level convolution on the coarse grid.
Cite this review
Pith. "Pith review of Multilevel Preconditioning Strategies for Convex Optimization Methods in Image Deblurring." pith.science (2026). https://pith.science/paper/JI5V2XLI
@misc{pith2026260710864,
author = {Pith},
title = {Pith review of: Multilevel Preconditioning Strategies for Convex Optimization Methods in Image Deblurring},
year = {2026},
howpublished = {\url{https://pith.science/paper/JI5V2XLI}},
note = {Machine review of arXiv:2607.10864}
}
read the original abstract
Proximal gradient methods are widely used in imaging, and their speed of convergence can be accelerated by incorporating variable metrics and/or extrapolation steps. Recent works have shown that preconditioning strategies can significantly enhance this acceleration, in particular, for image deblurring problems. In parallel, a multilevel framework has been introduced to speed up inertial and inexact forward-backward schemes for image restoration problems. In this paper, we combine preconditioning and multilevel strategies to design a robust and consistent acceleration framework for both standard and inexact forward-backward schemes applied to regularized convex optimization problems. Numerical experiments in image deblurring confirm that our approach yields a substantial improvement in convergence speed compared to standard methods.
Reference graph
Works this paper leans on
-
[1]
SIAM, Philadelphia (2006)
Hansen, P.C., Nagy, J.G., O’Leary, D.P.: Deblurring Images: Matrice s, Spectra, and Filtering. SIAM, Philadelphia (2006)
2006
-
[2]
Mathematics and Its Applications
Engl, H.W., Hanke, M., Neubauer, G.: Regularization of Inverse Pro blems, 1996 edn. Mathematics and Its Applications. Springer, Dordrecht, Net herlands (1996)
1996
-
[3]
Institute of Physics Publishing, Bristol (1998)
Bertero, M., Boccacci, P.: Introduction to Inverse Problems in I maging. Institute of Physics Publishing, Bristol (1998)
1998
-
[4]
SIAM journal on imaging sciences 2(1), 183–202 (2009) 32
Beck, A., Teboulle, M.: A fast iterative shrinkage-thresholding alg orithm for linear inverse problems. SIAM journal on imaging sciences 2(1), 183–202 (2009) 32
2009
-
[5]
Multiscale Model
Combettes, P.L., Wajs, V.R.: Signal recovery by proximal forwar d-backward splitting. Multiscale Model. Simul. 4(4), 1168–1200 (2005)
2005
-
[6]
Daubechies, I., Defrise, M., Mol, C.D.: An iterative thresholding algo rithm for linear inverse problems with a sparsity constraint. Commun. Pure Ap pl. Math. 57(11), 1413–1457 (2004)
2004
-
[7]
Bach, F., Jenatton, R., Mairal, J., Obozinski, G.: Structured spar sity through convex optimization. Stat. Sci. 27(4), 450–468 (2012)
2012
-
[8]
Polson, N.G., Scott, J.G., Willard, B.T.: Proximal Algorithms in Statistic s and Machine Learning. Stat. Sci. 30(4), 559–581 (2015)
2015
-
[9]
Chambolle, A., Pock, T.: A first–order primal–dual algorithm for co nvex problems with applications to imaging. J. Math. Imaging Vis. 40, 120–145 (2011)
2011
-
[10]
Malitsky, Y., Pock, T.: A First-Order Primal-Dual Algorithm with Lin esearch. SIAM J. Optim. 28(1), 411–432 (2018)
2018
-
[11]
Chambolle, A., Delplancke, C., Ehrhardt, M.J., Sch¨ onlieb, C.-B., Ta ng, J.: Stochastic Primal–Dual Hybrid Gradient Algorithm with Adaptive Step Sizes. J. Math. Imaging Vis. 66, 294–313 (2024)
2024
-
[12]
Bonettini, S., Porta, F., Ruggiero, V.: A variable metric forward- backward method with extrapolation. SIAM J. Sci. Comput. 38, 2558–2584 (2016)
2016
-
[13]
Schmidt, M., Roux, N.L., Bach, F.: Convergence rates of inexact proximal- gradient methods for convex optimization. arXiv:1109.2415v2 (201 1)
-
[14]
Villa, S., Salzo, S., Baldassarre, L., Verri, A.: Accelerated and inex act forward- backward algorithms. SIAM J. Optim. 23(3), 1607–1633 (2013)
2013
-
[15]
Bonettini, S., Rebegoldi, S., Ruggiero, V.: Inertial variable metric techniques for the inexact forward–backward algorithm. SIAM J. Sci. Comput. 40(5), 3180–3210 (2018)
2018
-
[16]
Chen, J., Loris, I.: On starting and stopping criteria for nested primal-dual iterations. Numer. Algorithms 82, 605–621 (2019)
2019
-
[17]
Chouzenoux, E., Pesquet, J.-C., Repetti, A.: Variable metric for ward-backward algorithm for minimizing the sum of a differentiable function and a conve x function. J. Optim. Theory Appl. 162, 107–132 (2014)
2014
-
[18]
Frankel, P., Garrigos, G., Peypouquet, J.: Splitting methods with variable met- ric for Kurdyka–/suppress Lojasiewicz functions and general convergence rates. J. Optim. Theory Appl. 165(3), 874–900 (2015)
2015
-
[19]
Ghanbari, H., Scheinberg, K.: Proximal quasi-Newton methods f or regularized 33 convex optimization with linear and accelerated sublinear convergen ce rates. Comput. Optim. Appl. 69, 597–627 (2018)
2018
-
[20]
Lee, C., Wright, S.J.: Inexact successive quadratic approximat ion for regularized optimization. Comput. Optim. Appl. 72, 641–674 (2019)
2019
-
[21]
IEEE Trans
Beck, A., Teboulle, M.: Fast gradient-based algorithms for cons trained total vari- ation image denoising and deblurring problems. IEEE Trans. Image Pr ocessing 18(11), 2419–34 (2009)
2009
-
[22]
Ochs, P., Chen, Y., Brox, T., Pock, T.: iPiano: Inertial proximal a lgorithm for non-convex optimization. SIAM J. Imaging Sci. 7(2), 1388–1419 (2014)
2014
-
[23]
Inverse Problems and Imaging 7(3), 717–736 (2013) https://doi.org/10.3934/ipi.2013.7.717
Huang, J., Donatelli, M., Chan, R.H.: Nonstationary iterated thre sholding algo- rithms for image deblurring. Inverse Problems and Imaging 7(3), 717–736 (2013) https://doi.org/10.3934/ipi.2013.7.717
-
[24]
Journal of S cientific Computing 103(3), 85 (2025) https://doi.org/10.1007/s10915-025-02863-8
Aleotti, S., Donatelli, M., Krause, R., Scarlato, G.: A preconditione d version of a nested primal-dual algorithm for image deblurring. Journal of S cientific Computing 103(3), 85 (2025) https://doi.org/10.1007/s10915-025-02863-8
-
[25]
Aleotti, S., Bonettini, S., Donatelli, M., Prato, M., Rebegoldi, S.: A nested primal–dual iterated tikhonov method for regularized conv ex opti- mization. Computational Optimization and Applications 91, 357–395 (2024) https://doi.org/10.1007/s10589-024-00613-4
-
[26]
Lauga, G., Riccietti, E., Pustelnik, N., Gon¸ calves, P.: Multilevel fis ta for image restoration. In: ICASSP 2023 - 2023 IEEE International Co nfer- ence on Acoustics, Speech and Signal Processing (ICASSP), pp. 1 –5 (2023). https://doi.org/10.1109/ICASSP49357.2023.10094710
-
[27]
Buccini, A., Donatelli, M.: A multigrid frame based method for image d eblurring. Electron. Trans. Numer. Anal. 53, 283–312 (2020) https://doi.org/10.1553/etna vol53s283
doi:10.1553/etna 2020
-
[28]
ap plication to image restoration
Lauga, G., Riccietti, E., Pustelnik, N., Gon¸ calves, P.: Iml fista: A mul- tilevel framework for inexact and inertial forward-backward. ap plication to image restoration. SIAM Journal on Imaging Sciences 17(3), 1347–1376 (2024) https://doi.org/10.1137/23M1582345
-
[29]
Numerical linear algebra with applications 12(8), 715–729 (2005)
Donatelli, M.: A multigrid for image deblurring with tikhonov regulariz ation. Numerical linear algebra with applications 12(8), 715–729 (2005)
2005
-
[30]
SIAM Journal on Scientific Computing 27(6), 2053–2076 (2006)
Donatelli, M., Serra-Capizzano, S.: On the regularizing power of m ultigrid-type algorithms. SIAM Journal on Scientific Computing 27(6), 2053–2076 (2006)
2053
-
[31]
SIAM Journal on Imaging Sciences 1(1), 51–74 (2008)
Morigi, S., Reichel, L., Sgallari, F., Shyshkov, A.: Cascadic multireso lution 34 methods for image deblurring. SIAM Journal on Imaging Sciences 1(1), 51–74 (2008)
2008
-
[32]
SIAM Journal on Scientific Computing 32(2), 1043–1063 (2010)
Chan, R.H., Chen, K.: A multilevel algorithm for simultaneously deno ising and deblurring images. SIAM Journal on Scientific Computing 32(2), 1043–1063 (2010)
2010
-
[33]
Princeton Mathematical Ser ies
Rockafellar, R.T.: Convex Analysis. Princeton Mathematical Ser ies. Princeton University Press, Princeton, N. J. (1970)
1970
-
[34]
Moreau, J.J.: Proximit´ e et dualit´ e dans un espace hilbertien. Bu l- letin de la Soci´ et´ e Math´ ematique de France 93, 273–299 (1965) https://doi.org/10.24033/bsmf.1625
-
[35]
Communications o n Pure and Applied Mathematics: A Journal Issued by the Courant Institute o f Mathematical Sciences 57(11), 1413–1457 (2004)
Daubechies, I., Defrise, M., De Mol, C.: An iterative thresholding a lgorithm for linear inverse problems with a sparsity constraint. Communications o n Pure and Applied Mathematics: A Journal Issued by the Courant Institute o f Mathematical Sciences 57(11), 1413–1457 (2004)
2004
-
[36]
Math- ematics and Its Applications, vol
Engl, H.W., Hanke, M., Neubauer, A.: Regularization of Inverse Pr oblems. Math- ematics and Its Applications, vol. 375. Kluwer Academic Publishers, D ordrecht, The Netherlands (1996). https://doi.org/10.1007/978-94-009-1740-8
-
[37]
Bonettini, S., Prato, M., Rebegoldi, S.: A nested primal–dual fista -like scheme for composite convex optimization problems. Computational Optimiz ation and Applications 84, 1–39 (2022) https://doi.org/10.1007/s10589-022-00410-x
-
[38]
SIAM Journal on Optimization 22(2), 557–580 (2012) https://doi.org/10.1137/100818327
Beck, A., Teboulle, M.: Smoothing and first order methods: A uni- fied framework. SIAM Journal on Optimization 22(2), 557–580 (2012) https://doi.org/10.1137/100818327
-
[39]
SIAM Journal on Optimization 25, 2408–2433 (2015) https://doi.org/10.1137/140994964
Aujol, J.-F., Dossal, C.: Stability of over-relaxations for the for ward-backward algorithm, application to fista. SIAM Journal on Optimization 25, 2408–2433 (2015) https://doi.org/10.1137/140994964
-
[40]
Rudin, L.I., Osher, S., Fatemi, E.: Nonlinear total variation based noise removal algorithms. J. Phys. D. 60(1–4), 259–268 (1992)
1992
-
[41]
Numerical Algorit hms 81 (2019) https://doi.org/10.1007/s11075-018-0570-7
Gazzola, S., Hansen, P.C., Nagy, J.: Ir tools: A matlab package of iterative regu- larization methods and large-scale test problems. Numerical Algorit hms 81 (2019) https://doi.org/10.1007/s11075-018-0570-7
-
[42]
Applied and Computational Harmonic Analysis 24(2), 131–149 (2008) 35 A Framelets Let W denote the tight frame associated with linear B-splines [ 42]
Cai, J.-F., Chan, R.H., Shen, Z.: A framelet-based image inpainting a lgorithm. Applied and Computational Harmonic Analysis 24(2), 131–149 (2008) 35 A Framelets Let W denote the tight frame associated with linear B-splines [ 42]. The one- dimensional linear B-spline system consists of a low-pass filter W0 and two high-pass filters W1 and W2. The correspondi...
2008
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.