REVIEW 3 major objections 4 minor 300 references
Domain shift in plug-and-play reconstruction reduces to a measurable 'proximal mismatch' that directly controls convergence.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-02 00:46 UTC pith:AU6UFDEF
load-bearing objection A useful, well-run empirical study of proximal-matching adaptation for PnP, wrapped in a correct but not novel theory that has a genuine unverified assumption in the GS experiments. the 3 major comments →
Domain Adaptation of Mismatched Proximal Denoiser for Plug-and-Play Image Reconstruction
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that the effect of domain shift on PnP-PGD is captured, to first order, by the sequence of proximal mismatch values d_k = || D_hat(z_k) - D_*(z_k) ||^2, where D_* is the proximal map of the target regularizer R_*. Theorem 3.1 shows that under smoothness and regularity assumptions, the average squared stationarity gap of the target objective decays as O(1/K) plus C_1 times the average squared mismatch. If the mismatch is square-summable the iterates converge to stationarity; if it is persistent, the stationarity error persists. This turns an abstract prior mismatch into a measurable quantity along the trajectory and provides a principled adaptation objective.
What carries the argument
The key object is the proximal mismatch d_k = || D_hat(z_k) - D_*(z_k) ||^2 between the deployed denoiser and the target proximal map at each PnP query point. It converts the deployed update into an inexact proximal step for the target objective. The analysis then uses the target proximal subproblem H_k(u) = (1/2)||u - z_k||^2 + R_*(u); its smoothness (L_H) and a gradient error inequality (Assumption 3.3) let the mismatch control both the descent loss and the stationarity residual. For Learned Proximal Networks and Gradient-Step denoisers, the paper verifies these conditions via explicit smoothness constants (1/alpha and 1/(1-L), respectively).
Load-bearing premise
The load-bearing premise is that the target domain has a well-defined proximal reference map D_* = prox_{R_*} and that every PnP query point satisfies the smoothness and unique-minimizer conditions of Assumption 3.3; the paper verifies these for ideal LPN and GS denoisers but not for the actually adapted ones.
What would settle it
Compute the stationarity gap of PnP-PGD on a controlled inverse problem with a known target regularizer, using a deployed denoiser deliberately mismatched to it; if the empirical average squared stationarity error does not grow approximately linearly with the average squared proximal mismatch as predicted, Theorem 3.1 is wrong. Equivalently, construct a denoiser with zero proximal mismatch at all query points that still fails to drive the stationarity measure to zero, disproving the direct implication.
If this is right
- If the bound holds, a denoiser that is well-matched to the target proximal map will make PnP-PGD converge to a stationary point of the target objective; any persistent mismatch creates a floor on achievable stationarity.
- The bound identifies average squared proximal mismatch along the PnP trajectory as the quantity to monitor and reduce during adaptation, rather than standalone denoising MSE.
- Proximal-matching adaptation consistently outperforms MSE-based adaptation in the few-shot regime across two denoiser families and two inverse problems, with the largest gains (over 10 dB in severe shifts) at one or five target images.
- In the matched case (deployed equals target reference), the bound recovers the standard O(1/K) stationarity rate of proximal gradient descent.
Where Pith is reading between the lines
- The paper does not explore how to estimate the target proximal map when no target-trained reference is available; a natural extension is self-supervised or trajectory-based proximal estimation that directly minimizes the mismatch term.
- A natural extension is to sample adaptation inputs from the actual PnP trajectory rather than only independent noisy images, which would directly reduce the mismatch term appearing in the bound.
- The proximal-matching idea may transfer beyond imaging to other plug-and-play inexact proximal algorithms (e.g., RED or ADMM variants); a testable prediction is that reconstruction quality should correlate monotonically with the average squared mismatch, with the correlation strength depending on the constants in the bound.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper studies plug-and-play proximal gradient descent (PnP-PGD) when the deployed denoiser is mismatched to the target domain. It defines proximal mismatch as the squared output difference between the deployed denoiser and a target reference proximal map D_* = prox_{R_*}, and shows (Theorem 3.1) that the average squared gradient of the target objective is bounded by O(1/K) plus a constant times the average squared mismatch, under smoothness and regularity assumptions on the target proximal subproblems. The bound motivates a proximal-matching (PM) adaptation objective, which is implemented for learned proximal networks (LPNs) and gradient-step (GS) denoisers. Experiments on Gaussian deblurring and 4x super-resolution under a BreCaHAD-to-CelebA domain shift report that PM adaptation improves PSNR over MSE adaptation, especially in the few-shot regime, and reduces a family-matched trajectory gap relative to a target-trained reference.
Significance. If the assumptions hold, Theorem 3.1 is a clean and useful result: it quantifies how persistent denoiser mismatch degrades stationarity in PnP-PGD and justifies proximal matching as an adaptation principle. The proof is self-contained, the mismatch measure d_k is defined rather than fitted, and there is no circular derivation. The two denoiser families (LPN and GS) are well chosen because they realize proximal structure in different ways. The experimental findings, if validated, are practically significant: the reported gains over MSE adaptation in the one-shot and five-shot regimes are substantial. The main weaknesses are that the GS half of the validation depends on an unverified global contractivity condition, and the experimental gap metric compares against a target-trained denoiser of the same family rather than the true D_*, so the empirical claims are conditional on a surrogate reference.
major comments (3)
- [Section 3.4.2 / Proposition B.2 / Tables 2 and 3] The GS proximal interpretation requires that ∇g_{σ,⋆} is globally L-Lipschitz with L<1; otherwise the induced regularizer may not exist, H_k may be nonconvex or nonsmooth, and L_H=1/(1-L) in Eq. (26) is invalid. The paper only reports bL_max, an empirical local Jacobian estimate evaluated on adaptation points. For a neural-network potential, global Lipschitz constants can exceed 1 even when pointwise Jacobian estimates are below 1. Since GS is one of the two families used to validate the central claim, this unverified global condition makes the theoretical support for the GS experiments conditional. The authors should either verify the global contractivity bound for their trained potentials, restrict the GS empirical claims to a version where the condition is checked, or clearly state that Theorem 3.1 applies to GS only when the global condition holds.
- [Section 5.1, gap definition; Section 6] The trajectory gap is computed against a target-trained denoiser of the same family, i.e., D_{θ⋆}, not against the true D_* = prox_{R_*}. Thus the experiments measure agreement with a surrogate reference, not with the proximal map of the target regularizer. The observation that lower gap correlates with higher PSNR is therefore an within-family consistency result, not a direct empirical confirmation of Theorem 3.1. The paper acknowledges this in the conclusion, but the abstract and Section 1 state more strongly that 'proximal matching adaptation reduces the proximal mismatch'; that claim should be qualified. A test with a synthetic or analytically known R_* would strengthen the validation, or the wording should be adjusted to 'mismatch relative to the family-matched target-trained reference.'
- [Assumption 3.3 / Section 3.4.2] Assumption 3.3 also requires that at every deployed iterate the gradient-dominance inequality (17) holds, and for GS denoisers that every deployed output lies in Im(D_{σ,⋆}). For LPNs this is automatic, but for GS it is not verified. The paper does not report any check of these conditions along actual PnP-PGD trajectories. Since the theorem's conclusion depends on them, the experimental validation should include at least trajectory-level diagnostics (e.g., whether \hat D_σ(z_k) stays in the image of the target map, or whether the inequality in (17) is satisfied). Without such checks, the applicability of Theorem 3.1 to the GS experiments is not established.
minor comments (4)
- [General] No code or detailed training configuration is provided. Releasing code and specifying hyperparameters (e.g., λ_con, L_max, γ annealing schedule, number of corruptions M) would substantially improve reproducibility.
- [Section 4.2/4.3] The proximal-matching objectives in Eqs. (37) and (41) depend on a bandwidth γ, but the annealing schedule is not described. Please specify how γ is set or annealed in the experiments.
- [Tables 2 and 3] The caption states that SSIM and gap are reported in units of 10^{-2}, but the figures use different scales. Clarify the units consistently. Also, the bL_max values are described as 'empirical local Jacobian estimates'; state explicitly how they are computed.
- [Throughout] There are typographical issues: 'asproximal mismatch' in the abstract, broken author name 'V o' in the references, and some missing spaces. Also, reference 'Vert et al., 2026' appears to be a future work; verify its status.
Circularity Check
No significant circularity: Theorem 3.1 is a standard inexact proximal-gradient bound with mismatch defined a priori; adaptation and evaluation rely on external results and independent target-trained references.
full rationale
The paper's central bound (Theorem 3.1) is not circular. d_k is defined in Eq. (11) as ||\hat D(z_k)-D_*(z_k)||^2 for an a priori fixed target reference D_*=prox_{R_*}; Lemma 3.1 bounds the proximal subproblem gap by (L_H/2)d_k^2 using L_H-smoothness of H_k, and Theorem 3.1 follows from telescoping the descent inequality and the residual control in Lemmas 3.2-3.3. No parameter is fitted to make the bound hold: C0 and C1 are explicit constants in Eq. (20). The LPN and GS realizations import proximal-representation theorems (Fang et al. 2024; Hurault et al. 2022b) as external, non-self citations; the GS instance is conditional on an assumption (L<1, outputs in Im(D_{σ,*})) whose empirical verification is incomplete, but that is a correctness/validity concern, not circularity. The adaptation objective is motivated by Proposition 4.1, whose population-target claim rests on the external consistency result of Fang et al.; the experimental gap metric is evaluated against a separately trained target-reference denoiser, acknowledged in the conclusion as a surrogate. Thus no step reduces to its own inputs by construction.
Axiom & Free-Parameter Ledger
free parameters (5)
- LPN strong-convexity parameter alpha =
alpha in (0,1), not reported
- PM bandwidth gamma and annealing schedule =
not reported
- GS contractivity penalty lambda_con and L_max =
not reported
- Adaptation corruption noise sigma_adapt =
not reported
- Adaptation epochs and numbers of corruptions M =
LPN 200 epochs, GS 20 epochs; M not stated
axioms (5)
- domain assumption The target domain is representable by a structured proximal reference D_* = prox_{R_*}, with R_* differentiable at the deployed iterates.
- ad hoc to paper Assumption 3.3: every proximal subproblem H_k has a unique minimizer, is uniformly L_H-smooth, and satisfies the gradient-dominance inequality at every deployed iterate.
- ad hoc to paper For GS denoisers, every visited deployed output lies in Im(D_{sigma,*}), so the induced regularizer phi_{sigma,*} is finite and differentiable there.
- domain assumption The population PM minimizer converges to the MAP/proximal denoiser as gamma -> 0, under the consistency conditions of Fang et al. (2024).
- standard math Standard convex-analysis facts: the conjugate of an alpha-strongly convex function is 1/alpha-smooth; strongly monotone gradient maps are invertible; the descent lemma for L-smooth functions.
invented entities (2)
-
Target-domain reference proximal map D_* = prox_{R_*}
no independent evidence
-
Gaussian-smoothed posterior mode target D*_{PM,gamma}
no independent evidence
read the original abstract
Plug-and-play proximal gradient descent (PnP-PGD) enables flexible image reconstruction by using denoisers as implicit priors. In practice, these denoisers are often deployed outside their training domains. Existing analyses establish convergence under structural assumptions on the deployed denoiser, such as requiring it to be a proximal map or a contraction. However, they do not measure how domain mismatch affects convergence of PnP-PGD. We define this effect as \emph{proximal mismatch}: the discrepancy between a deployed denoiser $\widehat{\mathsf D}$ and a target-domain reference map $\mathsf D_\star=\operatorname{prox}_{R_\star}$ associated with the underlying regularizer $R_\star$. Under this mismatch, each denoising update becomes an inexact proximal step for the target objective. We further derive a stationarity bound that decays at a rate of $\mathcal{O}(1/K)$, with an additive term proportional to the average squared proximal mismatch. This result motivates adaptation via proximal matching rather than MSE-based adaptation alone. We study this approach with two established denoiser families: learned proximal networks and gradient-step denoisers. Experiments on Gaussian deblurring and super-resolution under substantial domain shift show that proximal matching adaptation improves reconstruction quality significantly over MSE-based adaptation, yielding the largest numerical gains in the few-shot regime.
Figures
Reference graph
Works this paper leans on
-
[1]
Journal of digital imaging , volume=
The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository , author=. Journal of digital imaging , volume=. 2013 , publisher=
2013
-
[2]
Advances in Neural Information Processing Systems , volume=
Unsupervised learning from incomplete measurements for inverse problems , author=. Advances in Neural Information Processing Systems , volume=
-
[3]
IEEE Signal Processing Magazine , volume=
Algorithm unrolling: Interpretable, efficient deep learning for signal and image processing , author=. IEEE Signal Processing Magazine , volume=. 2021 , publisher=
2021
-
[4]
Inverse Problems , volume=
Deep unrolling networks with recurrent momentum acceleration for nonlinear inverse problems , author=. Inverse Problems , volume=. 2024 , publisher=
2024
-
[5]
hal-04820468 , year=
Practical Operator Sketching Framework for Accelerating Iterative Data-Driven Solutions in Inverse Problems , author=. hal-04820468 , year=
-
[6]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Equivariant plug-and-play image reconstruction , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[7]
SIAM Journal on Imaging Sciences , volume=
A stochastic proximal alternating minimization for nonsmooth and nonconvex optimization , author=. SIAM Journal on Imaging Sciences , volume=. 2021 , publisher=
2021
-
[8]
Inverse Problems , year=
A guide to stochastic optimisation for large-scale inverse problems , author=. Inverse Problems , year=
-
[9]
Advances in Neural Information Processing Systems , pages=
On lazy training in differentiable programming , author=. Advances in Neural Information Processing Systems , pages=
-
[10]
Advances in Neural Information Processing Systems , volume=
Normalization layers are all that sharpness-aware minimization needs , author=. Advances in Neural Information Processing Systems , volume=
-
[11]
International Conference on Artificial Intelligence and Statistics , pages=
Convex geometry of two-layer relu networks: Implicit autoencoding and interpretable models , author=. International Conference on Artificial Intelligence and Statistics , pages=. 2020 , organization=
2020
-
[12]
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
Robust equivariant imaging: a fully unsupervised framework for learning to image from noisy and partial measurements , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
-
[13]
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
Image restoration by deep projected GSURE , author=. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
-
[14]
IEEE Transactions on Computational Imaging , volume=
An educated warm start for deep image prior-based micro CT reconstruction , author=. IEEE Transactions on Computational Imaging , volume=. 2022 , publisher=
2022
-
[15]
ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=
Image restoration using total variation regularized deep image prior , author=. ICASSP 2019-2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=. 2019 , organization=
2019
-
[16]
Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops , pages=
DeepRED: Deep image prior powered by RED , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops , pages=
-
[17]
IEEE Signal Processing Magazine , volume=
Deep internal learning: Deep learning from a single input , author=. IEEE Signal Processing Magazine , volume=. 2024 , publisher=
2024
-
[18]
Radon Series on Computational and Applied Mathematics , year=
Unsupervised approaches based on optimal transport and convex analysis for inverse problems in imaging , author=. Radon Series on Computational and Applied Mathematics , year=
-
[19]
Mathematical Programming , volume=
Parallel coordinate descent methods for big data optimization , author=. Mathematical Programming , volume=. 2016 , publisher=
2016
-
[20]
Medical physics , volume=
A three-dimensional statistical approach to improved image quality for multislice helical CT , author=. Medical physics , volume=. 2007 , publisher=
2007
-
[21]
Journal of optimization theory and applications , volume=
A primal--dual splitting method for convex optimization involving Lipschitzian, proximable and linear composite terms , author=. Journal of optimization theory and applications , volume=. 2013 , publisher=
2013
-
[22]
Advances in Computational Mathematics , volume=
A splitting algorithm for dual monotone inclusions involving cocoercive operators , author=. Advances in Computational Mathematics , volume=. 2013 , publisher=
2013
-
[23]
arXiv preprint arXiv:2006.11630 , year=
A Fast Stochastic Plug-and-Play ADMM for Imaging Inverse Problems , author=. arXiv preprint arXiv:2006.11630 , year=
Pith/arXiv arXiv 2006
-
[24]
Set-valued and variational analysis , volume=
A three-operator splitting scheme and its optimization applications , author=. Set-valued and variational analysis , volume=. 2017 , publisher=
2017
-
[25]
Masters Thesis (Supervisor: Junqi Tang and Mike Davies), University of Edinburgh , year=
Compressing Denoising Networks , author=. Masters Thesis (Supervisor: Junqi Tang and Mike Davies), University of Edinburgh , year=
-
[26]
arXiv preprint arXiv:2409.01985 , year=
UNSURE: Unknown Noise level Stein's Unbiased Risk Estimator , author=. arXiv preprint arXiv:2409.01985 , year=
-
[27]
arXiv preprint arXiv:1903.08764 , year=
Generalized Framework for Nonlinear Acceleration , author=. arXiv preprint arXiv:1903.08764 , year=
Pith/arXiv arXiv 1903
-
[28]
SIAM Journal on Imaging Sciences (to appear) , year=
Spring: A fast stochastic proximal alternating method for non-smooth non-convex optimization , author=. SIAM Journal on Imaging Sciences (to appear) , year=
-
[29]
arXiv preprint arXiv:2006.14798 , year=
Training convolutional relu neural networks in polynomial time: Exact convex optimization formulations , author=. arXiv preprint arXiv:2006.14798 , year=
Pith/arXiv arXiv 2006
-
[30]
IEEE/CVF Conference on Computer Vision and Pattern Recognition , year=
The Neural Tangent Link Between CNN Denoisers and Non-Local Filters , author=. IEEE/CVF Conference on Computer Vision and Pattern Recognition , year=
-
[31]
Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
Equivariant imaging: Learning beyond the range space , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
-
[32]
arXiv preprint arXiv:2312.11232 , year=
Self-supervised learning for image super-resolution and deblurring , author=. arXiv preprint arXiv:2312.11232 , year=
-
[33]
arXiv preprint arXiv:2410.08646 , year=
Fully Unsupervised Dynamic MRI Reconstruction via Diffeo-Temporal Equivariance , author=. arXiv preprint arXiv:2410.08646 , year=
-
[34]
arXiv preprint arXiv:2403.09327 , year=
Perspective-Equivariant Imaging: an Unsupervised Framework for Multispectral Pansharpening , author=. arXiv preprint arXiv:2403.09327 , year=
-
[35]
Journal of Machine Learning Research , volume=
Sensing theorems for unsupervised learning in linear inverse problems , author=. Journal of Machine Learning Research , volume=
-
[36]
International Conference on Machine Learning , pages=
Gradient projection iterative sketch for large-scale constrained least-squares , author=. International Conference on Machine Learning , pages=. 2017 , organization=
2017
-
[37]
SIAM Journal on Imaging Sciences , volume=
NF-ULA: Normalizing Flow-Based Unadjusted Langevin Algorithm for Imaging Inverse Problems , author=. SIAM Journal on Imaging Sciences , volume=. 2024 , publisher=
2024
-
[38]
SIAM Journal on Imaging Sciences , volume=
Provably convergent plug-and-play quasi-Newton methods , author=. SIAM Journal on Imaging Sciences , volume=. 2024 , publisher=
2024
-
[39]
IEEE Journal of Selected Topics in Signal Processing , volume=
RARE: Image reconstruction using deep priors learned without groundtruth , author=. IEEE Journal of Selected Topics in Signal Processing , volume=. 2020 , publisher=
2020
-
[40]
2023 , organization=
3D PET-DIP reconstruction with relative difference prior using a SIRF-based objective , author=. 2023 , organization=
2023
-
[41]
International Workshop on Machine Learning in Medical Imaging , pages=
StoDIP: Efficient 3D MRF image reconstruction with deep image priors and stochastic iterations , author=. International Workshop on Machine Learning in Medical Imaging , pages=. 2024 , organization=
2024
-
[42]
ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=
Parameter-Efficient Adaptation for Computational Imaging , author=. ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) , pages=. 2024 , organization=
2024
-
[43]
IEEE Transactions on Computational Imaging , volume=
The practicality of stochastic optimization in imaging inverse problems , author=. IEEE Transactions on Computational Imaging , volume=. 2020 , publisher=
2020
-
[44]
Proceedings of the 37th International Conference on Machine Learning , pages =
Neural Networks are Convex Regularizers: Exact Polynomial-time Convex Optimization Formulations for Two-layer Networks , author =. Proceedings of the 37th International Conference on Machine Learning , pages =. 2020 , volume =
2020
-
[45]
IEEE Transactions on Image Processing , volume=
External Patch-Based Image Restoration Using Importance Sampling , author=. IEEE Transactions on Image Processing , volume=. 2019 , publisher=
2019
-
[46]
arXiv preprint arXiv:2012.05169 , year=
Convex Regularization Behind Neural Reconstruction , author=. arXiv preprint arXiv:2012.05169 , year=
Pith/arXiv arXiv 2012
-
[47]
arXiv preprint arXiv:2006.02379 , year=
CNN Denoisers As Non-Local Filters: The Neural Tangent Denoiser , author=. arXiv preprint arXiv:2006.02379 , year=
Pith/arXiv arXiv 2006
-
[48]
arXiv preprint arXiv:2006.03224 , year=
Scalable Plug-and-Play ADMM with Convergence Guarantees , author=. arXiv preprint arXiv:2006.03224 , year=
Pith/arXiv arXiv 2006
-
[49]
Numerical Algorithms , volume=
AIR Tools II: algebraic iterative reconstruction methods, improved implementation , author=. Numerical Algorithms , volume=. 2018 , publisher=
2018
-
[50]
IEEE Transactions on Signal Processing , volume=
A stochastic majorize-minimize subspace algorithm for online penalized least squares estimation , author=. IEEE Transactions on Signal Processing , volume=. 2017 , publisher=
2017
-
[51]
Advances in Neural Information Processing Systems , pages=
Nonlinear acceleration of stochastic algorithms , author=. Advances in Neural Information Processing Systems , pages=
-
[52]
arXiv preprint arXiv:2003.03910 , year=
Geometry of First-Order Methods and Adaptive Acceleration , author=. arXiv preprint arXiv:2003.03910 , year=
Pith/arXiv arXiv 2003
-
[53]
fast iterative shrinkage/thresholding algorithm
On the convergence of the iterates of the “fast iterative shrinkage/thresholding algorithm” , author=. Journal of Optimization theory and Applications , volume=. 2015 , publisher=
2015
-
[54]
Stochastic quasi-Fej
Combettes, Patrick L and Pesquet, Jean-Christophe , journal=. Stochastic quasi-Fej. 2015 , publisher=
2015
-
[55]
arXiv preprint arXiv:1903.01687 , year=
Optimal algorithms for stochastic three-composite convex-concave saddle point problems , author=. arXiv preprint arXiv:1903.01687 , year=
Pith/arXiv arXiv 1903
-
[56]
arXiv preprint arXiv:1901.07114 , year=
Training neural networks as learning data-adaptive kernels: Provable representation and approximation benefits , author=. arXiv preprint arXiv:1901.07114 , year=
Pith/arXiv arXiv 1901
-
[57]
arXiv preprint arXiv:1908.05355 , year=
The generalization error of random features regression: Precise asymptotics and double descent curve , author=. arXiv preprint arXiv:1908.05355 , year=
Pith/arXiv arXiv 1908
-
[58]
arXiv preprint arXiv:2003.01897 , year=
Optimal Regularization Can Mitigate Double Descent , author=. arXiv preprint arXiv:2003.01897 , year=
Pith/arXiv arXiv 2003
-
[59]
Proceedings of the National Academy of Sciences , volume=
Reconciling modern machine-learning practice and the classical bias--variance trade-off , author=. Proceedings of the National Academy of Sciences , volume=. 2019 , publisher=
2019
-
[60]
arXiv preprint arXiv:2003.02237 , year=
Neural Kernels Without Tangents , author=. arXiv preprint arXiv:2003.02237 , year=
Pith/arXiv arXiv 2003
-
[61]
Using the Nystr
Williams, Christopher KI and Seeger, Matthias , booktitle=. Using the Nystr
-
[62]
Advances in neural information processing systems , pages=
Random features for large-scale kernel machines , author=. Advances in neural information processing systems , pages=
-
[63]
Advances in neural information processing systems , pages=
End-to-end kernel learning with supervised convolutional kernel networks , author=. Advances in neural information processing systems , pages=
-
[64]
Advances in Neural Information Processing Systems , pages=
Generalization properties of learning with random features , author=. Advances in Neural Information Processing Systems , pages=
-
[65]
Yang, Tianbao and Li, Yu-Feng and Mahdavi, Mehrdad and Jin, Rong and Zhou, Zhi-Hua , booktitle=. Nystr
-
[66]
Advances in Neural Information Processing Systems , pages=
Learning kernels with random features , author=. Advances in Neural Information Processing Systems , pages=
-
[67]
Artificial Intelligence and Statistics , pages=
Deep kernel learning , author=. Artificial Intelligence and Statistics , pages=
-
[68]
Proceedings of the AAAI Conference on Artificial Intelligence , volume=
Learning adaptive random features , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
-
[69]
Advances in Neural Information Processing Systems , pages=
Stochastic variational deep kernel learning , author=. Advances in Neural Information Processing Systems , pages=
-
[70]
Advances in neural information processing systems , pages=
On the global convergence of gradient descent for over-parameterized models using optimal transport , author=. Advances in neural information processing systems , pages=
-
[71]
arXiv preprint arXiv:1810.02054 , year=
Gradient descent provably optimizes over-parameterized neural networks , author=. arXiv preprint arXiv:1810.02054 , year=
-
[72]
Advances in Neural Information Processing Systems , pages=
Implicit regularization in matrix factorization , author=. Advances in Neural Information Processing Systems , pages=
-
[73]
Advances in Neural Information Processing Systems , pages=
Graph neural tangent kernel: Fusing graph neural networks with graph kernels , author=. Advances in Neural Information Processing Systems , pages=
-
[74]
arXiv preprint arXiv:1911.00809 , year=
Enhanced Convolutional Neural Tangent Kernels , author=. arXiv preprint arXiv:1911.00809 , year=
Pith/arXiv arXiv 1911
-
[75]
Advances in neural information processing systems , pages=
Learning and generalization in overparameterized neural networks, going beyond two layers , author=. Advances in neural information processing systems , pages=
-
[76]
Advances in Neural Information Processing Systems , pages=
Learning overparameterized neural networks via stochastic gradient descent on structured data , author=. Advances in Neural Information Processing Systems , pages=
-
[77]
arXiv preprint arXiv:1811.03804 , year=
Gradient descent finds global minima of deep neural networks , author=. arXiv preprint arXiv:1811.03804 , year=
-
[78]
arXiv preprint arXiv:1906.05827 , year=
Kernel and deep regimes in overparametrized models , author=. arXiv preprint arXiv:1906.05827 , year=
Pith/arXiv arXiv 1906
-
[79]
arXiv preprint arXiv:1902.01996 , year=
Are all layers created equal? , author=. arXiv preprint arXiv:1902.01996 , year=
Pith/arXiv arXiv 1902
-
[80]
arXiv preprint arXiv:2002.00585 , year=
Proving the Lottery Ticket Hypothesis: Pruning is All You Need , author=. arXiv preprint arXiv:2002.00585 , year=
Pith/arXiv arXiv 2002
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.