REVIEW 3 minor 69 references
An implicit function theorem for generalized equations with maximally monotone operators yields local Lipschitz continuity and semismoothness for solution mappings of convex regularized least-squares problems.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.3
2026-06-28 18:30 UTC pith:XT3MSLL2
load-bearing objection The paper gives a new implicit function theorem for generalized equations with monotone operators and smooth perturbations, then uses C2-cone reducibility to turn generalized Hessian kernels into first-order conditions for stability in regularized least-squares.
Stability results for regularized least-squares problems via generalized Hessian expressions and monotone generalized equations
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Under C^2-cone reducibility assumptions on the conjugate of the regularizer, the kernel of the generalized Hessian is characterized by the subspace parallel to the subdifferential, replacing difficult second-order objects by tractable first-order conditions; combined with the implicit function theorem for generalized equations, this produces local Lipschitz continuity, directional differentiability, and semismoothness of solution mappings for broad classes of regularized least-squares problems.
What carries the argument
Implicit function theorem for generalized equations governed by maximally monotone operators and smooth perturbations, together with the first-order characterization of generalized Hessian kernels under C^2-cone reducibility of the regularizer conjugate.
Load-bearing premise
The conjugate of the regularizer satisfies C^2-cone reducibility assumptions.
What would settle it
A concrete regularizer obeying the stated assumptions for which the associated solution mapping fails to be locally Lipschitz continuous, or a counterexample to the implicit function theorem under the given monotonicity and smoothness conditions.
If this is right
- Solution mappings for weighted polyhedral support-function regularizers are locally Lipschitz continuous and semismooth.
- Solution mappings for piecewise linear-quadratic penalties are locally Lipschitz continuous and semismooth.
- LASSO-type models inherit local stability from the monotone generalized equation framework.
- Second-order conditions can be replaced by first-order subdifferential conditions throughout the stability analysis.
Where Pith is reading between the lines
- The same monotone-equation machinery could be applied directly to other convex composite optimization problems beyond least-squares.
- Semismoothness of the solution map would support the use of semismooth Newton methods for solving the regularized problems numerically.
- The kernel characterization may simplify sensitivity analysis when the regularizer is the support function of a polyhedron.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper develops stability results for solution mappings of convex regularized least-squares problems. It first proves an implicit function theorem for generalized equations driven by maximally monotone operators under smooth perturbations, establishing local Lipschitz continuity, directional differentiability, and semismoothness of the solution map. It then gives a characterization of the kernel of the generalized Hessian of a convex function as the subspace parallel to the subdifferential, under C²-cone reducibility of the conjugate of the regularizer. These tools are applied to obtain explicit stability conditions for weighted polyhedral support-function regularizers and piecewise linear-quadratic penalties, unifying and extending prior Lipschitz-stability results for LASSO-type models.
Significance. If the derivations hold, the work supplies a technically coherent unification of monotone-operator implicit-function results with first-order kernel characterizations of generalized Hessians. The reduction of second-order objects to tractable first-order conditions under explicitly stated C²-cone reducibility is a useful organizational device for the classes of regularizers (polyhedral support functions, PLQ penalties) where the assumption is known to be satisfied. The manuscript therefore offers a systematic route to Lipschitz and semismooth stability statements that had previously been obtained case-by-case.
minor comments (3)
- The statement of the implicit-function theorem in the abstract does not specify the precise regularity required on the perturbation (e.g., C¹ versus C^{1,1}); the body should make the minimal differentiability assumption explicit so that the semismoothness conclusion can be traced directly to it.
- Notation for the generalized Hessian and its kernel should be introduced once, with a clear reference to the definition used in the monotone-operator literature, to avoid any ambiguity when the kernel characterization is applied in the stability theorems.
- The applications section would benefit from a short table listing the concrete regularizers covered, the corresponding C²-cone reducibility verification, and the resulting stability modulus; this would make the unification claim immediately verifiable.
Simulated Author's Rebuttal
We thank the referee for the positive assessment of the manuscript, the accurate summary of its contributions, and the recommendation of minor revision. The significance statement correctly identifies the value of unifying the monotone-operator implicit-function theorem with first-order kernel characterizations under C²-cone reducibility.
Circularity Check
No significant circularity
full rationale
The derivation rests on an implicit function theorem for maximally monotone generalized equations (standard in the literature) followed by a kernel characterization of generalized Hessians under the explicitly declared C^2-cone reducibility assumption on the conjugate; both steps are independent of any fitted quantities or self-citation chains internal to the paper, and the applications to polyhedral and piecewise linear-quadratic cases follow directly from the stated assumptions without reduction to inputs by construction.
Axiom & Free-Parameter Ledger
axioms (2)
- standard math Maximal monotonicity of the governing operator
- domain assumption C^2-cone reducibility of the conjugate of the regularizer
read the original abstract
We study perturbation and stability properties of solution mappings associated with convex regularized least-squares problems. We first establish an implicit function theorem for generalized equations governed by maximally monotone operators and smooth perturbations, yielding conditions for local Lipschitz continuity, directional differentiability, and semismoothness of solution mappings. We then characterize the kernel of generalized Hessians of convex functions through the subspace parallel to the subdifferential under $C^2$-cone reducibility assumptions on the conjugate of the regularizer, thereby replacing difficult second-order objects by tractable first-order conditions. As applications, we derive stability results for broad classes of regularized least-squares problems, including weighted polyhedral support-function regularizers and piecewise linear-quadratic penalties. Our framework unifies and extends several recent results on Lipschitz stability for LASSO-type models and monotone generalized equations.
Reference graph
Works this paper leans on
-
[1]
F. J. Artacho Arag\'on and M. H. Geoffroy: Characterization of metric regularity of subdifferentials. J. Convex Anal. 15 (2), 365--380, 2008
2008
-
[2]
Auslender and M
A. Auslender and M. Teboulle: Asymptotic Cones and Functions in Optimization and Variational Inequalities. Springer Monographs in Mathematics. Springer, New York, 2003
2003
-
[3]
Belloni, V
A. Belloni, V. Chernozhukov, and L. Wang: Square-root LASSO: Pivotal recovery of sparse signals via conic programming. Biometrika 98 , 791--806, 2011
2011
-
[4]
Belloni, V
A. Belloni, V. Chernozhukov, and L. Wang: Pivotal estimation via square-root Lasso in nonparametric regression. Ann. Statist. 42 , 757--788, 2014
2014
-
[5]
A. Berk, S. Brugiapaglia, and T. Hoheisel: LASSO reloaded: A variational analysis perspective with applications to compressed sensing. SIAM J. Math. Data Sci., 2023
2023
-
[6]
A. Berk, S. Brugiapaglia, and T. Hoheisel: Square root lasso: Well-posedness, Lipschitz stability, and the tuning trade-off. SIAM J. Optim. 34 (3), 2609--2637, 2024
2024
-
[7]
Bolte, T
J. Bolte, T. Le, E. Pauwels, and A. Silveti-Falls: Nonsmooth implicit differentiation for machine learning and optimization. Adv. Neural Inf. Process. Syst. 34 , 2021
2021
-
[8]
Bolte, E
J. Bolte, E. Pauwels, and A. Silveti-Falls: Differentiating nonsmooth solutions to parametric monotone inclusion problems. SIAM J. Optim. 34 (1), 71--97, 2024
2024
-
[9]
Bonnans and H
J.F. Bonnans and H. Ram\'irez: Perturbation analysis of second-order cone programming problems. Math. Program. 104 (2):205--227, 2005
2005
-
[10]
J. F. Bonnans and A. Shapiro: Perturbation Analysis of Optimization Problems. Springer Series in Operations Research. Springer-Verlag, New York, 2000
2000
-
[11]
E. J. Cand\`es and B. Recht: Exact matrix completion via convex optimization. Found. Comput. Math. 9 , 717--772, 2009
2009
-
[12]
Clarke: Optimization and Nonsmooth Analysis
F. Clarke: Optimization and Nonsmooth Analysis. Society for Industrial and Applied Mathematics, Philadelphia, PA, 1990
1990
-
[13]
Y. Cui, C. Ding, X. Zhao : Quadratic growth conditions for convex matrix optimization problems associated with spectral functions. SIAM J. Optim. 27(4):2332--2355, 2017
2017
-
[14]
Y. Cui, T. Hoheisel, T. T. A. Nghia, and D. Sun: Lipschitz stability of least-squares problems regularized by functions with C ^2 -cone reducible conjugates. Math. Oper. Res., to appear, 2026. https://doi.org/10.1287/moor.2024.0692
-
[15]
A. L. Dontchev and R. T. Rockafellar: Implicit Functions and Solution Mappings: A View from Variational Analysis, 2nd ed. Springer Series in Operations Research and Financial Engineering. Springer, New York, 2014
2014
-
[16]
Fazel: Matrix rank minimization with applications
M. Fazel: Matrix rank minimization with applications. Ph.D. thesis, Stanford University, Stanford, CA, 2002
2002
-
[17]
M. P. Friedlander, A. Goodwin, and T. Hoheisel: From perspective maps to epigraphical projections. Math. Oper. Res. 49 (1), 1--26, 2024
2024
-
[18]
Genzel, G
M. Genzel, G. Kutyniok, and M. M\"arz: A new perspective on the sample complexity of the analysis basis pursuit. In 5th International Workshop on Compressed Sensing Applied to Radar, Multimodal Sensing, and Imaging (CoSeRa) , EURASIP, 2018
2018
-
[19]
Gfrerer: On directional metric subregularity and second-order optimality conditions for a class of nonsmooth mathematical programs
H. Gfrerer: On directional metric subregularity and second-order optimality conditions for a class of nonsmooth mathematical programs. SIAM J. Optim. 23 (1), 632--665, 2013
2013
-
[20]
Gfrerer and J
H. Gfrerer and J. V. Outrata: On a semismooth* Newton method for solving generalized equations. SIAM J. Optim. 31 (1), 489--517, 2021
2021
-
[21]
Henrion, J
R. Henrion, J. Outrata, and T. Surowiec: On the co-derivative of normal cone mappings to inequality systems. Nonlinear Anal. 71 (3--4), 1213--1226, 2009
2009
- [22]
-
[23]
Horn and C
R. Horn and C. R. Johnson: Matrix Analysis, 2nd ed. Cambridge University Press, Cambridge, 2013
2013
-
[24]
Kojima: Strongly stable stationary solutions in nonlinear programs
M. Kojima: Strongly stable stationary solutions in nonlinear programs. In S. M. Robinson, ed., Analysis and Computation of Fixed Points , Academic Press, New York, 93--138, 1980
1980
-
[25]
B. S. Mordukhovich: Nonsmooth analysis with nonconvex generalized differentials and adjoint mappings. Dokl. Akad. Nauk BSSR 28 , 976--979, 1984
1984
-
[26]
B. S. Mordukhovich: Sensitivity analysis in nonsmooth optimization. In Theoretical Aspects of Industrial Design , D. A. Field and V. Komkov, eds., SIAM Proc. Appl. Math. 58 , SIAM, Philadelphia, PA, 32--46, 1992
1992
- [27]
-
[28]
Mifflin: Semismooth and semiconvex functions in constrained optimization
R. Mifflin: Semismooth and semiconvex functions in constrained optimization. SIAM J. Control Optim. 15 , 957--972, 1977
1977
-
[29]
Mohammadi, B
A. Mohammadi, B. S. Mordukhovich, and M. E. Sarabi: Parabolic regularity in geometric variational analysis. Trans. Amer. Math. Soc. 374 , 1711--1763, 2021
2021
-
[30]
Mohammadi, B
A. Mohammadi, B. S. Mordukhovich, and M. E. Sarabi: Variational analysis of composite models with applications to continuous optimization. Math. Oper. Res. 47 (1), 397--426, 2022
2022
-
[31]
Mohammadian and M
A. Mohammadian and M. E. Sarabi: Twice epi-differentiability of extended-real-valued functions with applications in composite optimization. SIAM J. Optim. 30 (3), 2379--2409, 2020
2020
-
[32]
B. S. Mordukhovich: Variational Analysis and Generalized Differentiation I. Grundlehren der Mathematischen Wissenschaften. Springer, Berlin, 2006
2006
-
[33]
B. S. Mordukhovich: Variational Analysis and Applications. Springer Monographs in Mathematics. Springer, Cham, 2018
2018
- [34]
-
[35]
Poliquin and R
R. Poliquin and R. T. Rockafellar: Tilt stability of a local minimum. SIAM J. Optim. 8 (2), 287--299, 1998
1998
-
[36]
Qi and J
L. Qi and J. Sun: A nonsmooth version of Newton's method. Math. Program. 58 , 353--367, 1993
1993
-
[37]
Recht, M
B. Recht, M. Fazel, and P. A. Parrilo: Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization. SIAM Rev. 52 (3), 471--501, 2010
2010
-
[38]
S. M. Robinson: Strongly regular generalized equations. Math. Oper. Res. 5 (1), 43--62, 1980
1980
-
[39]
S. M. Robinson: Local structure of feasible sets in nonlinear programming, part II: Nondegeneracy. In B. Korte and K. Ritter, eds., Mathematical Programming at Oberwolfach II , Math. Program. Stud. 22 , Springer, Berlin, 217--230, 1984
1984
-
[40]
S. M. Robinson: Local structure of feasible sets in nonlinear programming, part III: Stability and sensitivity. In B. Cornet, V. H. Nguyen, and J. P. Vial, eds., Nonlinear Analysis and Optimization , Math. Program. Stud. 30 , Springer, Berlin, 45--66, 1987
1987
-
[41]
R. T. Rockafellar: Convex Analysis. Princeton University Press, Princeton, NJ, 1970
1970
-
[42]
R. T. Rockafellar: Generalized second derivatives of convex functions and saddle functions. Trans. Amer. Math. Soc. 322 (1), 51--77, 1990
1990
-
[43]
R. T. Rockafellar and B. S. Mordukhovich: Second-order subdifferential calculus with applications to tilt stability in optimization. SIAM J. Optim. 22 (3), 953--986, 2012
2012
-
[44]
R. T. Rockafellar and R. J.-B. Wets: Variational Analysis. Grundlehren der Mathematischen Wissenschaften, Vol. 317. Springer-Verlag, Berlin, 1998
1998
-
[45]
R. T. Rockafellar and D. Zagrodny: A derivative-coderivative inclusion in second-order nonsmooth analysis. Set-Valued Anal. 5 , 89--105, 1997
1997
-
[46]
F. Santosa and W. W. Symes: Linear inversion of band-limited reflection seismograms. SIAM J. Sci. Statist. Comput. 7 , 1307--1330, 1986. https://doi.org/10.1137/0907087
-
[47]
Shapiro: Sensitivity analysis of generalized equations
A. Shapiro: Sensitivity analysis of generalized equations. J. Math. Sci. 115 (4), 2554--2565, 2003
2003
-
[49]
Tibshirani: Regression shrinkage and selection via the lasso
R. Tibshirani: Regression shrinkage and selection via the lasso. J. Roy. Statist. Soc. Ser. B 58 (1), 267--288, 1996
1996
-
[50]
Vaiter, C
S. Vaiter, C. Deledalle, J. Fadili, G. Peyr\'e, and C. Dossal: Low complexity regularization of linear inverse problems. In Sampling Theory, a Renaissance , Appl. Numer. Harmon. Anal., Birkh\"auser/Springer, 103--153, 2015
2015
-
[51]
Vaiter, C
S. Vaiter, C. Deledalle, J. Fadili, G. Peyr\'e, and C. Dossal: The degrees of freedom of partly smooth regularizers. Ann. Inst. Statist. Math. 69 , 791--832, 2017
2017
-
[52]
Yuan and Y
M. Yuan and Y. Lin: Model selection and estimation in regression with grouped variables. J. Roy. Statist. Soc. Ser. B 68 (1), 49--67, 2006
2006
-
[53]
Belloni, V
A. Belloni, V. Chernozhukov, and L. Wang: Square-root LASSO: Pivotal recovery of sparse signals via conic programming. Biometrika 98 , pp. 791--806, 2011
2011
-
[54]
Belloni, V
A. Belloni, V. Chernozhukov, and L. Wang:
-
[55]
A. Berk, S. Brugiapaglia, and T. Hoheisel: Square root lasso: Well-posedness, Lipschitz stability, and the tuning trade-off
-
[56]
Bolte, T
J. Bolte, T. Le, E. Pauwels, and A. Silveti-Falls:
-
[57]
Cand\`es, and B
E.J. Cand\`es, and B. Recht:
-
[58]
Genzel, G
M. Genzel, G. Kutyniok, M. März:
-
[59]
Kojima: Strongly stable stationary solutions in nonlinear programs
M. Kojima: Strongly stable stationary solutions in nonlinear programs. Robinson SM, ed. Analysis and Computation of Fixed Points
-
[60]
Mordukhovich: Nonsmooth analysis with nonconvex generalized differentials and adjoint mappings
B.S. Mordukhovich: Nonsmooth analysis with nonconvex generalized differentials and adjoint mappings. Doklady Akademii Nauk BSSR 28 , pp. 976--979, 1984
1984
-
[61]
Mordukhovich: Sensitivity analysis in nonsmooth optimization
B.S. Mordukhovich: Sensitivity analysis in nonsmooth optimization
-
[62]
Recht, M
B. Recht, M. Fazel, and P.A. Parrilo: Guaranteed minimum-rank solutions of linear matrix equations via nuclear norm minimization
-
[63]
Robinson: Strongly regular generalized equations
S.M. Robinson: Strongly regular generalized equations. Mathetmatics of Operations Research 5(1), 1980, pp. 43–62
1980
-
[64]
Robinson: Local structure of feasible sets in nonlinear programming, part II
S.M. Robinson: Local structure of feasible sets in nonlinear programming, part II. Nondegeneracy. Korte B, Ritter K, eds. Mathemati-
-
[65]
Robinson: Local structure of feasible sets in nonlinear programming, part III
S.M. Robinson: Local structure of feasible sets in nonlinear programming, part III. Stability and sensitivity. Cornet B, Nguyen VH,
-
[66]
Santosa and W
F. Santosa and W. W. Symes:
-
[67]
P. Tang and C. Wang: Perturbation analysis of a class of composite optimization problems, arXiv:2401.10728, 2024
-
[68]
Vaiter, C
S. Vaiter, C. Deledalle, J. Fadili, G. Peyr\'e, and C. Dossal:
-
[69]
Vaiter, C
S. Vaiter, C. Deledalle, J. Fadili, G. Peyr\'e, and C. Dossal: The degrees of freedom of
-
[70]
Yuan and Y
M. Yuan and Y. Lin Model Selection and Estimation in Regression with Grouped Variables. Journal of the Royal Statistical Society: Series B (statistical Methodology) 68 (1) , pp. 49–67, 2006
2006
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.