Pith. sign in

REVIEW 2 major objections 4 minor 2 cited by

Generalized Twice Differentiability and Quadratic Bundles in Second-Order Variational Analysis

T0 review · 2 major / 4 minor · reviewed 2026-08-10 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Every prox-regular function has a nonempty quadratic bundle at every subgradient point, and generalized twice differentiability is characterized by classical twice differentiability of the Moreau envelope.

desk verdict Solid Moreau-envelope characterization for prox-bounded functions, but the nonemptiness theorem for prox-regular functions rests on a missing local version of Lemma 5.1. read the letter →

arxiv 2501.02067 v1 pith:AKMHX5PP submitted 2025-01-03 math.OC

Pham Duy Khanh , Boris S. Mordukhovich , Vo Thanh Phat , Le Duc Viet This is my paper · ORCID
classification math.OC MSC 49J5249J5390C31
keywords generalizedtwicedifferentiabilityquadraticbundlesprox-regularfunctionsMoreauenvelopessecond-ordervariationalanalysisnonsmoothoptimizationconvexityepi-convergence
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper studies two recently introduced second-order constructions for nonsmooth functions: generalized twice differentiability and quadratic bundles. It aims to show that every prox-regular function—a broad class of extended-real-valued lower-semicontinuous functions that includes convex, $C^{1,1}$, and lower-$C^2$ functions—has at least one quadratic second-order model, called a quadratic bundle, at every subgradient point. It also establishes a bridge: for such functions, generalized twice differentiability is equivalent to classical twice differentiability of the associated Moreau envelope at a shifted point. If the main results are right, nonsmooth optimization gains a robust primal-space second-order calculus that could support new optimality conditions and convergence proofs for proximal-type algorithms.

What carries the argument

The Moreau envelope $e_\lambda f(x)=\inf_u\{f(u)+\frac{1}{2\lambda}\|u-x\|^2\}$ and its proximal mapping $P_\lambda f$. On a neighborhood of $\bar{x}+\lambda\bar{v}$, the envelope is $C^{1,1}$ and its gradient satisfies $\nabla e_\lambda f=[\lambda I+T_\varepsilon^{-1}]^{-1}$, where $T_\varepsilon$ is an $f$-attentive localization of the subdifferential. This identity transfers classical twice differentiability of the smooth envelope back to generalized twice differentiability of $f$, and lets Hessian limits of the envelope be pulled back through the proximal mapping to construct the quadratic bundle.

What would settle it

Take a function that is prox-regular at $\bar{x}$ for $\bar{v}$ but not prox-bounded on all of $\mathbb{R}^n$, and check whether $\nabla e_\lambda f=[\lambda I+T_\varepsilon^{-1}]^{-1}$ holds on some neighborhood of $\bar{x}+\lambda\bar{v}$; if it fails, the sequence $(x_k,v_k)=(z_k-\lambda\nabla e_\lambda f(z_k),\nabla e_\lambda f(z_k))$ need not stay in $\operatorname{gph}\partial f$, and the nonemptiness proof of Theorem 6.11 collapses.

Watch

Extended reading notes

Core claim

The central claim is that quadratic bundles are always nonempty for prox-regular functions: at every pair $(\bar{x},\bar{v})\in\operatorname{gph}\partial f$, the bundle $\operatorname{quad} f(\bar{x}|\bar{v})$ contains at least one generalized quadratic form (Theorem 6.11). The engine behind this is Theorem 5.8: if $f$ is prox-bounded on $\mathbb{R}^n$ and $r$-level prox-regular at $\bar{x}$ for $\bar{v}$, then $f$ is generalized twice differentiable at $\bar{x}$ for $\bar{v}$ if and only if the Moreau envelope $e_\lambda f$ is twice differentiable at $\bar{x}+\lambda\bar{v}$ for every $\lambda\in(0,1/r)$. Since the envelope of a prox-regular function is $C^{1,1}$ around the shifted point, its Hessian bundle is nonempty; pulling Hessian limits back through the proximal mapping yields approximating primal-dual pairs $(x_k,v_k)$ where $f$ is generalized twice differentiable, and the epigraphical limits of the corresponding half second-order subderivatives populate the bundle.

Load-bearing premise

The proofs use a local gradient identity for the Moreau envelope that is formally stated only under global prox-boundedness, so the key step assumes an unstated local version for merely prox-regular functions.

Editorial extensions

If this is right

  • Every prox-regular function has at least one generalized quadratic second-order model at every subgradient pair, so the quadratic bundle is a universally available object for nonsmooth variational analysis.
  • Generalized twice differentiability of a prox-regular function is equivalent to classical twice differentiability of its Moreau envelope, uniformly along $f$-attentive localizations of the subdifferential.
  • For $C^{1,1}$ subdifferentially continuous functions, the quadratic bundle coincides with the set of half-Hessian quadratic forms from the Hessian bundle, recovering classical Hessian limits.
  • Adding a $C^2$-smooth function shifts the quadratic bundle by the half Hessian quadratic form, giving a basic sum rule.
  • The set of points where $f$ is generalized twice differentiable is dense in the subdifferential graph locally for prox-regular functions.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the local envelope identity holds without global prox-boundedness, the nonemptiness result would extend to a wider class; if not, a counterexample would show the proof's limit.
  • The Moreau-envelope characterization suggests a computational route: approximate second-order information for a nonsmooth prox-regular $f$ by classical Hessians of $e_\lambda f$, which could inform proximal and augmented-Lagrangian algorithms.
  • The revised $f$-attentive definition implies that for functions lacking subdifferential continuity, the old quadratic bundle can overcount; the new bundle may be the right object for detecting strong variational convexity and tilt stability.
  • One could test whether different sequences of Hessian limits of the envelope yield different elements of the bundle; if they do, the bundle is genuinely larger than the envelope's Hessian bundle, and the extra elements would carry information about the nonsmooth cusp.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 4 minor

Summary. The paper develops a second-order variational analysis of Rockafellar's recently introduced notions of generalized twice differentiability and quadratic bundles for extended-real-valued functions. The main results are: a characterization of generalized twice differentiability of prox-bounded, r-level prox-regular functions via classical twice differentiability of their Moreau envelopes (Theorem 5.8); a localized version of this characterization over f-attentive subdifferential localizations (Corollary 5.9); density of the set of generalized twice differentiable points in the graph of the subdifferential for prox-regular functions (Theorem 6.1); a sum rule for quadratic bundles (Theorem 6.6); a connection between quadratic bundles and Hessian bundles for C^{1,1} functions (Theorem 6.8); and the central nonemptiness assertion that every prox-regular function has nonempty quadratic bundle (Theorem 6.11). The paper also contains several instructive examples showing sharpness of the hypotheses.

Significance. If the main results hold, the paper provides a substantial step toward a usable primal-space second-order calculus: it gives a concrete test for generalized twice differentiability through Moreau envelopes and establishes a fundamental existence property for quadratic bundles of prox-regular functions, which is promising for tilt stability, variational convexity, and algorithmic applications. The paper is well structured, the proofs are detailed, and the examples are informative, including sharp counterexamples to natural extensions. The main weakness is a formal gap in the local use of the Moreau-envelope machinery: the nonemptiness theorem is proved under hypotheses weaker than those of the key lemma it invokes, and the missing local version is not supplied.

major comments (2)
  1. [§5, Lemma 5.3] Lemma 5.3 is stated for f prox-regular at xbar for vbar, with no global prox-boundedness assumption, but its proof invokes Lemma 5.1, whose hypotheses require f to be prox-bounded on all of R^n. This is not a cosmetic mismatch: without prox-boundedness the conclusion of Lemma 5.1 can fail dramatically. For example, f(x)=0 on B(0,1) and f(x)=-(||x||-1)^4 outside B(0,1) is variationally convex (hence prox-regular) at 0 for 0, but its Moreau envelope e_λ f is identically -∞ for every λ>0, so Lemma 5.1's C^{1,1} envelope conclusion is false. Therefore the proof of Lemma 5.3, and in particular the construction of the sequences (x_k,v_k) in (5.2), is not justified under the stated hypotheses. A local version of Lemma 5.1, or a truncation argument showing that one may pass to a prox-bounded function agreeing with f near (xbar,vbar), is needed.
  2. [§6, Theorem 6.11 and Theorem 6.1(i)] The proof of the central nonemptiness theorem uses Lemma 5.3 and then applies Corollary 5.9 to the resulting points (x_k,v_k). Corollary 5.9 is stated under the global prox-boundedness assumption of Theorem 5.8, but Theorem 6.11 assumes only prox-regularity at (xbar,vbar). Thus the proof of nonemptiness of quad f(xbar|vbar) is formally incomplete as written. The same gap affects Theorem 6.1(i), whose proof applies Lemma 5.1 to each point of an f-attentive localization; the required envelope regularity at those points is only guaranteed by the global lemma. Since the nonemptiness claim is the paper's headline application, this is a load-bearing issue. The gap appears repairable, for instance by localizing or truncating f while preserving the f-attentive subdifferential graph and the quadratic bundle, but that argument is not present in the manuscript.
minor comments (4)
  1. [§5, proof of Theorem 5.8] After equation (5.14) the text states 'Since 1/λ < r', but the hypothesis λ ∈ (0,1/r) gives 1/λ > r; the displayed inequality sign appears to be reversed. The argument needs 1/λ > r to conclude that B + (1/λ)I is positive definite.
  2. [§6, proofs of Theorem 6.8 and Theorem 6.11] There are incorrect cross-references: in the proof of Theorem 6.8, 'Remark 6.4(ii)' should be 'Remark 6.4(iv)', and in the proof of Theorem 6.11, 'Remark 6.4(i)' should be 'Proposition 6.2(i)' (or 'Remark 6.4(iii)') and the subsequent 'Remark 6.4(ii)' should be 'Remark 6.4(iv)'.
  3. [§4, Example 4.7] The example states that ∇f(x) = |x| for f(x)=x^2 sgn(x), but the correct derivative is ∇f(x)=2|x|. The factor 2 does not affect the argument, which uses only ∇f(0)=0, but the displayed formula should be corrected.
  4. [Throughout] There are several typographical slips, e.g., 'Deduce now from by [6, Lemma 2.2]' in the proof of Proposition 5.4, 'ix extended to to the same' in Lemma 5.7, and 'gph Tε(x,v)' notation in Proposition 3.3 that is not standard for a set-valued mapping. These should be cleaned up.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the Moreau-envelope characterization and quadratic-bundle nonemptiness are derived from external envelope calculus and epi-convergence; the only flagged issue is a local-vs-global prox-boundedness gap, which is a formal completeness problem, not circularity.

full rationale

The paper's derivation chain is self-contained against external benchmarks and does not, on inspection, reduce any claimed result to its own inputs. The central characterization Theorem 5.8 is proved from Rockafellar–Wets' external envelope calculus: Lemma 5.1 is 'extracted from [30, Proposition 13.37]', Proposition 5.4 uses '[30, Exercise 13.45]', and the final step (ii)=>(i) applies '[30, Proposition 13.40]' to infer a generalized quadratic form from the n-dimensional linear subspace gph DTε. Theorem 6.11 obtains nonemptiness of quad f(xbar|vbar) by taking a point H in the nonempty Hessian bundle of the C^{1,1} Moreau envelope eλf (nonempty by [30, Theorem 13.52]), transferring twice differentiability of eλf back to generalized twice differentiability of f via Corollary 5.9, and applying Proposition 6.2 to extract an epi-convergent subsequence whose limit is a generalized quadratic form by Remark 6.4(iv). No fitted parameter is renamed as a prediction, and no uniqueness theorem is imported from the authors' own prior work. The only self-citation, [12] in Remark 6.4(ii), is explicitly motivational ('Various results and discussions in this direction are given in our forthcoming manuscript [12]') and is not used in any proof. The one substantive concern is a formal hypothesis mismatch: Lemma 5.1 is stated and proved only for functions that are prox-bounded on all of R^n, yet Lemma 5.3, Theorem 6.1(i), and Theorem 6.11 invoke it under only local prox-regularity at (xbar,vbar). A globally prox-bounded truncation argument (or a local version of [30, Proposition 13.37]) is not supplied, so the proofs of these results are formally incomplete for prox-regular functions that are not prox-bounded. This is a correctness/completeness risk, not circularity: the missing premise is not the target conclusion, and the cited envelope facts are external, independently established results. Therefore the circularity score is 0.

Assumptions & free parameters 0 free parameters · 6 assumptions · 0 invented entities

The central results rest on standard second-order variational analysis and on the Moreau-envelope theory for prox-regular functions, all cited from [22, 30] and related literature. No numerical fitting is involved. The main definitional input is Rockafellar's generalized quadratic forms and quadratic bundles, which are the objects under study rather than free postulates.

assumptions (6)
  • domain assumption Moreau envelope of an r-level prox-regular function is C^{1,1} on a neighborhood of x+λv with gradient ∇e_λ f = [λI + T_ε^{-1}]^{-1} for λ ∈ (0, 1/r).
    Invoked as Lemma 5.1 to build approximating sequences and to transfer twice differentiability between f and its Moreau envelope in Theorem 5.8, Theorem 6.1, and Theorem 6.11.
  • domain assumption Hessian bundles of C^{1,1} functions are nonempty and compact ([30, Theorem 13.52]).
    Used in Theorem 6.1 and Theorem 6.11 to obtain points z_k where the Moreau envelope is twice differentiable.
  • standard math For epi-convergent convex functions, subdifferentials converge graphically ([30, Theorem 12.35]).
    Used in Proposition 6.2(ii) to prove the epi-limit of generalized quadratic forms is a generalized quadratic form.
  • standard math For twice epi-differentiable f, ∂(1/2 d2 f(x|v)) = D T_ε(x|v) for the f-attentive localization ([30, Proposition 13.40]).
    Used in Theorem 5.8(ii) to convert proto-differentiability of the localization into the generalized quadratic form property.
  • domain assumption A prox-regular twice epi-differentiable function with finite second subderivative has a quadratic expansion ([22, Theorem 6.7]).
    Used in Theorem 4.5(ii) to derive classical twice differentiability from a finite generalized quadratic second subderivative.
  • standard math Epi-convergence is preserved under addition with continuously converging functions ([30, Theorem 7.46]).
    Used in Proposition 4.8 and Theorem 6.6 to handle sums with smooth additions and to pass limits of quadratic forms.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Generalized Twice Differentiability and Quadratic Bundles in Second-Order Variational Analysis." pith.science (2026). https://pith.science/paper/AKMHX5PP

@misc{pith2026250102067,
  author       = {Pith},
  title        = {Pith review of: Generalized Twice Differentiability and Quadratic Bundles in Second-Order Variational Analysis},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/AKMHX5PP}},
  note         = {Machine review of arXiv:2501.02067}
}
read the original abstract

In this paper, we investigate the concepts of generalized twice differentiability and quadratic bundles of nonsmooth functions that have been very recently proposed by Rockafellar in the framework of second-order variational analysis. These constructions, in contrast to second-order subdifferentials, are defined in primal spaces. We develop new techniques to study generalized twice differentiability for a broad class of prox-regular functions, establish their novel characterizations. Subsequently, quadratic bundles of prox-regular functions are shown to be nonempty, which provides the ground of potential applications in variational analysis and optimization.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. On the hardness of deterministic second-order optimization of functions with Lipschitz gradients

    math.OC 2026-07 accept novelty 7.0 of 10

    No deterministic zero-respecting second-order algorithm can compute Goldstein approximate second-order stationary points of C^{1,1} functions within finitely many oracle calls; general deterministic algorithms need at...

  2. Characterizations of Variational Convexity and Tilt Stability via Quadratic Bundles

    math.OC 2025-01 accept novelty 5.0 of 10

    Prox-regular functions are variationally s-convex or have tilt-stable minimizers exactly when their quadratic bundles satisfy a uniform quadratic lower bound, without requiring subdifferential continuity.

Reference graph

Works this paper leans on

31 extracted references · 19 canonical work pages · cited by 2 Pith papers

  1. [1]

    Attouch, Variational Convergence for Functions and Operators , Pitman, London, 1984

    A. Attouch, Variational Convergence for Functions and Operators , Pitman, London, 1984

    work page 1984

  2. [2]

    Attouch and R

    H. Attouch and R. J-B. Wets, A convergence theory for sadd le functions, Trans. Amer. Math. Soc. 280 (1983), 1–41

    work page 1983

  3. [3]

    Drusvyatskiy, B

    D. Drusvyatskiy, B. S. Mordukhovich and T. T. A. Nghia, Se cond-order growth, tilt stability, and metric regularity of the subdifferential, J. Convex Anal. 21 (2014), 1165–1192

    2014

  4. [4]

    Gfrerer, On second-order variational analysis of var iational convexity of prox-regular functions, arXiv:2408.13795 (2024)

    H. Gfrerer, On second-order variational analysis of var iational convexity of prox-regular functions, arXiv:2408.13795 (2024)

    arXiv 2024

  5. [5]

    Gfrerer and B

    H. Gfrerer and B. S. Mordukhovich, Complete characteriz ations of tilt stability in nonlinear pro- gramming under weakest qualification conditions, SIAM J. Optim. 25 (2015), 2081–2119

    2015

  6. [6]

    W. L. Hare and R. A. Poliquin, Prox-regularity and stabil ity of the proximal mapping, J. Convex Anal. 14 (2007), 589–606

    work page 2007

  7. [7]

    A. F. Izmailov and M. V. Solodov, Newton-Type Methods for Optimization and Variational Prob lems, Springer, New York, 2014

    work page 2014

  8. [8]

    P. D. Khanh, V. V. H. Khoa, B. S. Mordukhovich and V. T. Phat , Variational and strong variational convexity in infinite-dimensional variational analysis, SIAM J. Optim. 34 (2024), 2756–2787

    work page 2024

Show all 31 references
  1. [9]

    P. D. Khanh, V. V. H. Khoa, B. S. Mordukhovich, and V.T. Pha t, Second-order subdifferential opti- mality conditions in nonsmooth optimization, to appear in SIAM J. Optim. (23025) arXiv:2312.16277

    arXiv

  2. [10]

    P. D. Khanh, B. S. Mordukhovich and V. T. Phat, Coderivat ive-based Newton methods in structured nonconvex and nonsmooth optimization, arXiv:2403.04262 (2024)

    2024

  3. [11]

    P. D. Khanh, B. S. Mordukhovich and V. T. Phat, Variation al convexity of functions and variational sufficiency in optimization, SIAM J. Optim. 33 (2023). 1121–1158

    2023

  4. [12]

    P. D. Khanh, B. S. Mordukhovich, V. T. Phat and L. D. Viet, Characterizations of variational convexity and tilt stability via quadratic bundles, prepri nt (2024). 30

    2024

  5. [13]

    Mohammadi, B

    A. Mohammadi, B. S. Mordukhovich and M. E. Sarabi, Parab olic regularity in geometric variational analysis, Trans. Amer. Soc. 374 (2021), 711–763

    2021

  6. [14]

    Mohammadi and M

    A. Mohammadi and M. E. Sarabi, Twice epi-differentiabili ty of extended-real-valued functions with applications to composite optimization, SIAM J. Optim. 30 (2020), 2379–2409

    2020

  7. [15]

    B. S. Mordukhovich, Variational Analysis and Generalized Differentiation, I: Ba sic Theory, Springer, Berlin, 2006

    2006

  8. [16]

    B. S. Mordukhovich, Variational Analysis and Applications , Springer, Cham, Switzerland, 2018

    2018

  9. [17]

    B. S. Mordukhovich, Second-Order Variational Analysis in Optimization, Varia tional Stability, and Control: Theory, Algorithms, Applications , Springer, Cham, Switzerland, 2024

    2024

  10. [18]

    B. S. Mordukhovich and T. T. A. Nghia, Second-order char acterizations of tilt stability with appli- cations to nonlinear programming, Math. Program 149 (2015), 83–104

    2015

  11. [19]

    B. S. Mordukhovich and R. T. Rockafellar, Second-order subdifferential calculus with applications to tilt stability in optimization, SIAM J. Optim. 22 (2012), 953–986

    2012

  12. [20]

    J. J. Moreau, Fonctions convexes duales et points proxi maux dans un espace hilbertien, C. R. Acad. Sci. Paris 255 (1962), 2897–2899

    1962

  13. [21]

    R. A. Poliquin and R. T. Rockafellar, Generalized Hessi an properties of regularized nonsmooth functions, SIAM J. Optim. 6 (1996), 1121–1137

    1996

  14. [22]

    R. A. Poliquin and R. T. Rockafellar, Prox-regular func tions in variational analysis, Trans. Amer. Math. Soc. 348 (1996), 1805–1838

    1996

  15. [23]

    R. A. Poliquin and R. T. Rockafellar, Tilt stability of a local minimum, SIAM J. Optim. 8 (1998), 287–299

    1998

  16. [24]

    R. T. Rockafellar, Maximal monotone relations and the s econd derivatives of nonsmooth functions, Ann. Inst. H. Poincar´ e: Anal. Non Lin´ eaire2 (1985), 167–184

    1985

  17. [25]

    R. T. Rockafellar, First and second-order epi-different iability in nonlinear programming, Trans. Amer. Math. Soc. 307 (1988), 75–108

    1988

  18. [26]

    R. T. Rockafellar, Variational convexity and the local monotonicity of subgradient mappings, Vietnam J. Math. 47 (2019), 547–561

    2019

  19. [27]

    R. T. Rockafellar, Augmented Lagrangians and hidden co nvexity in sufficient conditions for local optimality, Math. Program 198 (2023), 159–194

    2023

  20. [28]

    R. T. Rockafellar, Variational convexity and prox-reg ularity, to appear in J. Convex Anal. ; https://sites.math.washington.edu/ rtr/papers.html

  21. [29]

    R. T. Rockafellar, Derivative tests for prox-regulari ty and the modulus of convexity, https://sites.math.washington.edu/ rtr/papers.html

  22. [30]

    R. T. Rockafellar and R. J-B. Wets, Variational analysis, Springer, Berlin, 1998

    1998

  23. [31]

    Thibault

    L. Thibault. Unilateral Variational analysis in Banach spaces , World Scientific, Singapore, 2023 31

    2023

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.