Pith. sign in

REVIEW 2 major objections 5 minor 74 references

Nonlinear Joint Spectral Radius

T0 review · 2 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read The paper defines a nonlinear joint spectral radius on cones and proves it is the exact threshold for worst-case stability of switched subhomogeneous monotone systems: $\rho_K(F)<1$ if and only if the system is asymptotically stable.

desk verdict Solid core stability theory with honest disclosure of prior work; the computability claim rests on a subcone hypothesis that fails in the paper's own examples, so the exactness framing needs tightening. read the letter →

arxiv 2507.11314 v1 pith:GZAQG3EI submitted 2025-07-15 math.DS

classification math.DS MSC 37B2547H0715A18
keywords jointspectralradiusnonlinearPerron-Frobeniustheoryswitcheddynamicalsystemsorder-preservingmapssubhomogeneousThompsonmetricasymptoticstabilitydeepneuralnetworks
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper introduces a nonlinear joint spectral radius for families of subhomogeneous, order-preserving maps acting on a cone, and argues that it is the correct worst-case growth indicator for switched discrete-time systems. The central result is a threshold theorem: the family is asymptotically stable under every switching sequence if and only if this nonlinear joint spectral radius is strictly less than one. A companion estimate shows that the same number controls how fast two nearby trajectories separate, giving a computable Lipschitz-type bound along every composition. The authors also develop dual characterizations in terms of monotone prenorms, compare the joint spectral radius with a generalized version built from cone spectral radii of compositions, and give a polytopal-type algorithm that can compute the value exactly under spectral-maximizing conditions. A reader should care because this extends a classical linear tool to nonlinear Perron-Frobenius type systems and gives concrete stability and robustness certificates for switched networks, including nonnegative deep neural networks.

What carries the argument

The load-bearing object is the cone joint spectral radius $\rho_K(F)$, defined through the induced norm of subhomogeneous maps on a cone; its threshold behavior is carried by the order-preserving property, which makes each map non-expansive in Thompson's metric and connects Euclidean trajectory growth to the metric via standard cone-norm bounds. Two associated objects do most of the work: the asymptotic homogeneous maps $f_0(x)=\lim_{c\to 0} f(cx)/c$ and $f_\infty(x)=\lim_{c\to\infty} f(cx)/c$, whose joint spectral radii bracket $\rho_K(F)$ for a subhomogeneous family (Theorem 4.7); and the generalized cone joint spectral radius $\hat\rho_K(F)$ based on cone spectral radii of compositions, whose equality with $\rho_K(F)$ is established under the interior-subcone eigenvector condition and used in the polytopal-type algorithm. The algorithm itself builds an extremal finitely generated monotone prenorm whose vertices are images of a conjectured spectrum-maximizing product, mirroring the linear polytope method (Theorems 5.10, 6.4, Lemma 6.2).

What would settle it

Run the paper's Example 5.24: a bounded subhomogeneous family on $\mathbb{R}_+^2$ with $\rho_K(F)=1$ and $\hat\rho_K(F)=1/2$. The generalized-radius test would incorrectly certify asymptotic stability, while Theorem 3.4 says $\rho_K=1$ means the family is not asymptotically stable; any proposed relaxation of the interior-subcone condition must explain this example. A more decisive test would be to check whether equality can fail for a bounded family that is additionally equicontinuous — the open question the authors flag.

Watch

Extended reading notes

Core claim

On the paper's own terms, the discovery is that the classical joint spectral radius threshold survives nonlinearity: for a bounded family $F$ of continuous subhomogeneous maps on a solid closed cone $K$, $\rho_K(F)<1$ if and only if the switched system $x_{k+1}=f_{\sigma(k)}(x_k)$ is asymptotically stable for every switching sequence (Theorem 3.4). When the maps are also order-preserving and thus non-expansive in Thompson's metric, the same radius bounds trajectory separation: $\|f(x)-f(y)\| \leq C(x,y,\epsilon)(\rho_K(F)+\epsilon)^k\|x-y\|$ for every composition of length $k$ (Theorem 3.6). The paper further proves that in the homogeneous case the nonlinear JSR has a dual formula as the infimum over monotone prenorms of their induced suprema, and that it coincides with the generalized cone JSR — the limsup of $k$-th roots of cone spectral radii of length-$k$ compositions — whenever a fixed subcone inside the interior contains a dominant eigenvector of every composition (Corollary 5.22). Two explicit examples show that boundedness of the family alone is not enough for that equality, in contrast to the linear Berger-Wang theorem.

Load-bearing premise

The main extension beyond the linear theory assumes that all long compositions of the maps share a dominant eigenvector lying in a fixed region strictly inside the cone; without this assumption, boundedness alone does not make the easy spectral-radius-based test correct.

Editorial extensions

If this is right

  • If $\rho_K(F)<1$, every trajectory of the switched system converges to zero under any admissible switching rule; if $\rho_K(F)\geq 1$, the family is not asymptotically stable at the uniform rate.
  • The trajectory-separation bound (Theorem 3.6) turns the nonlinear JSR into a worst-case Lipschitz certificate: a small change in an interior input cannot be amplified by more than $(\rho_K(F)+\epsilon)^k$ up to a constant, across all layer choices.
  • For subhomogeneous families, the JSR is sandwiched between the JSRs of the two homogeneous asymptotic families, so stability bounds can be computed from homogeneous maps without simulating all switching sequences.
  • When the interior-subcone condition holds, $\rho_K(F)=\hat\rho_K(F)$, so the radius can be certified by checking spectral radii of length-$k$ compositions, and the proposed algorithm terminates finitely for finite families with a dominant spectrum-maximizing product.
  • Applied to nonnegative neural networks, the framework yields conditions for fixed-point attraction in deep equilibrium models and bounds on gradient growth, stated as a necessary condition $\rho_K<1$ for global convergence.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A practical consequence not stated in the paper is that the interior-subcone eigenvector condition is the real gatekeeper for spectral-radius certificates: without it, the easy test can be off by an arbitrary factor, as in the paper's Example 5.24 where $\rho_K(F)=1$ while $\hat\rho_K(F)=1/2$.
  • The framework suggests a testable design rule for neural network architectures: keep activations and maps such that all compositions share an invariant interior subcone, which would make the generalized JSR computable and the Lipschitz bound tight, extending what the paper proves for perturbed families in Example 5.25.
  • The open equicontinuity question could be probed numerically: if a bounded, equicontinuous, homogeneous order-preserving family with $\hat\rho_K<\rho_K$ exists, the analogy with the linear Berger-Wang theorem fails more strongly than the examples shown; the paper leaves this unresolved.
  • Because $f_0$ can degenerate to infinity when constant terms dominate, applying the framework to networks with biases requires shifting the cone or rescaling around a working point; the paper does not develop that variant.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper introduces a nonlinear joint spectral radius ρ_K(F) for switched systems x_{k+1}=f_{σ(k)}(x_k) whose maps f_i are subhomogeneous and order-preserving on a cone K. The main mathematical results are: Theorem 3.4, which characterizes asymptotic stability of the switched semigroup by ρ_K(F)<1; Theorem 3.6, which bounds trajectory separation under Thompson nonexpansiveness in terms of ρ_K(F); Theorem 4.7, which sandwiches ρ_K(F) between the JSRs of two homogeneous limit families; Theorem 5.10, a dual representation of the homogeneous JSR via monotone prenorms; and Section 5.2, which introduces a generalized JSR bρ_K(F) and proves equality with ρ_K(F) under a strong interior-subcone hypothesis. A polytopal-type algorithm is proposed in Section 6 with finite-time convergence conditions. The paper is notably transparent about limitations, including counterexamples where bρ_K≠ρ_K (Examples 5.24 and 5.27) and where continuous extremal prenorms fail (Examples 5.16 and 5.19).

Significance. If the main theorems are correct, the paper gives a coherent and natural threshold object for stability of switched monotone cone systems, extending the linear joint spectral radius to nonlinear Perron-Frobenius settings. The core stability theorem and the dual prenorm construction are nontrivial and appear internally consistent. A particular strength is the collection of counterexamples that delineate where the linear Berger-Wang equality fails in the nonlinear world; these examples are an honest and useful contribution. The practical significance is tempered, however, by the fact that the equality ρ_K(F)=bρ_K(F) and the finite-time convergence of the algorithm rest on hypotheses that are not checkable from the generator family alone and can fail in simple cases; the paper would benefit from stating this limitation at the level of the abstract and introduction.

major comments (2)
  1. [§5.2, Cor. 5.22; §6] The equality ρ_K(F)=bρ_K(F) and, through it, the exactness and finite-time convergence claims of the polytopal algorithm are proved only under the assumption that there is a closed subcone K'⊂Int(K) containing a dominant eigenvector of every f∈Σ(F). This hypothesis is not checkable from the generator family alone, and the manuscript's own examples show that it cannot be replaced by natural weaker assumptions: Example 5.24 gives a bounded homogeneous family with bρ_K(F)=1/2 and ρ_K(F)=1, and Example 5.27 gives two generators each with an interior dominant eigenvector whose product has only boundary eigenvectors. Since Section 6's algorithm is advertised as computing or certifying ρ_K(F), the paper should state prominently that this computability is conditional on K', explain how one could certify such a subcone in concrete applications, and describe what can be guaranteed when K' is not known to exist. Without such discussion, the algorithmic section overstates the scope of the results.
  2. [§3, 'Fixed points and deep equilibrium models'] The claim that Theorem 3.4 yields 'a necessary condition for global convergence to a fixed point' is not correct as stated. Theorem 3.4 concerns asymptotic stability in the sense of convergence to zero, whereas the fixed points of deep equilibrium models and of affine maps with bias are generally nonzero. A concrete counterexample within the paper's own framework is f(x)=x/2+1 on K=R_+. This map is continuous, subhomogeneous, and order-preserving, has the unique globally attracting fixed point x*=2, but ρ_K({f})=1 because ∥f^k∥→2 on the unit ball. Thus ρ_K(F)<1 is not necessary for global convergence to a nonzero fixed point. The application paragraph should be revised to refer instead to the error dynamics around a fixed point or to a separate stability notion for nonzero equilibria.
minor comments (5)
  1. [§3, proof of Theorem 3.4] In the converse direction, the normality constant δ of the cone is omitted when passing from ∥f(r_1x)∥≤α^k r_2 to a bound on ∥f(x)∥; the argument still works if one writes Cα^k and then notes that (Cα^k)^{1/k}→α, but the displayed chain of inequalities is not correct as written.
  2. [§5.2, Eq. (16)] The statement that the lim sup in the definition of bρ_K(F) can be replaced by a supremum is only plausible because any word can be repeated; the text says this follows from Proposition A.7, but Proposition A.7 alone does not give this replacement. A short explicit argument using ρ_K(f^m)=ρ_K(f)^m would improve the presentation.
  3. [§5.2, proof of Cor. 5.22] The proof applies Theorem 3.4 to the scaled family F_ε, but Theorem 3.4 assumes boundedness; in the present setting boundedness follows from Remark 5.23 under the same K' hypothesis. This chain of reasoning should be stated explicitly so the corollary is self-contained.
  4. [§6, Example 5.19] In Example 5.19 the computation of the supremum over Σ_k(F) is slightly confusing because it is written at the point x_0=(1,1) with ∥x_0∥_1=2, whereas the operator norm is an extremum over the unit ball. The final value ρ_K(F)=1/2 is correct, but the intermediate display would be clearer if the unit-normalized point were used.
  5. [Throughout] Several typographical errors should be corrected: 'controlloed' in Section 4, 'ans assume' in Proposition 4.2, 'Schouder' in Theorem 5.26, 'Algortihm' in Section 6, and 'sepctrum' in the proof of Theorem 6.4. These do not affect the mathematics.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the nonlinear JSR is defined independently by a limsup formula, the stability and duality theorems are proved by direct constructions from the semigroup, and the only non-trivial equality (rho_K = b_rho_K) is explicitly conditional on a subcone hypothesis that the paper states, tests, and does not disguise as unconditional.

full rationale

The central object rho_K(F) is introduced in Eq. (2) as a limsup of sup-norms over compositions, with no fitted parameters, and Theorem 3.4 proves asymptotic stability iff rho_K(F) < 1 by exhibiting U,V and the scaling factor from the definition, and conversely bounding rho_K by alpha from asymptotic stability; this is a direct derivation rather than a restatement. Theorem 3.6 uses the definition of rho_K together with Thompson nonexpansiveness and the normality lemma, yielding an explicit constant C(x,y,epsilon); the Lipschitz-type estimate is not folded into the definition of rho_K. Section 4 bounds rho_K(F) between rho_K(F_infty) and rho_K(F_0) using the pointwise limit maps f_0, f_infty and monotonicity of norms, so the comparison is derived, not assumed. The homogeneous duality Theorem 5.10 is constructive: it defines Theta_epsilon(x) = sup_{f in Sigma(F_epsilon)} psi(f(x)) and proves the key inequality Theta_epsilon(f_i) <= rho_K(F)+epsilon from semigroup closure, with non-degeneracy obtained from the JSR definition itself. This is the standard Rota-Strang argument, not a circular one. The equality rho_K(F) = b_rho_K(F) in Corollary 5.22 is conditional on the explicit hypothesis that a closed subcone K' subset Int(K) contains dominant eigenvectors of every composition; Theorem 5.21 proves the direction used, and the paper honestly gives Example 5.24 showing that boundedness alone is insufficient and Example 5.27 showing that generator-level interior eigenvectors need not survive composition. These are limitations of a sufficient condition, not circularity. The numerical algorithm in Section 6 terminates under stated hypotheses (contractivity and a dominant spectrum-maximizing product); Lemma 6.2 gives an if-and-only-if certificate whose proof uses the definitions of rho_K and M(x/z), and the numerical examples verify rather than fit the theory. Self-citations appear in the machine-learning motivation and in references to polytopal algorithms, but no load-bearing theorem is imported solely from the authors' prior work, and no uniqueness claim is used to forbid alternatives. The paper also explicitly flags an open question about equicontinuity, further indicating that unproved equivalences are not being smuggled in. Therefore no circular step meets the quoted-evidence threshold.

Assumptions & free parameters 0 free parameters · 7 assumptions · 3 invented entities

The central claim rests on standard results from nonlinear Perron-Frobenius theory (quoted from [46]) and on the paper's explicit modeling assumptions: solid closed cones, continuous sub-homogeneous order-preserving maps, bounded families, and the strong hypotheses needed for the JSR/gJSR equality (a common interior subcone of dominant eigenvectors) and for finite-time algorithm termination (Hilbert contractivity and a dominant spectral gap). No free parameters are fitted to data; all constants in the examples are stated example specifications, not fitted values.

assumptions (7)
  • standard math Nonlinear Perron-Frobenius background results quoted as Lemmas A.1-A.9 (normality bounds, Thompson/Hilbert nonexpansivity, perturbation eigenpair approximation, spectral radius continuity, boundary extension for polyhedral cones)
    Used in the proofs of Theorems 3.6, 5.6, 5.10, 5.26, 6.4 and Appendix B without reproof; these are established results from Lemmens-Nussbaum [46].
  • standard math Fekete's lemma and submultiplicativity of the induced operator norm for homogeneous maps
    Needed to replace the limsup by an inf/limit in Eq (6), Proposition 5.3, and Theorem 5.21.
  • standard math Brouwer and Schauder fixed point theorems, Ascoli-Arzela theorem, Dini's theorem
    Used in Appendix B for slice eigenvectors and continuous eigenpair curves (Brouwer, Ascoli-Arzela), in Theorem 5.26 (Schauder), and in Proposition 4.2 (Dini).
  • domain assumption Monotone limits c -> f(cx)/c exist in the Alexandrov compactification K-infinity for sub-homogeneous maps, with uniqueness of limits along monotone chains
    Section 4, Eqs (5), needs these limits to define f0 and f_infinity; the argument uses order completeness of the cone, discussed but not proved in the paper.
  • domain assumption Every map in the semigroup has its dominant eigenvector inside a common subcone K' strictly inside the cone
    Hypothesis of Theorem 5.21 and Corollary 5.22 for rho_K = b_rho_K; hard to verify and false in the paper's own Examples 5.24 and 5.27.
  • domain assumption The cone is polyhedral (condition G) for boundary-continuous extensions of prenorms and limit maps
    Propositions 4.4, 5.14, 5.17 and Theorem A.9 assume polyhedrality or condition G.
  • domain assumption Each map contracts the Hilbert metric with parameter beta < 1 and has an interior dominant eigenvector
    Theorem 5.26 and Theorem 6.4 require strict Hilbert contractivity; fails already for cone-preserving linear maps with boundary or Jordan-like behavior (Example 5.27).
invented entities (3)
  • Nonlinear cone joint spectral radius rho_K(F) independent evidence
    purpose: Worst-case asymptotic growth rate over all switching sequences for switched sub-homogeneous cone systems
    Defined by an explicit limsup formula (Eq 2); grounded externally as a special case of the competitive spectral radius in [2] (Remark 5.5) and characterized by theorems against the independent notion of asymptotic stability (Theorem 3.4).
  • Generalized cone joint spectral radius b_rho_K(F) independent evidence
    purpose: Spectral-radius-based alternative whose equality with rho_K is shown under an interior-eigenvector subcone condition
    Definition (16) mirrors the linear generalized JSR of [10]; its equality with rho_K is proved (Corollary 5.22), and a counterexample (Example 5.24) shows where it strictly drops, so its semantic content is anchored.
  • Finitely generated monotone prenorms (Definition 6.1)
    purpose: Finite-dimensional representation of extremal prenorms used by the polytopal algorithm
    An internal construction: the paper proves its properties (continuity, monotonicity, non-degeneracy) and exact extremality under Lemma 6.2's conditions, so it is not a free postulate, but it has no external referent.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Nonlinear Joint Spectral Radius." pith.science (2026). https://pith.science/paper/GZAQG3EI

@misc{pith2026250711314,
  author       = {Pith},
  title        = {Pith review of: Nonlinear Joint Spectral Radius},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/GZAQG3EI}},
  note         = {Machine review of arXiv:2507.11314}
}
read the original abstract

We introduce a nonlinear extension of the joint spectral radius (JSR) for switched discrete-time dynamical systems governed by sub-homogeneous and order-preserving maps acting on cones. We show that this nonlinear JSR characterizes both the asymptotic stability of the system and the divergence or convergence rate of trajectories originating from different points within the cone. Our analysis establishes upper and lower bounds on the nonlinear JSR of a sub-homogeneous family via the JSRs of two associated homogeneous families obtained through asymptotic scaling. In the homogeneous case, we develop a dual formulation of the JSR and investigate the equality between the joint spectral radius and the generalized joint spectral radius, extending classical results from linear theory to the nonlinear setting. We also propose a polytopal-type algorithm to approximate the nonlinear JSR and provide conditions ensuring its finite-time convergence. The proposed framework is motivated by applications such as the analysis of deep neural networks, which can be modeled as switched systems with structured nonlinear layers. Our results offer new theoretical tools for studying the stability, robustness, and convergence behavior of such models.

Figures

Figures reproduced from arXiv: 2507.11314 by the authors.

Figure 1
Figure 1. Left to right, top to bottom, the algorithm starts with [PITH_FULL_IMAGE:figures/full_fig_p044_1.png] view at source ↗
Figure 2
Figure 2. Extremal polytope norm (left figure) and prenorm (right figure) generated [PITH_FULL_IMAGE:figures/full_fig_p045_2.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

74 extracted references · 74 canonical work pages

  1. [1]

    Akian, S

    M. Akian, S. Gaubert, and B. Lemmens. Stability and convergence in discrete convex monotone dynamical systems. Journal of Fixed Point Theory and Applications , 9:295–325, 2011

  2. [2]

    The Competive Spectral Radius of Families of Nonexpansive Mappings

    M. Akian, S. Gaubert, and L. Marchesini. The competive spectral radius of families of nonexpansive mappings. arXiv preprint arXiv:2410.21097 , 2024

  3. [3]

    Angeli and E

    D. Angeli and E. D. Sontag. Translation-invariant monotone systems, and a global convergence result for enzymatic futile cycles. Nonlinear Analysis: Real World Applications, 9(1):128–140, 2008

  4. [4]

    N. P. Archer and S. Wang. Application of the back propagation neural network algo- rithm with monotonicity constraints for two-group classification problems. Decision Sciences, 24(1):60–75, 1993. 45

  5. [5]

    Arjovsky, A

    M. Arjovsky, A. Shah, and Y. Bengio. Unitary evolution recurrent neural networks. In Proceedings of the 33rd International Conference on Machine Learning (ICML) , pages 1120–1128, 2016

  6. [6]

    Auslender and M

    A. Auslender and M. Teboulle. Asymptotic cones and functions in optimization and variational inequalities. Springer Science & Business Media, 2006

  7. [7]

    Avelin and A

    B. Avelin and A. Karlsson. Deep limits and a cut-off phenomenon for neural net- works. Journal of Machine Learning Research , 23(191):1–29, 2022

  8. [8]

    S. Bai, J. Z. Kolter, and V. Koltun. Deep equilibrium models. Advances in neural information processing systems, 32, 2019

Show all 74 references
  1. [9]

    Bengio, P

    Y. Bengio, P. Simard, and P. Frasconi. Learning long-term dependencies with gra- dient descent is difficult. IEEE transactions on neural networks , 5(2):157–166, 1994

  2. [10]

    M. A. Berger and Y. Wang. Bounded semigroups of matrices. Linear Algebra and its Applications, 166:21–27, 1992

  3. [11]

    Biggio, I

    B. Biggio, I. Corona, D. Maiorca, B. Nelson, N. ˇSrndi´ c, P. Laskov, G. Giacinto, and F. Roli. Evasion Attacks against Machine Learning at Test Time. In Machine Learning and Knowledge Discovery in Databases , 2013

  4. [12]

    Bourbaki

    N. Bourbaki. General Topology Chapters 5–10. Springer, 1989

  5. [13]

    Brayton and C

    R. Brayton and C. Tong. Stability of dynamical systems: A constructive approach. IEEE Transactions on Circuits and Systems , 26(4):224–234, 1979

  6. [14]

    Brayton and C

    R. Brayton and C. Tong. Constructive stability and asymptotic stability of dy- namical systems. IEEE Transactions on Circuits and Systems , 27(11):1121–1130, 1980

  7. [15]

    Bungert, E

    L. Bungert, E. Hait-Fraenkel, N. Papadakis, and G. Gilboa. Nonlinear power method for computing eigenvectors of proximal operators and neural networks. SIAM Jour- nal on Imaging Sciences , 14(3):1114–1148, 2021

  8. [16]

    R. L. Cavalcante, Q. Liao, and S. Sta´ nczak. Connections between spectral prop- erties of asymptotic mappings and solutions to wireless network problems. IEEE Transactions on Signal Processing, 67(10):2747–2760, 2019

  9. [17]

    R. L. G. Cavalcante, Y. Shen, and S. Sta´ nczak. Elementary properties of positive concave mappings with applications to network planning and optimization. IEEE Transactions on Signal Processing, 64(7):1774–1783, 2016

  10. [18]

    Celledoni, D

    E. Celledoni, D. Murari, B. Owren, C.-B. Sch¨ onlieb, and F. Sherry. Dynam- ical Systems–Based Neural Networks. SIAM Journal on Scientific Computing , 45(6):A3071–A3094, 2023

  11. [19]

    Cisse, P

    M. Cisse, P. Bojanowski, E. Grave, Y. Dauphin, and N. Usunier. Parseval networks: Improving robustness to adversarial examples. Proceedings of the 34th International Conference on Machine Learning (ICML) , 2017

  12. [20]

    Daniels and M

    H. Daniels and M. Velikova. Monotone and partially monotone neural networks. IEEE Transactions on Neural Networks , 21(6):906–917, 2010. 46

  13. [21]

    L. Elsner. The generalized spectral-radius theorem: an analytic-geometric proof. Linear Algebra and its Applications , 220:151–159, 1995

  14. [22]

    Fung and B

    V. Fung and B. Amos. Fixed-point differentiation: Theory and applications. In Advances in Neural Information Processing Systems (NeurIPS) , 2021

  15. [23]

    Gilton, G

    D. Gilton, G. Ongie, and R. Willett. Deep equilibrium architectures for inverse problems in imaging. IEEE Transactions on Computational Imaging , 7:1123–1133, 2021

  16. [24]

    Glorot and Y

    X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS) , pages 249–256, 2010

  17. [25]

    Goodfellow, J

    I. Goodfellow, J. Shlens, and C. Szegedy. Explaining and harnessing adversarial examples. In International Conference on Learning Representations , 2015

  18. [26]

    I. J. Goodfellow, J. Shlens, and C. Szegedy. Explaining and Harnessing Adversarial Examples. In International Conference on Learning Representations , 2015

  19. [27]

    Gou¨ ezel and A

    S. Gou¨ ezel and A. Karlsson. Subadditive and multiplicative ergodic theorems.Jour- nal of the European Mathematical Society , 22(6):1893–1915, 2020

  20. [28]

    Guglielmi, A

    N. Guglielmi, A. De Marinis, A. Savostianov, and F. Tudisco. Contractivity of neural ODEs: an eigenvalue optimization problem. arXiv preprint arXiv:2402.13092, 2024

  21. [29]

    Guglielmi, L

    N. Guglielmi, L. Laglia, and V. Protasov. Polytope Lyapunov functions for stable and for stabilizable LSS. Found. Comput. Math. , 17(2):567–623, 2017

  22. [30]

    Guglielmi and V

    N. Guglielmi and V. Protasov. Exact computation of joint spectral characteristics of linear operators. Foundations of Computational Mathematics , 13:37–97, 2013

  23. [31]

    Guglielmi and V

    N. Guglielmi and V. Y. Protasov. Invariant polytopes of sets of matrices with application to regularity of wavelets and subdivisions. SIAM J. Matrix Anal. Appl. , 37(1):18–52, 2016

  24. [32]

    Guglielmi, F

    N. Guglielmi, F. Wirth, and M. Zennaro. Complex polytope extremality results for families of matrices. SIAM journal on matrix analysis and applications , 27(3):721– 743, 2005

  25. [33]

    Guglielmi and M

    N. Guglielmi and M. Zennaro. On the asymptotic properties of a family of matrices. Linear algebra and its applications , 322(1-3):169–192, 2001

  26. [34]

    Guglielmi and M

    N. Guglielmi and M. Zennaro. Balanced complex polytopes and related vector and matrix norms. J. Convex Anal. , 14(4):729–766, 2007

  27. [35]

    Haber and L

    E. Haber and L. Ruthotto. Stable architectures for deep neural networks. Inverse problems, 34(1):014004, 2017

  28. [36]

    Heil and G

    C. Heil and G. Strang. Continuity of the joint spectral radius: application to wavelets. In Linear Algebra for Signal Processing , pages 51–61. Springer, 1995

  29. [37]

    Hein and M

    M. Hein and M. Andriushchenko. Formal guarantees on the robustness of a clas- sifier against adversarial manipulation. Advances in Neural Information Processing Systems, 30, 2017. 47

  30. [38]

    M. W. Hirsch and H. Smith. Monotone dynamical systems. Handbook of differential equations: ordinary differential equations , 2:239–357, 2006

  31. [39]

    Hochreiter

    S. Hochreiter. The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems, 6(02):107–116, 1998

  32. [40]

    R. Jungers. The joint spectral radius: theory and applications , volume 385. Springer Science & Business Media, 2009

  33. [41]

    Karlsson

    A. Karlsson. Non-expanding maps and busemann functions. Ergodic Theory and Dynamical Systems, 21(5):1447–1457, 2001

  34. [42]

    Karlsson

    A. Karlsson. From linear to metric functional analysis. Proceedings of the National Academy of Sciences, 118(28):e2107069118, 2021

  35. [43]

    Karlsson

    A. Karlsson. A metric fixed point theorem and some of its applications. Geometric and Functional Analysis , 34(2):486–511, 2024

  36. [44]

    Leino, Z

    K. Leino, Z. Wang, and M. Fredrikson. Globally-robust neural networks. In Inter- national Conference on Machine Learning , pages 6212–6222. PMLR, 2021

  37. [45]

    Lemmens, B

    B. Lemmens, B. Lins, R. Nussbaum, and M. Wortel. Denjoy-wolff theorems for hilbert’s and thompson’s metric spaces. Journal d’Analyse Math´ ematique, 134:671– 718, 2018

  38. [46]

    Lemmens and R

    B. Lemmens and R. Nussbaum. Nonlinear Perron-Frobenius Theory, volume 189. Cambridge University Press, 2012

  39. [47]

    Q. Li, Z. Han, and X.-m. Wu. Deeper insights into graph convolutional networks for semi-supervised learning. Proceedings of the AAAI Conference on Artificial In- telligence, 32(1), Apr. 2018

  40. [48]

    Lim and B

    L.-H. Lim and B. J. Nelson. What is an equivariant neural network? Notices Of The American Mathematical Society , 70(4), 2022

  41. [49]

    J. K. Merikoski. On c-norms and c-antinorms on cones. Linear Algebra and its Applications, 150:315–329, 1991

  42. [50]

    Meunier, B

    L. Meunier, B. J. Delattre, A. Araujo, and A. Allauzen. A dynamical system perspec- tive for lipschitz neural networks. In International Conference on Machine Learning, pages 15484–15500. PMLR, 2022

  43. [51]

    Mukherjee, S

    S. Mukherjee, S. Dittmer, Z. Shumaylov, S. Lunz, O. ¨Oktem, and C.-B. Sch¨ onlieb. Learned convex regularizers for inverse problems. arXiv preprint arXiv:2008.02839 , 2020

  44. [52]

    R. D. Nussbaum. Some nonlinear weak ergodic theorems. SIAM Journal on Math- ematical Analysis, 21(2):436–460, 1990

  45. [53]

    C. J. Nuzman. Contraction approach to power control, with non-monotonic appli- cations. In IEEE GLOBECOM 2007-IEEE Global Telecommunications Conference, pages 5283–5287. IEEE, 2007. 48

  46. [54]

    Pascanu, T

    R. Pascanu, T. Mikolov, and Y. Bengio. On the difficulty of training recurrent neural networks. In Proceedings of the 30th International Conference on Machine Learning, volume 28, pages 1310–1318, 2013

  47. [55]

    T. J. Piotrowski, R. L. G. Cavalcante, and M. Gabor. Fixed points of nonnegative neural networks. Journal of Machine Learning Research , 25(139):1–40, 2024

  48. [56]

    Reich and A

    S. Reich and A. J. Zaslavski. Convergence of generic infinite products of homo- geneous order-preserving mappings. Discrete and Continuous Dynamical Systems , 5(4):929–945, 1999

  49. [57]

    Revay, D

    M. Revay, D. L. Gilton, Z. Li, T. Hohage, and M. Unser. Lipconvnet: Lipshitz- constrained neural networks with convolutional structure for solving inverse prob- lems. SIAM Journal on Imaging Sciences , 16(3):1344–1373, 2023

  50. [58]

    Rota and G

    G.-C. Rota and G. Strang. A note on the joint spectral radius. Indag. Math , 22(4):379–381, 1960

  51. [59]

    Savostianova, E

    D. Savostianova, E. Zangrando, G. Ceruti, and F. Tudisco. Robust low-rank training via approximate orthonormal constraints. Advances in Neural Information Process- ing Systems , 36:66064–66083, 2023

  52. [60]

    Shih, J.-W

    M.-H. Shih, J.-W. Wu, and C.-T. Pang. Asymptotic stability and generalized gelfand spectral radius formula. Linear algebra and its applications , 252(1-3):61–70, 1997

  53. [61]

    J. Sill. Monotonic networks. Advances in neural information processing systems, 10, 1997

  54. [62]

    Singla, S

    S. Singla, S. Singla, and S. Feizi. Improved deterministic l2 robustness on cifar-10 and cifar-100. In International Conference on Learning Representations , 2021

  55. [63]

    Sittoni and F

    P. Sittoni and F. Tudisco. Subhomogeneous deep equilibrium models. In Proceedings of the 41st International Conference on Machine Learning, volume 235, pages 45794– 45812, 2024

  56. [64]

    Z. Sun. Switched linear systems: control and design . Springer Science & Business Media, 2006

  57. [65]

    Szegedy, W

    C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, and R. Fergus. Intriguing properties of neural networks. In International Conference on Learning Representations (ICLR), 2014

  58. [66]

    Trockman and J

    A. Trockman and J. Z. Kolter. Orthogonalizing convolutional layers with the cayley transform. In International Conference on Learning Representations , 2021

  59. [67]

    Tsuzuku, I

    Y. Tsuzuku, I. Sato, and M. Sugiyama. Lipschitz-margin training: Scalable certi- fication of perturbation invariance for deep neural networks. Advances in Neural Information Processing Systems, 31, 2018

  60. [68]

    F. Wirth. The generalized spectral radius is strictly increasing. Linear algebra and its applications, 395:141–153, 2005

  61. [69]

    Zhang, Y

    H. Zhang, Y. N. Dauphin, and T. Ma. Fixup initialization: Residual learning without normalization. In International Conference on Learning Representations (ICLR) , 2019. 49

  62. [70]

    Zhang, P

    K. Zhang, P. Deidda, D. Higham, and F. Tudisco. Rethinking oversmoothing in graph neural networks: A rank-based perspective. arXiv preprint arXiv:2502.04591, 2025. A Technical results from Nonlinear Perron-Frobenius Theory Lemma A.1 (Lemma 2.5.1 and Lemma 2.5.5 [46]) . Let K b...

  63. [71]

    For any c >0, ρc K(f ) = bρc K(f ) = ˇρc K(f )

  64. [72]

    There exists a continuous curve c ∈ (0, ∞) → (xc, ρc K(f )), where xc ∈ Ωc is some eigenvector associated to ρc K(f ), such that: xc1 ≤K xc2 , ρ c2 K (fϵ) ≤ ρc1 K (fϵ) ≤ c2 c1 ρc2 K (fϵ), for any 0 < c1 < c2. Proof. Start considering xc ∈ Ωc such that f (xc) = ρc K(f )xc. Then...

  65. [73]

    In particular: ρc K(f ) = sup x∈Ωc m(f (x)/x)

    If there exists x ∈ Ωc with f (x) ≥K αx, then ρc K(f ) ≥ α. In particular: ρc K(f ) = sup x∈Ωc m(f (x)/x). (25)

  66. [74]

    In particular: ρc K(f ) = inf x∈Int(K)∩Ωc M (f (x)/x)

    If there exists x ∈ Int(K)∩Ωc such that f (x) ≤K βx, then ρc K(f ) ≤ β. In particular: ρc K(f ) = inf x∈Int(K)∩Ωc M (f (x)/x). Proof. We start by proving the first thesis. Assume x as in the hypothesis and consider y ∈ Int(K), then M (f (x)/y) ≥ M (αx/y) = αM (x/y). In particu...

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.