pith. sign in

arxiv: 2505.19724 · v2 · submitted 2025-05-26 · 🧮 math.OC

Local near-quadratic convergence of Riemannian interior point methods

Pith reviewed 2026-05-19 14:27 UTC · model grok-4.3

classification 🧮 math.OC
keywords Riemannian optimizationinterior point methodslocal convergencesuperlinear convergencenear-quadratic convergenceconstrained optimizationsecond-order stationarity
0
0 comments X

The pith

Riemannian interior point methods achieve local near-quadratic convergence by solving one linear system per outer iteration with a specific barrier update.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper analyzes a class of Riemannian interior point methods for optimization problems with equality and inequality constraints on manifolds. It shows that under standard assumptions the outer iteration requires only a single linear system solve to reach local superlinear convergence, with no further inner-iteration work needed. A tailored update rule for the barrier parameter then lifts the rate to local near-quadratic convergence. The same analysis is applied to an existing algorithm to establish both its local rates and its global convergence to second-order stationary points.

Core claim

Under standard assumptions the algorithm achieves local superlinear convergence by solving a linear system at each outer iteration, removing the need for further computations in the inner iterations. A specific update for the barrier parameter achieves local near-quadratic convergence of the algorithm. When applied to the method of Obara, Okuno, and Takeda (2026) the analysis also confirms second-order stationarity in the global convergence result.

What carries the argument

The outer-inner iteration structure of the Riemannian interior point method together with a barrier-parameter update rule that controls the local convergence rate.

If this is right

  • Only one linear solve per outer iteration is required for local superlinear convergence.
  • The barrier-parameter update produces local near-quadratic convergence near a solution.
  • The analysis supplies both local rates and global convergence to a second-order stationary point for the algorithm to which it is applied.
  • The same framework covers problems with both equality and inequality constraints on Riemannian manifolds.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The single-solve outer iteration may be reusable as a local accelerator inside other Riemannian constrained solvers.
  • The barrier update strategy could be tested on higher-dimensional manifold problems to check whether the predicted rates survive floating-point effects.
  • Similar local-rate results might be derived for Riemannian variants of other classical interior-point families such as primal-dual or penalty methods.

Load-bearing premise

The standard assumptions on constraint qualifications, second-order stationarity, and the properties of the Riemannian metric and barrier function hold in a neighborhood of the solution.

What would settle it

Numerical runs on a low-dimensional constrained Riemannian problem that show the error sequence remains only linearly convergent even after the proposed barrier update is applied would refute the near-quadratic claim.

read the original abstract

We consider Riemannian optimization problems with inequality and equality constraints and analyze a class of Riemannian interior point methods for solving them. The algorithm of interest consists of outer and inner iterations. We show that, under standard assumptions, the algorithm achieves local superlinear convergence by solving a linear system at each outer iteration, removing the need for further computations in the inner iterations. We also provide a specific update for the barrier parameter that achieves local near-quadratic convergence of the algorithm. We apply our results to the method proposed by Obara, Okuno, and Takeda (2026) and show its local superlinear and near-quadratic convergence with an analysis of the second-order stationarity. To our knowledge, this is the first algorithm for constrained optimization on Riemannian manifolds that achieves both local convergence and global convergence to a second-order stationary point. Numerical results support the theoretical analyses of the proposed methods.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 3 minor

Summary. The manuscript analyzes a class of Riemannian interior point methods for constrained optimization problems on Riemannian manifolds with equality and inequality constraints. Under standard assumptions (constraint qualifications, second-order stationarity, and suitable smoothness/convexity properties of the barrier function with respect to the Riemannian metric), it establishes that the algorithm achieves local superlinear convergence because each outer iteration reduces to solving a single linear system whose solution yields the step, eliminating further inner-iteration computations. A specific barrier-parameter update is proposed that yields local near-quadratic convergence. The analysis is applied to the concrete method of Obara, Okuno, and Takeda (2026), proving both local rates and second-order stationarity; global convergence to a second-order stationary point is shown separately via a potential-function argument. Numerical results support the theory, and the work claims to be the first Riemannian constrained optimizer with both local convergence and global convergence to second-order points.

Significance. If the results hold, the manuscript makes a solid contribution to Riemannian optimization by supplying the first local superlinear and near-quadratic convergence analysis for interior-point methods on manifolds, together with global convergence to second-order stationary points. The explicit verification that the listed assumptions are inherited by the Obara et al. method, the clean separation between the global potential-function argument and the local error-recursion analysis, and the retraction-based feasibility arguments are strengths that enhance applicability and credibility. The work provides a reusable framework that can be instantiated on other Riemannian IPMs and addresses a genuine gap in the literature on constrained manifold optimization.

minor comments (3)
  1. [Local-analysis section] § Local-analysis section: the precise definition of the 'near-quadratic' rate (how the barrier update modifies the standard quadratic error recursion) would benefit from an explicit side-by-side comparison with the Euclidean IPM quadratic rate to clarify the distinction.
  2. [Local-analysis section] The statement of the standard assumptions is given in the local-analysis section but would be easier to reference if collected into a single numbered assumption block or table.
  3. [Numerical results] Numerical results section: adding log-log plots of the error versus iteration count would make the observed superlinear/near-quadratic behavior visually immediate and strengthen the empirical support.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for the positive and thorough evaluation of our manuscript on Riemannian interior point methods. We appreciate the recognition of the local superlinear and near-quadratic convergence results, the global convergence to second-order stationary points, and the reusable framework for other Riemannian IPMs. The recommendation for minor revision is noted, and we will make appropriate improvements to enhance the presentation and clarity.

Circularity Check

0 steps flagged

No significant circularity in derivation chain

full rationale

The paper derives local superlinear and near-quadratic convergence rates for a class of Riemannian interior-point methods by showing that, under explicitly enumerated standard assumptions (constraint qualifications, second-order stationarity, smoothness of the barrier with respect to the Riemannian metric), each outer iteration reduces to a single linear-system solve whose step, combined with the proposed barrier-parameter update, produces the stated rates via standard error-recursion arguments. The global convergence to a second-order stationary point is established separately via a potential-function argument that does not rely on the local-rate machinery. Application of the general results to the concrete method of Obara et al. (2026) consists of verifying that the listed assumptions are inherited by that method; this verification step is independent of the rate derivations themselves. No equation reduces by construction to a fitted parameter, no central premise rests solely on a self-citation whose content is unverified, and the analysis remains self-contained against external benchmarks once the stated assumptions are granted.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The central claims rest on unspecified 'standard assumptions' typical of Riemannian optimization literature; no free parameters, invented entities, or ad-hoc axioms are introduced in the abstract.

axioms (1)
  • domain assumption Standard assumptions for local convergence of Riemannian interior-point methods (constraint qualifications, second-order stationarity, smoothness of the barrier function)
    Invoked to guarantee the local superlinear and near-quadratic rates; location referenced in abstract as 'under standard assumptions'.

pith-pipeline@v0.9.0 · 5679 in / 1378 out tokens · 36688 ms · 2026-05-19T14:27:10.584415+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

60 extracted references · 60 canonical work pages · 1 internal anchor

  1. [1]

    Princeton University Press, Princeton (2008)

    Absil, P.A., Mahony, R., Sepulchre, R.: Optimization algorithms on matrix manifolds. Princeton University Press, Princeton (2008)

  2. [2]

    In: IEEE Symposium on Foundations of Computer Science, pp

    Acuaviva, A., Makam, V., Nieuwboer, H., P´ erez-Garc´ ıa, D., Sittner, F., Walter, M., Witteveen, F.: The minimal canonical form of a tensor network. In: IEEE Symposium on Foundations of Computer Science, pp. 328–362 (2023)

  3. [3]

    SIAM Journal on Optimization 27(1), 269–291 (2017)

    Adachi, S., Iwata, S., Nakatsukasa, Y., Takeda, A.: Solving the trust-region subproblem by a generalized eigenvalue problem. SIAM Journal on Optimization 27(1), 269–291 (2017)

  4. [4]

    SIAM Journal on Optimization 34(2), 1799–1825 (2024)

    Andreani, R., Couto, K.R., Ferreira, O.P., Haeser, G.: Constraint qualifications and strong global convergence properties of an augmented Lagrangian method on Rieman- nian manifolds. SIAM Journal on Optimization 34(2), 1799–1825 (2024)

  5. [5]

    URL https://optimization-online.org/?p=27595

    Andreani, R., Couto, K.R., Ferreira, O.P., Haeser, G., Prudente, L.F.: Global conver- gence of an augmented Lagrangian method for nonlinear programming via Riemannian optimization (2024). URL https://optimization-online.org/?p=27595

  6. [6]

    Mathematical Programming 115(2), 199–222 (2006)

    Armand, P., Benoist, J.: A local convergence property of primal-dual methods for non- linear programming. Mathematical Programming 115(2), 199–222 (2006)

  7. [7]

    Computational Optimization and Applica- tions 41(1), 1573–2894 (2007)

    Armand, P., Benoist, J., Orban, D.: Dynamic updates of the barrier parameter in primal- dual methods for nonlinear programming. Computational Optimization and Applica- tions 41(1), 1573–2894 (2007)

  8. [8]

    Optimization Methods and Software 28(5), 1051–1080 (2012)

    Armand, P., Benoist, J., Orban, D.: From global to local convergence of interior meth- ods for nonlinear optimization. Optimization Methods and Software 28(5), 1051–1080 (2012)

  9. [9]

    SIAM Journal on Optimization 29(4), 2423–2444 (2010)

    Bergmann, R., Herzog, R.: Intrinsic formulation of KKT conditions and constraint qual- ifications on smooth manifolds. SIAM Journal on Optimization 29(4), 2423–2444 (2010)

  10. [10]

    URL https://optimization-online.org/?p=28986

    Birgin, E.G., Ferreira, O.P., Haeser, G., Maculan, N., Ramirez, L.M., Prudente, L.F.: Smoothing ℓ1-exact penalty methiod for intrinsically constarined Riemannian optimiza- tion problems (2025). URL https://optimization-online.org/?p=28986

  11. [11]

    Cambridge Univer- sity Press, Cambridge (2023)

    Boumal, N.: An introduction to optimization on smooth manifolds. Cambridge Univer- sity Press, Cambridge (2023)

  12. [12]

    IEEE Transactions on Robotics 34(5), 1252–1265 (2018)

    Brossette, S., Escande, A., Kheddar, A.: Multicontact postures computation on mani- folds. IEEE Transactions on Robotics 34(5), 1252–1265 (2018)

  13. [13]

    Mathematical Programming 89(1), 149–185 (2000) 38 Mitsuaki Obara, Takayuki Okuno, and Akiko Takeda

    Byrd, R.H., Gilbert, J.C., Nocedal, J.: A trust region method based on interior point techniques for nonlinear programming. Mathematical Programming 89(1), 149–185 (2000) 38 Mitsuaki Obara, Takayuki Okuno, and Akiko Takeda

  14. [14]

    In: Numerical Analysis 1997, pp

    Byrd, R.H., Liu, G., Nocedal, J.: On the local behavior of an interior point method for nonlinear programming. In: Numerical Analysis 1997, pp. 37–56. Chapman and Hall/CRC, Harlow (1997)

  15. [15]

    Birkh¨ auser, Basel (1992)

    do Carmo, M.P.: Riemannian Geometry. Birkh¨ auser, Basel (1992)

  16. [16]

    SIAM Review 62(2), 395—-436 (2020)

    Carmon, Y., Duchi, J.C.: First-order methods for nonconvex quadratic minimization. SIAM Review 62(2), 395—-436 (2020)

  17. [17]

    Mathematical Programming 87(2), 215–249 (2000)

    Conn, A.R., Gould, N.I.M., Orban, D., Toint, P.L.: A primal-dual trust-region algorithm for non-convex nonlinear programming. Mathematical Programming 87(2), 215–249 (2000)

  18. [18]

    IEEE Transactions on Signal Processing 59(7), 3120–3132 (2011)

    Dai, W., Milenkovic, O., Kerman, E.: Subspace evaluation and transfer (SET) for low- rank matrix completion. IEEE Transactions on Signal Processing 59(7), 3120–3132 (2011)

  19. [19]

    IEEE Transactions on Information Theory 58(1), 237–247 (2012)

    Dai, W., Milenkovic, O., Kerman, E.: A geometric approach to low-rank matrix com- pletion. IEEE Transactions on Information Theory 58(1), 237–247 (2012)

  20. [20]

    Journal of Industrial & Management Optimization 16(2), 1009–1035 (2020)

    Dai, Y.H., Liu, X.W., Sun, J.: A primal-dual interior-point method capable of rapidly detecting infeasibility for nonlinear programs. Journal of Industrial & Management Optimization 16(2), 1009–1035 (2020)

  21. [21]

    Econometrica 20(2), 295–300 (1952)

    Debreu, G.: Definite and semidefinite quadratic forms. Econometrica 20(2), 295–300 (1952)

  22. [22]

    Journal of Optimization Theory and Application 89(3), 507–541 (1996)

    El-Bakry, A.S., Tapia, R.A., Tsuchiya, T., Zhang, Y.: On the formulation and theory of the Newton interior-point method for nonlinear programming. Journal of Optimization Theory and Application 89(3), 507–541 (1996)

  23. [23]

    Journal of Optimization Theory and Applications 173(3), 828–843 (2017)

    Fernandes, T.A., Ferreira, O.P., Yuan, J.: On the superlinear convergence of Newton’s method on Riemannian manifolds. Journal of Optimization Theory and Applications 173(3), 828–843 (2017)

  24. [24]

    SIAM Review 44(4), 525–597 (2002)

    Forsgren, A., Gill, P.E., Wright, M.H.: Interior methods for nonlinear optimization. SIAM Review 44(4), 525–597 (2002)

  25. [25]

    In: High- Performance Scientific Computing, pp

    Gallivan, K.A., Qi, C., Absil, P.A.: A Riemannian Dennis-Mor´ e condition. In: High- Performance Scientific Computing, pp. 281–293. Springer, London (2012)

  26. [26]

    arXiv:2306.00873 (2023)

    Gao, B., Peng, R., Yuan, Y.X.: Optimization on product manifolds under a precondi- tioned metric. arXiv:2306.00873 (2023)

  27. [27]

    SIAM Journal on Optimiza- tion 11(4), 974–1002 (2001)

    Gould, N.I.M., Orban, D., Sartenaer, A., Toint, P.L.: Superlinear convergence of primal- dual interior point algorithms for nonlinear programming. SIAM Journal on Optimiza- tion 11(4), 974–1002 (2001)

  28. [28]

    In: IEEE Symposium on Foundations of Computer Science, pp

    Hirai, H., Nieuwboer, H., Walter, M.: Interior-point methods on manifolds: theory and applications. In: IEEE Symposium on Foundations of Computer Science, pp. 2021–2030 (2023)

  29. [29]

    Mathematical Programming 150(2), 179–216 (2015)

    Huang, W., Absil, P.A., Gallivan, K.A.: A Riemannian symmetric rank-one trust-region method. Mathematical Programming 150(2), 179–216 (2015)

  30. [30]

    Journal of Optimization Theory and Applications 201(1), 433–469 (2024)

    Lai, Z., Yoshise, A.: Riemannian interior point methods for constrained optimization on manifolds. Journal of Optimization Theory and Applications 201(1), 433–469 (2024)

  31. [31]

    Springer, New York (2012)

    Lee, J.M.: Introduction to smooth manifolds, second edn. Springer, New York (2012)

  32. [32]

    Applied Mathematics & Optimization 82(3), 949–981 (2020)

    Liu, C., Boumal, N.: Simple algorithms for optimization on Riemannian manifolds with constraints. Applied Mathematics & Optimization 82(3), 949–981 (2020)

  33. [33]

    Mathematical Programming125(1), 163–193 (2010)

    Liu, X., Yuan, Y.: A null-space primal-dual interior-point algorithm for nonlinear opti- mization with nice convergence properties. Mathematical Programming125(1), 163–193 (2010)

  34. [34]

    European Journal of Operational Research 214(3), 512–525 (2011)

    L´ opez, C.O., Beasley, J.E.: A heuristic for circle packing problem with a variety of containers. European Journal of Operational Research 214(3), 512–525 (2011)

  35. [35]

    Bolet´ ın de la Sociedad Matem´ atica Mexicana1(2), 137–148 (1995)

    Mart´ ınez, H.J., Parada, Z., Tapia, R.A.: On the characterization of Q-superlinear con- vergence of quasi-Newton interior-point methods for nonlinear programming. Bolet´ ın de la Sociedad Matem´ atica Mexicana1(2), 137–148 (1995)

  36. [36]

    IEEE Control Systems Letters 6, 2539–2544 (2022)

    Misawa, S., Sato, K.: H2-optimal reduction of positive networks using Riemannian augmented Lagrangian method. IEEE Control Systems Letters 6, 2539–2544 (2022)

  37. [37]

    SIAM Journal on Optimization 26(1), 635–660 (2016)

    Mishra, B., Sepulchre, R.: Riemannian preconditioning. SIAM Journal on Optimization 26(1), 635–660 (2016)

  38. [38]

    Springer, New York (2006) Local Near-Quadratic Convergence of Riemannian Interior Point Methods 39

    Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, New York (2006) Local Near-Quadratic Convergence of Riemannian Interior Point Methods 39

  39. [39]

    SIAM Journal on Optimization32(2), 822–853 (2022)

    Obara, M., Okuno, T., Takeda, A.: Sequential quadratic optimization for nonlinear optimization problems on Riemannian manifolds. SIAM Journal on Optimization32(2), 822–853 (2022)

  40. [40]

    A primal-dual interior point trust region method for second-order stationary points of Riemannian inequality-constrained optimization problems

    Obara, M., Okuno, T., Takeda, A.: A primal-dual interior point trust region method for second-order stationary points of Riemanian inequality-constrained optimization problems. arXiv:2501.15419v2 (2025)

  41. [41]

    IEEE Transactions on Automatic Control 69(3), 2060–2066 (2024)

    Obara, M., Sato, K., Sakamoto, H., Okuno, T., Takeda, A.: Stable linear system identi- fication with prior knowledge by Riemannian sequential quadratic optimization. IEEE Transactions on Automatic Control 69(3), 2060–2066 (2024)

  42. [42]

    Mathematical Programming (2024)

    Rebjock, Q., Boumal, N.: Fast convergence of trust-regions for non-isolated minima via analysis of CG on indefinite matrices. Mathematical Programming (2024). To appear

  43. [43]

    Mathematical Programming (2024)

    Rebjock, Q., Boumal, N.: Fast convergence to non-isolated minima: four equivalent conditions for C2 functions. Mathematical Programming (2024). To appear

  44. [44]

    IEEE Access 7, 14,689 – 14,698 (2019)

    Sato, K.: Riemannian optimal model reduction of stable linear systems. IEEE Access 7, 14,689 – 14,698 (2019)

  45. [45]

    IEEE Transactions on Automatic Control 65(11), 4493–4508 (2020)

    Sato, K., Sato, H., Damm, T.: Riemannian optimal identification method for linear systems with symmetric positive-definite matrix. IEEE Transactions on Automatic Control 65(11), 4493–4508 (2020)

  46. [46]

    SIAM Journal on Optimization 31(3), 949–981 (2021)

    Schiela, A., Ortiz, J.: An SQP method for equality constrained optimization on Hilbert manifolds. SIAM Journal on Optimization 31(3), 949–981 (2021)

  47. [47]

    Applied Mathematics Letters 105, 106,300 (2020)

    Song, G.J., Ng, M.K.: Nonnegative low rank matrix approximation for nonnegative matrices. Applied Mathematics Letters 105, 106,300 (2020)

  48. [48]

    SIAM Journal on Optimization 25(1), 713–739 (2015)

    Sra, S., Hosseini, R.: Conic geometric optimization on the manifold of positive definite matrices. SIAM Journal on Optimization 25(1), 713–739 (2015)

  49. [49]

    In: Approximation, Randomization, and Combinatorial Optimization

    Sra, S., Vishnoi, N.K., Yildiz, O.: On geodesically convex formulations for the Brascamp- Lieb constant. In: Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, vol. 116, pp. 25:1–25:15 (2018)

  50. [50]

    SIAM Journal on Optimization 14(1), 173–199 (2003)

    Tits, A.L., W¨ achter, A., Bakhtiari, S., Urban, T.J., Lawrence, C.T.: A primal-dual interior-point method for nonlinear programming with strong global and local conver- gence properties. SIAM Journal on Optimization 14(1), 173–199 (2003)

  51. [51]

    Computational Optimization and Applications 22(3), 311–328 (2002)

    Vicente, L., Wright, S.J.: Local convergence of a primal-dual method for degenerate nonlinear programming. Computational Optimization and Applications 22(3), 311–328 (2002)

  52. [52]

    SIAM Journal on Optimization 16(1), 1–31 (2005)

    W¨ achter, A., Biegler, L.T.: Line search filter methods for nonlinear programming: mo- tivation and global convergence. SIAM Journal on Optimization 16(1), 1–31 (2005)

  53. [53]

    Mathematical Programming 106(1), 25–57 (2006)

    W¨ achter, A., Biegler, L.T.: On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Mathematical Programming 106(1), 25–57 (2006)

  54. [54]

    Mathematics of Operations Research 27(3), 585–613 (2002)

    Wright, S.J., Orban, D.: Properties of the log-barrier function on degenerate nonlinear programs. Mathematics of Operations Research 27(3), 585–613 (2002)

  55. [55]

    Computational Optimization and Applications 81(2), 397–421 (2022)

    Yamakawa, Y., Sato, H.: Sequential optimality conditions for nonlinear optimization on Riemannian manifolds and a globally convergent augmented Lagrangian method. Computational Optimization and Applications 81(2), 397–421 (2022)

  56. [56]

    Mathematical Programming 75(3), 377–397 (1996)

    Yamashita, H., Yabe, H.: Superlinear and quadratic convergence of some primal-dual interior point methods for constrained optimization. Mathematical Programming 75(3), 377–397 (1996)

  57. [57]

    SIAM Journal on Optimization 14(2), 479– 499 (2003)

    Yamashita, H., Yabe, H.: An interior point method with a primal-dual quadratic barrier penalty function for nonlinear optimization. SIAM Journal on Optimization 14(2), 479– 499 (2003)

  58. [58]

    Computational Optimization and Ap- plications 31(2), 1573–2894 (2005)

    Yamashita, H., Yabe, H.: Quadratic convergence of a primal-dual interior point method for degenerate nolninear optimization problem. Computational Optimization and Ap- plications 31(2), 1573–2894 (2005)

  59. [59]

    Math- ematical Programming 102(1), 111–151 (2005)

    Yamashita, H., Yabe, H., Tanabe, T.: A globally and superlinearly convergent primal- dual interior point trust region method for large scale constrained optimization. Math- ematical Programming 102(1), 111–151 (2005)

  60. [60]

    Pacific Journal of Optimization 10(2), 415– 434 (2014)

    Yang, W.H., Zhang, L.H., Song, R.: Optimality conditions for the nonlinear program- ming problems on Riemannian manifolds. Pacific Journal of Optimization 10(2), 415– 434 (2014)