Local near-quadratic convergence of Riemannian interior point methods
Pith reviewed 2026-05-19 14:27 UTC · model grok-4.3
The pith
Riemannian interior point methods achieve local near-quadratic convergence by solving one linear system per outer iteration with a specific barrier update.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Under standard assumptions the algorithm achieves local superlinear convergence by solving a linear system at each outer iteration, removing the need for further computations in the inner iterations. A specific update for the barrier parameter achieves local near-quadratic convergence of the algorithm. When applied to the method of Obara, Okuno, and Takeda (2026) the analysis also confirms second-order stationarity in the global convergence result.
What carries the argument
The outer-inner iteration structure of the Riemannian interior point method together with a barrier-parameter update rule that controls the local convergence rate.
If this is right
- Only one linear solve per outer iteration is required for local superlinear convergence.
- The barrier-parameter update produces local near-quadratic convergence near a solution.
- The analysis supplies both local rates and global convergence to a second-order stationary point for the algorithm to which it is applied.
- The same framework covers problems with both equality and inequality constraints on Riemannian manifolds.
Where Pith is reading between the lines
- The single-solve outer iteration may be reusable as a local accelerator inside other Riemannian constrained solvers.
- The barrier update strategy could be tested on higher-dimensional manifold problems to check whether the predicted rates survive floating-point effects.
- Similar local-rate results might be derived for Riemannian variants of other classical interior-point families such as primal-dual or penalty methods.
Load-bearing premise
The standard assumptions on constraint qualifications, second-order stationarity, and the properties of the Riemannian metric and barrier function hold in a neighborhood of the solution.
What would settle it
Numerical runs on a low-dimensional constrained Riemannian problem that show the error sequence remains only linearly convergent even after the proposed barrier update is applied would refute the near-quadratic claim.
read the original abstract
We consider Riemannian optimization problems with inequality and equality constraints and analyze a class of Riemannian interior point methods for solving them. The algorithm of interest consists of outer and inner iterations. We show that, under standard assumptions, the algorithm achieves local superlinear convergence by solving a linear system at each outer iteration, removing the need for further computations in the inner iterations. We also provide a specific update for the barrier parameter that achieves local near-quadratic convergence of the algorithm. We apply our results to the method proposed by Obara, Okuno, and Takeda (2026) and show its local superlinear and near-quadratic convergence with an analysis of the second-order stationarity. To our knowledge, this is the first algorithm for constrained optimization on Riemannian manifolds that achieves both local convergence and global convergence to a second-order stationary point. Numerical results support the theoretical analyses of the proposed methods.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript analyzes a class of Riemannian interior point methods for constrained optimization problems on Riemannian manifolds with equality and inequality constraints. Under standard assumptions (constraint qualifications, second-order stationarity, and suitable smoothness/convexity properties of the barrier function with respect to the Riemannian metric), it establishes that the algorithm achieves local superlinear convergence because each outer iteration reduces to solving a single linear system whose solution yields the step, eliminating further inner-iteration computations. A specific barrier-parameter update is proposed that yields local near-quadratic convergence. The analysis is applied to the concrete method of Obara, Okuno, and Takeda (2026), proving both local rates and second-order stationarity; global convergence to a second-order stationary point is shown separately via a potential-function argument. Numerical results support the theory, and the work claims to be the first Riemannian constrained optimizer with both local convergence and global convergence to second-order points.
Significance. If the results hold, the manuscript makes a solid contribution to Riemannian optimization by supplying the first local superlinear and near-quadratic convergence analysis for interior-point methods on manifolds, together with global convergence to second-order stationary points. The explicit verification that the listed assumptions are inherited by the Obara et al. method, the clean separation between the global potential-function argument and the local error-recursion analysis, and the retraction-based feasibility arguments are strengths that enhance applicability and credibility. The work provides a reusable framework that can be instantiated on other Riemannian IPMs and addresses a genuine gap in the literature on constrained manifold optimization.
minor comments (3)
- [Local-analysis section] § Local-analysis section: the precise definition of the 'near-quadratic' rate (how the barrier update modifies the standard quadratic error recursion) would benefit from an explicit side-by-side comparison with the Euclidean IPM quadratic rate to clarify the distinction.
- [Local-analysis section] The statement of the standard assumptions is given in the local-analysis section but would be easier to reference if collected into a single numbered assumption block or table.
- [Numerical results] Numerical results section: adding log-log plots of the error versus iteration count would make the observed superlinear/near-quadratic behavior visually immediate and strengthen the empirical support.
Simulated Author's Rebuttal
We thank the referee for the positive and thorough evaluation of our manuscript on Riemannian interior point methods. We appreciate the recognition of the local superlinear and near-quadratic convergence results, the global convergence to second-order stationary points, and the reusable framework for other Riemannian IPMs. The recommendation for minor revision is noted, and we will make appropriate improvements to enhance the presentation and clarity.
Circularity Check
No significant circularity in derivation chain
full rationale
The paper derives local superlinear and near-quadratic convergence rates for a class of Riemannian interior-point methods by showing that, under explicitly enumerated standard assumptions (constraint qualifications, second-order stationarity, smoothness of the barrier with respect to the Riemannian metric), each outer iteration reduces to a single linear-system solve whose step, combined with the proposed barrier-parameter update, produces the stated rates via standard error-recursion arguments. The global convergence to a second-order stationary point is established separately via a potential-function argument that does not rely on the local-rate machinery. Application of the general results to the concrete method of Obara et al. (2026) consists of verifying that the listed assumptions are inherited by that method; this verification step is independent of the rate derivations themselves. No equation reduces by construction to a fitted parameter, no central premise rests solely on a self-citation whose content is unverified, and the analysis remains self-contained against external benchmarks once the stated assumptions are granted.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption Standard assumptions for local convergence of Riemannian interior-point methods (constraint qualifications, second-order stationarity, smoothness of the barrier function)
Reference graph
Works this paper leans on
-
[1]
Princeton University Press, Princeton (2008)
Absil, P.A., Mahony, R., Sepulchre, R.: Optimization algorithms on matrix manifolds. Princeton University Press, Princeton (2008)
work page 2008
-
[2]
In: IEEE Symposium on Foundations of Computer Science, pp
Acuaviva, A., Makam, V., Nieuwboer, H., P´ erez-Garc´ ıa, D., Sittner, F., Walter, M., Witteveen, F.: The minimal canonical form of a tensor network. In: IEEE Symposium on Foundations of Computer Science, pp. 328–362 (2023)
work page 2023
-
[3]
SIAM Journal on Optimization 27(1), 269–291 (2017)
Adachi, S., Iwata, S., Nakatsukasa, Y., Takeda, A.: Solving the trust-region subproblem by a generalized eigenvalue problem. SIAM Journal on Optimization 27(1), 269–291 (2017)
work page 2017
-
[4]
SIAM Journal on Optimization 34(2), 1799–1825 (2024)
Andreani, R., Couto, K.R., Ferreira, O.P., Haeser, G.: Constraint qualifications and strong global convergence properties of an augmented Lagrangian method on Rieman- nian manifolds. SIAM Journal on Optimization 34(2), 1799–1825 (2024)
work page 2024
-
[5]
URL https://optimization-online.org/?p=27595
Andreani, R., Couto, K.R., Ferreira, O.P., Haeser, G., Prudente, L.F.: Global conver- gence of an augmented Lagrangian method for nonlinear programming via Riemannian optimization (2024). URL https://optimization-online.org/?p=27595
work page 2024
-
[6]
Mathematical Programming 115(2), 199–222 (2006)
Armand, P., Benoist, J.: A local convergence property of primal-dual methods for non- linear programming. Mathematical Programming 115(2), 199–222 (2006)
work page 2006
-
[7]
Computational Optimization and Applica- tions 41(1), 1573–2894 (2007)
Armand, P., Benoist, J., Orban, D.: Dynamic updates of the barrier parameter in primal- dual methods for nonlinear programming. Computational Optimization and Applica- tions 41(1), 1573–2894 (2007)
work page 2007
-
[8]
Optimization Methods and Software 28(5), 1051–1080 (2012)
Armand, P., Benoist, J., Orban, D.: From global to local convergence of interior meth- ods for nonlinear optimization. Optimization Methods and Software 28(5), 1051–1080 (2012)
work page 2012
-
[9]
SIAM Journal on Optimization 29(4), 2423–2444 (2010)
Bergmann, R., Herzog, R.: Intrinsic formulation of KKT conditions and constraint qual- ifications on smooth manifolds. SIAM Journal on Optimization 29(4), 2423–2444 (2010)
work page 2010
-
[10]
URL https://optimization-online.org/?p=28986
Birgin, E.G., Ferreira, O.P., Haeser, G., Maculan, N., Ramirez, L.M., Prudente, L.F.: Smoothing ℓ1-exact penalty methiod for intrinsically constarined Riemannian optimiza- tion problems (2025). URL https://optimization-online.org/?p=28986
work page 2025
-
[11]
Cambridge Univer- sity Press, Cambridge (2023)
Boumal, N.: An introduction to optimization on smooth manifolds. Cambridge Univer- sity Press, Cambridge (2023)
work page 2023
-
[12]
IEEE Transactions on Robotics 34(5), 1252–1265 (2018)
Brossette, S., Escande, A., Kheddar, A.: Multicontact postures computation on mani- folds. IEEE Transactions on Robotics 34(5), 1252–1265 (2018)
work page 2018
-
[13]
Mathematical Programming 89(1), 149–185 (2000) 38 Mitsuaki Obara, Takayuki Okuno, and Akiko Takeda
Byrd, R.H., Gilbert, J.C., Nocedal, J.: A trust region method based on interior point techniques for nonlinear programming. Mathematical Programming 89(1), 149–185 (2000) 38 Mitsuaki Obara, Takayuki Okuno, and Akiko Takeda
work page 2000
-
[14]
In: Numerical Analysis 1997, pp
Byrd, R.H., Liu, G., Nocedal, J.: On the local behavior of an interior point method for nonlinear programming. In: Numerical Analysis 1997, pp. 37–56. Chapman and Hall/CRC, Harlow (1997)
work page 1997
-
[15]
do Carmo, M.P.: Riemannian Geometry. Birkh¨ auser, Basel (1992)
work page 1992
-
[16]
SIAM Review 62(2), 395—-436 (2020)
Carmon, Y., Duchi, J.C.: First-order methods for nonconvex quadratic minimization. SIAM Review 62(2), 395—-436 (2020)
work page 2020
-
[17]
Mathematical Programming 87(2), 215–249 (2000)
Conn, A.R., Gould, N.I.M., Orban, D., Toint, P.L.: A primal-dual trust-region algorithm for non-convex nonlinear programming. Mathematical Programming 87(2), 215–249 (2000)
work page 2000
-
[18]
IEEE Transactions on Signal Processing 59(7), 3120–3132 (2011)
Dai, W., Milenkovic, O., Kerman, E.: Subspace evaluation and transfer (SET) for low- rank matrix completion. IEEE Transactions on Signal Processing 59(7), 3120–3132 (2011)
work page 2011
-
[19]
IEEE Transactions on Information Theory 58(1), 237–247 (2012)
Dai, W., Milenkovic, O., Kerman, E.: A geometric approach to low-rank matrix com- pletion. IEEE Transactions on Information Theory 58(1), 237–247 (2012)
work page 2012
-
[20]
Journal of Industrial & Management Optimization 16(2), 1009–1035 (2020)
Dai, Y.H., Liu, X.W., Sun, J.: A primal-dual interior-point method capable of rapidly detecting infeasibility for nonlinear programs. Journal of Industrial & Management Optimization 16(2), 1009–1035 (2020)
work page 2020
-
[21]
Econometrica 20(2), 295–300 (1952)
Debreu, G.: Definite and semidefinite quadratic forms. Econometrica 20(2), 295–300 (1952)
work page 1952
-
[22]
Journal of Optimization Theory and Application 89(3), 507–541 (1996)
El-Bakry, A.S., Tapia, R.A., Tsuchiya, T., Zhang, Y.: On the formulation and theory of the Newton interior-point method for nonlinear programming. Journal of Optimization Theory and Application 89(3), 507–541 (1996)
work page 1996
-
[23]
Journal of Optimization Theory and Applications 173(3), 828–843 (2017)
Fernandes, T.A., Ferreira, O.P., Yuan, J.: On the superlinear convergence of Newton’s method on Riemannian manifolds. Journal of Optimization Theory and Applications 173(3), 828–843 (2017)
work page 2017
-
[24]
SIAM Review 44(4), 525–597 (2002)
Forsgren, A., Gill, P.E., Wright, M.H.: Interior methods for nonlinear optimization. SIAM Review 44(4), 525–597 (2002)
work page 2002
-
[25]
In: High- Performance Scientific Computing, pp
Gallivan, K.A., Qi, C., Absil, P.A.: A Riemannian Dennis-Mor´ e condition. In: High- Performance Scientific Computing, pp. 281–293. Springer, London (2012)
work page 2012
-
[26]
Gao, B., Peng, R., Yuan, Y.X.: Optimization on product manifolds under a precondi- tioned metric. arXiv:2306.00873 (2023)
-
[27]
SIAM Journal on Optimiza- tion 11(4), 974–1002 (2001)
Gould, N.I.M., Orban, D., Sartenaer, A., Toint, P.L.: Superlinear convergence of primal- dual interior point algorithms for nonlinear programming. SIAM Journal on Optimiza- tion 11(4), 974–1002 (2001)
work page 2001
-
[28]
In: IEEE Symposium on Foundations of Computer Science, pp
Hirai, H., Nieuwboer, H., Walter, M.: Interior-point methods on manifolds: theory and applications. In: IEEE Symposium on Foundations of Computer Science, pp. 2021–2030 (2023)
work page 2021
-
[29]
Mathematical Programming 150(2), 179–216 (2015)
Huang, W., Absil, P.A., Gallivan, K.A.: A Riemannian symmetric rank-one trust-region method. Mathematical Programming 150(2), 179–216 (2015)
work page 2015
-
[30]
Journal of Optimization Theory and Applications 201(1), 433–469 (2024)
Lai, Z., Yoshise, A.: Riemannian interior point methods for constrained optimization on manifolds. Journal of Optimization Theory and Applications 201(1), 433–469 (2024)
work page 2024
-
[31]
Lee, J.M.: Introduction to smooth manifolds, second edn. Springer, New York (2012)
work page 2012
-
[32]
Applied Mathematics & Optimization 82(3), 949–981 (2020)
Liu, C., Boumal, N.: Simple algorithms for optimization on Riemannian manifolds with constraints. Applied Mathematics & Optimization 82(3), 949–981 (2020)
work page 2020
-
[33]
Mathematical Programming125(1), 163–193 (2010)
Liu, X., Yuan, Y.: A null-space primal-dual interior-point algorithm for nonlinear opti- mization with nice convergence properties. Mathematical Programming125(1), 163–193 (2010)
work page 2010
-
[34]
European Journal of Operational Research 214(3), 512–525 (2011)
L´ opez, C.O., Beasley, J.E.: A heuristic for circle packing problem with a variety of containers. European Journal of Operational Research 214(3), 512–525 (2011)
work page 2011
-
[35]
Bolet´ ın de la Sociedad Matem´ atica Mexicana1(2), 137–148 (1995)
Mart´ ınez, H.J., Parada, Z., Tapia, R.A.: On the characterization of Q-superlinear con- vergence of quasi-Newton interior-point methods for nonlinear programming. Bolet´ ın de la Sociedad Matem´ atica Mexicana1(2), 137–148 (1995)
work page 1995
-
[36]
IEEE Control Systems Letters 6, 2539–2544 (2022)
Misawa, S., Sato, K.: H2-optimal reduction of positive networks using Riemannian augmented Lagrangian method. IEEE Control Systems Letters 6, 2539–2544 (2022)
work page 2022
-
[37]
SIAM Journal on Optimization 26(1), 635–660 (2016)
Mishra, B., Sepulchre, R.: Riemannian preconditioning. SIAM Journal on Optimization 26(1), 635–660 (2016)
work page 2016
-
[38]
Springer, New York (2006) Local Near-Quadratic Convergence of Riemannian Interior Point Methods 39
Nocedal, J., Wright, S.J.: Numerical Optimization. Springer, New York (2006) Local Near-Quadratic Convergence of Riemannian Interior Point Methods 39
work page 2006
-
[39]
SIAM Journal on Optimization32(2), 822–853 (2022)
Obara, M., Okuno, T., Takeda, A.: Sequential quadratic optimization for nonlinear optimization problems on Riemannian manifolds. SIAM Journal on Optimization32(2), 822–853 (2022)
work page 2022
-
[40]
Obara, M., Okuno, T., Takeda, A.: A primal-dual interior point trust region method for second-order stationary points of Riemanian inequality-constrained optimization problems. arXiv:2501.15419v2 (2025)
work page internal anchor Pith review Pith/arXiv arXiv 2025
-
[41]
IEEE Transactions on Automatic Control 69(3), 2060–2066 (2024)
Obara, M., Sato, K., Sakamoto, H., Okuno, T., Takeda, A.: Stable linear system identi- fication with prior knowledge by Riemannian sequential quadratic optimization. IEEE Transactions on Automatic Control 69(3), 2060–2066 (2024)
work page 2060
-
[42]
Mathematical Programming (2024)
Rebjock, Q., Boumal, N.: Fast convergence of trust-regions for non-isolated minima via analysis of CG on indefinite matrices. Mathematical Programming (2024). To appear
work page 2024
-
[43]
Mathematical Programming (2024)
Rebjock, Q., Boumal, N.: Fast convergence to non-isolated minima: four equivalent conditions for C2 functions. Mathematical Programming (2024). To appear
work page 2024
-
[44]
IEEE Access 7, 14,689 – 14,698 (2019)
Sato, K.: Riemannian optimal model reduction of stable linear systems. IEEE Access 7, 14,689 – 14,698 (2019)
work page 2019
-
[45]
IEEE Transactions on Automatic Control 65(11), 4493–4508 (2020)
Sato, K., Sato, H., Damm, T.: Riemannian optimal identification method for linear systems with symmetric positive-definite matrix. IEEE Transactions on Automatic Control 65(11), 4493–4508 (2020)
work page 2020
-
[46]
SIAM Journal on Optimization 31(3), 949–981 (2021)
Schiela, A., Ortiz, J.: An SQP method for equality constrained optimization on Hilbert manifolds. SIAM Journal on Optimization 31(3), 949–981 (2021)
work page 2021
-
[47]
Applied Mathematics Letters 105, 106,300 (2020)
Song, G.J., Ng, M.K.: Nonnegative low rank matrix approximation for nonnegative matrices. Applied Mathematics Letters 105, 106,300 (2020)
work page 2020
-
[48]
SIAM Journal on Optimization 25(1), 713–739 (2015)
Sra, S., Hosseini, R.: Conic geometric optimization on the manifold of positive definite matrices. SIAM Journal on Optimization 25(1), 713–739 (2015)
work page 2015
-
[49]
In: Approximation, Randomization, and Combinatorial Optimization
Sra, S., Vishnoi, N.K., Yildiz, O.: On geodesically convex formulations for the Brascamp- Lieb constant. In: Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques, vol. 116, pp. 25:1–25:15 (2018)
work page 2018
-
[50]
SIAM Journal on Optimization 14(1), 173–199 (2003)
Tits, A.L., W¨ achter, A., Bakhtiari, S., Urban, T.J., Lawrence, C.T.: A primal-dual interior-point method for nonlinear programming with strong global and local conver- gence properties. SIAM Journal on Optimization 14(1), 173–199 (2003)
work page 2003
-
[51]
Computational Optimization and Applications 22(3), 311–328 (2002)
Vicente, L., Wright, S.J.: Local convergence of a primal-dual method for degenerate nonlinear programming. Computational Optimization and Applications 22(3), 311–328 (2002)
work page 2002
-
[52]
SIAM Journal on Optimization 16(1), 1–31 (2005)
W¨ achter, A., Biegler, L.T.: Line search filter methods for nonlinear programming: mo- tivation and global convergence. SIAM Journal on Optimization 16(1), 1–31 (2005)
work page 2005
-
[53]
Mathematical Programming 106(1), 25–57 (2006)
W¨ achter, A., Biegler, L.T.: On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming. Mathematical Programming 106(1), 25–57 (2006)
work page 2006
-
[54]
Mathematics of Operations Research 27(3), 585–613 (2002)
Wright, S.J., Orban, D.: Properties of the log-barrier function on degenerate nonlinear programs. Mathematics of Operations Research 27(3), 585–613 (2002)
work page 2002
-
[55]
Computational Optimization and Applications 81(2), 397–421 (2022)
Yamakawa, Y., Sato, H.: Sequential optimality conditions for nonlinear optimization on Riemannian manifolds and a globally convergent augmented Lagrangian method. Computational Optimization and Applications 81(2), 397–421 (2022)
work page 2022
-
[56]
Mathematical Programming 75(3), 377–397 (1996)
Yamashita, H., Yabe, H.: Superlinear and quadratic convergence of some primal-dual interior point methods for constrained optimization. Mathematical Programming 75(3), 377–397 (1996)
work page 1996
-
[57]
SIAM Journal on Optimization 14(2), 479– 499 (2003)
Yamashita, H., Yabe, H.: An interior point method with a primal-dual quadratic barrier penalty function for nonlinear optimization. SIAM Journal on Optimization 14(2), 479– 499 (2003)
work page 2003
-
[58]
Computational Optimization and Ap- plications 31(2), 1573–2894 (2005)
Yamashita, H., Yabe, H.: Quadratic convergence of a primal-dual interior point method for degenerate nolninear optimization problem. Computational Optimization and Ap- plications 31(2), 1573–2894 (2005)
work page 2005
-
[59]
Math- ematical Programming 102(1), 111–151 (2005)
Yamashita, H., Yabe, H., Tanabe, T.: A globally and superlinearly convergent primal- dual interior point trust region method for large scale constrained optimization. Math- ematical Programming 102(1), 111–151 (2005)
work page 2005
-
[60]
Pacific Journal of Optimization 10(2), 415– 434 (2014)
Yang, W.H., Zhang, L.H., Song, R.: Optimality conditions for the nonlinear program- ming problems on Riemannian manifolds. Pacific Journal of Optimization 10(2), 415– 434 (2014)
work page 2014
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.