pith. sign in

arxiv: 1806.00413 · v1 · pith:QX6KLSVAnew · submitted 2018-06-01 · 💻 cs.LG · math.OC· stat.ML

Global linear convergence of Newton's method without strong-convexity or Lipschitz gradients

classification 💻 cs.LG math.OCstat.ML
keywords linearmethodnewtonconvergencefunctionsonlyrateachieve
0
0 comments X
read the original abstract

We show that Newton's method converges globally at a linear rate for objective functions whose Hessians are stable. This class of problems includes many functions which are not strongly convex, such as logistic regression. Our linear convergence result is (i) affine-invariant, and holds even if an (ii) approximate Hessian is used, and if the subproblems are (iii) only solved approximately. Thus we theoretically demonstrate the superiority of Newton's method over first-order methods, which would only achieve a sublinear $O(1/t^2)$ rate under similar conditions.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. INTHOP: A Second-Order Globally Convergent Method for Nonconvex Optimization

    math.OC 2025-10 unverdicted novelty 6.0

    INTHOP is a second-order method that bounds the difference between an approximate positive definite Hessian and the exact one within an interval, reuses the approximation when iterates stay inside it, and proves globa...