REVIEW 1 cited by
Extra-Newton: A First Approach to Noise-Adaptive Accelerated Second-Order Methods
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
This work proposes a universal and adaptive second-order method for minimizing second-order smooth, convex functions. Our algorithm achieves $O(\sigma / \sqrt{T})$ convergence when the oracle feedback is stochastic with variance $\sigma^2$, and improves its convergence to $O( 1 / T^3)$ with deterministic oracles, where $T$ is the number of iterations. Our method also interpolates these rates without knowing the nature of the oracle apriori, which is enabled by a parameter-free adaptive step-size that is oblivious to the knowledge of smoothness modulus, variance bounds and the diameter of the constrained set. To our knowledge, this is the first universal algorithm with such global guarantees within the second-order optimization literature.
Forward citations
Cited by 1 Pith paper
-
Simple Stepsize for Quasi-Newton Methods with Global Convergence Guarantees
An explicit stepsize schedule for quasi-Newton updates achieves O(1/k) global convergence on convex functions, and O(1/k^2) when Hessian approximation error is controlled.
Discussion (0). Continue with ORCID to comment.