A new first-order method for online bilevel optimization achieves regret O(1 + V_T + H_{2,T}) over O(T log T) iterations without Hessian-vector products.
Online min-max problems with non-convexity and non-stationarity.Transactions on Machine Learning Research
3 Pith papers cite this work. Polarity classification is still indexing.
fields
cs.LG 3verdicts
UNVERDICTED 3representative citing papers
Algorithms achieve optimal regret bounds of Ω(1+V_T) for standard bilevel local regret with O(T log T) inner gradients and Ω(T/W²) for window-averaged regret using adaptive and window-based analyses.
Introduces a novel search direction enabling sublinear stochastic bilevel regret guarantees for first- and zeroth-order online bilevel optimization algorithms without relying on window smoothing.
citing papers explorer
-
Fully First-Order Algorithms for Online Bilevel Optimization
A new first-order method for online bilevel optimization achieves regret O(1 + V_T + H_{2,T}) over O(T log T) iterations without Hessian-vector products.
-
Achieving Better Local Regret Bound for Online Non-Convex Bilevel Optimization
Algorithms achieve optimal regret bounds of Ω(1+V_T) for standard bilevel local regret with O(T log T) inner gradients and Ω(T/W²) for window-averaged regret using adaptive and window-based analyses.
-
Stochastic Regret Guarantees for Online Zeroth- and First-Order Bilevel Optimization
Introduces a novel search direction enabling sublinear stochastic bilevel regret guarantees for first- and zeroth-order online bilevel optimization algorithms without relying on window smoothing.