pith. sign in

arxiv: 1502.06398 · v1 · pith:P3CDKY6Hnew · submitted 2015-02-23 · 💻 cs.LG · math.OC

Bandit Convex Optimization: sqrt{T} Regret in One Dimension

classification 💻 cs.LG math.OC
keywords convexproblemregretminimaxanalysisbanditbayesianfunctions
0
0 comments X
read the original abstract

We analyze the minimax regret of the adversarial bandit convex optimization problem. Focusing on the one-dimensional case, we prove that the minimax regret is $\widetilde\Theta(\sqrt{T})$ and partially resolve a decade-old open problem. Our analysis is non-constructive, as we do not present a concrete algorithm that attains this regret rate. Instead, we use minimax duality to reduce the problem to a Bayesian setting, where the convex loss functions are drawn from a worst-case distribution, and then we solve the Bayesian version of the problem with a variant of Thompson Sampling. Our analysis features a novel use of convexity, formalized as a "local-to-global" property of convex functions, that may be of independent interest.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.