pith. sign in

arxiv: 2312.01386 · v2 · pith:QVZ3LUI6new · submitted 2023-12-03 · 💻 cs.LG · stat.ML

On the Suboptimality of GP-UCB under Polynomial Effective Optimism

classification 💻 cs.LG stat.ML
keywords gp-ucbboundboundseffectiveminimaxoptimismregretupper
0
0 comments X
read the original abstract

Gaussian process upper confidence bound (GP-UCB) is widely used for sequential optimization of expensive black-box functions. Although many upper bounds on its cumulative regret have been established in the literature, whether GP-UCB is minimax optimal remains open. We study this question through the effective optimism level, defined as the product of the exploration coefficient and the regularization parameter in kernel ridge regression. Under a uniform confidence assumption, we prove a new regret lower bound for GP-UCB with Mat\'ern kernels. The bound shows that polynomial growth of the effective optimism level, up to logarithmic factors, rules out the minimax-optimal regret rate. Since this is the regime covered by most existing analyses, our result identifies a concrete obstacle to proving minimax optimality for standard GP-UCB. More broadly, it suggests that the gap between current upper bounds and minimax lower bounds may reflect a real limitation of the algorithm, not only of the analysis.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Bayesian Optimization by Kernel Regression and Density-based Exploration

    math.OC 2025-02 unverdicted novelty 4.0

    BOKE uses kernel regression and density-based exploration in a confidence-bound acquisition function to achieve quadratic-complexity Bayesian optimization with a claimed global convergence guarantee under noise.