Under a piecewise-polynomial utility structure and a regularity condition, tuning one hyperparameter across tasks needs O(sqrt((log N + d log(Delta M) + log(1/delta))/m)) tasks for near-optimal average utility.
Algorithm Configuration for Structured Pfaffian Settings
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Data-driven algorithm design automatically adapts algorithms to specific application domains, achieving better performance. In the context of parameterized algorithms, this approach involves tuning the algorithm's hyperparameters using problem instances drawn from the problem distribution of the target application domain. This can be achieved by maximizing empirical utilities that measure the algorithms' performance as a function of their hyperparameters, using problem instances. While empirical evidence supports the effectiveness of data-driven algorithm design, providing theoretical guarantees for several parameterized families remains challenging. This is due to the intricate behaviors of their corresponding utility functions, which typically admit piecewise discontinuous structures. In this work, we present refined frameworks for providing learning guarantees for parameterized data-driven algorithm design problems in both distributional and online learning settings. For the distributional learning setting, we introduce the \textit{Pfaffian GJ framework}, an extension of the classical \textit{GJ framework}, that is capable of providing learning guarantees for function classes for which the computation involves Pfaffian functions. Unlike the GJ framework, which is limited to function classes with computation characterized by rational functions, our proposed framework can deal with function classes involving Pfaffian functions, which are much more general and widely applicable. We then show that for many parameterized algorithms of interest, their utility function possesses a \textit{refined piecewise structure}, which automatically translates to learning guarantees using our proposed framework.
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Sample complexity of data-driven tuning of model hyperparameters in neural networks with structured parameter-dependent dual function
Under a piecewise-polynomial utility structure and a regularity condition, tuning one hyperparameter across tasks needs O(sqrt((log N + d log(Delta M) + log(1/delta))/m)) tasks for near-optimal average utility.