A model-independent upper bound on generalization gap is established that depends solely on the Rรฉnyi entropy of the data-generating distribution for histogram-determined algorithms such as ERM.
This means (๐ด2,1 โ) 3 ln ๐โ ๐ 2 ln 2 ๐ฟ3 2๐ < ๐2 12
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
stat.ML 1years
2025 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Overfitting has a limitation: a model-independent generalization gap bound based on R\'enyi entropy
A model-independent upper bound on generalization gap is established that depends solely on the Rรฉnyi entropy of the data-generating distribution for histogram-determined algorithms such as ERM.