A per-sample confidence score derived from the pNML min-max regret is applied to linear regression and neural networks, and improves OOD detection, adversarial robustness, and active learning.
Normalized Maximum Likelihood with Luckiness for Multivariate Normal Distributions
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
The normalized maximum likelihood (NML) is one of the most important distribution in coding theory and statistics. NML is the unique solution (if exists) to the pointwise minimax regret problem. However, NML is not defined even for simple family of distributions such as the normal distributions. Since there does not exist any meaningful minimax-regret distribution for such case, it is pointed out that NML with luckiness (LNML) can be employed as an alternative to NML. In this paper, we develop the closed form of LNMLs for multivariate normal distributions.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2024 1verdicts
CONDITIONAL 1roles
baseline 1polarities
baseline 1representative citing papers
citing papers explorer
-
Quantifying the Prediction Uncertainty of Machine Learning Models for Individual Data
A per-sample confidence score derived from the pNML min-max regret is applied to linear regression and neural networks, and improves OOD detection, adversarial robustness, and active learning.