REVIEW 5 cited by
An Axiomatic Assessment of Entropy- and Variance-based Uncertainty Quantification in Regression
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Uncertainty quantification is crucial in machine learning, yet most (axiomatic) studies of uncertainty measures focus on classification, leaving a gap in regression settings with limited formal justification and evaluations. In this work, we provide a formal way of representing uncertainty in continuous space, using a general parametric formulation, allowing for tractable analysis and evaluation of uncertainty measures. Within this framework, we propose a set of axioms that enable rigorous assessment of total, aleatoric, and epistemic uncertainty measures. Together, this allows for a theoretical examination of uncertainty measures and their corresponding properties. As a specific example, we compare the widely used entropy- and variance-based measures with respect to established predictive models and analyze their limitations and challenges in uncertainty quantification. Our work provides a principled way to understand and develop uncertainty measures in supervised regression, offering theoretical insights and practical guidelines for reliable uncertainty assessment.
Forward citations
Cited by 5 Pith papers
-
Mobile Network Control with a World Model
A world model trained on network data can plan hourly on/off control of capacity cells, improving the energy/QoS trade-off over a threshold baseline and an RL agent in simulation.
-
Subjective Risk Decomposition: A New View for Uncertainty Quantification
Most existing epistemic/aleatoric uncertainty measures are special cases of one bias-variance-entropy decomposition of subjective risk under a strictly proper loss.
-
Response Uncertainty and Probe Modeling: Two Sides of the Same Coin in LLM Interpretability?
LLM response uncertainty and linear probe performance are strongly negatively correlated across six fact-based datasets and six models, with high-uncertainty responses associated with more spread-out feature importance.
-
Uncertainty Quantification for Regression: A Unified Framework based on kernel scores
Kernel-score divergences define a unified family of regression uncertainty measures whose kernel choice controls robustness, tail sensitivity, and OOD responsiveness.
-
Aleatoric and Epistemic Uncertainty Measures for Ordinal Classification through Binary Reduction
Order-consistent binary reduction, summing entropy or variance uncertainties over all ordered splits, provides competitive aleatoric and epistemic uncertainty measures for ordinal classification.
Discussion (0). Continue with ORCID to comment.