A recursive fine-tuning study claims quality filtering reverses model collapse, but the paper's own data show the filtered model only matched its starting score.
Non-Parametric Goodness-of-Fit Tests Using Tsallis Entropy Measures
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
In this paper, we investigate new procedures for statistical testing based on Tsallis entropy, a parametric generalization of Shannon entropy. Focusing on multivariate generalized Gaussian and $q$-Gaussian distributions, we develop entropy-based goodness-of-fit tests based on maximum entropy formulations and nearest neighbour entropy estimators. Furthermore, we propose a novel iterative approach for estimating the shape parameters of the distributions, which is crucial for practical inference. This method extends entropy estimation techniques beyond traditional approaches, improving precision in heavy-tailed and non-Gaussian contexts. The numerical experiments are demonstrative of the statistical properties and convergence behaviour of the proposed tests. These findings are important for disciplines that require robust distributional tests, such as machine learning, signal processing, and information theory.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
REJECT 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
The Anti-Ouroboros Effect: Emergent Resilience in Large Language Models from Recursive Selective Feedback
A recursive fine-tuning study claims quality filtering reverses model collapse, but the paper's own data show the filtered model only matched its starting score.