REVIEW 4 cited by
Monotonicity of Entropy and Fisher Information: A Quick Proof via Maximal Correlation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
A simple proof is given for the monotonicity of entropy and Fisher information associated to sums of i.i.d. random variables. The proof relies on a characterization of maximal correlation for partial sums due to Dembo, Kagan and Shepp.
Forward citations
Cited by 4 Pith papers
-
Sub-Gaussian Concentration and Entropic Normality of the Maximum Likelihood Estimator
Under regularity conditions plus assumptions on the score, the normalized MLE has sub-Gaussian tails, all moments converge, and the estimator converges in relative entropy to Gaussian when Fisher information is bounde...
-
Causal Covariate Shift Correction using Fisher information penalty
A Fisher information penalty added to the loss during batchwise training is claimed to correct covariate shift and improve accuracy, but the supporting derivation and experiments are incomplete.
-
PIcsC: Partitioning-Induced Covariate Shift Correction
A Fisher-information regularizer is proposed to correct partition-induced covariate shift in cross-validation and federated learning, with reported gains of 3-5 points over FedAvg-class baselines.
-
Confidence-calibrated covariate shift correction for few-shot classification in Vision-Language Models
A proposed unified regularizer for CLIP prompt learning, combining Fisher information and confidence penalties, is reported to improve few-shot accuracy and calibration, but the core combined method is not tested and ...
Discussion (0). Continue with ORCID to comment.