FADE adapts to sequential covariate shift by combining a Fisher-weighted KL shift signal with a smoothed Fisher information regularizer, reporting gains on vision, text, and tabular benchmarks.
Testing for concept shift online
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
This note continues study of exchangeability martingales, i.e., processes that are martingales under any exchangeable distribution for the observations. Such processes can be used for detecting violations of the IID assumption, which is commonly made in machine learning. Violations of the IID assumption are sometimes referred to as dataset shift, and dataset shift is sometimes subdivided into concept shift, covariate shift, etc. Our primary interest is in concept shift, but we will also discuss exchangeability martingales that decompose perfectly into two components one of which detects concept shift and the other detects what we call label shift. Our methods will be based on techniques of conformal prediction.
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
REJECT 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
Adapting to Fragmented and Evolving Data: A Fisher Information Perspective
FADE adapts to sequential covariate shift by combining a Fisher-weighted KL shift signal with a smoothed Fisher information regularizer, reporting gains on vision, text, and tabular benchmarks.