A Short Survey on Importance Weighting for Machine Learning
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:MAWUB6BXrecord.jsonopen to challenge →
read the original abstract
Importance weighting is a fundamental procedure in statistics and machine learning that weights the objective function or probability distribution based on the importance of the instance in some sense. The simplicity and usefulness of the idea has led to many applications of importance weighting. For example, it is known that supervised learning under an assumption about the difference between the training and test distributions, called distribution shift, can guarantee statistically desirable properties through importance weighting by their density ratio. This survey summarizes the broad applications of importance weighting in machine learning and related research.
This paper has not been read by Pith yet.
Forward citations
Cited by 5 Pith papers
-
A Practical Upper Bound on Selection Bias Effects in Medical Prediction Models
A new upper bound is derived for the worst-case effect of selection bias on medical prediction model performance under partial observation of the selection process and target data.
-
M$^3$: Reframing Training Measures for Discretized Physical Simulations
M³ partitions space by physical variation using multi-scale Morton ordering to balance training measures, yielding up to 4.7× lower error on industrial volumetric datasets and outperforming higher-resolution training ...
-
Stabilizing In-Context Multi-Source Domain Adaptation for Biomedical Images Through Controls
Meta-learning with in-context control samples closes the domain gap for mechanism-of-action classification, raising accuracy on new batches from 0.862 to 0.935 on the JUMP-CP dataset.
-
General Frameworks for Conditional Two-Sample Testing
The paper introduces two general frameworks for conditional two-sample testing by converting conditional independence tests or using density ratio estimation to enable marginal comparisons.
-
Stabilizing In-Context Multi-Source Domain Adaptation for Biomedical Images Through Controls
CS-ARM-BN uses negative control samples to stabilize Batch Normalization statistics in a meta-learning framework, achieving robust MoA classification on new experimental batches under label shift and small sample sizes.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.