Selecting per-class medoids (samples with lowest average L2 distance to all same-class samples in teacher feature space) consistently outperforms random, herding, and k-center Greedy baselines for few-shot knowledge distillation on from-scratch students.
Moderate Coreset: A Universal Method of Data Selection for Real-World Data- Efficient Deep Learning, in: Proceedings of ICLR
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation
Selecting per-class medoids (samples with lowest average L2 distance to all same-class samples in teacher feature space) consistently outperforms random, herding, and k-center Greedy baselines for few-shot knowledge distillation on from-scratch students.