A teacher-free distillation method transfers dark knowledge by projecting student features into a PCA coordinate system of a self-supervised teacher and pruning irrelevant coordinates.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
All You Need in Knowledge Distillation Is a Tailored Coordinate System
A teacher-free distillation method transfers dark knowledge by projecting student features into a PCA coordinate system of a self-supervised teacher and pruning irrelevant coordinates.