MEAL uses adversarial block-wise distillation from randomly selected teacher networks to train a single student that outperforms both the individual teachers and conventional ensembles at no extra inference cost.
Swapout: Learning an ensemble of deep architectures,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CV 1years
2019 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Adversarial-Based Knowledge Distillation for Multi-Model Ensemble and Noisy Data Refinement
MEAL uses adversarial block-wise distillation from randomly selected teacher networks to train a single student that outperforms both the individual teachers and conventional ensembles at no extra inference cost.