LLKD selects unlabeled samples that combine high teacher confidence with high student uncertainty, improving text classification accuracy and data efficiency over existing distillation baselines.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AI 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data
LLKD selects unlabeled samples that combine high teacher confidence with high student uncertainty, improving text classification accuracy and data efficiency over existing distillation baselines.