Iterative decoder pruning plus QLoRA and knowledge distillation compress Qwen2-Audio-7B by up to 50% with 97-100% of teacher translation quality on English-German and English-Chinese.
online" 'onlinestring :=
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Efficient Speech Translation through Model Compression and Knowledge Distillation
Iterative decoder pruning plus QLoRA and knowledge distillation compress Qwen2-Audio-7B by up to 50% with 97-100% of teacher translation quality on English-German and English-Chinese.