EI-BERT compresses a Chinese NLU model to 1.91 MB with competitive accuracy using attention-based vocabulary pruning, cross-distillation, and module-wise INT8 quantization, and reports deployment at Alipay.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Put Teacher in Student's Shoes: Cross-Distillation for Ultra-compact Model Compression Framework
EI-BERT compresses a Chinese NLU model to 1.91 MB with competitive accuracy using attention-based vocabulary pruning, cross-distillation, and module-wise INT8 quantization, and reports deployment at Alipay.