A sememe- and morpheme-based tensor product embedding layer compresses transformer embedding parameters by up to 80x while keeping BLEU close to the uncompressed model.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
SEE: Sememe Entanglement Encoding for Transformer-bases Models Compression
A sememe- and morpheme-based tensor product embedding layer compresses transformer embedding parameters by up to 80x while keeping BLEU close to the uncompressed model.