Coarser duration-penalized speech units hurt phone/word discrimination but help resynthesis and lexical/syntactic modeling when the codebook is large enough.
Tak- ing the results together, it appears that coarser units are not bene- ficial at the lowest levels in discriminating between isolated units like phones or words
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Spoken Language Modeling with Duration-Penalized Self-Supervised Units
Coarser duration-penalized speech units hurt phone/word discrimination but help resynthesis and lexical/syntactic modeling when the codebook is large enough.