Using character-duration sequences from WhisperX, a transformer identifies speakers with balanced accuracy of 0.39 on LibriSpeech but only 0.03 on VoxCeleb1, and fusion with x-vectors does not improve accuracy.
Rhythm Features for Speaker Identification
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
While deep learning models have demonstrated robust performance in speaker recognition tasks, they primarily rely on low-level audio features learned empirically from spectrograms or raw waveforms. However, prior work has indicated that idiosyncratic speaking styles heavily influence the temporal structure of linguistic units in speech signals (rhythm). This makes rhythm a strong yet largely overlooked candidate for a speech identity feature. In this paper, we test this hypothesis by applying deep learning methods to perform text-independent speaker identification from rhythm features. Our findings support the usefulness of rhythmic information for speaker recognition tasks but also suggest that high intra-subject variability in ad-hoc speech can degrade its effectiveness.
citation-role summary
citation-polarity summary
fields
eess.AS 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
support 1representative citing papers
citing papers explorer
-
Rhythm Features for Speaker Identification
Using character-duration sequences from WhisperX, a transformer identifies speakers with balanced accuracy of 0.39 on LibriSpeech but only 0.03 on VoxCeleb1, and fusion with x-vectors does not improve accuracy.