A zero-shot TTS method that splits reference audio into ASR word segments, encodes local styles, and merges them via self-attention improves intelligibility and speaker similarity on unseen voices.
GSA-TTS : Toward Zero-Shot Speech Synthesis based on Gradual Style Adaptor
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
We present the gradual style adaptor TTS (GSA-TTS) with a novel style encoder that gradually encodes speaking styles from an acoustic reference for zero-shot speech synthesis. GSA first captures the local style of each semantic sound unit. Then the local styles are combined by self-attention to obtain a global style condition. This semantic and hierarchical encoding strategy provides a robust and rich style representation for an acoustic model. We test GSA-TTS on unseen speakers and obtain promising results regarding naturalness, speaker similarity, and intelligibility. Additionally, we explore the potential of GSA in terms of interpretability and controllability, which stems from its hierarchical structure.
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
GSA-TTS : Toward Zero-Shot Speech Synthesis based on Gradual Style Adaptor
A zero-shot TTS method that splits reference audio into ASR word segments, encodes local styles, and merges them via self-attention improves intelligibility and speaker similarity on unseen voices.