CtrlSpeech adds phone-level pitch, loudness, and duration controls to a diffusion-transformer TTS backbone, improving local prosody control while preserving zero-shot speaker similarity.
CtrlSpeech: Coarse-to-Fine Control for Expressive Speech Synthesis
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Recent Text-To-Speech (TTS) systems have achieved strong naturalness and zero-shot voice cloning performance, but fine-grained control of expressive speech at the word or phoneme level remains challenging. We propose CtrlSpeech, a controllable, expressive TTS framework with coarse-to-fine control. Built on the DiTAR architecture, CtrlSpeech combines global speaker conditioning with phone-aligned pitch, loudness, and duration signals, enabling localized prosodic control while preserving the target speaker's timbre. This design allows users to adjust expressive attributes at a fine temporal granularity, making speech refinement more flexible and controllable. Experimental results show that CtrlSpeech achieves competitive zero-shot TTS performance and improves controllability over expressive attributes, demonstrating its effectiveness for flexible and practical expressive speech synthesis.
fields
eess.AS 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
CtrlSpeech: Coarse-to-Fine Control for Expressive Speech Synthesis
CtrlSpeech adds phone-level pitch, loudness, and duration controls to a diffusion-transformer TTS backbone, improving local prosody control while preserving zero-shot speaker similarity.