REVIEW 11 cited by
Diff-TTS: A Denoising Diffusion Model for Text-to-Speech
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Although neural text-to-speech (TTS) models have attracted a lot of attention and succeeded in generating human-like speech, there is still room for improvements to its naturalness and architectural efficiency. In this work, we propose a novel non-autoregressive TTS model, namely Diff-TTS, which achieves highly natural and efficient speech synthesis. Given the text, Diff-TTS exploits a denoising diffusion framework to transform the noise signal into a mel-spectrogram via diffusion time steps. In order to learn the mel-spectrogram distribution conditioned on the text, we present a likelihood-based optimization method for TTS. Furthermore, to boost up the inference speed, we leverage the accelerated sampling method that allows Diff-TTS to generate raw waveforms much faster without significantly degrading perceptual quality. Through experiments, we verified that Diff-TTS generates 28 times faster than the real-time with a single NVIDIA 2080Ti GPU.
Forward citations
Cited by 11 Pith papers
-
Autonomous Collaborative Learning Among an Ensemble of Tsetlin Machines with Consensus-Based Inference
A two-layer Tsetlin Machine ensemble with gossip-based vote sharing matches centralized accuracy on several benchmarks without exchanging raw data.
-
DiTReducio: A Training-Free Acceleration for DiT-Based TTS via Progressive Calibration
DiTReducio is a training-free, pattern-guided layer and branch skipping method that accelerates DiT-based TTS, reporting significant FLOP and RTF reductions with modest quality loss at tuned thresholds.
-
Continuous Autoregressive Modeling with Stochastic Monotonic Alignment for Speech Synthesis
Continuous autoregressive text-to-speech with a Gaussian-mixture codec matches or beats a discrete-codec VALL-E baseline with a fraction of the language model parameters.
-
BiDM: Pushing the Limit of Quantization for Diffusion Models
BiDM achieves the first fully binarized (W1A1) diffusion model, with FID 22.74 on LSUN-Bedrooms, by adding timestep-aware binary structures and patch-based distillation.
-
CloneShield: A Framework for Universal Perturbation Against Zero-Shot Voice Cloning
A universal adversarial perturbation framework claiming to protect speech against zero-shot voice cloning by degrading cloned outputs while preserving input naturalness.
-
Towards Flow-Matching-based TTS without Classifier-Free Guidance
Modifying the flow-matching training target lets F5-TTS synthesize speech without classifier-free guidance at inference, halving per-step cost and improving measured WER, SIM-O, and MOS.
-
UIBDiffusion: Universal Imperceptible Backdoor Attack for Diffusion Models
UIBDiffusion uses imperceptible universal adversarial perturbations as backdoor triggers for diffusion models, claiming high attack success and evasion of Elijah and TERD.
-
I2TTS: Image-indicated Immersive Text-to-speech Synthesis with Spatial Perception
I2TTS is an end-to-end TTS that conditions on CLIP image features and a frozen reverberation classifier to synthesize scene-matched, speaker-adaptive speech, reporting gains on SRE, MOS, and WER.
-
Constraint-Aware Diffusion Guidance for Robotics: Real-Time Obstacle Avoidance for Autonomous Racing
A diffusion trajectory planner with a barrier-function guidance term and warm starting avoids obstacles in real time on a miniature race car, with 100% success in the reported trials.
-
Language translation, and change of accent for speech-to-speech task using diffusion model
A diffusion-based pipeline is proposed for simultaneous language translation and accent change, but only text-to-speech subtasks are evaluated and the combined S2ST result is not demonstrated.
-
Survey on AI-Generated Media Detection: From Non-MLLM to MLLM
A survey organizing AI-generated media detection into Non-MLLM and MLLM based methods, with task and benchmark taxonomies.
Discussion (0). Continue with ORCID to comment.