REVIEW 7 cited by
A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Generative AI has demonstrated impressive performance in various fields, among which speech synthesis is an interesting direction. With the diffusion model as the most popular generative model, numerous works have attempted two active tasks: text to speech and speech enhancement. This work conducts a survey on audio diffusion model, which is complementary to existing surveys that either lack the recent progress of diffusion-based speech synthesis or highlight an overall picture of applying diffusion model in multiple fields. Specifically, this work first briefly introduces the background of audio and diffusion model. As for the text-to-speech task, we divide the methods into three categories based on the stage where diffusion model is adopted: acoustic model, vocoder and end-to-end framework. Moreover, we categorize various speech enhancement tasks by either certain signals are removed or added into the input speech. Comparisons of experimental results and discussions are also covered in this survey.
Forward citations
Cited by 7 Pith papers
-
Permutation-Invariant Spectral Learning via Dyson Diffusion
Dyson Diffusion Model learns graph spectra by scoring Dyson Brownian Motion and matches or beats GNN/transformer diffusion baselines without ad-hoc spectral features.
-
The Effect of Stochasticity in Score-Based Diffusion Sampling: a KL Divergence Analysis
KL divergence bounds show stochasticity in diffusion sampling contracts error with exact scores, but for learned scores it can help or hurt depending on the time profile of the score error.
-
MPQ-DMv2: Flexible Residual Mixed Precision Quantization for Low-Bit Diffusion Models with Temporal Distillation
MPQ-DMv2 adds binary residual quantization, temporal relation distillation, and SVD-initialized LoRA to mixed-precision quantization, improving low-bit diffusion model generation quality.
-
UmbraTTS: Adapting Text-to-Speech to Environmental Contexts with Flow Matching
UmbraTTS jointly synthesizes speech and environmental audio via conditional flow matching, conditioned on text and acoustic context, with controllable background volume.
-
Marco-Voice Technical Report
Marco-Voice is a TTS system combining voice cloning and emotional speech generation via speaker-emotion disentanglement, contrastive learning, and a new Mandarin emotional dataset, with claimed quality gains over Cosy...
-
Smoothed Preference Optimization via ReNoise Inversion for Aligning Diffusion Models with Varied Human Preferences
SmPO-Diffusion improves diffusion-model preference alignment with reward-model soft labels and ReNoise inversion, reporting higher human-preference scores and up to 26x lower training cost than Diffusion-KTO.
-
SyntheticPop: Attacking Speaker Verification Systems With Synthetic VoicePops
SyntheticPop adds a low-frequency sine tone to spoofed training audio and drops a VoicePop-based voice authentication system from 69% to 14% accuracy.
Discussion (0). Sign in to comment.