REVIEW 6 cited by
Neural Vocoder is All You Need for Speech Super-resolution
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Speech super-resolution (SR) is a task to increase speech sampling rate by generating high-frequency components. Existing speech SR methods are trained in constrained experimental settings, such as a fixed upsampling ratio. These strong constraints can potentially lead to poor generalization ability in mismatched real-world cases. In this paper, we propose a neural vocoder based speech super-resolution method (NVSR) that can handle a variety of input resolution and upsampling ratios. NVSR consists of a mel-bandwidth extension module, a neural vocoder module, and a post-processing module. Our proposed system achieves state-of-the-art results on the VCTK multi-speaker benchmark. On 44.1 kHz target resolution, NVSR outperforms WSRGlow and Nu-wave by 8% and 37% respectively on log spectral distance and achieves a significantly better perceptual quality. We also demonstrate that prior knowledge in the pre-trained vocoder is crucial for speech SR by performing mel-bandwidth extension with a simple replication-padding method. Samples can be found in https://haoheliu.github.io/nvsr.
Forward citations
Cited by 6 Pith papers
-
A2SB: Audio-to-Audio Schrodinger Bridges
A2SB applies Schrödinger bridges to music restoration, achieving state-of-the-art bandwidth extension and inpainting at 44.1kHz in a single vocoder-free model.
-
Bridge-SR: Schr\"odinger Bridge for Efficient SR
Bridge-SR applies tractable Schrödinger bridge models to waveform-domain speech super-resolution, and with 1.7M parameters reports the lowest log-spectral distance on VCTK while matching diffusion quality at 4 sampling steps.
-
A lightweight and robust method for blind wideband-to-fullband extension of speech
A 370K-parameter hybrid DSP-DNN model blindly extends wideband speech to fullband with 0.27 ms lookahead, significantly improving Opus 1.5 quality at 6-12 kb/s.
-
CS-ETS: Chaos-Inspired Samba-Based EMG-To-Speech Synthesis with Nonlinear Chaotic Losses
CS-ETS applies Lyapunov and detrended-fluctuation-analysis losses inside a Samba encoder, but its headline audio gains are confounded by a DTW alignment step not applied to baselines.
-
Inference-time Scaling for Diffusion-based Audio Super-resolution
Generating 120 candidate super-resolved audios and choosing the best by task-specific verifiers improves speech, music, and sound effects over single-sample diffusion output, at 120x compute.
-
Generative Adversarial Network based Voice Conversion: Techniques, Challenges, and Recent Advancements
A narrative review of GAN-based voice conversion that maps the existing landscape but leans heavily on the authors' own models for its 'recent advancements' section.
Discussion (0). Continue with ORCID to comment.