A lightweight VAD model with a learnable sinc filterbank and a squared-margin ranking loss reports higher AUROC and F2 scores on AVA-Speech and ACAM using only 8.0k parameters.
A Real-Time Voice Activity Detection Based On Lightweight Neural
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Voice activity detection (VAD) is the task of detecting speech in an audio stream, which is challenging due to numerous unseen noises and low signal-to-noise ratios in real environments. Recently, neural network-based VADs have alleviated the degradation of performance to some extent. However, the majority of existing studies have employed excessively large models and incorporated future context, while neglecting to evaluate the operational efficiency and latency of the models. In this paper, we propose a lightweight and real-time neural network called MagicNet, which utilizes casual and depth separable 1-D convolutions and GRU. Without relying on future features as input, our proposed model is compared with two state-of-the-art algorithms on synthesized in-domain and out-domain test datasets. The evaluation results demonstrate that MagicNet can achieve improved performance and robustness with fewer parameter costs.
citation-role summary
citation-polarity summary
fields
cs.SD 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
SincQDR-VAD: A Noise-Robust Voice Activity Detection Framework Leveraging Learnable Filters and Ranking-Aware Optimization
A lightweight VAD model with a learnable sinc filterbank and a squared-margin ranking loss reports higher AUROC and F2 scores on AVA-Speech and ACAM using only 8.0k parameters.