Spatial-Magnifier uses a neural network to generate virtual microphone signals from limited real ones and, via the SARL framework, conditions speech enhancement systems to nearly match full-array oracle performance.
Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
While the spatial directivity of multichannel speech enhancement algorithms improves with the number of microphones, fitting large capture arrays into real-world edge devices is typically limited by physical constraints. To overcome this limitation, we propose Spatial-Magnifier, a neural network designed to generate virtual microphone (VM) signals from a limited set of real microphone (RM) measurements. Moreover, we introduce the Spatial Audio Representation Learning (SARL) framework, which leverages estimated VM signals and features to condition a downstream speech enhancement system. Experimental results demonstrate that the proposed framework outperforms existing spatial upsampling baselines across various speech extraction systems, including end-to-end multichannel speech enhancement and neural beamforming. The proposed method nearly recovers the oracle performance achieved when all microphones are available.
fields
eess.AS 1years
2026 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Spatial-Magnifier: Spatial upsampling for multichannel speech enhancement
Spatial-Magnifier uses a neural network to generate virtual microphone signals from limited real ones and, via the SARL framework, conditions speech enhancement systems to nearly match full-array oracle performance.