A single audio-plus-text LLM jointly performs voice trigger detection, device-directed speech detection, dialog act classification, and ASR, with reported EER reductions of 64% and 22% over dedicated baselines.
Multichannel Voice Trigger Detection Based on Transform-average-concatenate
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Voice triggering (VT) enables users to activate their devices by just speaking a trigger phrase. A front-end system is typically used to perform speech enhancement and/or separation, and produces multiple enhanced and/or separated signals. Since conventional VT systems take only single-channel audio as input, channel selection is performed. A drawback of this approach is that unselected channels are discarded, even if the discarded channels could contain useful information for VT. In this work, we propose multichannel acoustic models for VT, where the multichannel output from the frond-end is fed directly into a VT model. We adopt a transform-average-concatenate (TAC) block and modify the TAC block by incorporating the channel from the conventional channel selection so that the model can attend to a target speaker when multiple speakers are present. The proposed approach achieves up to 30% reduction in the false rejection rate compared to the baseline channel selection approach.
citation-role summary
citation-polarity summary
fields
cs.SD 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
SELMA: A Speech-Enabled Language Model for Virtual Assistant Interactions
A single audio-plus-text LLM jointly performs voice trigger detection, device-directed speech detection, dialog act classification, and ASR, with reported EER reductions of 64% and 22% over dedicated baselines.