REVIEW 5 cited by
Speech Model Pre-training for End-to-End Spoken Language Understanding
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Speech Model Pre-training for End-to-End Spoken Language Understanding
read the original abstract
Whereas conventional spoken language understanding (SLU) systems map speech to text, and then text to intent, end-to-end SLU systems map speech directly to intent through a single trainable model. Achieving high accuracy with these end-to-end models without a large amount of training data is difficult. We propose a method to reduce the data requirements of end-to-end SLU in which the model is first pre-trained to predict words and phonemes, thus learning good features for SLU. We introduce a new SLU dataset, Fluent Speech Commands, and show that our method improves performance both when the full dataset is used for training and when only a small subset is used. We also describe preliminary experiments to gauge the model's ability to generalize to new phrases not heard during training.
Forward citations
Cited by 5 Pith papers
-
Versatile On-device Adaptation at the Edge by Unifying Few-shot, Zero-shot, Continual, and In-context Learning
ECL unifies few-shot, continual, zero-shot, and in-context learning on a single TCN-based edge chip, with first hardware baselines on several tasks.
-
VAD to the Bone: Ultra-Tiny Speech Activity Detection for Edge Deployment
kiloVAD, a 2.1k-parameter causal CNN VAD on standard Mel features, reaches 0.850 AUC on AVA-Speech and beats standard QAT by 1–4% at INT4 via angle-based self-distillation.
-
findsylls: A Language-Agnostic Toolkit for Syllable-Level Speech Tokenization and Embedding
A modular toolkit standardizes classical and SSL syllabifiers, enables component recombination, and benchmarks speed–accuracy trade-offs on English, Spanish, and newly annotated Kono.
-
Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
A system-first taxonomy and literature synthesis of multimodal unlearning across vision, language, video, and audio, with datasets, benchmarks, metrics, applications, and open challenges.
-
WQ-Fusion: Dynamic Gated Attention for Cross-Domain Audio Representation
WQ-Fusion combines Whisper and Qwen encoders with gated attention to reach 0.836 on the Interspeech 2026 Audio Encoder Capability Challenge, outperforming single-encoder baselines.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.