Pith. sign in

REVIEW 1 cited by

Iterative Compression of End-to-End ASR Model using AutoML

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2008.02897 v1 pith:AN5WNPVV submitted 2020-08-06 cs.LG stat.ML

Iterative Compression of End-to-End ASR Model using AutoML

Abhinav Mehrotra , {\L}ukasz Dudziak , Jinsu Yeo , Young-yoon Lee , Ravichander Vipperla , Mohamed S. Abdelfattah , Sourav Bhattacharya , Samin Ishtiaq
show 4 more authors
Alberto Gil C. P. Ramos SangJeong Lee Daehyun Kim Nicholas D. Lane
This is my paper
classification cs.LG stat.ML
keywords compressionautoml-basedmodelautomaticend-to-enditerativetechniqueswork
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Increasing demand for on-device Automatic Speech Recognition (ASR) systems has resulted in renewed interests in developing automatic model compression techniques. Past research have shown that AutoML-based Low Rank Factorization (LRF) technique, when applied to an end-to-end Encoder-Attention-Decoder style ASR model, can achieve a speedup of up to 3.7x, outperforming laborious manual rank-selection approaches. However, we show that current AutoML-based search techniques only work up to a certain compression level, beyond which they fail to produce compressed models with acceptable word error rates (WER). In this work, we propose an iterative AutoML-based LRF approach that achieves over 5x compression without degrading the WER, thereby advancing the state-of-the-art in ASR compression.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. ASKD-Whisper: Adaptive Self-knowledge Distillation for Efficient and Low-Latency Automatic Speech Recognition

    cs.CL 2026-01 reject novelty 4.0

    A distillation method that decays teacher loss then applies self-distillation yields a Whisper-derived ASR model with 5x lower latency and slightly better average WER only on in-domain noisy datasets.