Pith. sign in

REVIEW 2 cited by

Sequence-to-Sequence Speech Recognition with Time-Depth Separable Convolutions

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1904.02619 v1 pith:XWJDO62O submitted 2019-04-04 cs.CL

Awni Hannun , Ann Lee , Qiantong Xu , Ronan Collobert This is my paper · ORCID
classification cs.CL
keywords modelefficientseparablesequence-to-sequencetime-deptharchitectureconvolutionconvolutional
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We propose a fully convolutional sequence-to-sequence encoder architecture with a simple and efficient decoder. Our model improves WER on LibriSpeech while being an order of magnitude more efficient than a strong RNN baseline. Key to our approach is a time-depth separable convolution block which dramatically reduces the number of parameters in the model while keeping the receptive field large. We also give a stable and efficient beam search inference procedure which allows us to effectively integrate a language model. Coupled with a convolutional language model, our time-depth separable convolution architecture improves by more than 22% relative WER over the best previously reported sequence-to-sequence results on the noisy LibriSpeech test set.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Let SSMs be ConvNets: State-space Modeling with Optimal Tensor Contractions

    cs.LG 2025-01 conditional novelty 7.0 of 10

    Treating state-space layers as tensor networks with CNN-style connectivity and optimized contraction orders yields hybrid SSM networks that outperform homogeneous SSMs on raw audio tasks and enable competitive streami...

  2. Scaling and Distilling Transformer Models for sEMG

    eess.AS 2025-07 accept novelty 6.0 of 10

    Vanilla transformers on the emg2qwerty dataset improve cross-user typing accuracy up to 109M parameters, and simple logit distillation recovers most of the gain in a 2.2M-parameter student.

Pith tools