Pith. sign in

Factorization tricks for LSTM networks

2 Pith papers cite this work. Polarity classification is still indexing.

2 Pith papers citing it
abstract

We present two simple ways of reducing the number of parameters and accelerating the training of large Long Short-Term Memory (LSTM) networks: the first one is "matrix factorization by design" of LSTM matrix into the product of two smaller matrices, and the second one is partitioning of LSTM matrix, its inputs and states into the independent groups. Both approaches allow us to train large LSTM networks significantly faster to the near state-of the art perplexity while using significantly less RNN parameters.

citation-role summary

background 1

citation-polarity summary

fields

cs.CL 1 cs.CV 1

years

2019 1 2017 1

verdicts

UNVERDICTED 2

roles

background 1

polarities

background 1

representative citing papers

Attention Is All You Need

cs.CL · 2017-06-12 · unverdicted · novelty 5.0

Pith review generated a malformed one-line summary.

citing papers explorer

Showing 2 of 2 citing papers.