Recognition: unknown
Making Neural Machine Reading Comprehension Faster
classification
💻 cs.CL
keywords
beenmodelscomprehensiondevelopedfastermachinemodelreading
read the original abstract
This study aims at solving the Machine Reading Comprehension problem where questions have to be answered given a context passage. The challenge is to develop a computationally faster model which will have improved inference time. State of the art in many natural language understanding tasks, BERT model, has been used and knowledge distillation method has been applied to train two smaller models. The developed models are compared with other models which have been developed with the same intention.
This paper has not been read by Pith yet.
Forward citations
Cited by 1 Pith paper
-
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
DistilBERT compresses BERT by 40% via pre-training distillation with a triple loss, retaining 97% performance and running 60% faster.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.