REVIEW 1 cited by
Structured Model Pruning of Convolutional Networks on Tensor Processing Units
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The deployment of convolutional neural networks is often hindered by high computational and storage requirements. Structured model pruning is a promising approach to alleviate these requirements. Using the VGG-16 model as an example, we measure the accuracy-efficiency trade-off for various structured model pruning methods and datasets (CIFAR-10 and ImageNet) on Tensor Processing Units (TPUs). To measure the actual performance of models, we develop a structured model pruning library for TensorFlow2 to modify models in place (instead of adding mask layers). We show that structured model pruning can significantly improve model memory usage and speed on TPUs without losing accuracy, especially for small datasets (e.g., CIFAR-10).
Forward citations
Cited by 1 Pith paper
-
Adaptive Pruning for Large Language Models with Structural Importance Awareness
SAAP scores LLM structures with a weighted fusion of two importance measures, prunes the most volatile units, and recovers performance with grouped quantized low-rank fine-tuning.
Discussion (0). Continue with ORCID to comment.