REVIEW 1 cited by
Depthwise Separable Convolutions Allow for Fast and Memory-Efficient Spectral Normalization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
An increasing number of models require the control of the spectral norm of convolutional layers of a neural network. While there is an abundance of methods for estimating and enforcing upper bounds on those during training, they are typically costly in either memory or time. In this work, we introduce a very simple method for spectral normalization of depthwise separable convolutions, which introduces negligible computational and memory overhead. We demonstrate the effectiveness of our method on image classification tasks using standard architectures like MobileNetV2.
Forward citations
Cited by 1 Pith paper
-
Smooth Model Compression without Fine-Tuning
Training a ResNet-18 with smoothness penalties on weights, then compressing via truncated SVD, keeps 91% CIFAR-10 accuracy at 70% sparsity with no post-compression fine-tuning.
Discussion (0). Continue with ORCID to comment.