Adding priority weights to the multi-source model-distributed inference objective and scheduling each layer-group by a greedy delay-to-priority ratio shortens average inference time for high-priority sources on edge testbeds.
Pruning Algorithms to Accelerate Convolutional Neural Networks for Edge Applications: A Survey
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
With the general trend of increasing Convolutional Neural Network (CNN) model sizes, model compression and acceleration techniques have become critical for the deployment of these models on edge devices. In this paper, we provide a comprehensive survey on Pruning, a major compression strategy that removes non-critical or redundant neurons from a CNN model. The survey covers the overarching motivation for pruning, different strategies and criteria, their advantages and drawbacks, along with a compilation of major pruning techniques. We conclude the survey with a discussion on alternatives to pruning and current challenges for the model compression community.
citation-role summary
citation-polarity summary
fields
cs.DC 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
background 1representative citing papers
citing papers explorer
-
Priority-Aware Model-Distributed Inference at Edge Networks
Adding priority weights to the multi-source model-distributed inference objective and scheduling each layer-group by a greedy delay-to-priority ratio shortens average inference time for high-priority sources on edge testbeds.