PLayer-FL picks the layer split in partial federated learning from a low-cost sensitivity metric computed at epoch 1, and reports competitive F1, fairness, and participation incentives across seven non-IID datasets.
Layer-wise Model Pruning based on Mutual Information
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
The proposed pruning strategy offers merits over weight-based pruning techniques: (1) it avoids irregular memory access since representations and matrices can be squeezed into their smaller but dense counterparts, leading to greater speedup; (2) in a manner of top-down pruning, the proposed method operates from a more global perspective based on training signals in the top layer, and prunes each layer by propagating the effect of global signals through layers, leading to better performances at the same sparsity level. Extensive experiments show that at the same sparsity level, the proposed strategy offers both greater speedup and higher performances than weight-based pruning methods (e.g., magnitude pruning, movement pruning).
citation-role summary
citation-polarity summary
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
PLayer-FL: A Principled Approach to Personalized Layer-wise Cross-Silo Federated Learning
PLayer-FL picks the layer split in partial federated learning from a low-cost sensitivity metric computed at epoch 1, and reports competitive F1, fairness, and participation incentives across seven non-IID datasets.