REVIEW 6 cited by
Byzantine-Robust Decentralized Learning via ClippedGossip
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
In this paper, we study the challenging task of Byzantine-robust decentralized training on arbitrary communication graphs. Unlike federated learning where workers communicate through a server, workers in the decentralized environment can only talk to their neighbors, making it harder to reach consensus and benefit from collaborative training. To address these issues, we propose a ClippedGossip algorithm for Byzantine-robust consensus and optimization, which is the first to provably converge to a $O(\delta_{\max}\zeta^2/\gamma^2)$ neighborhood of the stationary point for non-convex objectives under standard assumptions. Finally, we demonstrate the encouraging empirical performance of ClippedGossip under a large number of attacks.
Forward citations
Cited by 6 Pith papers
-
Enhancing Parallelism in Decentralized Stochastic Convex Optimization
DAT-SGD improves the parallelism bound in decentralized stochastic convex optimization from O((ρ√N)^(1/2)) to O(ρ√N), matching centralized rates on dense graphs.
-
RED-SEGA:Resilient Decentralized Stochastic Proximal Optimization with Gradient Sketching over Time-Varying Networks
RED-SEGA achieves Byzantine-resilient linear convergence for non-decomposable SRM via gradient sketching and norm-penalized aggregation over time-varying networks.
-
Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation
D-Byz-SGDM aggregates cached momentum from non-sampled clients together with fresh momentum from sampled clients, preserving Byzantine robustness under partial participation and achieving an optimal O(cδζ²/p) stationa...
-
DICE: Data Influence Cascade in Decentralized Learning
DICE defines and approximates multi-hop data influence in decentralized learning, showing that influence is shaped by data, topology, and loss curvature.
-
Generalization Error Analysis for Attack-Free and Byzantine-Resilient Decentralized Learning with Data Heterogeneity
Decentralized SGD generalization error is bounded by O(init/(µNZ)) plus noise and heterogeneity terms, with a Byzantine-attack term that persists as sample size grows.
-
Trust-Aware Topology Learning for Dynamic Decentralized Federated Learning under Adversaries
DMTT screens both model updates and topology claims with a Beta-trust model, and on two HAR datasets it is the only tested method that beats local-only learning under 10 to 80 percent Byzantine devices.
Discussion (0). Sign in to comment.