REVIEW 22 cited by
Federated Learning Based on Dynamic Regularization
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Federated Learning Based on Dynamic Regularization
read the original abstract
We propose a novel federated learning method for distributively training neural network models, where the server orchestrates cooperation between a subset of randomly chosen devices in each round. We view Federated Learning problem primarily from a communication perspective and allow more device level computations to save transmission costs. We point out a fundamental dilemma, in that the minima of the local-device level empirical loss are inconsistent with those of the global empirical loss. Different from recent prior works, that either attempt inexact minimization or utilize devices for parallelizing gradient computation, we propose a dynamic regularizer for each device at each round, so that in the limit the global and device solutions are aligned. We demonstrate both through empirical results on real and synthetic data as well as analytical results that our scheme leads to efficient training, in both convex and non-convex settings, while being fully agnostic to device heterogeneity and robust to large number of devices, partial participation and unbalanced data.
Forward citations
Cited by 22 Pith papers
-
BESplit: Bias-Compensated Split Federated Learning with Evidential Aggregation
BESplit mitigates non-IID bias in split federated learning via evidential aggregation, bias-compensated client pairing, and dual-teacher distillation, outperforming prior methods on five benchmarks.
-
FedACT: Federated Adaptive Coordinate Trust Modulation for Robust Transformer Training under Data Heterogeneity
Global-aware coordinate trust modulation after corrected AdamW updates improves federated Transformer and LLM training under data heterogeneity over strong adaptive baselines.
-
AS-FedBridge: Pseudo-Spike Bridge Distillation for Heterogeneous ANN-SNN Federated Learning
AS-FedBridge trains a shared pseudo-spike bridge so ANN and SNN clients in federated learning can align representations and improve collaborative accuracy.
-
TriShield: Zero-Utility-Loss Defense Against Privacy Backdoors in Federated Language Model Fine-Tuning via Orthogonal Gradient Projection and Optimizer State Entanglement
TriShield combines artifact detection, Adam momentum pre-entanglement, and SVD task-subspace projection to drive NeuroImprint reconstruction to 0% with claimed near-zero utility loss.
-
FM$^2$: Unified Federated Foundation Models for Heterogeneous Multimodal Medical Imaging
FM² uses dual mixture-of-experts (per-class local, per-modality shared) with a proximal alignment regularizer to train federated medical imaging models across overlapped and disjoint modality settings, reporting consi...
-
Towards the Next Frontier of LLMs, Training on Private Data: A Cross-Domain Benchmark for Federated Fine-Tuning
Federated PEFT on LLMs across healthcare and finance datasets performs close to centralized training and beats isolated local training under non-IID conditions.
-
Fed3D: Federated 3D Object Detection
Fed3D is a federated 3D object detection system using local-global class-aware loss for heterogeneity and prompt modules for low-bandwidth communication, claiming better performance than prior methods on limited local data.
-
Degree of Staleness-Aware Data Updating in Federated Learning
DUFL is a payment-based incentive mechanism that jointly balances data staleness and data volume via a Stackelberg game and derives a closed-form optimal client data update strategy.
-
HERO: A Heterogeneity-Aware Benchmark Library for Federated Continual Learning
HERO shows that FCL method rankings shift when client data skew and task-order mismatch are controlled separately, and that average accuracy can hide weak bottom-client performance.
-
TriShield: Zero-Utility-Loss Defense Against Privacy Backdoors in Federated Language Model Fine-Tuning via Orthogonal Gradient Projection and Optimizer State Entanglement
TriShield claims to eliminate NeuroImprint-style privacy backdoors in federated fine-tuning, but its full-scale results are projections and its key theorems assume the very conditions they need to establish.
-
One Round Is All You Need: Analytic Federated Learning for Task-Heterogeneous Multi-Label Medical Image Classification
Per-class closed-form ridge aggregation reproduces the centralized balanced-label classifier in one round and outperforms gradient-based federated baselines on ChestXray14 under missing-class heterogeneity.
-
Enhancing Federated Quadruplet Learning: Stochastic Client Selection and Embedding Stability Analysis
FedQuad uses quadruplet constraints and stochastic client selection in federated learning to reduce representation misalignment and improve generalization on heterogeneous data.
-
FedFrozen: Two-Stage Federated Optimization via Attention Kernel Freezing
FedFrozen improves stability in heterogeneous federated Transformer training by warming up the full model then freezing the attention kernel (query/key) while optimizing the value block under a fixed kernel.
-
Federated Distillation for Whole Slide Image via Gaussian-Mixture Feature Alignment and Curriculum Integration
FedHD is a federated learning framework for whole slide images that distills one-to-one synthetic features aligned via Gaussian mixtures and progressively integrates cross-site features through curriculum learning to ...
-
Federated Distillation for Whole Slide Image via Gaussian-Mixture Feature Alignment and Curriculum Integration
FedHD performs federated distillation for whole slide images by generating one synthetic feature set per real slide via Gaussian-mixture alignment and adding them via curriculum integration, outperforming prior federa...
-
Adaptive Federated Learning to Optimize Integrated Flows in Cyber-Physical Data Centers
An adaptive federated learning-to-optimization method with a rejection-capable acceptance rule and verifiable double aggregation achieves near-centralized cost for data center energy management without exposing local data.
-
Dissecting Federated-Graph Aggregation under Domain Shift: Importance-Aware Aggregation via Empirical Analysis
A top-rho gradient masking plus influence-weighted averaging method (FedIA) improves federated graph learning accuracy and stability under domain shift.
-
Multi-Hop Privacy Propagation for Differentially Private Federated Learning in Social Networks
A game-theoretic mechanism for differentially private federated learning that accounts for multi-hop privacy leakage over social networks, claimed to achieve near-optimal social welfare with lower server cost.
-
Benchmarking Federated Learning and Knowledge Distillation for Point Cloud Classification
Benchmark of federated learning plus knowledge distillation for point cloud classification reveals that label-free distillation objectives are required for student accuracy to reflect federated teacher quality rather ...
-
Rethinking the Personalized Relaxed Initialization in the Federated Learning: Consistency and Generalization
FedInit uses reverse personalized initialization in FL to reduce client drift effects, showing via excess risk that inconsistency impacts generalization error more than optimization error.
-
FedQuad: Federated Stochastic Quadruplet Learning to Mitigate Data Heterogeneity
A quadruplet-based loss for federated learning that aims to reduce representational collapse under data heterogeneity, with mixed empirical support.
-
Generalizable Federated Learning using Client Adaptive Focal Modulation
The abstract describes AdaptFED, a claimed federated learning method, but the full text is an unrelated graph theory paper, so the claimed results are absent from the submission.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.