REVIEW 8 cited by
When Foundation Model Meets Federated Learning: Motivations, Challenges, and Future Directions
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
The intersection of Foundation Model (FM) and Federated Learning (FL) presents a unique opportunity to unlock new possibilities for real-world applications. On the one hand, FL, as a collaborative learning paradigm, help address challenges in FM development by expanding data availability, enabling computation sharing, facilitating the collaborative development of FMs, tackling continuous data update, avoiding FM monopoly, response delay and FM service down. On the other hand, FM, equipped with pre-trained knowledge and exceptional performance, can serve as a robust starting point for FL. It can also generate synthetic data to enrich data diversity and enhance overall performance of FL. Meanwhile, FM unlocks new sharing paradigm and multi-task and multi-modality capabilities for FL. By examining the interplay between FL and FM, this paper presents the motivations, challenges, and future directions of empowering FL with FM and empowering FM with FL. We hope that this work provides a good foundation to inspire future research efforts to drive advancements in both fields.
Forward citations
Cited by 8 Pith papers
-
FM$^2$: Unified Federated Foundation Models for Heterogeneous Multimodal Medical Imaging
FM² uses dual mixture-of-experts (per-class local, per-modality shared) with a proximal alignment regularizer to train federated medical imaging models across overlapped and disjoint modality settings, reporting consi...
-
Flexible Personalized Split Federated Learning for On-Device Fine-Tuning of Foundation Models
FlexP-SFL fine-tunes foundation models on resource-constrained devices through personalized split learning without parameter aggregation, improving accuracy and cutting wall-clock time and communication versus federat...
-
Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
Fed-HeLLo allocates different LoRA layers to clients of different resource levels using importance scores and geometric patterns, improving federated fine-tuning accuracy over random allocation baselines.
-
FEDEXCHANGE: Bridging the Domain Gap in Federated Object Detection for Free
FEDEXCHANGE improves cross-domain federated object detection by server-side clustering and exchanging client decoder models, achieving higher mAP in some domains at no extra local compute.
-
BetaWeb: Towards a Blockchain-enabled Trustworthy Agentic Web
BetaWeb promises a blockchain-enabled trustworthy agentic web, but the submitted manuscript body is a different mining-robot paper, leaving the proposal without supporting evidence.
-
Scaling Decentralized Learning with FLock
FLock claims the first secure decentralized fine-tuning of a 70B-class LLM, but the experiments omit the validator mechanism and compare against weak baselines.
-
FedPhD: Federated Pruning with Hierarchical Learning of Diffusion Models
A hierarchical federated learning method with distribution-aware aggregation and structured pruning trains diffusion models under non-IID data with lower communication cost.
-
Towards Group Fairness with Multiple Sensitive Attributes in Federated Foundation Models
EFF-DVP extends FF-DVP to multiple sensitive attributes with parallel demographic prompts and claims that larger causal effects of an attribute on the label predict smaller fairness improvements.
Discussion (0). Sign in to comment.