FLoRIST aggregates federated LoRA adapters through SVD in a small intermediate space and thresholding, producing compact global adapters with up to hundreds-fold lower download cost at comparable MMLU accuracy.
It achieves high performance but incurs additional communication cost proportional to client rank
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models
FLoRIST aggregates federated LoRA adapters through SVD in a small intermediate space and thresholding, producing compact global adapters with up to hundreds-fold lower download cost at comparable MMLU accuracy.