FLoRIST aggregates federated LoRA adapters through SVD in a small intermediate space and thresholding, producing compact global adapters with up to hundreds-fold lower download cost at comparable MMLU accuracy.
FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models Overall Per-Round Complexity
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
FLoRIST: Singular Value Thresholding for Efficient and Accurate Federated Fine-Tuning of Large Language Models
FLoRIST aggregates federated LoRA adapters through SVD in a small intermediate space and thresholding, producing compact global adapters with up to hundreds-fold lower download cost at comparable MMLU accuracy.