A warm-up phase of ordinary federated training followed by zeroth-order forward-pass-only updates lets low-resource clients participate in federated pre-training from random initialization.
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.LG 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Warming Up for Zeroth-Order Federated Pre-Training with Low Resource Clients
A warm-up phase of ordinary federated training followed by zeroth-order forward-pass-only updates lets low-resource clients participate in federated pre-training from random initialization.