REVIEW 3 major objections 5 minor 55 references
Rethinking Federated Learning Over the Air: The Blessing of Scaling Up
T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read In over-the-air federated learning, scaling up the client count shrinks privacy leakage, fading, and convergence error.
desk verdict Solid convergence and channel-hardening results, but the privacy theorem relies on a false decorrelation claim and should not be trusted as stated. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The mechanism is the averaging of $N$ independent, channel-faded client gradients at the server; $N$ independent fading coefficients make the effective channel concentrate at its mean. Formally, the argument rides on three pieces: a Berry–Esseen-style entropic central limit theorem that lower-bounds the differential entropy of the aggregated signal and yields the $O(1/N)$ mutual-information upper bound; a Bernstein/McDiarmid concentration inequality (Lemma 1) showing the difference between the faded and mean-faded gradients is exponentially small in $N$; and standard smoothness and SGD-drift bounds that place sampling noise into terms with $1/(N^2 B)$ denominators. Together these convert "more clients" from an added communication burden into a noise-reduction and privacy-enhancing resource.
What would settle it
Compute or measure the mutual information between one client's gradient and the server's aggregated gradient for $N = 10$, $50$, $100$, and $500$ on the same task, but skip the random-flipping decorrelation step; if the decay flattens or the bound breaks once gradient entries stay correlated, the $O(1/N)$ privacy result rests on preprocessing rather than on the number of clients. A smaller-scale check: at $N = 10$, compare convergence with and without instantaneous-CSI power control; the paper's own experiments already show power control helps there, so the "not essential" claim is limited to large $N$.
Extended reading notes
Core claim
On the paper's own terms, the central claim is that the wireless impairments in over-the-air federated learning—fading, thermal noise, and sampling noise—are progressively neutralized as the number of participating clients $N$ grows, so scale improves privacy, robustness, and convergence simultaneously. Theorem 1 bounds the per-client mutual information between a local gradient and the aggregated gradient by $C_{\bar{g}} d^*/N$ plus a logarithmic term, decaying as $O(1/N)$ under an honest-but-curious server and average-case leakage. Lemma 1 establishes exponential concentration of the channel-corrupted aggregated gradient around the mean-fading aggregated gradient, a channel-hardening effect that removes small-scale fading from the global update. Theorem 3 bounds the non-convex convergence rate by a leading term plus $d\sigma_z^2/(\mu_c^2 N^2)$ and $\sum \sigma_{s,n}^2/(N^2 B)$, so the noisy analog update becomes equivalent to a noiseless global gradient as $N$ grows. The paper concludes that instantaneous channel estimation and power control are not essential in this regime, since the averaging already does the work that power control was designed to do.
Load-bearing premise
The argument assumes the system is large ($N$ big) and that privacy is measured as average mutual information after a preprocessing step that makes each client's gradient entries statistically independent; if $N$ is only in the tens or an adversary needs worst-case guarantees, the $O(1/N)$ privacy decay and the dismissal of power control do not follow.
Editorial extensions
If this is right
- Per-client privacy leakage, measured by mutual information, falls as $O(1/N)$, so larger systems can achieve the same average privacy with less added artificial noise.
- Small-scale fading disappears from the global gradient through channel hardening, so blind transmission without instantaneous CSI becomes nearly as accurate as ideal power control.
- The non-convex convergence error from thermal noise and mini-batch sampling vanishes as $N$ grows, meaning over-the-air training with many clients behaves like noiseless training.
- Instantaneous-CSI power control is not essential at scale: Theorem 4 shows it introduces client dropout and channel-estimation-error penalties, and the experiments show its benefit nearly vanishes for large $N$.
- Larger client populations also make training more robust to label-flipping and noisy-label attacks and allow second-order updates such as L-BFGS to work, as the experiments show.
Reading between the lines
- Because the mutual-information bound is average-case and assumes preprocessing decorrelates gradient entries, a natural next test is whether worst-case gradient-inversion attacks on a single client also decay with $N$; the paper's own framing suggests they are not covered by the bound.
- The channel-hardening logic suggests that client population size can substitute for many-antenna hardware in suppressing fading, which would change deployment cost calculations for edge-learning infrastructure.
- The $N^2$ denominators in the convergence bounds imply a design trade-off not explored in the paper: for a fixed communication budget, operators could trade client count against local epochs and batch size to reach a target error floor.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper studies an over-the-air federated edge learning system in which N clients transmit accumulated local gradients as analog signals over i.i.d. fading channels and the server receives a noisy linear combination. The authors derive three sets of analytical results: a mutual-information upper bound on privacy leakage that is claimed to scale as O(1/N) (Theorem 1, Section III-A), a concentration inequality for the aggregated gradient that is used to claim a channel-hardening effect (Lemma 1, Section III-B), and convergence rates for strongly convex (Theorem 2, Corollary 1) and non-convex (Theorem 3, Corollary 2) objectives in which thermal noise and SGD noise terms vanish with N. Section III-D analyzes truncated channel-inversion power control under imperfect CSI (Theorem 4) and concludes that instantaneous power control is unnecessary in large-scale systems. The theoretical claims are supplemented with experiments on EMNIST and CIFAR-10 using CNN, ResNet-18, and logistic-regression/L-BFGS setups.
Significance. If the results held as stated, the paper would make a useful contribution to over-the-air federated learning by showing that a large number of clients improves privacy, suppresses fading, and accelerates convergence, rather than only exacerbating communication cost. The paper's strengths are the clarity of the system model, the use of a standard FedAvg proof template for the convergence analysis, the explicit treatment of power control with imperfect CSI, and the experimental section that directly checks the predicted privacy, channel-hardening, and convergence trends. The main reservations are proof gaps in Theorem 1 and in the convergence proofs, which are central to the paper's three headline claims rather than presentation issues.
major comments (3)
- [Appendix A, Eqs. (32)-(35)] The proof of Theorem 1 asserts that after multiplying entries of s_{n,t} by independent Rademacher variables S, the entries of \hat s_{n,t} are mutually independent. This is false for a general correlated vector. For example, take X1=Z and X2=Z+W with independent standard Gaussians Z,W and independent Rademachers S1,S2; then S1X1 and S2X2 have zero covariance but are dependent because E[(S1X1)^2(S2X2)^2]=4 while E[(S1X1)^2]E[(S2X2)^2]=2. Consequently, the coordinate-wise entropy decomposition and the Berry-Esseen entropic CLT lower bound in Eq. (35) do not follow for correlated gradient entries, and the O(1/N) privacy bound in Eq. (10) with its consequence in Eq. (25) is not established as stated for general local gradients. The footnote about random flipping reducing correlations is insufficient; the proof needs either an explicit entrywise-independence assumption on the preprocessed gradient or a genuinely multivariate entropic CLT argument. The MINE experiments provide empirical evidence but do not close this gap.
- [Appendix C, Eq. (44); Appendix E, Eq. (48); Theorems 2-3] The convergence proofs replace the random fading coefficients c_{n,t} in the global update (6) by their mean \mu_c without a residual term. In Appendix C, the line before Eq. (44) writes \eta_t/N \sum_n \mu_c(w_t-w_{n,t}^{(E)})/\eta_l, which equals the true update only when c_{n,t}=\mu_c; similarly, Eq. (48) in Appendix E computes E[\|\hat g_t\|^2] from an expression containing no c_{n,t}. As a result, the bounds in Theorems 2 and 3 (and Corollaries 1 and 2) are proved for a channel-mean system, not for the random-fading model of Section II-B; a term of order \sigma_c^2 G^2/N would enter the residual. Lemma 1 provides only a high-probability concentration statement and is not integrated into the expectation bounds in these proofs. The claim that communication impairments vanish as N grows may survive a repair, but the theorem statements as proved are not supported.
- [Corollary 1 and Appendix D, Eqs. (45)-(46)] The displayed algebra in the proof of Corollary 1 is inconsistent with the stated \kappa. Under the stated condition \eta_0\le 1/(4\mu_c L), we have \lambda\mu_c\eta_0-1<0 because \lambda\le L, so the first argument in the max in Eq. (22) is negative; then \kappa collapses to \|w_0-w^*\|^2 and all noise and heterogeneity terms disappear from the bound. The induction step in Eq. (46) requires \kappa to be at least on the order of \mu_c^2\eta_0^2 Q1/(\lambda\mu_c\eta_0), not the expression with \lambda\mu_c\eta_0-1 in the denominator. Please correct the formula or the proof; as printed, Corollary 1 is not derived.
minor comments (5)
- [Section III-A] The statement that 'after certain preprocessing steps, the local gradient entries can be statistically independent of each other' is an assumption in all but name; since it drives Theorem 1, it should be stated as an explicit assumption with a precise description of the preprocessing.
- [Eq. (8) and Appendix A] The privacy metric conditions on the past gradients {g_p}, but the proof of Theorem 1 computes entropies without making the conditioning visible in every step; please make the conditioning explicit and explain why past public models do not change the bounds.
- [Eq. (18)] The notation for the term involving \beta_\nu is typeset ambiguously; please define \beta_\nu^N (or the intended expression) explicitly and state the dependence of the final bound on \nu.
- [Section IV, Figs. 2 and 4] The MI estimates in Fig. 2 are obtained with MINE, an approximate estimator with known bias, and no error bars or seeds are reported; the O(1/N) privacy law is therefore only qualitatively validated. In addition, increasing N in Fig. 4 also increases the total amount of training data, so part of the observed accuracy gain may be a data-volume effect rather than the noise-reduction effect claimed in the analysis.
- [Section III-C.2] The statement that the gradient discrepancy 'decreases at the rate of O(exp(-N))' is stronger than what Lemma 1 proves; Lemma 1 is a high-probability large-deviation bound, so the conclusion should be phrased as an exponential concentration statement rather than a bound on the mean discrepancy.
Circularity Check
No significant circularity: the paper's analytical claims derive from standard concentration inequalities, entropic CLT bounds, and established FedAvg proof techniques, with no fitted parameter renamed as a prediction.
full rationale
The derivation chain in this paper is self-contained and does not reduce its conclusions to its inputs by construction. Theorem 1's mutual-information bound is derived from entropy calculus, a linear-transformation entropy identity, and the entropic central limit theorem [52], under the explicitly stated conditional-independence preprocessing assumption; it is not a restatement of the definition of the metric. Lemma 1 is a direct Bernstein/McDiarmid concentration bound on the channel-averaging term, with no fitted constants. Theorems 2 and 3 follow the standard proof templates of [37] and [55] for FedAvg-type updates, and the O(1/N^2) noise terms enter algebraically from the global averaging and AWGN variance, not from tuning parameters to match the desired conclusion. The power-control comparison in Theorem 4 is likewise an analytical bound: the extra dropout and CSI-error terms are shown to vanish as N grows, and the claim that instant power control is unnecessary is explicitly conditional on large N and on the specific truncated channel-inversion scheme, so it is a derived comparison, not a circular one. Self-citations such as [10], [11], [12], and [33] are contextual (system model, prior OTA results, DP definitions) and are not load-bearing for the new theorems. Two flagged items are correctness/completeness concerns rather than circularity: the independence assertion after Rademacher flipping in Eq. (32) is not generally valid for correlated gradient entries, and Theorem 4 is stated without a corresponding appendix proof (the appendix stops at Corollary 2). These do not constitute circular reductions, so the circularity score remains 0.
Assumptions & free parameters
free parameters (4)
- mu_c and sigma_c^2 (channel fading mean and variance) =
mu_c = 1 in experiments; Rayleigh fading used
- sigma_z^2 (thermal noise variance) =
not specified numerically
- sigma_s^2 (SGD sampling variance) =
not specified
- C_g in Theorem 1 =
unspecified constant
assumptions (6)
- domain assumption Local gradient entries can be made statistically independent via decorrelation preprocessing such as random flipping (Section III-A, footnote 2).
- domain assumption All clients' local gradient covariance matrices share the same rank d* (Section III-A).
- domain assumption Honest-but-curious server and no malicious attackers for the privacy analysis (Section III-A).
- domain assumption Assumption 4: expected squared norm of stochastic gradients is bounded by G_n^2.
- standard math The entropic central limit theorem bound from Bobkov et al. [52] holds for the preprocessed gradient vectors.
- domain assumption For the power control analysis, the CSI estimation error is bounded by |Delta| <= Delta_max with known distributional assumptions (Section III-D).
Cite this review
Pith. "Pith review of Rethinking Federated Learning Over the Air: The Blessing of Scaling Up." pith.science (2026). https://pith.science/paper/KQWUPD7S
@misc{pith2026250817697,
author = {Pith},
title = {Pith review of: Rethinking Federated Learning Over the Air: The Blessing of Scaling Up},
year = {2026},
howpublished = {\url{https://pith.science/paper/KQWUPD7S}},
note = {Machine review of arXiv:2508.17697}
}
read the original abstract
Federated learning facilitates collaborative model training across multiple clients while preserving data privacy. However, its performance is often constrained by limited communication resources, particularly in systems supporting a large number of clients. To address this challenge, integrating over-the-air computations into the training process has emerged as a promising solution to alleviate communication bottlenecks. The system significantly increases the number of clients it can support in each communication round by transmitting intermediate parameters via analog signals rather than digital ones. This improvement, however, comes at the cost of channel-induced distortions, such as fading and noise, which affect the aggregated global parameters. To elucidate these effects, this paper develops a theoretical framework to analyze the performance of over-the-air federated learning in large-scale client scenarios. Our analysis reveals three key advantages of scaling up the number of participating clients: (1) Enhanced Privacy: The mutual information between a client's local gradient and the server's aggregated gradient diminishes, effectively reducing privacy leakage. (2) Mitigation of Channel Fading: The channel hardening effect eliminates the impact of small-scale fading in the noisy global gradient. (3) Improved Convergence: Reduced thermal noise and gradient estimation errors benefit the convergence rate. These findings solidify over-the-air model training as a viable approach for federated learning in networks with a large number of clients. The theoretical insights are further substantiated through extensive experimental evaluations.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
Communication-efficient learning of deep networks from decentralized data,
B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. Int. Conf. Artif. Intell. Stat. (AISTATS) , Fort Lauderdale, FL, Apr. 2017, pp. 1273–1282
work page 2017
-
[2]
Federated learning: Challenges, methods, and future directions,
T. Li, A. K. Sahu, A. Talwalkar, and V . Smith, “Federated learning: Challenges, methods, and future directions,” IEEE Signal Process. Mag., vol. 37, no. 3, pp. 50–60, May 2020
2020
-
[3]
Federated learning for wireless communications: Motivation, opportunities, and challenges,
S. Niknam, H. S. Dhillon, and J. H. Reed, “Federated learning for wireless communications: Motivation, opportunities, and challenges,” IEEE Commun. Mag. , vol. 58, no. 6, pp. 46–51, Jun. 2020
2020
-
[4]
Broadband analog aggregation for low-latency federated edge learning,
G. Zhu, Y . Wang, and K. Huang, “Broadband analog aggregation for low-latency federated edge learning,” IEEE Trans. Wireless Commun. , vol. 19, no. 1, pp. 491–506, Jan. 2020
2020
-
[5]
Federated learning via over- the-air computation,
K. Yang, T. Jiang, Y . Shi, and Z. Ding, “Federated learning via over- the-air computation,” IEEE Trans. Wireless Commun., vol. 19, no. 3, pp. 2022–2035, Mar. 2020
2022
-
[6]
On analog gradient descent learning over multiple access fading channels,
T. Sery and K. Cohen, “On analog gradient descent learning over multiple access fading channels,” IEEE Trans. Signal Process. , vol. 68, pp. 2897–2911, Apr. 2020
work page 2020
-
[7]
Federated learning over wireless fading channels,
M. M. Amiri and D. G ¨und¨uz, “Federated learning over wireless fading channels,” IEEE Trans. Wireless Commun. , vol. 19, no. 5, pp. 3546– 3557, May 2020
work page 2020
-
[8]
Computation over multiple-access channels,
B. Nazer and M. Gastpar, “Computation over multiple-access channels,” IEEE Trans. Inf. Theory , vol. 53, no. 10, pp. 3498–3516, Oct. 2007
work page 2007
Show all 55 references
-
[9]
Model pruning for distributed learning over the air,
Z. Zhao, K. Xu, W. Hong, Z. Ding, T. Q. Quek, H. H. Yang et al. , “Model pruning for distributed learning over the air,”IEEE Trans. Signal Process., vol. 72, pp. 5533–5549, Oct. 2024
2024
-
[10]
Revisiting analog over-the-air machine learning: The blessing and curse of interference,
H. H. Yang, Z. Chen, T. Q. Quek, and H. V . Poor, “Revisiting analog over-the-air machine learning: The blessing and curse of interference,” IEEE J. Sel. Topics Signal Process. , vol. 16, no. 3, pp. 406–419, Apr. 2022
2022
-
[11]
Unleashing edgeless feder- ated learning with analog transmissions,
H. H. Yang, Z. Chen, and T. Q. Quek, “Unleashing edgeless feder- ated learning with analog transmissions,” IEEE Trans. Signal Process. , vol. 72, pp. 774–791, Jan. 2024
2024
-
[12]
Edge intelligence over the air: Two faces of interference in federated learning,
Z. Chen, H. H. Yang, and T. Q. Quek, “Edge intelligence over the air: Two faces of interference in federated learning,” IEEE Commun. Mag. , vol. 61, no. 12, pp. 62–68, Dec. 2023
2023
-
[13]
Over-the-air computation systems: Optimization, analysis and scaling laws,
W. Liu, X. Zang, Y . Li, and B. Vucetic, “Over-the-air computation systems: Optimization, analysis and scaling laws,” IEEE Trans. Wireless Commun., vol. 19, no. 8, pp. 5488–5502, Aug. 2020
2020
-
[14]
Optimized power control for over-the-air computation in fading channels,
X. Cao, G. Zhu, J. Xu, and K. Huang, “Optimized power control for over-the-air computation in fading channels,” IEEE Trans. Wireless Commun., vol. 19, no. 11, pp. 7498–7513, Nov. 2020
2020
-
[15]
Optimized power control design for over-the-air federated edge learning,
X. Cao, G. Zhu, J. Xu, Z. Wang, and S. Cui, “Optimized power control design for over-the-air federated edge learning,” IEEE J. Sel. Areas Commun., vol. 40, no. 1, pp. 342–358, Jan. 2022
2022
-
[16]
Joint device selection and power control for wireless federated learning,
W. Guo, R. Li, C. Huang, X. Qin, K. Shen, and W. Zhang, “Joint device selection and power control for wireless federated learning,” IEEE J. Sel. Areas Commun., vol. 40, no. 8, pp. 2395–2410, Aug. 2022
2022
-
[17]
Federated learning via over-the-air computation with statistical channel state information,
S. Jing and C. Xiao, “Federated learning via over-the-air computation with statistical channel state information,” IEEE Trans. Wireless Com- mun., vol. 21, no. 11, pp. 9351–9365, Nov. 2022
2022
-
[18]
Optimal adaptive power control for over-the-air federated edge learning under fading channels,
X. Yu, B. Xiao, W. Ni, and X. Wang, “Optimal adaptive power control for over-the-air federated edge learning under fading channels,” IEEE Trans. Commun., vol. 71, no. 9, pp. 5199–5213, Sept. 2023
2023
-
[19]
Blind federated edge learning,
M. M. Amiri, T. M. Duman, D. G ¨und¨uz, S. R. Kulkarni, and H. V . Poor, “Blind federated edge learning,” IEEE Trans. Wireless Commun. , vol. 20, no. 8, pp. 5129–5143, Aug. 2021
2021
-
[20]
Random orthogonalization for federated learning in massive MIMO systems,
X. Wei, C. Shen, J. Yang, and H. V . Poor, “Random orthogonalization for federated learning in massive MIMO systems,” IEEE Trans. Wireless Commun., vol. 23, no. 3, pp. 2469–2485, Mar. 2024
2024
-
[21]
Deep leakage from gradients,
L. Zhu, Z. Liu, and S. Han, “Deep leakage from gradients,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), Vancouver, BC, Canada, Dec. 2019
2019
-
[22]
Inverting gradients-How easy is it to break privacy in federated learning?
J. Geiping, H. Bauermeister, H. Dr ¨oge, and M. Moeller, “Inverting gradients-How easy is it to break privacy in federated learning?” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS) , Vancouver, Canada, Dec. 2020, pp. 16 937–16 947
2020
-
[23]
Membership inference attacks against machine learning models,
R. Shokri, M. Stronati, C. Song, and V . Shmatikov, “Membership inference attacks against machine learning models,” in Proc. IEEE Symp. Security Priv. (SP) , San Jose, CA, May 2017, pp. 3–18
2017
-
[24]
Wireless federated learning with local differential privacy,
M. Seif, R. Tandon, and M. Li, “Wireless federated learning with local differential privacy,” in Proc. IEEE Int. Symp. Inf. Theory (ISIT) , Los Angeles, CA, Jun. 2020, pp. 2604–2609
2020
-
[25]
Differentially private aircomp federated learning with power adaptation harnessing receiver noise,
Y . Koda, K. Yamamoto, T. Nishio, and M. Morikura, “Differentially private aircomp federated learning with power adaptation harnessing receiver noise,” in Proc. IEEE Global Commun. Conf. , Taipei, Taiwan, Dec. 2020, pp. 1–6
2020
-
[26]
Privacy for free: Wireless federated learning via uncoded transmission with adaptive power control,
D. Liu and O. Simeone, “Privacy for free: Wireless federated learning via uncoded transmission with adaptive power control,” IEEE J. Sel. Areas Commun., vol. 39, no. 1, pp. 170–185, Jan. 2021
2021
-
[27]
Harnessing wireless channels for scalable and privacy-preserving federated learning,
A. Elgabli, J. Park, C. B. Issaid, and M. Bennis, “Harnessing wireless channels for scalable and privacy-preserving federated learning,” IEEE Trans. Commun., vol. 69, no. 8, pp. 5194–5208, Aug. 2021
2021
-
[28]
Communication- efficient federated learning: A second order newton-type method with analog over-the-air aggregation,
M. Krouka, A. Elgabli, C. B. Issaid, and M. Bennis, “Communication- efficient federated learning: A second order newton-type method with analog over-the-air aggregation,” IEEE Trans. Green Commun. Netw. , vol. 6, no. 3, pp. 1862–1874, Sept. 2022
2022
-
[29]
RSS-based location estimation with unknown pathloss model,
X. Li, “RSS-based location estimation with unknown pathloss model,” IEEE Trans. Wireless Commun. , vol. 5, no. 12, pp. 3626–3633, Dec. 2006. 14
2006
-
[30]
Practical secure aggregation for privacy-preserving machine learning,
K. Bonawitz, V . Ivanov, B. Kreuter, A. Marcedone, H. B. McMahan, S. Patel, D. Ramage, A. Segal, and K. Seth, “Practical secure aggregation for privacy-preserving machine learning,” in Proc. ACM SIGSAC Conf. Comput. Commun. Security , Dallas, TX, Oct. 2017, pp. 1175–1191
2017
-
[31]
How much privacy does federated learning with secure aggrega- tion guarantee?
A. R. Elkordy, J. Zhang, Y . H. Ezzeldin, K. Psounis, and S. Avestimehr, “How much privacy does federated learning with secure aggrega- tion guarantee?” in Proc. Priv. Enhanc. Technol. (PoPETs) , Lausanne, Switzerland, Jul. 2023
2023
-
[32]
The algorithmic foundations of differential privacy,
C. Dwork, A. Roth et al. , “The algorithmic foundations of differential privacy,”Found. Trends. Theory Comput. Sci., vol. 9, no. 3–4, pp. 211– 407, 2014
2014
-
[33]
Federated learning with differential privacy: Algorithms and performance analysis,
K. Wei, J. Li, M. Ding, C. Ma, H. H. Yang, F. Farokhi, S. Jin, T. Q. Quek, and H. V . Poor, “Federated learning with differential privacy: Algorithms and performance analysis,” IEEE Trans. Inf. Forensics Security, vol. 15, pp. 3454–3469, Apr. 2020
2020
-
[34]
On the relation between identifiability, differential privacy, and mutual-information privacy,
W. Wang, L. Ying, and J. Zhang, “On the relation between identifiability, differential privacy, and mutual-information privacy,” IEEE Trans. Inf. Theory, vol. 62, no. 9, pp. 5018–5029, Sept. 2016
2016
-
[35]
Differential privacy as a mutual information constraint,
P. Cuff and L. Yu, “Differential privacy as a mutual information constraint,” in Proc. ACM SIGSAC Conf. Comp. Commun. Security , Vienna, Austria, Oct. 2016, pp. 43–54
2016
-
[36]
Over-the-air federated multi-task learning via model sparsification, random compression, and turbo compressed sensing,
H. Ma, X. Yuan, Z. Ding, D. Fan, and J. Fang, “Over-the-air federated multi-task learning via model sparsification, random compression, and turbo compressed sensing,” IEEE Trans. Wireless Commun. , vol. 22, no. 7, pp. 4974–4988, Jul. 2023
2023
-
[37]
On the convergence of FedAvg on non-iid data,
X. Li, K. Huang, W. Yang, S. Wang, and Z. Zhang, “On the convergence of FedAvg on non-iid data,” in Proc. Int. Conf. Learn. Represent. , May 2020
2020
-
[38]
Over-the-air fed- erated learning from heterogeneous data,
T. Sery, N. Shlezinger, K. Cohen, and Y . C. Eldar, “Over-the-air fed- erated learning from heterogeneous data,” IEEE Trans. Signal Process., vol. 69, pp. 3796–3811, Jun. 2021
2021
-
[39]
Multiple-antenna channel hardening and its implications for rate feedback and scheduling,
B. M. Hochwald, T. L. Marzetta, and V . Tarokh, “Multiple-antenna channel hardening and its implications for rate feedback and scheduling,” IEEE Trans. Inf. Theory , vol. 50, no. 9, pp. 1893–1909, Sept. 2004
1909
-
[40]
T. M. Cover and J. A. Thomas, Elements of information theory. Wiley- Interscience, USA, 2006
2006
-
[41]
One-bit over-the-air aggregation for communication-efficient federated edge learning: Design and convergence analysis,
G. Zhu, Y . Du, D. G ¨und¨uz, and K. Huang, “One-bit over-the-air aggregation for communication-efficient federated edge learning: Design and convergence analysis,” IEEE Trans. Wireless Commun. , vol. 20, no. 3, pp. 2120–2135, Mar. 2021
2021
-
[42]
Learning multiple layers of features from tiny images,
A. Krizhevsky and G. Hinton, “Learning multiple layers of features from tiny images,” Univ. Toronto, Toronto, ON, Canada, Tech. Rep. 4 , 2009
2009
-
[43]
EMNIST: Extend- ing MNIST to handwritten letters,
G. Cohen, S. Afshar, J. Tapson, and A. Van Schaik, “EMNIST: Extend- ing MNIST to handwritten letters,” in Proc. Int. Jt. Conf. Neural Netw. (IJCNN), Anchorage, AK, May 2017, pp. 2921–2926
2017
-
[44]
Deep residual learning for image recognition,
K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , Las Vegas, NV , Jun. 2016, pp. 770–778
2016
-
[45]
Measuring the effects of non- identical data distribution for federated visual classification,
T.-M. H. Hsu, H. Qi, and M. Brown, “Measuring the effects of non- identical data distribution for federated visual classification,” Available as ArXiv:1909.06335, 2019
1909 arXiv
-
[46]
Mutual information neural estimation,
M. I. Belghazi, A. Baratin, S. Rajeshwar, S. Ozair, Y . Bengio, A. Courville, and D. Hjelm, “Mutual information neural estimation,” in Proc. Int. Conf. Mach. Learn. , Jul. 2018, pp. 531–540
2018
-
[47]
Fedcorr: Multi- stage federated learning for label noise correction,
J. Xu, Z. Chen, T. Q. Quek, and K. F. E. Chong, “Fedcorr: Multi- stage federated learning for label noise correction,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , New Orleans, LA, Jun. 2022, pp. 10 184–10 193
2022
-
[48]
Byzantine-robust dis- tributed learning: Towards optimal statistical rates,
D. Yin, Y . Chen, R. Kannan, and P. Bartlett, “Byzantine-robust dis- tributed learning: Towards optimal statistical rates,” in Proc. Int. Conf. Mach. Learn., Stockholm, Sweden, Jul. 2018, pp. 5650–5659
2018
-
[49]
Nocedal and S
J. Nocedal and S. J. Wright, Numerical optimization . Springer, New York, 2006
2006
-
[50]
Over-the-air federated learning: Status quo, open challenges, and future directions,
B. Xiao, X. Yu, W. Ni, X. Wang, and H. V . Poor, “Over-the-air federated learning: Status quo, open challenges, and future directions,” Fundamental Research, 2024
2024
-
[51]
Experimental demonstration of over the air federated learning for cellular networks,
S. Pradhan, A. Koc, K. Alemdar, M. A. Arfaoui, P. Pietraski, F. Periard, G. Zhang, M. Hudon, and K. Chowdhury, “Experimental demonstration of over the air federated learning for cellular networks,” Available as ArXiv: 2503.06376, 2025
2025 arXiv
-
[52]
Berry-esseen bounds in the entropic central limit theorem,
S. G. Bobkov, G. P. Chistyakov, and F. G ¨otze, “Berry-esseen bounds in the entropic central limit theorem,” Probab. Theory Relat. Fields , vol. 159, no. 3, pp. 435–478, Aug. 2014
2014
-
[53]
Sub-sampled cubic regularization for non- convex optimization,
J. M. Kohler and A. Lucchi, “Sub-sampled cubic regularization for non- convex optimization,” in Proc. Int. Conf. Mach. Learn. , Jul. 2017, pp. 1895–1904
2017
-
[54]
An extension of McDiarmid’s inequality,
R. Combes, “An extension of McDiarmid’s inequality,” Available as ArXiv:1511.05240, 2015
2015 arXiv
-
[55]
Tighter theory for local SGD on identical and heterogeneous data,
A. Khaled, K. Mishchenko, and P. Richt ´arik, “Tighter theory for local SGD on identical and heterogeneous data,” in Proc. Int. Conf. Artif. Intell. Stat. (AISTATS), Jun. 2020, pp. 4519–4529
2020
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.