Pith. sign in

REVIEW 3 major objections 5 minor 55 references

Rethinking Federated Learning Over the Air: The Blessing of Scaling Up

T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Pith's one-line read In over-the-air federated learning, scaling up the client count shrinks privacy leakage, fading, and convergence error.

desk verdict Solid convergence and channel-hardening results, but the privacy theorem relies on a false decorrelation claim and should not be trusted as stated. read the letter →

arxiv 2508.17697 v1 pith:KQWUPD7S submitted 2025-08-25 cs.LG

classification cs.LG
keywords over-the-aircomputationfederatedlearningprivacyleakagemutualinformationchannelhardeningconvergenceratepowercontrollarge-scalesystems
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Federated learning over the air sends client updates as analog signals that add together on the wireless channel, so the server receives a noisy but automatically aggregated gradient. This paper argues that the standard worry about that noise is inverted: when many clients participate, the aggregation itself becomes a blessing. The mutual information between one client's local gradient and the server's aggregated gradient is bounded by a term of order $O(1/N)$, so each participant hides better in a larger crowd. A concentration inequality shows channel hardening, meaning small-scale fading is averaged away as $N$ grows, and the convergence error contributions from thermal noise and mini-batch sampling carry $N^2$ denominators and vanish at scale. If these results hold, over-the-air federated learning becomes attractive precisely in the large-scale regime where digital communication would be most costly.

What carries the argument

The mechanism is the averaging of $N$ independent, channel-faded client gradients at the server; $N$ independent fading coefficients make the effective channel concentrate at its mean. Formally, the argument rides on three pieces: a Berry–Esseen-style entropic central limit theorem that lower-bounds the differential entropy of the aggregated signal and yields the $O(1/N)$ mutual-information upper bound; a Bernstein/McDiarmid concentration inequality (Lemma 1) showing the difference between the faded and mean-faded gradients is exponentially small in $N$; and standard smoothness and SGD-drift bounds that place sampling noise into terms with $1/(N^2 B)$ denominators. Together these convert "more clients" from an added communication burden into a noise-reduction and privacy-enhancing resource.

What would settle it

Compute or measure the mutual information between one client's gradient and the server's aggregated gradient for $N = 10$, $50$, $100$, and $500$ on the same task, but skip the random-flipping decorrelation step; if the decay flattens or the bound breaks once gradient entries stay correlated, the $O(1/N)$ privacy result rests on preprocessing rather than on the number of clients. A smaller-scale check: at $N = 10$, compare convergence with and without instantaneous-CSI power control; the paper's own experiments already show power control helps there, so the "not essential" claim is limited to large $N$.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central claim is that the wireless impairments in over-the-air federated learning—fading, thermal noise, and sampling noise—are progressively neutralized as the number of participating clients $N$ grows, so scale improves privacy, robustness, and convergence simultaneously. Theorem 1 bounds the per-client mutual information between a local gradient and the aggregated gradient by $C_{\bar{g}} d^*/N$ plus a logarithmic term, decaying as $O(1/N)$ under an honest-but-curious server and average-case leakage. Lemma 1 establishes exponential concentration of the channel-corrupted aggregated gradient around the mean-fading aggregated gradient, a channel-hardening effect that removes small-scale fading from the global update. Theorem 3 bounds the non-convex convergence rate by a leading term plus $d\sigma_z^2/(\mu_c^2 N^2)$ and $\sum \sigma_{s,n}^2/(N^2 B)$, so the noisy analog update becomes equivalent to a noiseless global gradient as $N$ grows. The paper concludes that instantaneous channel estimation and power control are not essential in this regime, since the averaging already does the work that power control was designed to do.

Load-bearing premise

The argument assumes the system is large ($N$ big) and that privacy is measured as average mutual information after a preprocessing step that makes each client's gradient entries statistically independent; if $N$ is only in the tens or an adversary needs worst-case guarantees, the $O(1/N)$ privacy decay and the dismissal of power control do not follow.

Editorial extensions

If this is right

  • Per-client privacy leakage, measured by mutual information, falls as $O(1/N)$, so larger systems can achieve the same average privacy with less added artificial noise.
  • Small-scale fading disappears from the global gradient through channel hardening, so blind transmission without instantaneous CSI becomes nearly as accurate as ideal power control.
  • The non-convex convergence error from thermal noise and mini-batch sampling vanishes as $N$ grows, meaning over-the-air training with many clients behaves like noiseless training.
  • Instantaneous-CSI power control is not essential at scale: Theorem 4 shows it introduces client dropout and channel-estimation-error penalties, and the experiments show its benefit nearly vanishes for large $N$.
  • Larger client populations also make training more robust to label-flipping and noisy-label attacks and allow second-order updates such as L-BFGS to work, as the experiments show.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Because the mutual-information bound is average-case and assumes preprocessing decorrelates gradient entries, a natural next test is whether worst-case gradient-inversion attacks on a single client also decay with $N$; the paper's own framing suggests they are not covered by the bound.
  • The channel-hardening logic suggests that client population size can substitute for many-antenna hardware in suppressing fading, which would change deployment cost calculations for edge-learning infrastructure.
  • The $N^2$ denominators in the convergence bounds imply a design trade-off not explored in the paper: for a fixed communication budget, operators could trade client count against local epochs and batch size to reach a target error floor.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This paper studies an over-the-air federated edge learning system in which N clients transmit accumulated local gradients as analog signals over i.i.d. fading channels and the server receives a noisy linear combination. The authors derive three sets of analytical results: a mutual-information upper bound on privacy leakage that is claimed to scale as O(1/N) (Theorem 1, Section III-A), a concentration inequality for the aggregated gradient that is used to claim a channel-hardening effect (Lemma 1, Section III-B), and convergence rates for strongly convex (Theorem 2, Corollary 1) and non-convex (Theorem 3, Corollary 2) objectives in which thermal noise and SGD noise terms vanish with N. Section III-D analyzes truncated channel-inversion power control under imperfect CSI (Theorem 4) and concludes that instantaneous power control is unnecessary in large-scale systems. The theoretical claims are supplemented with experiments on EMNIST and CIFAR-10 using CNN, ResNet-18, and logistic-regression/L-BFGS setups.

Significance. If the results held as stated, the paper would make a useful contribution to over-the-air federated learning by showing that a large number of clients improves privacy, suppresses fading, and accelerates convergence, rather than only exacerbating communication cost. The paper's strengths are the clarity of the system model, the use of a standard FedAvg proof template for the convergence analysis, the explicit treatment of power control with imperfect CSI, and the experimental section that directly checks the predicted privacy, channel-hardening, and convergence trends. The main reservations are proof gaps in Theorem 1 and in the convergence proofs, which are central to the paper's three headline claims rather than presentation issues.

major comments (3)
  1. [Appendix A, Eqs. (32)-(35)] The proof of Theorem 1 asserts that after multiplying entries of s_{n,t} by independent Rademacher variables S, the entries of \hat s_{n,t} are mutually independent. This is false for a general correlated vector. For example, take X1=Z and X2=Z+W with independent standard Gaussians Z,W and independent Rademachers S1,S2; then S1X1 and S2X2 have zero covariance but are dependent because E[(S1X1)^2(S2X2)^2]=4 while E[(S1X1)^2]E[(S2X2)^2]=2. Consequently, the coordinate-wise entropy decomposition and the Berry-Esseen entropic CLT lower bound in Eq. (35) do not follow for correlated gradient entries, and the O(1/N) privacy bound in Eq. (10) with its consequence in Eq. (25) is not established as stated for general local gradients. The footnote about random flipping reducing correlations is insufficient; the proof needs either an explicit entrywise-independence assumption on the preprocessed gradient or a genuinely multivariate entropic CLT argument. The MINE experiments provide empirical evidence but do not close this gap.
  2. [Appendix C, Eq. (44); Appendix E, Eq. (48); Theorems 2-3] The convergence proofs replace the random fading coefficients c_{n,t} in the global update (6) by their mean \mu_c without a residual term. In Appendix C, the line before Eq. (44) writes \eta_t/N \sum_n \mu_c(w_t-w_{n,t}^{(E)})/\eta_l, which equals the true update only when c_{n,t}=\mu_c; similarly, Eq. (48) in Appendix E computes E[\|\hat g_t\|^2] from an expression containing no c_{n,t}. As a result, the bounds in Theorems 2 and 3 (and Corollaries 1 and 2) are proved for a channel-mean system, not for the random-fading model of Section II-B; a term of order \sigma_c^2 G^2/N would enter the residual. Lemma 1 provides only a high-probability concentration statement and is not integrated into the expectation bounds in these proofs. The claim that communication impairments vanish as N grows may survive a repair, but the theorem statements as proved are not supported.
  3. [Corollary 1 and Appendix D, Eqs. (45)-(46)] The displayed algebra in the proof of Corollary 1 is inconsistent with the stated \kappa. Under the stated condition \eta_0\le 1/(4\mu_c L), we have \lambda\mu_c\eta_0-1<0 because \lambda\le L, so the first argument in the max in Eq. (22) is negative; then \kappa collapses to \|w_0-w^*\|^2 and all noise and heterogeneity terms disappear from the bound. The induction step in Eq. (46) requires \kappa to be at least on the order of \mu_c^2\eta_0^2 Q1/(\lambda\mu_c\eta_0), not the expression with \lambda\mu_c\eta_0-1 in the denominator. Please correct the formula or the proof; as printed, Corollary 1 is not derived.
minor comments (5)
  1. [Section III-A] The statement that 'after certain preprocessing steps, the local gradient entries can be statistically independent of each other' is an assumption in all but name; since it drives Theorem 1, it should be stated as an explicit assumption with a precise description of the preprocessing.
  2. [Eq. (8) and Appendix A] The privacy metric conditions on the past gradients {g_p}, but the proof of Theorem 1 computes entropies without making the conditioning visible in every step; please make the conditioning explicit and explain why past public models do not change the bounds.
  3. [Eq. (18)] The notation for the term involving \beta_\nu is typeset ambiguously; please define \beta_\nu^N (or the intended expression) explicitly and state the dependence of the final bound on \nu.
  4. [Section IV, Figs. 2 and 4] The MI estimates in Fig. 2 are obtained with MINE, an approximate estimator with known bias, and no error bars or seeds are reported; the O(1/N) privacy law is therefore only qualitatively validated. In addition, increasing N in Fig. 4 also increases the total amount of training data, so part of the observed accuracy gain may be a data-volume effect rather than the noise-reduction effect claimed in the analysis.
  5. [Section III-C.2] The statement that the gradient discrepancy 'decreases at the rate of O(exp(-N))' is stronger than what Lemma 1 proves; Lemma 1 is a high-probability large-deviation bound, so the conclusion should be phrased as an exponential concentration statement rather than a bound on the mean discrepancy.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper's analytical claims derive from standard concentration inequalities, entropic CLT bounds, and established FedAvg proof techniques, with no fitted parameter renamed as a prediction.

full rationale

The derivation chain in this paper is self-contained and does not reduce its conclusions to its inputs by construction. Theorem 1's mutual-information bound is derived from entropy calculus, a linear-transformation entropy identity, and the entropic central limit theorem [52], under the explicitly stated conditional-independence preprocessing assumption; it is not a restatement of the definition of the metric. Lemma 1 is a direct Bernstein/McDiarmid concentration bound on the channel-averaging term, with no fitted constants. Theorems 2 and 3 follow the standard proof templates of [37] and [55] for FedAvg-type updates, and the O(1/N^2) noise terms enter algebraically from the global averaging and AWGN variance, not from tuning parameters to match the desired conclusion. The power-control comparison in Theorem 4 is likewise an analytical bound: the extra dropout and CSI-error terms are shown to vanish as N grows, and the claim that instant power control is unnecessary is explicitly conditional on large N and on the specific truncated channel-inversion scheme, so it is a derived comparison, not a circular one. Self-citations such as [10], [11], [12], and [33] are contextual (system model, prior OTA results, DP definitions) and are not load-bearing for the new theorems. Two flagged items are correctness/completeness concerns rather than circularity: the independence assertion after Rademacher flipping in Eq. (32) is not generally valid for correlated gradient entries, and Theorem 4 is stated without a corresponding appendix proof (the appendix stops at Corollary 2). These do not constitute circular reductions, so the circularity score remains 0.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The central claims rest on standard optimization assumptions (smoothness, convexity, bounded variance, bounded gradients), a specific statistical model for fading and noise, and the honest-but-curious privacy model. The only entities introduced are analytical constructs (channel hardening, MI metric), not new physical or algorithmic objects, so no invented entities are recorded. The main unquantified ingredients are C_g, the channel statistics, and the noise variances.

free parameters (4)
  • mu_c and sigma_c^2 (channel fading mean and variance) = mu_c = 1 in experiments; Rayleigh fading used
    The channel statistics are treated as known inputs, but the convergence bounds require the mean mu_c to be known to set the global learning rate eta_t = eta_l / mu_c. In practice mu_c is estimated from long-term averages. The experiments set mu_c = 1. This is not fitted to the target result, but it is a system parameter.
  • sigma_z^2 (thermal noise variance) = not specified numerically
    Appears in the privacy and convergence bounds as a noise variance. It is a physical system parameter, not a fitted constant, but its value is not reported in the experiments, making quantitative verification difficult.
  • sigma_s^2 (SGD sampling variance) = not specified
    Bounded variance assumption in Assumption 3. The bounds depend on it, but the experiments do not estimate or report it.
  • C_g in Theorem 1 = unspecified constant
    The mutual information bound contains an unspecified constant C_g depending on the fourth moment of the preprocessed gradient. Its value is not estimated, so the bound is not numerically evaluable as a privacy guarantee.
assumptions (6)
  • domain assumption Local gradient entries can be made statistically independent via decorrelation preprocessing such as random flipping (Section III-A, footnote 2).
    This is required for the diagonal covariance structure in Theorem 1 and is assumed rather than proven for the actual networks used in experiments.
  • domain assumption All clients' local gradient covariance matrices share the same rank d* (Section III-A).
    The privacy bound requires d*_n = d* for all clients; this is a simplifying assumption that may fail for heterogeneous data and networks.
  • domain assumption Honest-but-curious server and no malicious attackers for the privacy analysis (Section III-A).
    The privacy claim is restricted to a server that follows the protocol; the experiments with label-flipping and noisy-label attacks are about robustness, not privacy.
  • domain assumption Assumption 4: expected squared norm of stochastic gradients is bounded by G_n^2.
    Used in Lemma 1 and Theorems 3, 4. Justified by the finite transmit power budget, but it is an assumption on the loss landscape and data.
  • standard math The entropic central limit theorem bound from Bobkov et al. [52] holds for the preprocessed gradient vectors.
    This is the external mathematical result that drives the lower bound on entropy in the proof of Theorem 1. It is cited, not proved, and its finite-fourth-moment conditions are assumed.
  • domain assumption For the power control analysis, the CSI estimation error is bounded by |Delta| <= Delta_max with known distributional assumptions (Section III-D).
    This is an adopted model for imperfect CSI, and the conclusion that power control is unnecessary is conditional on this model and on the truncated channel inversion scheme.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Rethinking Federated Learning Over the Air: The Blessing of Scaling Up." pith.science (2026). https://pith.science/paper/KQWUPD7S

@misc{pith2026250817697,
  author       = {Pith},
  title        = {Pith review of: Rethinking Federated Learning Over the Air: The Blessing of Scaling Up},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/KQWUPD7S}},
  note         = {Machine review of arXiv:2508.17697}
}
read the original abstract

Federated learning facilitates collaborative model training across multiple clients while preserving data privacy. However, its performance is often constrained by limited communication resources, particularly in systems supporting a large number of clients. To address this challenge, integrating over-the-air computations into the training process has emerged as a promising solution to alleviate communication bottlenecks. The system significantly increases the number of clients it can support in each communication round by transmitting intermediate parameters via analog signals rather than digital ones. This improvement, however, comes at the cost of channel-induced distortions, such as fading and noise, which affect the aggregated global parameters. To elucidate these effects, this paper develops a theoretical framework to analyze the performance of over-the-air federated learning in large-scale client scenarios. Our analysis reveals three key advantages of scaling up the number of participating clients: (1) Enhanced Privacy: The mutual information between a client's local gradient and the server's aggregated gradient diminishes, effectively reducing privacy leakage. (2) Mitigation of Channel Fading: The channel hardening effect eliminates the impact of small-scale fading in the noisy global gradient. (3) Improved Convergence: Reduced thermal noise and gradient estimation errors benefit the convergence rate. These findings solidify over-the-air model training as a viable approach for federated learning in networks with a large number of clients. The theoretical insights are further substantiated through extensive experimental evaluations.

Figures

Figures reproduced from arXiv: 2508.17697 by the authors.

Figure 1
Figure 1. An overview of the edge learning system. The following steps are repeated until the model converges: (1) each client [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Impact of client number N on privacy leakage, evalu￾ated from training a CNN on the EMNIST dataset. participants accordingly. We further consider the same learning rate η = 0.03 for both local and global training (since µc = 1), local epoch E = ⌊ M B ⌋, and local batch size B = 50. All experiments are implemented with Pytorch on NVIDIA RTX 3090 GPU. 3) MI Estimation: We use Mutual Information Neural Es￾timator (MINE… view at source ↗
Figure 3
Figure 3. Visualizing the channel hardening effect, exemplified [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (4 more)
Figure 5
Figure 5. Figure 5: , we can see that an increase in data heterogeneity impedes the training process, whereby it not only slows down the convergence rate but also inflicts additional fluctuations. However, with more clients participating in the system, the impact of data heterogeneity is …
Figure 6
Figure 6. Figure 6: Impact of power control on training efficiency, exem [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]
Figure 8
Figure 8. Figure 8: Impact of the number of clients N on test accuracy, exemplified by training a logistic regression model on the EMNIST dataset. challenge. To evaluate this, we train a logistic regression model for multi-class classification tasks on the EMNIST dataset and assess its pe…
Figure 7
Figure 7. Figure 7: Performance in the presence of malicious attacks, [PITH_FULL_IMAGE:figures/full_fig_p010_7.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

55 extracted references · 45 canonical work pages

  1. [1]

    Communication-efficient learning of deep networks from decentralized data,

    B. McMahan, E. Moore, D. Ramage, S. Hampson, and B. A. y Arcas, “Communication-efficient learning of deep networks from decentralized data,” in Proc. Int. Conf. Artif. Intell. Stat. (AISTATS) , Fort Lauderdale, FL, Apr. 2017, pp. 1273–1282

  2. [2]

    Federated learning: Challenges, methods, and future directions,

    T. Li, A. K. Sahu, A. Talwalkar, and V . Smith, “Federated learning: Challenges, methods, and future directions,” IEEE Signal Process. Mag., vol. 37, no. 3, pp. 50–60, May 2020

  3. [3]

    Federated learning for wireless communications: Motivation, opportunities, and challenges,

    S. Niknam, H. S. Dhillon, and J. H. Reed, “Federated learning for wireless communications: Motivation, opportunities, and challenges,” IEEE Commun. Mag. , vol. 58, no. 6, pp. 46–51, Jun. 2020

  4. [4]

    Broadband analog aggregation for low-latency federated edge learning,

    G. Zhu, Y . Wang, and K. Huang, “Broadband analog aggregation for low-latency federated edge learning,” IEEE Trans. Wireless Commun. , vol. 19, no. 1, pp. 491–506, Jan. 2020

  5. [5]

    Federated learning via over- the-air computation,

    K. Yang, T. Jiang, Y . Shi, and Z. Ding, “Federated learning via over- the-air computation,” IEEE Trans. Wireless Commun., vol. 19, no. 3, pp. 2022–2035, Mar. 2020

  6. [6]

    On analog gradient descent learning over multiple access fading channels,

    T. Sery and K. Cohen, “On analog gradient descent learning over multiple access fading channels,” IEEE Trans. Signal Process. , vol. 68, pp. 2897–2911, Apr. 2020

  7. [7]

    Federated learning over wireless fading channels,

    M. M. Amiri and D. G ¨und¨uz, “Federated learning over wireless fading channels,” IEEE Trans. Wireless Commun. , vol. 19, no. 5, pp. 3546– 3557, May 2020

  8. [8]

    Computation over multiple-access channels,

    B. Nazer and M. Gastpar, “Computation over multiple-access channels,” IEEE Trans. Inf. Theory , vol. 53, no. 10, pp. 3498–3516, Oct. 2007

Show all 55 references
  1. [9]

    Model pruning for distributed learning over the air,

    Z. Zhao, K. Xu, W. Hong, Z. Ding, T. Q. Quek, H. H. Yang et al. , “Model pruning for distributed learning over the air,”IEEE Trans. Signal Process., vol. 72, pp. 5533–5549, Oct. 2024

  2. [10]

    Revisiting analog over-the-air machine learning: The blessing and curse of interference,

    H. H. Yang, Z. Chen, T. Q. Quek, and H. V . Poor, “Revisiting analog over-the-air machine learning: The blessing and curse of interference,” IEEE J. Sel. Topics Signal Process. , vol. 16, no. 3, pp. 406–419, Apr. 2022

  3. [11]

    Unleashing edgeless feder- ated learning with analog transmissions,

    H. H. Yang, Z. Chen, and T. Q. Quek, “Unleashing edgeless feder- ated learning with analog transmissions,” IEEE Trans. Signal Process. , vol. 72, pp. 774–791, Jan. 2024

  4. [12]

    Edge intelligence over the air: Two faces of interference in federated learning,

    Z. Chen, H. H. Yang, and T. Q. Quek, “Edge intelligence over the air: Two faces of interference in federated learning,” IEEE Commun. Mag. , vol. 61, no. 12, pp. 62–68, Dec. 2023

  5. [13]

    Over-the-air computation systems: Optimization, analysis and scaling laws,

    W. Liu, X. Zang, Y . Li, and B. Vucetic, “Over-the-air computation systems: Optimization, analysis and scaling laws,” IEEE Trans. Wireless Commun., vol. 19, no. 8, pp. 5488–5502, Aug. 2020

  6. [14]

    Optimized power control for over-the-air computation in fading channels,

    X. Cao, G. Zhu, J. Xu, and K. Huang, “Optimized power control for over-the-air computation in fading channels,” IEEE Trans. Wireless Commun., vol. 19, no. 11, pp. 7498–7513, Nov. 2020

  7. [15]

    Optimized power control design for over-the-air federated edge learning,

    X. Cao, G. Zhu, J. Xu, Z. Wang, and S. Cui, “Optimized power control design for over-the-air federated edge learning,” IEEE J. Sel. Areas Commun., vol. 40, no. 1, pp. 342–358, Jan. 2022

  8. [16]

    Joint device selection and power control for wireless federated learning,

    W. Guo, R. Li, C. Huang, X. Qin, K. Shen, and W. Zhang, “Joint device selection and power control for wireless federated learning,” IEEE J. Sel. Areas Commun., vol. 40, no. 8, pp. 2395–2410, Aug. 2022

  9. [17]

    Federated learning via over-the-air computation with statistical channel state information,

    S. Jing and C. Xiao, “Federated learning via over-the-air computation with statistical channel state information,” IEEE Trans. Wireless Com- mun., vol. 21, no. 11, pp. 9351–9365, Nov. 2022

  10. [18]

    Optimal adaptive power control for over-the-air federated edge learning under fading channels,

    X. Yu, B. Xiao, W. Ni, and X. Wang, “Optimal adaptive power control for over-the-air federated edge learning under fading channels,” IEEE Trans. Commun., vol. 71, no. 9, pp. 5199–5213, Sept. 2023

  11. [19]

    Blind federated edge learning,

    M. M. Amiri, T. M. Duman, D. G ¨und¨uz, S. R. Kulkarni, and H. V . Poor, “Blind federated edge learning,” IEEE Trans. Wireless Commun. , vol. 20, no. 8, pp. 5129–5143, Aug. 2021

  12. [20]

    Random orthogonalization for federated learning in massive MIMO systems,

    X. Wei, C. Shen, J. Yang, and H. V . Poor, “Random orthogonalization for federated learning in massive MIMO systems,” IEEE Trans. Wireless Commun., vol. 23, no. 3, pp. 2469–2485, Mar. 2024

  13. [21]

    Deep leakage from gradients,

    L. Zhu, Z. Liu, and S. Han, “Deep leakage from gradients,” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), Vancouver, BC, Canada, Dec. 2019

  14. [22]

    Inverting gradients-How easy is it to break privacy in federated learning?

    J. Geiping, H. Bauermeister, H. Dr ¨oge, and M. Moeller, “Inverting gradients-How easy is it to break privacy in federated learning?” in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS) , Vancouver, Canada, Dec. 2020, pp. 16 937–16 947

  15. [23]

    Membership inference attacks against machine learning models,

    R. Shokri, M. Stronati, C. Song, and V . Shmatikov, “Membership inference attacks against machine learning models,” in Proc. IEEE Symp. Security Priv. (SP) , San Jose, CA, May 2017, pp. 3–18

  16. [24]

    Wireless federated learning with local differential privacy,

    M. Seif, R. Tandon, and M. Li, “Wireless federated learning with local differential privacy,” in Proc. IEEE Int. Symp. Inf. Theory (ISIT) , Los Angeles, CA, Jun. 2020, pp. 2604–2609

  17. [25]

    Differentially private aircomp federated learning with power adaptation harnessing receiver noise,

    Y . Koda, K. Yamamoto, T. Nishio, and M. Morikura, “Differentially private aircomp federated learning with power adaptation harnessing receiver noise,” in Proc. IEEE Global Commun. Conf. , Taipei, Taiwan, Dec. 2020, pp. 1–6

  18. [26]

    Privacy for free: Wireless federated learning via uncoded transmission with adaptive power control,

    D. Liu and O. Simeone, “Privacy for free: Wireless federated learning via uncoded transmission with adaptive power control,” IEEE J. Sel. Areas Commun., vol. 39, no. 1, pp. 170–185, Jan. 2021

  19. [27]

    Harnessing wireless channels for scalable and privacy-preserving federated learning,

    A. Elgabli, J. Park, C. B. Issaid, and M. Bennis, “Harnessing wireless channels for scalable and privacy-preserving federated learning,” IEEE Trans. Commun., vol. 69, no. 8, pp. 5194–5208, Aug. 2021

  20. [28]

    Communication- efficient federated learning: A second order newton-type method with analog over-the-air aggregation,

    M. Krouka, A. Elgabli, C. B. Issaid, and M. Bennis, “Communication- efficient federated learning: A second order newton-type method with analog over-the-air aggregation,” IEEE Trans. Green Commun. Netw. , vol. 6, no. 3, pp. 1862–1874, Sept. 2022

  21. [29]

    RSS-based location estimation with unknown pathloss model,

    X. Li, “RSS-based location estimation with unknown pathloss model,” IEEE Trans. Wireless Commun. , vol. 5, no. 12, pp. 3626–3633, Dec. 2006. 14

  22. [30]

    Practical secure aggregation for privacy-preserving machine learning,

    K. Bonawitz, V . Ivanov, B. Kreuter, A. Marcedone, H. B. McMahan, S. Patel, D. Ramage, A. Segal, and K. Seth, “Practical secure aggregation for privacy-preserving machine learning,” in Proc. ACM SIGSAC Conf. Comput. Commun. Security , Dallas, TX, Oct. 2017, pp. 1175–1191

  23. [31]

    How much privacy does federated learning with secure aggrega- tion guarantee?

    A. R. Elkordy, J. Zhang, Y . H. Ezzeldin, K. Psounis, and S. Avestimehr, “How much privacy does federated learning with secure aggrega- tion guarantee?” in Proc. Priv. Enhanc. Technol. (PoPETs) , Lausanne, Switzerland, Jul. 2023

  24. [32]

    The algorithmic foundations of differential privacy,

    C. Dwork, A. Roth et al. , “The algorithmic foundations of differential privacy,”Found. Trends. Theory Comput. Sci., vol. 9, no. 3–4, pp. 211– 407, 2014

  25. [33]

    Federated learning with differential privacy: Algorithms and performance analysis,

    K. Wei, J. Li, M. Ding, C. Ma, H. H. Yang, F. Farokhi, S. Jin, T. Q. Quek, and H. V . Poor, “Federated learning with differential privacy: Algorithms and performance analysis,” IEEE Trans. Inf. Forensics Security, vol. 15, pp. 3454–3469, Apr. 2020

  26. [34]

    On the relation between identifiability, differential privacy, and mutual-information privacy,

    W. Wang, L. Ying, and J. Zhang, “On the relation between identifiability, differential privacy, and mutual-information privacy,” IEEE Trans. Inf. Theory, vol. 62, no. 9, pp. 5018–5029, Sept. 2016

  27. [35]

    Differential privacy as a mutual information constraint,

    P. Cuff and L. Yu, “Differential privacy as a mutual information constraint,” in Proc. ACM SIGSAC Conf. Comp. Commun. Security , Vienna, Austria, Oct. 2016, pp. 43–54

  28. [36]

    Over-the-air federated multi-task learning via model sparsification, random compression, and turbo compressed sensing,

    H. Ma, X. Yuan, Z. Ding, D. Fan, and J. Fang, “Over-the-air federated multi-task learning via model sparsification, random compression, and turbo compressed sensing,” IEEE Trans. Wireless Commun. , vol. 22, no. 7, pp. 4974–4988, Jul. 2023

  29. [37]

    On the convergence of FedAvg on non-iid data,

    X. Li, K. Huang, W. Yang, S. Wang, and Z. Zhang, “On the convergence of FedAvg on non-iid data,” in Proc. Int. Conf. Learn. Represent. , May 2020

  30. [38]

    Over-the-air fed- erated learning from heterogeneous data,

    T. Sery, N. Shlezinger, K. Cohen, and Y . C. Eldar, “Over-the-air fed- erated learning from heterogeneous data,” IEEE Trans. Signal Process., vol. 69, pp. 3796–3811, Jun. 2021

  31. [39]

    Multiple-antenna channel hardening and its implications for rate feedback and scheduling,

    B. M. Hochwald, T. L. Marzetta, and V . Tarokh, “Multiple-antenna channel hardening and its implications for rate feedback and scheduling,” IEEE Trans. Inf. Theory , vol. 50, no. 9, pp. 1893–1909, Sept. 2004

  32. [40]

    T. M. Cover and J. A. Thomas, Elements of information theory. Wiley- Interscience, USA, 2006

  33. [41]

    One-bit over-the-air aggregation for communication-efficient federated edge learning: Design and convergence analysis,

    G. Zhu, Y . Du, D. G ¨und¨uz, and K. Huang, “One-bit over-the-air aggregation for communication-efficient federated edge learning: Design and convergence analysis,” IEEE Trans. Wireless Commun. , vol. 20, no. 3, pp. 2120–2135, Mar. 2021

  34. [42]

    Learning multiple layers of features from tiny images,

    A. Krizhevsky and G. Hinton, “Learning multiple layers of features from tiny images,” Univ. Toronto, Toronto, ON, Canada, Tech. Rep. 4 , 2009

  35. [43]

    EMNIST: Extend- ing MNIST to handwritten letters,

    G. Cohen, S. Afshar, J. Tapson, and A. Van Schaik, “EMNIST: Extend- ing MNIST to handwritten letters,” in Proc. Int. Jt. Conf. Neural Netw. (IJCNN), Anchorage, AK, May 2017, pp. 2921–2926

  36. [44]

    Deep residual learning for image recognition,

    K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , Las Vegas, NV , Jun. 2016, pp. 770–778

  37. [45]

    Measuring the effects of non- identical data distribution for federated visual classification,

    T.-M. H. Hsu, H. Qi, and M. Brown, “Measuring the effects of non- identical data distribution for federated visual classification,” Available as ArXiv:1909.06335, 2019

  38. [46]

    Mutual information neural estimation,

    M. I. Belghazi, A. Baratin, S. Rajeshwar, S. Ozair, Y . Bengio, A. Courville, and D. Hjelm, “Mutual information neural estimation,” in Proc. Int. Conf. Mach. Learn. , Jul. 2018, pp. 531–540

  39. [47]

    Fedcorr: Multi- stage federated learning for label noise correction,

    J. Xu, Z. Chen, T. Q. Quek, and K. F. E. Chong, “Fedcorr: Multi- stage federated learning for label noise correction,” in Proc. IEEE Conf. Comput. Vis. Pattern Recog. (CVPR) , New Orleans, LA, Jun. 2022, pp. 10 184–10 193

  40. [48]

    Byzantine-robust dis- tributed learning: Towards optimal statistical rates,

    D. Yin, Y . Chen, R. Kannan, and P. Bartlett, “Byzantine-robust dis- tributed learning: Towards optimal statistical rates,” in Proc. Int. Conf. Mach. Learn., Stockholm, Sweden, Jul. 2018, pp. 5650–5659

  41. [49]

    Nocedal and S

    J. Nocedal and S. J. Wright, Numerical optimization . Springer, New York, 2006

  42. [50]

    Over-the-air federated learning: Status quo, open challenges, and future directions,

    B. Xiao, X. Yu, W. Ni, X. Wang, and H. V . Poor, “Over-the-air federated learning: Status quo, open challenges, and future directions,” Fundamental Research, 2024

  43. [51]

    Experimental demonstration of over the air federated learning for cellular networks,

    S. Pradhan, A. Koc, K. Alemdar, M. A. Arfaoui, P. Pietraski, F. Periard, G. Zhang, M. Hudon, and K. Chowdhury, “Experimental demonstration of over the air federated learning for cellular networks,” Available as ArXiv: 2503.06376, 2025

  44. [52]

    Berry-esseen bounds in the entropic central limit theorem,

    S. G. Bobkov, G. P. Chistyakov, and F. G ¨otze, “Berry-esseen bounds in the entropic central limit theorem,” Probab. Theory Relat. Fields , vol. 159, no. 3, pp. 435–478, Aug. 2014

  45. [53]

    Sub-sampled cubic regularization for non- convex optimization,

    J. M. Kohler and A. Lucchi, “Sub-sampled cubic regularization for non- convex optimization,” in Proc. Int. Conf. Mach. Learn. , Jul. 2017, pp. 1895–1904

  46. [54]

    An extension of McDiarmid’s inequality,

    R. Combes, “An extension of McDiarmid’s inequality,” Available as ArXiv:1511.05240, 2015

  47. [55]

    Tighter theory for local SGD on identical and heterogeneous data,

    A. Khaled, K. Mishchenko, and P. Richt ´arik, “Tighter theory for local SGD on identical and heterogeneous data,” in Proc. Int. Conf. Artif. Intell. Stat. (AISTATS), Jun. 2020, pp. 4519–4529

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.