REVIEW 3 major objections 6 minor 1 cited by
Empowering Near-Field Communications in Low-Altitude Economy with LLM: Fundamentals, Potentials, Solutions, and Future Directions
T0 review · 3 major / 6 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read A pretrained GPT-2, with most layers frozen, can be fine-tuned to distinguish far- and near-field users and compute multiuser precoding in downlink XL-MIMO for low-altitude drone networks.
desk verdict A readable tutorial that floats a plausible GPT-2-for-near-field idea, but the case study has no numbers and the contribution over [13] is thin. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the six-module LLM-based framework, with the frozen GPT-2 backbone (dimension $d=768$) as its core. The key mechanism is the split between frozen and trainable parts: self-attention and MLP layers are frozen to retain universal knowledge, while only the residual 'addition' and layer-normalization layers are fine-tuned for the wireless tasks. For precoding, the paper uses the proven optimal beamforming form $w_k^*=(\mathbf{I}_N+\sum_{k=1}^K \frac{\lambda_k}{\sigma^2} \mathbf{h}_k \mathbf{h}_k^H)^{-1} \mathbf{h}_k / \|(\mathbf{I}_N+\sum_{k=1}^K \frac{\lambda_k}{\sigma^2} \mathbf{h}_k \mathbf{h}_k^H)^{-1} \mathbf{h}_k\|$, so the network learns only the $K$ scalars $\lambda_k$ and the power allocation $\mathbf{p}$ instead of the whole matrix $\mathbf{W}$; this dimensionality reduction is what makes the precoding task tractable for a language-model backbone.
What would settle it
Train the proposed architecture twice under identical data and hyperparameters, once with the published GPT-2 weights and once with the same architecture but randomly initialized transformer layers. If the pretrained and random versions perform equally on far/near-field classification accuracy and achieved spectrum efficiency, the text pretraining is not load-bearing and the reported gains would reduce to the task-specific encoders and fine-tuned layers.
Extended reading notes
Core claim
The paper's discovery claim is that GPT-2, a text-trained transformer, transfers to physical-layer signal processing after only residual-connection and layer-normalization layers are fine-tuned. In the proposed pipeline, raw complex channel matrices are concatenated, normalized, discretized, and encoded, then passed through the frozen GPT-2 backbone; output decoders map the internal features to a far/near-field label per user and to the scalar power-allocation parameters $\lambda_k$ that determine the precoding vectors via $w_k^* = (\mathbf{I}_N + \sum_{k} \frac{\lambda_k}{\sigma^2} \mathbf{h}_k \mathbf{h}_k^H)^{-1} \mathbf{h}_k / \|(\mathbf{I}_N + \sum_{k} \frac{\lambda_k}{\sigma^2} \mathbf{h}_k \mathbf{h}_k^H)^{-1} \mathbf{h}_k\|$. The case study reports that this scheme demonstrates excellent performance under various parameter settings and outperforms other deep learning-based methods on multiuser spectrum efficiency.
Load-bearing premise
The entire gain rests on the premise that the knowledge stored in GPT-2's frozen text-trained weights transfers to complex-valued wireless channel matrices after generic preprocessing, so that fine-tuning only residual and layer-norm layers is enough to adapt the model to far/near-field classification and precoding.
Editorial extensions
If this is right
- A single frozen GPT-2 backbone can serve multiple physical-layer tasks at once, so user classification and precoding need not be separate specialist networks.
- Near-field beamfocusing and location division multiple access become compatible with low-altitude drone networks, since the model can place users in the distance domain instead of treating all links as planar-wave.
- Because only residual and layer-norm layers are fine-tuned, adapting the model to a new wireless scenario costs less than retraining a full transformer.
- The same LLM-based scheme should extend to channel prediction and user localization, tasks the authors list as future outputs of the framework.
- LLM-based methods can surpass codebook-based beamforming and CNN/Transformer baselines in spectrum efficiency as the antenna array grows.
Reading between the lines
- If the transfer result is real, text-pretrained transformers could become a common backbone for other complex-valued channel tasks, such as channel prediction or integrated sensing, where the input is not language at all.
- A direct test of the mechanism would ablate pretraining: replace GPT-2 weights with random weights and compare, a comparison the paper does not report.
- The proposed pipeline could likely work with much smaller language models, since the wireless task uses only 256-antenna channels; scaling studies would reveal whether the LLM size is actually buying performance or just capacity.
- Real deployment would need to weigh the GPT-2 backbone's inference cost against the claimed gains on battery-limited UAVs, an issue the paper lists as an open challenge.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes applying large language models (LLMs) to near-field communications in low-altitude economy (LAE) networks. It argues that LAE user equipment is naturally located in the near-field region of XL-MIMO base stations, benefiting from spherical-wave beamfocusing and the additional distance dimension. The authors identify signal processing complexity and far/near-field user classification as key challenges, and they propose an LLM-based framework with input encoders, a GPT-2 backbone with frozen self-attention/MLP layers, and output decoders for two tasks: distinguishing far- and near-field users and designing multi-user precoding. A case study is presented with simulation results claimed to show the proposed scheme outperforms CNN, Transformer, and conventional codebook-based schemes. The paper also discusses future directions such as multi-task and multi-modal LLMs for LAE.
Significance. If the central empirical claim were substantiated, the paper would demonstrate a novel application of pretrained LLMs to physical-layer wireless tasks, specifically near-field user classification and precoding in XL-MIMO for LAE. The main strength is the system-level framing: connecting near-field propagation, LAE mobility, and a single LLM backbone could, in principle, provide a unified solution to multiple tasks. The authors also correctly cite a known structure for optimal downlink beamforming to reduce the learning target from a full precoding matrix to a per-user power-allocation-like parameter vector. However, the paper does not currently provide any verifiable quantitative evidence for its headline claims: no numerical values, no error bars, no baseline specifications, and no ablation isolating the contribution of the pretrained LLM. Until such evidence is supplied, the significance remains potential rather than demonstrated.
major comments (3)
- [Section IV-B, Fig. 4] The central claim that the proposed scheme 'demonstrates excellent performance under various parameter settings' and 'outperforms other deep learning-based methods' is not supported by any quantitative data in the manuscript. The text reports no numerical values for spectrum efficiency, classification accuracy, or comparison margins; no error bars or confidence intervals are given; and the baseline schemes (CNN, Transformer, NOMA, LDMA, SDMA) are not specified in terms of architecture, parameter count, or training budget. Without these numbers, the claimed superiority cannot be checked, and the reader cannot distinguish a genuine gain from random variation or favorable axis scaling.
- [Section IV-A, 'Pre-processing Module' and 'LLM Backbone With Finetuning'] The training recipe is critically under-specified. The paper does not define loss functions for the classification and precoding tasks, does not provide the channel model equations, does not describe how the 8,000/1,000/1,000 training/validation/testing samples are generated, and does not specify the 'Discretization' and 'Domain Transformation' steps in the pre-processing module. These details are essential for reproducibility and for assessing whether the preprocessing preserves the phase information that distinguishes near-field users from far-field users. The statement that only addition and layer-normalization layers are fine-tuned while self-attention and MLP layers are frozen is a key architectural choice, but the paper provides no ablation or feature-analysis evidence that frozen text-pretrained representations transfer to raw complex channel state information.
- [Section IV-B2, Eq. (1)] The optimal beamforming formula is cited from [12] rather than derived or adapted to the near-field channel model, and the mapping from the LLM output to the parameter vector λ and the power allocation vector p is not specified. The paper does not state the output projection dimensions, activation functions, how the power constraint is enforced, or how the λ parameters are converted into the final precoding vectors. Because the precoding task is a central component of the case study, this missing specification weakens the entire empirical section.
minor comments (6)
- [Section III-A] The phrase 'Beside, compared with users on the ground' should be 'Besides, compared with users on the ground'.
- [Fig. 4 caption] The caption contains a typographical error: 'θ_tit = 5°' should be 'θ_tilt = 5°'. The variables in the plots ('Spectrum efficiency against ?', 'against ?N', 'against ?min') are not defined in the caption or the text.
- [Section IV-A, subsection titles] The subsection titles 'Input encoders', 'Output decoders', and 'LLM Backbone With Finetuning' are inconsistently capitalized and use different formatting from 'Input Module' and 'Output Module'; please standardize them.
- [References] Reference [11] lists the first author as 'R. K. Alec', which does not match the standard citation for the GPT-2 technical report (Alec Radford et al.). The authors should correct this reference.
- [Throughout] The spacing in 'UA Vs' is inconsistent (sometimes 'UAVs', sometimes 'UA Vs'); please unify the notation. Also, 'fine-tuning' and 'finetuning' are used interchangeably; please choose one spelling.
- [Section V-A] The discussion of the authors' prior work [13] is brief and does not clearly delineate the novelty of the proposed scheme relative to [13]. Since the proposed framework closely resembles the multi-task LLM network in [13], the authors should explicitly state what is new in this paper beyond that prior work.
Circularity Check
No significant circularity: no claimed result reduces to its inputs; the sole self-citation is not load-bearing.
full rationale
This paper makes no derivation that reduces to its own inputs. The only equation used as a starting point is the beamforming structure w*_k = (I_N + sum_{k'} lambda_{k'}/sigma^2 h_{k'} h_{k'}^H)^{-1} h_k / ||...|| from [12], an external result in the deep-learning beamforming literature; the paper uses it to reparameterize the precoding output from the full matrix W to the coefficient vector lambda, which is a legitimate use of an external theoretical result rather than a self-referential fit. The LLM is trained on a training dataset and evaluated on separate validation and test datasets, so no fitted quantity is renamed as a prediction. The authors' prior work [13] (T. Zheng and L. Dai) is cited only in Section V-A as a future direction for multi-task networks; it is not used to justify the proposed architecture, the choice of GPT-2, or the reported performance gains, and therefore is not load-bearing. The empirical claims are presented without numerical values in Fig. 4, which is a verifiability and evidence limitation, not a circularity. Accordingly, the paper receives a circularity score of 0.
Assumptions & free parameters
free parameters (2)
- Fine-tuned GPT-2 weights (addition and LayerNorm layers) =
not disclosed
- Training hyperparameters (0.0001 learning rate, batch size 100, 500 epochs) =
0.0001, 100, 500
assumptions (3)
- domain assumption Near-field channels are described by a spherical-wave model parameterized by angle and distance, with the Rayleigh distance marking the near-field boundary.
- standard math The optimal downlink beamforming vectors for spectrum efficiency maximization have the normalized form given in reference [12], so learning lambda and the power allocation p suffices.
- ad hoc to paper A text-pretrained GPT-2 with self-attention and MLP layers frozen can encode raw complex channel information after generic preprocessing and transfer to wireless classification and precoding tasks.
Cite this review
Pith. "Pith review of Empowering Near-Field Communications in Low-Altitude Economy with LLM: Fundamentals, Potentials, Solutions, and Future Directions." pith.science (2026). https://pith.science/paper/FWMQ6BUI
@misc{pith2026250617067,
author = {Pith},
title = {Pith review of: Empowering Near-Field Communications in Low-Altitude Economy with LLM: Fundamentals, Potentials, Solutions, and Future Directions},
year = {2026},
howpublished = {\url{https://pith.science/paper/FWMQ6BUI}},
note = {Machine review of arXiv:2506.17067}
}
read the original abstract
The low-altitude economy (LAE) is gaining significant attention from academia and industry. Fortunately, LAE naturally aligns with near-field communications in extremely large-scale MIMO (XL-MIMO) systems. By leveraging near-field beamfocusing, LAE can precisely direct beam energy to unmanned aerial vehicles, while the additional distance dimension boosts overall spectrum efficiency. However, near-field communications in LAE still face several challenges, such as the increase in signal processing complexity and the necessity of distinguishing between far and near-field users. Inspired by the large language models (LLM) with powerful ability to handle complex problems, we apply LLM to solve challenges of near-field communications in LAE. The objective of this article is to provide a comprehensive analysis and discussion on LLM-empowered near-field communications in LAE. Specifically, we first introduce fundamentals of LLM and near-field communications, including the key advantages of LLM and key characteristics of near-field communications. Then, we reveal the opportunities and challenges of near-field communications in LAE. To address these challenges, we present a LLM-based scheme for near-field communications in LAE, and provide a case study which jointly distinguishes far and near-field users and designs multi-user precoding matrix. Finally, we outline and highlight several future research directions and open issues.
Figures
Forward citations
Cited by 1 Pith paper
-
Large Language Models for Next-Generation Wireless Network Management: A Survey and Tutorial
A survey and tutorial that organizes LLM-enabled wireless network optimization into formulation, solution, and verification stages, with case studies drawn from the authors' own prior papers.
Reference graph
Works this paper leans on
-
[13]
Large language model enabled multi-task physical layer network,
T. Zheng and L. Dai, “Large language model enabled multi-task physical layer network,”arXiv:2412.20772, 2024
arXiv 2024
-
[12]
A deep learning framework for optimization of MISO downlink beam- forming,
W. Xia, G. Zheng, Y . Zhu, J. Zhang, J. Wang, and A. P. Petropulu, “A deep learning framework for optimization of MISO downlink beam- forming,”IEEE Trans. Commun., vol. 68, no. 3, pp. 1866–1880, 2020
work page 2020
-
[1]
Sensing capacity for integrated sensing and communication systems in low-altitude economy,
J. Wan, H. Ren, C. Pan, Z. Zhang, S. Gao, Y . Yu, and C. Wang, “Sensing capacity for integrated sensing and communication systems in low-altitude economy,”IEEE Commun. Lett., 2025
work page 2025
-
[2]
Cooperative ISAC-empowered low-altitude economy,
J. Tang, Y . Yu, C. Pan, H. Ren, D. Wang, J. Wang, and X. You, “Cooperative ISAC-empowered low-altitude economy,”IEEE Trans. Wireless Commun., vol. 24, no. 5, pp. 3837–3853, May 2025
work page 2025
-
[3]
Accessing from the sky: A tutorial on UA V communications for 5G and beyond,
Y . Zeng, Q. Wu, and R. Zhang, “Accessing from the sky: A tutorial on UA V communications for 5G and beyond,”Proc. IEEE, vol. 107, no. 12, pp. 2327–2375, Dec. 2019. 7
work page 2019
-
[4]
A tutorial on extremely large-scale MIMO for 6G: Fundamentals, signal processing, and applications,
Z. Wang, J. Zhang, H. Du, D. Niyato, S. Cui, B. Ai, M. Debbah, K. B. Letaief, and H. V . Poor, “A tutorial on extremely large-scale MIMO for 6G: Fundamentals, signal processing, and applications,”IEEE Commun. Surv. Tutor., 2024
work page 2024
-
[5]
A tutorial on near-field XL-MIMO communications towards 6G,
H. Lu, Y . Zeng, C. You, Y . Han, J. Zhang, Z. Wang, Z. Dong, S. Jin, C.-X. Wang, T. Jianget al., “A tutorial on near-field XL-MIMO communications towards 6G,”IEEE Commun. Surv. Tutor., 2024
work page 2024
-
[6]
Beam focusing for near-field multiuser MIMO communications,
H. Zhang, N. Shlezinger, F. Guidi, D. Dardari, M. F. Imani, and Y . C. Eldar, “Beam focusing for near-field multiuser MIMO communications,” IEEE Trans. Wireless Commun., vol. 21, no. 9, pp. 7476–7490, Sep. 2022
2022
Show all 15 references
-
[7]
Large language model enhanced multi-agent systems for 6G communications,
F. Jiang, Y . Peng, L. Dong, K. Wang, K. Yang, C. Pan, D. Niyato, and O. A. Dobre, “Large language model enhanced multi-agent systems for 6G communications,”IEEE Wireless Commun., vol. 31, no. 6, pp. 48–55, Dec. 2024
2024
-
[8]
A comprehensive survey of large AI models for future communications: Foundations, applications and challenges,
F. Jiang, C. Pan, L. Dong, K. Wang, M. Debbah, D. Niyato, and Z. Han, “A comprehensive survey of large AI models for future communications: Foundations, applications and challenges,”arXiv:2505.03556, 2025
2025 arXiv
-
[9]
Prompt-enabled large AI models for CSI feedback,
J. Guo, Y . Cui, C.-K. Wen, and S. Jin, “Prompt-enabled large AI models for CSI feedback,”arXiv:2501.10629, 2025
2025 arXiv
-
[10]
Mixed near-and far- field communications for extremely large-scale array: An interference perspective,
Y . Zhang, C. You, L. Chen, and B. Zheng, “Mixed near-and far- field communications for extremely large-scale array: An interference perspective,”IEEE Commun. Lett., vol. 27, no. 9, pp. 2496–2500, Sep. 2023
2023
-
[11]
Language models are unsupervised multitask learners,
R. K. Alec, J. Wu, R. Child, D. Luan, D. Amodei, and I. Sutskever, “Language models are unsupervised multitask learners,”OpenAI blog, vol. 1, no. 8, p. 9, 2019
2019
-
[14]
Multi-modal generative AI: Multi- modal LLM, diffusion and beyond,
H. Chen, X. Wang, Y . Zhou, B. Huang, Y . Zhang, W. Feng, H. Chen, Z. Zhang, S. Tang, and W. Zhu, “Multi-modal generative AI: Multi- modal LLM, diffusion and beyond,”arXiv:2409.14993, 2024
2024
-
[15]
Generative AI-enabled wireless communications for robust low-altitude economy networking,
C. Zhao, J. Wang, R. Zhang, D. Niyato, G. Sun, H. Du, D. I. Kim, and A. Jamalipour, “Generative AI-enabled wireless communications for robust low-altitude economy networking,”arXiv:2502.18118, 2025. Zhuo Xuis currently an M.S. student in the Department of Electronic Engineerin...
2025 arXiv
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.