REVIEW 5 major objections 8 minor 3 cited by
Large Language Model-Based Semantic Communication System for Image Transmission
T0 review · 5 major / 8 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read This paper proposes transmitting images as short text captions generated by a vision-language model and regenerated by a diffusion model at the receiver, cutting transmitted data 4,250-fold while raising effective data rate.
desk verdict The 4250x compression claim is an artifact of comparing a caption to raw image bits; the system is an off-the-shelf integration whose evaluation doesn't support its headline numbers. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the text prompt as a semantic bottleneck: Algorithm 1 compresses an image into caption tokens through an autoregressive vision-language model, and Algorithm 2 embeds those tokens with a CLIP text encoder and regenerates an image through a denoising diffusion process. This pair converts bit errors in the channel into semantic errors, so a corrupted token changes a few letters of the caption while the overall meaning remains recoverable. The channel is a full OFDM chain with LDPC coding, 4-QAM, pilots, channel estimation, and equalization over the UMa model, which is what makes the data-size and rate numbers physically meaningful.
What would settle it
Take a set of images containing small task-critical details such as street signs, license plates, or fine-grained species, run the described LLaVA-to-Stable-Diffusion pipeline over the UMa channel at high SNR, and compare a downstream classifier's accuracy on the original images with its accuracy on the reconstructed ones. If accuracy drops substantially even though SSIM stays high, then the caption bottleneck does not preserve the semantic content that the claimed 4,250-fold compression is supposed to carry.
Extended reading notes
Core claim
The paper's central claim is that semantic content, not raw pixels, is what needs to cross a wireless channel, and that modern vision-language and generative models make this practical. The proposed system uses LLaVA as the semantic encoder: its image encoder and aligned text decoder produce a token-by-token prompt such as "A brown and white bird perched on a wooden post." At the receiver, a CLIP text encoder embeds the received prompt and Stable Diffusion generates an image conditioned on that embedding. Evaluated over a 28 GHz UMa channel with 60–120 km/h mobility, the prompt-based system transmits 4,250 times less data and achieves a higher effective data rate than the conventional LDPC-coded QAM-OFDM baseline, because it sends only the text that describes the image. At low SNR the semantic system has higher SSIM than the conventional one; at high SNR the conventional system has higher SSIM, which the authors attribute to the unavoidable variation in generative reconstruction.
Load-bearing premise
The promised gain rests on the assumption that a short caption is a faithful enough stand-in for the image's meaning, so that an image regenerated from the caption is an acceptable substitute for the original; the paper never validates this against a task, a human reader, or an external semantic ground truth.
Editorial extensions
If this is right
- If the caption bottleneck is accepted, image delivery over 6G links can be planned in terms of hundreds of bytes per image rather than megabytes, shifting bandwidth budgets from source coding to semantic coding.
- The system's robustness at low SNR means a corrupted caption still yields a recognizable image, so link-budget margins for image traffic could be relaxed compared with bit-exact transmission.
- Because the semantic decoder always regenerates something, there is an inherent ceiling on pixel-level fidelity at high SNR; applications that need exact images would keep conventional transmission, while meaning-oriented applications would use the semantic pipeline.
- The paper positions the same LLM-based semantic coding as extendable to other data modalities, making language the common representation across future intelligent communicating nodes.
Reading between the lines
- Beyond the paper's claims, the 4,250-fold ratio compares a lossy semantic description against a bit-exact source; a fair engineering comparison would also count the bits an application actually consumes, so the ratio may be smaller for tasks that need fine-grained details such as text inside the image.
- A reader might test the semantic-fidelity claim by replacing SSIM with task-level metrics: if the caption omits a stop sign's text or a vehicle's license plate, a downstream detector on the reconstructed image would fail while SSIM looks acceptable.
- The prompt itself is a high-level description, so the scheme implicitly converts image transmission into a text-understanding problem; this suggests a possible extension where the same channel carries editing instructions such as "same scene at night" rather than the original caption, turning the link into a generative image-editing channel.
- Because the receiver's diffusion model is fixed and pretrained, the system's low-SNR robustness is partly a property of the generative prior rather than of the wireless chain; a different receiver prior would shift the SNR at which the semantic and conventional curves cross.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes an end-to-end OFDM-based semantic communication system for image transmission. At the transmitter, a LLaVA-based semantic encoder converts an image into a short text prompt; after LDPC coding, QAM modulation, and OFDM transmission over a 3GPP Urban Macro-cell channel model, the receiver decodes the prompt and uses a CLIP text encoder together with Stable Diffusion to regenerate an image. The authors report SSIM and BLEU results versus SNR and claim a 4250-fold reduction in transmitted data size (5.916 Mb to 1.392 Kb) together with a higher effective data rate (23.05 Mbps vs. 19.34 Mbps) than a conventional communication method.
Significance. If the claims were supported, the work would be a potentially interesting demonstration that LLM-generated captions can serve as the semantic source representation for image transmission over realistic channels, achieving compression far beyond conventional source coding. The use of a 3GPP UMa channel model rather than only AWGN, the end-to-end integration of a full physical-layer chain, and the reliance on public tools (Sionna, LLaVA, Stable Diffusion) are all strengths that make the system reproducible in principle. However, the current evidence does not establish the central claims: the evaluation rests on a single illustrative image, no test corpus or error bars are reported, the conventional baseline is not defined, and the adopted metrics (SSIM, and BLEU measured against the encoder's own prompt) do not measure semantic fidelity or task utility. The headline compression ratio conflates source substitution (sending a caption instead of pixels) with compression, so the quantitative claims are not yet credible.
major comments (5)
- [Section IV, Table II] The evaluation reports no dataset, no number of test images, no confidence intervals, and no description of how the SSIM and BLEU curves in Figs. 2 and 3 are averaged. The only concrete example is a single bird image in Fig. 4. Without a defined test corpus and protocol, the central quantitative claims (4250x data reduction and 23.05 vs. 19.34 Mbps) are not reproducible, and the reported curves cannot be meaningfully assessed.
- [Section IV, Table II and Fig. 2] The 'conventional communication' baseline is never specified. If it transmits the raw uncompressed image, then the 4250x ratio compares a text caption to raw pixels and is not a source-compression ratio; if it uses a compressed format or a learned codec, that must be stated and the comparison must be made at equal end-to-end rate. The manuscript also does not state the SNR at which the effective data rates in Table II are computed, even though the success-rate factor S = Bs/Bt presumably depends on the operating SNR.
- [Section IV, Fig. 3] The BLEU score is computed between the received prompt and the prompt generated by the semantic encoder at the transmitter, which is part of the system under test rather than an external ground truth. A high BLEU score therefore only shows that the wireless channel delivered the transmitted caption with few errors; it says nothing about whether the caption faithfully represents the image content. A task-oriented metric (e.g., retrieval, classification, caption-based QA) or human judgment of semantic preservation is needed to validate the semantic representation.
- [Section IV, Figs. 2 and 4] SSIM is used as the main reconstruction metric, but the decoder deliberately generates a new image from a text description, so pixel-level similarity to the original is not the appropriate notion of fidelity. The authors acknowledge this variation, yet the claimed 'superior' low-SNR performance is an artifact of comparing a generated image with the original using a metric that the pipeline is structurally unable to maximize. The example in Fig. 4 at SNR=3.3 dB actually shows loss of the wooden post in both the prompt and the reconstructed image, which is a semantic content error; treating this as a successful reconstruction is not justified.
- [Section IV, Effective Data Rate] The definitions of Bs, Bt, N, and Tsymbol are not tied to the numerical values in Table II. The table reports data sizes of 1.392 Kb and 5.916 Mb and rates of 23.05 and 19.34 Mbps, but the manuscript does not show how the success rates and the total transmission time T were obtained for each system, nor how many OFDM symbols were used for the conventional transmission. Without these details, the comparison in Table II cannot be verified.
minor comments (8)
- [Abstract and Section III-B] The paper repeatedly describes the receiver as an 'LLM-based semantic decoder', but Section III-B shows that the decoder is a CLIP text encoder plus Stable Diffusion; the wording should be corrected for consistency.
- [Section II-A, Eq. (4)] The quantity Hse(X̂) is introduced as the entropy of the reconstructed data, but the notation and the surrounding explanation are not sufficient to connect it to the semantic channel capacity formula; moreover, this theoretical framework is not used in the experimental section.
- [Section IV, Fig. 3] The figure label says 'BLUE score' instead of 'BLEU score'.
- [Section IV] There are numerous typos and grammar errors, including 'recontacted image quality', 'the semantic information prompt was successfully recovered', 'wnoden p st', 'provinding', and 'by by'; the manuscript should be carefully proofread.
- [Algorithm 1] The functions EnI, Enp, Align, and Autoreg are not specified; since the implementation is based on LLaVA, the manuscript should state the exact model version, prompt template, and alignment mechanism used.
- [Table I] The table gives subcarrier spacing and the number of OFDM symbols but not the total transmission time T; stating T would make the data-rate calculation in Table II directly verifiable.
- [Related Work and Section IV] The paper cites several semantic communication systems but provides no quantitative comparison against any of them (e.g., DeepJSCC or other image-oriented semantic communication baselines); a comparison table would help position the contribution.
- [Fig. 4] The reconstructed images referenced as ①, ②, ③, and ④ in the text are not clearly identified in the figure caption, and the caption does not state which panel corresponds to which SNR; please clarify.
Circularity Check
No significant circularity: the compression and data-rate figures are arithmetic, and the image-quality metric uses an external reference.
full rationale
The paper's central claims are arithmetic or externally benchmarked, not derived from their own outputs. The 4250x data-size reduction is a ratio of the measured bit counts in Table II (1.392 Kb vs 5.916 Mb) and is therefore a definitional accounting of the two payloads, not a fitted prediction. The SSIM evaluation in Fig. 2 compares the reconstructed image to the original transmitted image, an external reference outside the system's own encoder output. The BLEU comparison in Fig. 3 measures how faithfully the OFDM/LDPC channel delivered the semantic encoder's prompt; although this does not validate the caption as a sufficient semantic representation, it is a standard channel-fidelity check analogous to BER, not a circular derivation. No parameter is fitted to the test data, no uniqueness theorem is imported from the authors' prior work, and no load-bearing premise is justified solely by self-citation; the self-citations [3, 5, 8, 9] appear only as background. The paper's genuine weakness, namely that the semantic sufficiency of a LLaVA caption is asserted rather than validated against task-oriented or human ground truth, is a validity and correctness concern, not a circularity of the derivation chain.
Assumptions & free parameters
assumptions (4)
- domain assumption Semantic entropy and semantic channel capacity formulas (Eqs. 1-4) from [20] and [22] are assumed correct.
- domain assumption Pre-trained LLaVA, CLIP, and Stable Diffusion models perform the semantic encoding and decoding functions as claimed.
- domain assumption The conventional communication baseline transmits the full image without source compression.
- ad hoc to paper SSIM between the original and generated image is an appropriate measure of semantic communication quality.
Cite this review
Pith. "Pith review of Large Language Model-Based Semantic Communication System for Image Transmission." pith.science (2026). https://pith.science/paper/R3ZVZLGM
@misc{pith2026250112988,
author = {Pith},
title = {Pith review of: Large Language Model-Based Semantic Communication System for Image Transmission},
year = {2026},
howpublished = {\url{https://pith.science/paper/R3ZVZLGM}},
note = {Machine review of arXiv:2501.12988}
}
read the original abstract
The remarkable success of Large Language Models (LLMs) in understanding and generating various data types, such as images and text, has demonstrated their ability to process and extract semantic information across diverse domains. This transformative capability lays the foundation for semantic communications, enabling highly efficient and intelligent communication systems. In this work, we present a novel OFDM-based semantic communication framework for image transmission. We propose an innovative semantic encoder design that leverages the ability of LLMs to extract the meaning of transmitted data rather than focusing on its raw representation. On the receiver side, we design an LLM-based semantic decoder capable of comprehending context and generating the most appropriate representation to fit the given context. We evaluate our proposed system under different scenarios, including Urban Macro-cell environments with varying speed ranges. The evaluation metrics demonstrate that our proposed system reduces the data size 4250 times, while achieving a higher data rate compared to conventional communication methods. This approach offers a robust and scalable solution to unlock the full potential of 6G connectivity.
Figures
Forward citations
Cited by 3 Pith papers
-
Large-Scale Model Enabled Semantic Communication Based on Robust Knowledge Distillation
A framework that combines neural architecture search and knowledge distillation to compress a ViT-B/16 teacher into a compact, channel-robust semantic encoder for image classification.
-
AI Reasoning for Wireless Communications and Networking: A Survey and Perspectives
A survey that organizes LLM and AI reasoning methods into a taxonomy and maps them onto the physical, link, network, transport, and application layers of wireless networks.
-
From Large AI Models to Agentic AI: A Tutorial on Future Intelligent Communications
This paper is a broad tutorial on applying LAMs and agentic AI to 6G, largely restating existing research rather than introducing new results.
Reference graph
Works this paper leans on
- [1]
-
[2]
& Others On the road to 6G: Visions, requirements, key technologies, and testbeds
Wang, C., You, X., Gao, X., Zhu, X., Li, Z., Zhang, C., Wang, H., Huang, Y ., Chen, Y ., Haas, H. & Others On the road to 6G: Visions, requirements, key technologies, and testbeds. IEEE Communications Surveys & Tutorials . 25, 905-974 (2023)
work page 2023
-
[3]
Ribouh, S., Sadli, R., Elhillali, Y ., Rivenq, A. & Hadid, A. Vehicular Environment Identification Based on Channel State Information and Deep Learning. Sensors. 22, 9018 (2022)
work page 2022
-
[4]
Study on Artificial Intelligence (AI)/Machine Learn- ing (ML) for NR Air Interface RAN,
3GPP Release 18, “Study on Artificial Intelligence (AI)/Machine Learn- ing (ML) for NR Air Interface RAN,” Meeting #112, Athens, Greece, Tech. Rep., 27th February – 3rd March 2023
2023
-
[5]
Ribouh, S., Elhillali, Y . & Rivenq, A. Multiple sequential constraint removal algorithm for channel estimation in vehicular environment. 2020 International Symposium On Networks, Computers And Communications (ISNCC). pp. 1-7 (2020)
work page 2020
- [6]
- [7]
-
[8]
& Hadid, A
Ribouh, S. & Hadid, A. Is Semantic Communication for Autonomous Driving Secured against Adversarial Attacks?. 2024 IEEE 6th Interna- tional Conference On AI Circuits And Systems (AICAS) . pp. 139-143 (2024)
2024
Show all 28 references
-
[9]
& Hadid, A
Ribouh, S. & Hadid, A. SEECAD: Semantic End-to-End Communication for Autonomous Driving. 2024 IEEE Intelligent V ehicles Symposium (IV). pp. 1808-1813 (2024)
2024
-
[10]
& You, X
Jiang, F., Peng, Y ., Dong, L., Wang, K., Yang, K., Pan, C. & You, X. Large ai model-based semantic communications. IEEE Wireless Commu- nications. 31, 68-75 (2024)
2024
-
[11]
& Kim, S
Nam, H., Park, J., Choi, J., Bennis, M. & Kim, S. Language-oriented communication with semantic coding and knowledge distillation for text- to-image generation. ICASSP 2024-2024 IEEE International Conference On Acoustics, Speech And Signal Processing (ICASSP) . pp. 13506-13510 (2024)
2024
-
[12]
& Shi, G
Yang, M., Gao, D., Xie, F., Li, J., Song, X. & Shi, G. SG2SC: A generative semantic communication framework for scene understanding- oriented image transmission. ICASSP 2024-2024 IEEE International Conference On Acoustics, Speech And Signal Processing (ICASSP) . pp. 13486-13490 (2024)
2024
-
[13]
& Cai, K
Zheng, C. & Cai, K. GeNet: A Graph Neural Network-based Anti- noise Task-Oriented Semantic Communication Paradigm. ArXiv Preprint arXiv:2403.18296. (2024)
2024 arXiv
-
[14]
& Yin, C
Tong, H., Yang, Z., Wang, S., Hu, Y ., Saad, W. & Yin, C. Federated learning based audio semantic communication over wireless networks. 2021 IEEE Global Communications Conference (GLOBECOM) . pp. 1-6 (2021)
2021
-
[15]
& Qin, Z
Xie, H. & Qin, Z. A lite distributed semantic communication system for Internet of Things. IEEE Journal On Selected Areas In Communications . 39, 142-153 (2020)
2020
-
[16]
& Qin, Z
Weng, Z. & Qin, Z. Semantic communication systems for speech transmission. IEEE Journal On Selected Areas In Communications . 39, 2434-2444 (2021)
2021
-
[17]
& Leung, V
Zhang, W., Bai, K., Zeadally, S., Zhang, H., Shao, H., Ma, H. & Leung, V . Deepma: End-to-end deep multiple access for wireless image trans- mission in semantic communication. IEEE Transactions On Cognitive Communications And Networking . (2023)
2023
-
[18]
& Fernando, A
Lokumarambage, M., Gowrisetty, V ., Rezaei, H., Sivalingam, T., Ra- jatheva, N. & Fernando, A. Wireless end-to-end image transmission system using semantic communications. IEEE Access . (2023)
2023
-
[19]
https://www.atis.org/wp-content/uploads/3gpp docu- ments/Rel15/ATIS.3GPP.37.885.V1530.pdf
-
[20]
Qin, Z., Tao, X., Lu, J., Tong, W. & Li, G. Semantic communications: Principles and challenges. ArXiv Preprint arXiv:2201.01389 . (2021)
2021 arXiv
-
[21]
Sionna: An Open-Source Library for Next-Generation Physical Layer Research,
Hoydis, J., Cammerer, S., Ait Aoudia, F., Vem, A., Binder, N., Marcus, G., and Keller, A., “Sionna: An Open-Source Library for Next-Generation Physical Layer Research,” arxiv preprint arXiv:2203.11854, 2022
2022 arXiv
-
[22]
& Others An outline of a theory of semantic information
Carnap, R., Bar-Hillel, Y . & Others An outline of a theory of semantic information. (Research Laboratory of Electronics, Massachusetts Institute of Technology,1952)
1952
-
[23]
& Lee, Y
Liu, H., Li, C., Wu, Q. & Lee, Y . Visual instruction tuning. Advances In Neural Information Processing Systems . 36 (2024)
2024
-
[24]
An image is worth 16x16 words: Transformers for image recognition at scale
Dosovitskiy, A. An image is worth 16x16 words: Transformers for image recognition at scale. ArXiv Preprint arXiv:2010.11929 . (2020)
2020 arXiv
-
[25]
& Others Llama: Open and efficient foundation language models
Touvron, H., Lavril, T., Izacard, G., Martinet, X., Lachaux, M., Lacroix, T., Rozi`ere, B., Goyal, N., Hambro, E., Azhar, F. & Others Llama: Open and efficient foundation language models. arXiv 2023. ArXiv Preprint arXiv:2302.13971. 10 (2023)
2023 arXiv
-
[26]
& Others Learning trans- ferable visual models from natural language supervision
Radford, A., Kim, J., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., Clark, J. & Others Learning trans- ferable visual models from natural language supervision. International Conference On Machine Learning . pp. 8748-8763 (2021)
2021
-
[27]
& Ommer, B
Rombach, R., Blattmann, A., Lorenz, D., Esser, P. & Ommer, B. High- resolution image synthesis with latent diffusion models. Proceedings Of The IEEE/CVF Conference On Computer Vision And Pattern Recognition . pp. 10684-10695 (2022)
2022
-
[28]
& Abbeel, P
Ho, J., Jain, A. & Abbeel, P. Denoising diffusion probabilistic models. Advances In Neural Information Processing Systems . 33 pp. 6840-6851 (2020)
2020
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.