REVIEW 3 major objections 4 minor 19 references
Input-Correlated Supervision Noise Limits the Benefits of OTA Training for Learned Receivers
T0 review · 3 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read The paper shows that increasing over-the-air training data monotonically improves an end-to-end neural receiver, but degrades a neural channel estimator past an optimum because its labels inherit noise from the input.
desk verdict A careful OTA measurement study showing a real asymmetry between end-to-end and channel-estimator receivers as OTA fraction increases, with a plausible but not fully pinned-down causal mechanism. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the OTA channel-label construction $H^{\mathrm{gt}}_{ij}=y_{ij}/x_{ij}$, which extends the least-squares pilot estimate to the full time-frequency grid. Its error term $n_{ij}/x_{ij}$ shares the noise realization with the network input $Y$, so under MSE training the estimator converges to the conditional expectation of the label given the input and retains a bias that extra data cannot remove; this is what the paper calls input-correlated supervision noise. The controlled intervention is the same separable time-frequency average used by decision-directed estimation (kernels $k_f=5$, $k_t=3$), applied to the labels only while input, architecture, and optimization stay fixed. That isolates the supervision mechanism from measurement diversity.
What would settle it
A decisive test: in a simulator with unlimited samples, corrupt synthetic channel labels as $H + \alpha n/x$ with the same noise realization $n$ that appears in the input, and sweep $\alpha$ from 0 (independent noise) to 1 (fully correlated). If the fully correlated case reproduces the channel estimator's peak-and-degrade pattern at high OTA fractions and the independent case does not, the paper's mechanism is confirmed; if both degrade equally, the cause is elsewhere.
Extended reading notes
Core claim
The central claim is that OTA training data is not uniformly beneficial: it consistently helps an end-to-end receiver (CM DeepRx) while limiting a capacity-matched channel estimator (ACM-E) at high measured-data fractions. The paper attributes this asymmetry to input-correlated supervision noise. At each resource element, the OTA channel label is $H^{\mathrm{gt}}_{ij}=y_{ij}/x_{ij}=H_{ij}+n_{ij}/x_{ij}$, where $n_{ij}$ is the same noise realization already present in the input $Y$. Because the MSE optimum is the conditional expectation of the target given the input, the correlated error term contributes a non-zero bias that does not vanish as the dataset grows. Bit-level supervision from CRC-validated decoded bits does not inherit input noise, so the end-to-end receiver keeps improving with OTA fraction. A controlled experiment that denoised the channel labels with separable time-frequency smoothing removed most of the high-OTA degradation, confirming that input-correlated supervision noise, not limited data diversity, is responsible.
Load-bearing premise
The load-bearing premise, stated in Sec. III-D, is that CRC-validated decoded bits are effectively error-free supervision: residual undetected decoding errors are assumed negligible, so the end-to-end bit targets do not inherit input-correlated noise.
Editorial extensions
If this is right
- End-to-end neural receivers trained on measured data should be trained with the largest available OTA fraction; the paper observed monotonic improvement through $p_m=100\%$.
- Neural channel estimators should be trained with moderate OTA fractions (about 40% in this study) and denoised labels; fully measured raw labels can underperform simulation-only training.
- Adding more OTA measurements cannot cure bias caused by input-correlated supervision noise; the fix is to change the target, not grow the dataset.
- When supervision targets must be derived from noisy observations, label denoising should be applied before training, for example the same smoothing used by decision-directed estimation.
- The same principle constrains any learned receiver stage whose target is a function of the received signal, not just channel estimators in OFDM.
Reading between the lines
- The same mechanism should bind any learned intermediate estimator whose target is constructed from the received signal, such as MIMO channel estimators using pilot-division labels; the paper notes MIMO is out of scope, but the argument does not rely on SISO-specific structure beyond the label construction.
- A testable extension: replacing noisy OTA channel labels with estimates from a separate clean reference pass, such as repeated pilot averaging or a second receiver chain, should push the optimal OTA fraction toward 100%, because the bias term would then be uncorrelated with the input.
- The paper's asymmetry suggests a design heuristic for future receiver pipelines: prefer bit-level or semantic supervision over intermediate physical quantities whenever the intermediate quantity is observed through the same noisy channel; alternatively, learn the intermediate quantity with a self-supervised objective that avoids noisy explicit targets.
- The optimal OTA fraction for channel estimators is likely deployment-dependent, but the qualitative shape of improvement followed by decline should transfer across architectures and frequencies; practitioners can probe it with a small denoising sweep rather than assuming more measurements are always better.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper reports a 5.88 GHz over-the-air (OTA) OFDM measurement campaign and uses it to train two learned receivers with controlled mixtures of measured and synthetic data: ACM-E, a neural channel estimator, and CM DeepRx, an end-to-end LLR receiver. The central empirical finding is an asymmetry: CM DeepRx improves monotonically as the OTA fraction increases, while ACM-E peaks at an intermediate OTA fraction and degrades at p_m = 100%. The paper attributes this to input-correlated supervision noise: OTA channel labels are constructed as y_ij/x_ij, so the label error shares the noise realization present in the network input, and the MSE objective converges to a conditional expectation that retains a bias (Eq. 6). A denoising experiment that smooths the OTA labels with the DDCE kernel is presented as confirming the mechanism. The paper concludes with practical guidance: end-to-end receivers benefit from fully measured training, whereas channel estimators require improved supervision quality rather than simply more OTA data.
Significance. If the causal claim holds, the paper gives the first systematic OTA evidence that the value of measured training data depends on the supervision target, and it identifies a mechanism—input-correlated supervision noise—that is distinct from the usual independent-label-noise setting. The measurement campaign is substantial, the experiments use five seeds with standard deviations on the headline metric, and the evaluation is on held-out OTA data, which is a clear strength. The theoretical argument in Sec. IV is a straightforward and correct application of the conditional-expectation property of MSE training, and the within-ACM-E denoising intervention changes only the target construction. These strengths make the paper a useful contribution to the practical literature on training learned receivers with real-world data, provided the causal attribution is supported or appropriately qualified.
major comments (3)
- [Sec. V-C] The denoising experiment does not uniquely identify input-correlated supervision noise as the cause of the high-OTA degradation. Smoothing the label y_ij/x_ij with the DDCE kernel simultaneously (i) reduces the variance of the label noise regardless of whether that noise is correlated with the input, (ii) introduces a bias relative to the true channel, and (iii) acts as a regularizer against overfitting to the fixed pool of roughly 44,000 measured slots, which is increasingly re-used as p_m grows. Equation (6) proves that in the infinite-data limit correlated label noise leaves a residual bias, but the experiments do not approach that limit and do not show that more unique OTA data at p_m = 100% fails to close the gap. A control that corrupts synthetic labels with independent noise of the same variance, or one that compares smoothed correlated versus smoothed independent noise at matched variance, is needed to support the abstract's causal claim that the correlation, rather than limited data diversity or finite-data overfitting, caused the degradation.
- [Sec. III-D] The claim that CRC-validated decoded bits provide 'effectively error-free' supervision rests on an unquantified assumption: the paper discards the fewer than 1% of slots failing CRC, but it does not bound the rate of undetected decoding errors in accepted frames. If residual undetected errors are non-negligible, CM DeepRx's bit targets would also carry input-correlated noise, and the asymmetry attributed to the supervision objective would be confounded. Please provide an estimate of the residual post-CRC frame error probability, for example by re-encoding and re-modulating decoded bits and comparing with the received signal on held-out data, or explain quantitatively why code rate 0.25 combined with CRC makes this assumption safe.
- [Sec. III-C] The statement that comparing architectures at similar parameter counts 'isolates the benefit of end-to-end optimization from differences in model size' is stronger than the evidence supports. CM DeepRx has 475K parameters versus 412K for ACM-E (about 15% more), roughly 1.9 times the MFLOPs, and a different architecture family and inductive bias. The cross-architecture asymmetry could therefore be influenced by architecture rather than purely by the supervision objective. The within-ACM-E denoising experiment does control architecture, but the headline comparison of 'capacity-matched' models should either be softened or supplemented by a sensitivity analysis over parameter count or latent dimension.
minor comments (4)
- [Sec. V-B / Table IV] At the headline operating point, the raw-OTA degradation of ACM-E is small: the required SINR at BER = 10^-2 is 16.07 dB at p_m = 100% versus 15.86 dB at p_m = 0%, a 0.21 dB gap. This is significant relative to the standard deviations reported, but the practical magnitude should be stated more explicitly so that readers can calibrate the 'degradation' claim.
- [Sec. IV] The notation 'E[H_ij | Y] + E[n_ij/x_ij | Y]' in Eq. (6) is correct, but the sentence 'the label error shares the same realization of measurement noise as the input' could be misread as saying the error is exactly n_ij; it is n_ij/x_ij, which is known only up to the transmitted symbol. A brief clarifying remark that x_ij is known at training time would improve readability.
- [Sec. V-C] The phrase 'controlled denoising experiment' is potentially misleading because the intervention changes the variance and bias of the target in addition to the correlation structure; consider renaming it a 'target-smoothing experiment' or explicitly listing the three confounded effects.
- [References] Reference [12] is typeset as 'AI - Based' with an unintended space; this should be corrected.
Circularity Check
No significant circularity: Eq. (6) is a direct conditional-expectation identity, and the denoising experiment is an independent manipulation rather than a fitted re-statement.
full rationale
The paper's central claim is not circular. Section IV derives the residual bias from the definition of the OTA label H^gt_ij = y_ij/x_ij = H_ij + n_ij/x_ij and the standard MSE property that the minimizer is the conditional expectation E[H^gt|Y]. This is a mathematical identity with no fitted parameters, and the statement that additional data cannot remove the conditional-mean bias follows from the identity rather than from the experimental results. The observed asymmetry between CM DeepRx and ACM-E is measured, and the Sec. V-C denoising experiment changes only the target construction while keeping input, architecture, and optimization fixed, so the mechanism claim is not equivalent to its inputs. The only self-citation, [12], is used to motivate the topic and is not load-bearing; no uniqueness theorem or ansatz is imported from prior author work. The skeptic's concern that smoothing also reduces label-noise variance and acts as regularization is a possible threat to causal uniqueness, but that is a validity confound, not a circularity, and does not affect the self-contained derivation. No circular step is identified.
Assumptions & free parameters
free parameters (3)
- DDCE/denoising smoothing kernel sizes (kf, kt) =
5, 3
- ACM-E encoder width d and depthwise kernel sizes =
d=128, Kt=3, Kf=5
- CM DeepRx hidden dimension d and number of blocks L =
d=256, L=6
assumptions (4)
- standard math The MSE-optimal predictor equals the conditional expectation of the target given the input, E[H^gt|Y].
- domain assumption OTA channel labels H^gt = y/x are unbiased for the true channel, with label error correlated with the input Y through the shared noise realization.
- domain assumption CRC-validated decoded bits are effectively error-free, making bit supervision independent of the input noise.
- domain assumption The conditional expectation of the label-error term n/x given Y is non-zero under OTA measurement.
Cite this review
Pith. "Pith review of Input-Correlated Supervision Noise Limits the Benefits of OTA Training for Learned Receivers." pith.science (2026). https://pith.science/paper/L4ZO6JB4
@misc{pith2026260812918,
author = {Pith},
title = {Pith review of: Input-Correlated Supervision Noise Limits the Benefits of OTA Training for Learned Receivers},
year = {2026},
howpublished = {\url{https://pith.science/paper/L4ZO6JB4}},
note = {Machine review of arXiv:2608.12918}
}
read the original abstract
While learned wireless receivers are typically studied using synthetic data, the impact of over-the-air (OTA) measurements for training remains unclear. We conducted a 5.88 GHz measurement campaign with a 5G/6G-like orthogonal frequency-division multiplexing (OFDM) system across diverse environments and mobility conditions, and trained a neural channel estimator and a capacity-matched end-to-end neural receiver using mixtures of measured and synthetic data. Increasing the OTA fraction revealed a fundamental asymmetry: measured data consistently improved the end-to-end receiver, whereas the channel estimator peaked at an intermediate fraction and degraded with fully measured training. We showed that this difference arises from the supervision target: OTA channel labels are derived from noisy received signals and therefore contain supervision errors correlated with the receiver input, whereas decoded bits validated by a cyclic redundancy check (CRC) provide effectively error-free supervision. A controlled denoising experiment confirmed that this correlation, rather than limited data diversity, caused the degradation. These results provide practical guidance for training learned receivers with OTA data: end-to-end receivers benefit from fully measured training, whereas channel estimators benefit from moderate OTA fractions but require improved label quality, e.g. via denoising, to unlock further gains.
Figures
Reference graph
Works this paper leans on
-
[1]
A neural network based channel estimation scheme for OFDM system,
K. Hiray and K. V . Babu, “A neural network based channel estimation scheme for OFDM system,” in2016 International Conference on Communication and Signal Processing (ICCSP). Melmaruvathur, Tamilnadu, India: IEEE, Apr. 2016, pp. 0438–0441
work page 2016
-
[2]
A Low Complexity Learning-Based Channel Estimation for OFDM Systems With Online Training,
K. Meiet al., “A Low Complexity Learning-Based Channel Estimation for OFDM Systems With Online Training,”IEEE Transactions on Communications, vol. 69, no. 10, pp. 6722–6733, Oct. 2021
work page 2021
-
[3]
DeepRx: Fully Convolutional Deep Learning Receiver,
M. Honkala, D. Korpi, and J. M. J. Huttunen, “DeepRx: Fully Convolutional Deep Learning Receiver,”IEEE Transactions on Wireless Communications, vol. 20, no. 6, pp. 3925–3940, Jun. 2021
work page 2021
-
[4]
HybridDeepRx: Deep Learning Receiver for High-EVM Signals,
J. Pihlajasaloet al., “HybridDeepRx: Deep Learning Receiver for High-EVM Signals,” 2021, version Number: 1
work page 2021
-
[5]
Study on 6G Scenarios and Requirements,
3GPP, “Study on 6G Scenarios and Requirements,” 3rd Generation Partnership Project, Technical Contribution TR 38.914, Version 20.0.0, 2026
work page 2026
-
[6]
Feature Lead summary on 6G waveform,
3GPP, “Feature Lead summary on 6G waveform,” inTSG RAN WG1 Meeting #122bis, vol. TDoc R1-2508043, 2025
work page 2025
-
[7]
Channel estimation techniques based on pilot arrangement in OFDM systems,
S. Coleriet al., “Channel estimation techniques based on pilot arrangement in OFDM systems,”IEEE Transactions on Broadcasting, vol. 48, no. 3, pp. 223–229, Sep. 2002
work page 2002
-
[8]
A comparison of pilot-aided channel estimation methods for OFDM systems,
M. Morelli and U. Mengali, “A comparison of pilot-aided channel estimation methods for OFDM systems,”IEEE Transactions on Signal Processing, vol. 49, no. 12, pp. 3065–3073, Dec. 2001
work page 2001
Show all 19 references
-
[9]
CD3-OFDM: a novel demodulation scheme for fixed and mobile receivers,
V . Mignone and A. Morello, “CD3-OFDM: a novel demodulation scheme for fixed and mobile receivers,”IEEE Transactions on Communications, vol. 44, no. 9, pp. 1144–1151, Sep. 1996
1996
-
[10]
A comparative study of iterative channel estimators for mobile ofdm systems,
F. Sanzi, S. Jelting, and J. Speidel, “A comparative study of iterative channel estimators for mobile ofdm systems,”IEEE Transactions on Wireless Communications, vol. 2, no. 5, pp. 849–859, Sep. 2003
2003
-
[11]
Multi-input multi-output fading channel tracking and equalization using Kalman estimation,
C. Komninakiset al., “Multi-input multi-output fading channel tracking and equalization using Kalman estimation,”IEEE Transactions on Signal Processing, vol. 50, no. 5, pp. 1065–1076, May 2002
2002
-
[12]
Adapting to Reality: Over-the-Air Validation of AI - Based Receivers Trained with Simulated Channels,
R. Luostariet al., “Adapting to Reality: Over-the-Air Validation of AI - Based Receivers Trained with Simulated Channels,” in2025 IEEE Wireless Communications and Networking Conference (WCNC), Milan, Italy, Mar. 2025, pp. 01–06
2025
-
[13]
T. F. Collinset al.,Software-defined radio for engineers, ser. Artech House mobile communications series. Boston London: Artech House, 2018
2018
-
[14]
Axial Attention in Multidimensional Transformers,
J. Hoet al., “Axial Attention in Multidimensional Transformers,” Dec. 2019, arXiv:1912.12180 [cs]
2019 arXiv
-
[15]
Patches Are All You Need?
A. Trockman and J. Z. Kolter, “Patches Are All You Need?” Jan. 2022, arXiv:2201.09792 [cs]
2022 arXiv
-
[16]
Deep Residual Learning for Image Recognition,
K. Heet al., “Deep Residual Learning for Image Recognition,” in 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV , USA, Jun. 2016, pp. 770–778
2016
-
[17]
Study on channel model for frequencies from 0.5 to 100 GHz,
3GPP, “Study on channel model for frequencies from 0.5 to 100 GHz,” Technical Specification (TS) TS 38.901, Sep. 2020
2020
-
[18]
Sionna: An Open-Source Library for Next-Generation Physical Layer Research,
J. Hoydiset al., “Sionna: An Open-Source Library for Next-Generation Physical Layer Research,” Mar. 2023, arXiv:2203.11854 [cs]
2023 arXiv
-
[19]
Classification in the Presence of Label Noise: A Survey,
B. Frenay and M. Verleysen, “Classification in the Presence of Label Noise: A Survey,”IEEE Transactions on Neural Networks and Learning Systems, vol. 25, no. 5, pp. 845–869, May 2014. 6
2014
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.