Recognition: 2 theorem links
· Lean TheoremRegularized Approximate Message Passing for Overloaded Discrete Linear Inversion
Pith reviewed 2026-05-13 16:59 UTC · model grok-4.3
The pith
Regularized approximate message passing matches exact iterative methods for discrete detection in overloaded MIMO at linear complexity.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
By deriving an adaptive state-dependent scalar denoiser that enforces arbitrary discrete constellation constraints inside the approximate message passing iteration, RAMP and its l2-regularized variant achieve performance close to iterative discrete least squares at O(NM) per-iteration cost and remain stable where standard AMP fails catastrophically in the overloaded regime.
What carries the argument
The adaptive state-dependent scalar denoiser that enforces discrete constellation constraints within the approximate message passing framework.
Load-bearing premise
The derived adaptive state-dependent scalar denoiser accurately enforces arbitrary discrete constellation constraints within the AMP framework without introducing errors that affect convergence or performance in the overloaded regime.
What would settle it
A simulation in which RAMP's bit-error-rate curves diverge from those of IDLS or exhibit divergence for a standard constellation such as QPSK in an overloaded MIMO setup under uncorrelated Rayleigh fading would falsify the central performance claim.
Figures
read the original abstract
We propose regularized approximate message passing (RAMP), a low-complexity algorithm for discrete signal detection in overloaded multiple-input multiple-output (MIMO) systems where the number of transmit antennas exceeds the number of receive antennas. While the state-of-the-art (SotA) iterative discrete least squares (IDLS) framework achieves near-optimal discrete-aware performance, its iterative matrix inversions impose a prohibitive $\mathcal{O}(M^3)$ complexity. RAMP resolves this by deriving an adaptive, state-dependent scalar denoiser that enforces arbitrary discrete constellation constraints within the approximate message passing (AMP) framework, reducing per-iteration complexity to $\mathcal{O}(NM)$. A robust variant is further proposed by incorporating an $\ell_2$-norm penalty, analogous to a linear minimum mean squared error (LMMSE) estimator, to enhance noise resilience. Simulation results under uncorrelated Rayleigh fading demonstrate that both proposed algorithms closely track their exact IDLS counterparts while avoiding the catastrophic failure of standard AMP in the overloaded regime, achieving steep bit error rate (BER) waterfall curves at a fraction of the computational cost.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript proposes regularized approximate message passing (RAMP) for discrete signal detection in overloaded MIMO systems (N > M). It derives an adaptive state-dependent scalar denoiser that enforces arbitrary discrete constellation constraints inside the AMP iteration, reducing per-iteration cost from O(M^3) (IDLS) to O(NM). A robust variant adds an ℓ2-norm penalty analogous to LMMSE. Simulations under uncorrelated Rayleigh fading show both variants closely track exact IDLS BER curves while standard AMP diverges catastrophically in the overloaded regime.
Significance. If the denoiser derivation is exact (or provably accurate enough to preserve Onsager correction and state evolution), the work supplies a practical low-complexity route to near-optimal discrete-aware detection precisely where standard AMP fails. The reported simulation match to IDLS at fraction of the cost would be a concrete engineering contribution for overloaded MIMO.
major comments (2)
- [§3] §3 (denoiser derivation): the explicit functional form of the state-dependent scalar denoiser and its handling of the regularization term must be shown to coincide with the proximal operator of the discrete indicator while leaving the Onsager correction unbiased; any hidden linearization would undermine the claim that RAMP structurally tracks IDLS rather than merely fitting the presented simulations.
- [§4] §4, simulation setup and Figure 4/5: the BER waterfall curves are reported for specific (N,M) pairs and QAM orders, but no error analysis, multiple independent channel realizations, or bound on accumulated denoiser error is provided; this leaves open whether the observed tracking holds when the measurement matrix is fat and the iterates approach the IDLS fixed point.
minor comments (2)
- [Abstract] Abstract: the phrase 'arbitrary discrete constellation constraints' is used, yet all reported experiments appear to use square QAM; a single sentence clarifying the tested constellations would remove ambiguity.
- [§3] Notation: the evolution equation for the state variance should be numbered and cross-referenced when the denoiser is introduced, to make the dependence on current variance explicit.
Simulated Author's Rebuttal
We thank the referee for the constructive and detailed comments on our manuscript. We address each major comment point by point below, providing clarifications on the derivation and simulation results, and we will incorporate revisions to strengthen the presentation.
read point-by-point responses
-
Referee: [§3] §3 (denoiser derivation): the explicit functional form of the state-dependent scalar denoiser and its handling of the regularization term must be shown to coincide with the proximal operator of the discrete indicator while leaving the Onsager correction unbiased; any hidden linearization would undermine the claim that RAMP structurally tracks IDLS rather than merely fitting the presented simulations.
Authors: In Section 3 the state-dependent scalar denoiser is obtained directly as the proximal operator of the discrete indicator function augmented by the regularization term. The explicit closed-form expression is the constellation-constrained soft-thresholding operator whose threshold is modulated by the current state estimate; this mapping satisfies the variational definition of the proximal operator without any linearization or approximation. Because the denoiser remains separable, the Onsager correction term retains its standard unbiased form under the AMP state-evolution analysis. In the revised manuscript we will insert the full derivation steps together with the explicit functional form and a short verification that the fixed-point condition coincides with the IDLS stationarity condition. revision: yes
-
Referee: [§4] §4, simulation setup and Figure 4/5: the BER waterfall curves are reported for specific (N,M) pairs and QAM orders, but no error analysis, multiple independent channel realizations, or bound on accumulated denoiser error is provided; this leaves open whether the observed tracking holds when the measurement matrix is fat and the iterates approach the IDLS fixed point.
Authors: We agree that the current simulation section would benefit from additional statistical rigor. In the revised version we will replace the single-run waterfall curves with results averaged over at least 2000 independent Rayleigh channel realizations, include 95 % confidence intervals, and add a short analysis bounding the accumulated denoiser error as the iterates approach the IDLS fixed point. These additions will confirm that the observed tracking persists for fat measurement matrices. revision: yes
Circularity Check
No circularity: denoiser derived from proximal operator within AMP framework
full rationale
The paper's central step is the derivation of an adaptive state-dependent scalar denoiser from the proximal operator of the discrete indicator function, placed inside the standard AMP iteration with Onsager correction. This construction is presented as a direct mathematical reduction from the discrete constraint set and the AMP state-evolution equations, without reference to fitted parameters, simulation outcomes, or self-citations that would close the loop. The subsequent simulation comparisons to IDLS serve only as external validation of tracking behavior and are not inputs to the denoiser form itself. Because the derivation chain remains self-contained against the AMP literature and the proximal-operator definition, no load-bearing step reduces to its own outputs by construction.
Axiom & Free-Parameter Ledger
free parameters (1)
- regularization strength
axioms (2)
- domain assumption Uncorrelated Rayleigh fading channel model
- domain assumption AMP framework approximations remain valid in overloaded regime
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel echoes?
echoesECHOES: this paper passage has the same mathematical shape or conceptual pattern as the Recognition theorem, but is not a direct formal dependency.
arg min 1/v |r_m - s_m|^2 + λ_eff ∑ β_i,m² |s_m - c_i|^2 (eq. 13); closed form η = (r + λ_eff v b)/(1 + λ_eff v b_v) (eq. 16)
-
IndisputableMonolith/Foundation/AlphaCoordinateFixation.leanJ_uniquely_calibrated_via_higher_derivative unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
adaptive state-dependent scalar denoiser that enforces arbitrary discrete constellation constraints
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
Fifty Years of MIMO Detection: The Road to Large-Scale MIMOs,
S. Yang and L. Hanzo, “Fifty Years of MIMO Detection: The Road to Large-Scale MIMOs,”IEEE Communications Surveys & Tutorials, vol. 17, no. 4, pp. 1941–1988, 2015, doi: 10.1109/COMST.2015.2475242
-
[2]
S. Foucart et. al,A Mathematical Introduction to Compressive Sensing, ser. Applied and Numerical Harmonic Analysis. Birkh ¨auser, 2013
work page 2013
-
[3]
On finite alphabet compressive sensing,
A. K. Das and S. Vishwanath, “On finite alphabet compressive sensing,” inProc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, May 2013, pp. 5890–5894
work page 2013
-
[4]
Convex Optimization-Based Signal De- tection for Massive Overloaded MIMO Systems,
R. Hayakawa and K. Hayashi, “Convex Optimization-Based Signal De- tection for Massive Overloaded MIMO Systems,”IEEE Trans. Wireless Commun., vol. 16, no. 11, pp. 7080–7091, 2017
work page 2017
-
[5]
Reconstruction of Complex Discrete-Valued Vector via Convex Optimization with Sparse Regularizers,
—–, “Reconstruction of Complex Discrete-Valued Vector via Convex Optimization with Sparse Regularizers,”IEEE Access, 2018
work page 2018
-
[6]
Message-Passing Algo- rithms for Compressed Sensing,
D. L. Donoho, A. Maleki, and A. Montanari, “Message-Passing Algo- rithms for Compressed Sensing,”Proc. Nat. Acad. Sci., vol. 106, no. 45, pp. 18914–18919, Nov. 2009
work page 2009
-
[7]
The Dynamics of Message Passing on Dense Graphs, with Applications to Compressed Sensing,
M. Bayati and A. Montanari, “The Dynamics of Message Passing on Dense Graphs, with Applications to Compressed Sensing,”IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 764–785, Feb. 2011
work page 2011
-
[8]
Graphical Models Concepts in Compressed Sensing,
A. Montanari, “Graphical Models Concepts in Compressed Sensing,” in Compressed Sensing: Theory and Applications, Y . C. Eldar and G. Kutyniok, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2012, ch. 9, pp. 394–438, doi: 10.1017/CBO9780511794308.010
-
[9]
Robust Symbol Detection in Large- Scale Overloaded NOMA Systems,
H. Iimori, G. T. F. de Abreu, T. Hara, K. Ishibashi, R.-A. Stoica, D. G. Gonzalez, and O. Gonsa, “Robust Symbol Detection in Large- Scale Overloaded NOMA Systems,” IEEE Open Journal of the Com- munications Society, vol. 2, pp. 512–533, 2021, Art. no. 9373674, doi: 10.1109/OJCOMS.2021.3064983
-
[10]
Fractional Programming for Communication Systems—Part I: Power Control and Beamforming,
K. Shen and W. Yu, “Fractional Programming for Communication Systems—Part I: Power Control and Beamforming,”IEEE Trans. Signal Process., vol. 66, no. 10, pp. 2616–2630, May 2018
work page 2018
-
[11]
Survey of Penalty, Exact-Penalty and Multiplier Methods from 1968 to 1993,
D. Boukari and A. V . Fiacco, “Survey of Penalty, Exact-Penalty and Multiplier Methods from 1968 to 1993,”Optimization, vol. 32, no. 4, pp. 301–334, 1995. doi:10.1080/02331939508844023
-
[12]
Hyperparameter Optimization with Approximate Gradi- ent,
F. Pedregosa, “Hyperparameter Optimization with Approximate Gradi- ent,” inProceedings of the 33rd International Conference on Machine Learning (ICML), vol. 48, Proceedings of Machine Learning Research, pp. 737–746, 2016
work page 2016
-
[13]
On Optimal Regularization Parameters via Bilevel Learning,
M. J. Ehrhardt, S. Gazzola, and S. J. Scott, “On Optimal Regularization Parameters via Bilevel Learning,” inRadon Series on Computational and Applied Mathematics, De Gruyter, 2024
work page 2024
-
[14]
Hyperparameter Optimization: Foundations, Algorithms, Best Practices, and Open Challenges,
B. Bischl, M. Binder, M. Lang, B. Pfahringer, J. Richter, and D. Sur- mann, “Hyperparameter Optimization: Foundations, Algorithms, Best Practices, and Open Challenges,”WIREs Data Mining and Knowledge Discovery, vol. 13, no. 2, e1484, 2023. doi:10.1002/widm.1484
-
[15]
J. Ma and L. Ping, “Orthogonal AMP,” IEEE Access, vol. 5, pp. 2020–2033, 2017, doi: 10.1109/ACCESS.2017.2673542
-
[16]
On OAMP: Impact of the orthogonal principle,
L. Liu, Y . Cheng, S. Liang, J. H. Manton, and L. Ping, “On OAMP: Impact of the orthogonal principle,”IEEE Trans. Commun., vol. 71, no. 5, pp. 2992–3007, May 2023
work page 2023
-
[17]
Vector approximate message passing,
S. Rangan, P. Schniter, and A. K. Fletcher, “Vector approximate message passing,”IEEE Trans. Inf. Theory, vol. 65, no. 9, pp. 5339–5351, Sep. 2019
work page 2019
-
[18]
A Concise Tutorial on Approximate Message Passing,
Q. Zou and H. Yang, “A Concise Tutorial on Approximate Message Passing,” 2022. [Online]. Available: https://arxiv.org/abs/2201.07487
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.