pith. sign in

arxiv: 2604.17853 · v1 · submitted 2026-04-20 · 📡 eess.SP

Symbol-Level Mask-Compliant Hybrid Precoding for Multi-User MIMO-OFDM Systems

Navid Reyhanian , Parisa Ramezani , Emil Bj\"ornson This is my paper

Pith reviewed 2026-05-10 04:36 UTC · model grok-4.3

classification 📡 eess.SP
keywords hybrid precodingMIMO-OFDMmmWaveblock coordinate descentspectral maskout-of-band emissionsphase errorssum MSE minimization
0
0 comments X

The pith

A block coordinate descent algorithm with closed-form solutions designs hybrid precoders and combiners to minimize sum MSE in multi-user MIMO-OFDM systems while satisfying transmit power, clipping, and out-of-band mask constraints.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper develops practical methods for hybrid digital and RF precoding in millimeter-wave multi-user MIMO systems that use OFDM to handle frequency-selective channels. It focuses on minimizing the total mean squared error experienced by users, taking into account real-world limitations such as phase errors in analog phase shifters, maximum transmit power, signal clipping at amplifiers, and regulatory out-of-band emission masks. To solve this difficult nonconvex problem, the authors introduce an MMSE-based block coordinate descent procedure that alternates between optimizing the transmitter precoders and the receiver combiners, deriving efficient closed-form expressions for each step. This approach allows scalable implementation and is shown through simulations to outperform existing benchmark designs in error performance while complying with all constraints.

Core claim

We investigate robust joint digital--RF precoder design for minimizing the downlink sum mean-squared error (MSE) in hybrid multi-user (MU) MIMO--OFDM systems subject to maximum transmit-power, clipping, and OOB spectral-mask constraints. The resulting optimization is nonconvex and challenging to solve. To address this, we develop a minimum mean-squared error (MMSE) based block coordinate descent (BCD) algorithm that alternates between updating the transmitter-side digital--RF precoders and the user-side digital--RF combiners. For each BCD subproblem, we propose computationally efficient and scalable, closed-form solution strategies suitable for practical implementation.

What carries the argument

MMSE-based block coordinate descent (BCD) algorithm that alternates between transmitter-side digital-RF precoder updates and user-side digital-RF combiner updates, supplying closed-form solutions for each subproblem.

If this is right

  • The algorithm yields lower downlink sum MSE compared to benchmark schemes under the same constraints.
  • The closed-form solutions make the method computationally efficient and scalable for practical deployment in wideband systems.
  • The designs satisfy the out-of-band spectral mask and clipping constraints while accounting for phase shifter errors.
  • The approach enables effective hybrid precoding in frequency-selective channels using OFDM.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • Similar alternating optimization strategies could be adapted to other constrained beamforming problems involving hardware impairments or different modulation formats.
  • If convergence to high-quality points holds across varied channel conditions, it may reduce reliance on exhaustive search or convex relaxation methods in system design.
  • Real-world testing with measured hardware impairments beyond the modeled phase errors could further validate and refine the precoder performance.

Load-bearing premise

The nonconvex joint optimization admits effective solutions via alternating BCD updates with closed-form expressions that converge to high-quality points, with the phase error, clipping, and OOB mask models accurately representing real hardware and regulatory behavior.

What would settle it

Numerical experiments where the proposed BCD algorithm fails to achieve lower sum MSE than a baseline method while meeting all constraints, or where the optimized precoders violate the OOB mask in time-domain simulations.

Figures

Figures reproduced from arXiv: 2604.17853 by Emil Bj\"ornson, Navid Reyhanian, Parisa Ramezani.

Figure 1
Figure 1. Figure 1: Convergence and performance of the proposed scheme. (a) Convergence of the proposed BCD approach. (b) Average [PITH_FULL_IMAGE:figures/full_fig_p011_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: PSD of the transmitted 20-MHz-bandwidth OFDM symbol at antenna 1 for 5 different masks. [PITH_FULL_IMAGE:figures/full_fig_p012_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: (a) In-band/out-of-band emitted power and the average per-subcarrier sum-MSE for 5 different masks. (b) Per-subcarrier [PITH_FULL_IMAGE:figures/full_fig_p012_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Average per-subcarrier sum-MSE of different hybrid [PITH_FULL_IMAGE:figures/full_fig_p012_4.png] view at source ↗
Figure 5
Figure 5. Figure 5: The proposed BCD methods with different PS noise [PITH_FULL_IMAGE:figures/full_fig_p013_5.png] view at source ↗
read the original abstract

Millimeter-wave (mmWave) technology is a crucial enabler for next-generation networks because it offers substantially greater available bandwidth. mmWave multiple-input multiple-output (MIMO) systems cannot rely solely on fully digital precoding due to hardware costs. As a result, hybrid precoding, which combines digital baseband processing with RF precoding, has emerged as a practical solution that balances performance and implementation complexity. As mmWave links typically operate over wideband, frequency-selective channels, orthogonal frequency-division multiplexing (OFDM) is commonly used to mitigate dispersive effects, yet OFDM introduces practical drawbacks, including out-of-band (OOB) emissions from abrupt spectral transitions among subcarriers and additional spectral leakage induced by windowing. Moreover, nonideal phase shifters (PS) in the RF transmit precoder and the user combiner impose inherent implementation limits that result in phase errors. We investigate robust joint digital--RF precoder design for minimizing the downlink sum mean-squared error (MSE) in hybrid multi-user (MU) MIMO--OFDM systems subject to maximum transmit-power, clipping, and OOB spectral-mask constraints. The resulting optimization is nonconvex and challenging to solve. To address this, we develop a minimum mean-squared error (MMSE) based block coordinate descent (BCD) algorithm that alternates between updating the transmitter-side digital--RF precoders and the user-side digital--RF combiners. For each BCD subproblem, we propose computationally efficient and scalable, closed-form solution strategies suitable for practical implementation. Extensive simulations validate the proposed methods and show clear performance improvements over established benchmark schemes.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 2 minor

Summary. The paper addresses robust hybrid precoding in multi-user mmWave MIMO-OFDM systems. It minimizes the downlink sum MSE subject to maximum transmit power, clipping, OOB spectral-mask, and non-ideal phase-shifter error constraints. The core contribution is an MMSE-based block coordinate descent (BCD) algorithm that alternates between transmitter-side digital-RF precoder updates and user-side digital-RF combiner updates, with claimed closed-form solutions for each subproblem that are computationally efficient and scalable. Performance is validated through simulations showing gains over benchmark schemes.

Significance. If the closed-form derivations hold rigorously without hidden relaxations, the work would provide a practical alternating-optimization framework for mask-compliant hybrid precoding that jointly handles hardware impairments and regulatory OOB constraints in wideband OFDM. This could be useful for implementation in next-generation systems where fully digital solutions are infeasible. The MMSE-BCD structure is standard, but explicit handling of the frequency-selective OOB mask and nonlinear clipping within closed forms would strengthen the contribution if shown to be exact.

major comments (2)
  1. Abstract: The central claim that each BCD subproblem admits 'computationally efficient and scalable, closed-form solution strategies' under the joint power, clipping, and OOB spectral-mask constraints is load-bearing but unsupported by explicit derivation in the abstract. The OOB mask is a frequency-selective constraint on the PSD of the precoded OFDM waveform while clipping is nonlinear; standard MMSE closed-forms apply only to simpler power-constrained cases, so the manuscript must show the exact reformulation (e.g., via DFT diagonalization or successive approximation) used to obtain closed forms, or clarify any relaxations.
  2. Algorithm description (BCD updates): The incorporation of phase errors from nonideal phase shifters into the robust MMSE objective and the alternating updates requires a concrete expression for the effective channel or error model; without it, it is unclear whether the claimed closed forms remain exact or become approximate when phase errors are included.
minor comments (2)
  1. The abstract states 'extensive simulations validate the proposed methods' but provides no details on Monte Carlo trial count, channel model (e.g., clustered mmWave), or exact SNR/clipping threshold ranges, which would aid reproducibility.
  2. Notation for the digital precoder F_BB, RF precoder F_RF, and their combiner counterparts should be introduced with a consistent table or list of symbols to avoid ambiguity when reading the BCD subproblems.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive comments, which help clarify the presentation of our contributions. We respond to each major comment below and indicate planned revisions where appropriate.

read point-by-point responses

  1. Referee: [—] Abstract: The central claim that each BCD subproblem admits 'computationally efficient and scalable, closed-form solution strategies' under the joint power, clipping, and OOB spectral-mask constraints is load-bearing but unsupported by explicit derivation in the abstract. The OOB mask is a frequency-selective constraint on the PSD of the precoded OFDM waveform while clipping is nonlinear; standard MMSE closed-forms apply only to simpler power-constrained cases, so the manuscript must show the exact reformulation (e.g., via DFT diagonalization or successive approximation) used to obtain closed forms, or clarify any relaxations.

    Authors: We agree that the abstract is high-level. The closed-form solutions are derived in Sections III-B and III-C by (i) expressing the OOB mask via the DFT of the time-domain waveform to obtain a quadratic constraint diagonalized in the frequency domain, and (ii) handling the clipping nonlinearity through a first-order Taylor approximation around the previous iterate within the BCD loop, which preserves closed-form updates for the digital precoder. These steps are exact for the reformulated subproblems; no additional hidden relaxations are introduced beyond the standard BCD alternation. We will revise the abstract to include a one-sentence indication of these reformulations. revision: yes

  2. Referee: [—] Algorithm description (BCD updates): The incorporation of phase errors from nonideal phase shifters into the robust MMSE objective and the alternating updates requires a concrete expression for the effective channel or error model; without it, it is unclear whether the claimed closed forms remain exact or become approximate when phase errors are included.

    Authors: Section II-C explicitly defines the phase-error model: the effective RF precoder is F_RF ⊙ E, where E is a random matrix with known variance σ_e² per entry. The robust MMSE objective is formed by taking the expectation over E, yielding an effective channel H_eff = E[H (F_RF ⊙ E)] that is substituted directly into the quadratic forms. Because this expectation is linear and closed-form, the subsequent BCD subproblem solutions (digital precoder and combiner updates) remain exact closed forms; the phase-error statistics simply modify the effective Gram matrix. We will add an explicit cross-reference from the algorithm section to Eq. (8) and Appendix A to make this transparent. revision: partial

Circularity Check

0 steps flagged

No significant circularity; derivation applies standard MMSE-BCD to constraints

full rationale

The paper's central contribution is an MMSE-based block coordinate descent algorithm that alternates between transmitter precoders and user combiners, with closed-form updates for each subproblem under power, clipping, and OOB mask constraints. No quoted step reduces a claimed prediction or result to a fitted parameter, self-definition, or unverified self-citation chain. The approach builds on established optimization techniques without redefining inputs in terms of outputs or smuggling ansatzes via self-reference. The derivation remains self-contained against external benchmarks such as standard BCD convergence and MMSE closed forms.

Axiom & Free-Parameter Ledger

0 free parameters · 2 axioms · 0 invented entities

The central claim rests on the assumption that the nonconvex problem can be decomposed into subproblems solvable in closed form via MMSE-based BCD, without introducing new physical entities or fitted constants beyond standard wireless models.

axioms (2)
  • domain assumption The downlink sum MSE minimization problem can be effectively addressed by alternating optimization between transmitter precoders and receiver combiners using the MMSE criterion.
    Invoked when developing the BCD algorithm for the joint design.
  • ad hoc to paper Closed-form solutions exist for each BCD subproblem under the power, clipping, and OOB mask constraints.
    Proposed as the key enabler for practical implementation.

pith-pipeline@v0.9.0 · 5598 in / 1546 out tokens · 38722 ms · 2026-05-10T04:36:52.122193+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

30 extracted references · 30 canonical work pages

  1. [1]

    Hybrid analog and digital beamforming for mmWave OFDM large-scale antenna arrays,

    F. Sohrabi and W. Yu, “Hybrid analog and digital beamforming for mmWave OFDM large-scale antenna arrays,”IEEE J. Sel. Areas Commun., vol. 35, no. 7, pp. 1432–1443, Apr. 2017

    work page 2017

  2. [2]

    Alternating minimization algorithms for hybrid precoding in millimeter wave MIMO systems,

    X. Yu, J-.C. Shen, J. Zhang, and K.B. Letaief, “Alternating minimization algorithms for hybrid precoding in millimeter wave MIMO systems,” IEEE J. Sel. Topics Signal Process., vol. 10, no. 3, pp. 485–500, Feb. 2016

    work page 2016

  3. [3]

    Low-complexity hybrid precoding in massive multiuser MIMO systems,

    L. Liang, W. Xu, and X. Dong, “Low-complexity hybrid precoding in massive multiuser MIMO systems,”IEEE Wireless Commun. Lett., vol. 3, no. 6, pp. 653–656, Oct. 2014

    work page 2014

  4. [4]

    Hybrid MMSE precoding and combining designs for mmWave multiuser systems,

    D. Nguyen, L. Le Bao, T. Le-Ngoc, and R.W. Heath, “Hybrid MMSE precoding and combining designs for mmWave multiuser systems,”IEEE Access, vol. 5, pp. 19167–19181, Sep. 2017

    work page 2017

  5. [5]

    Partially-connected hybrid beamforming for spectral efficiency maximization via a weighted MMSE equivalence,

    X. Zhao, T. Lin, Y . Zhu, and J. Zhang, “Partially-connected hybrid beamforming for spectral efficiency maximization via a weighted MMSE equivalence,”IEEE Trans. Wireless Commun., vol. 20, no. 12, pp. 8218– 8232, Jul. 2021

    work page 2021

  6. [6]

    Suppressing alignment: Joint PAPR and out-of-band power leakage reduction for OFDM-based systems,

    A. Tom, A. ¸ Sahin, and H. Arslan, “Suppressing alignment: Joint PAPR and out-of-band power leakage reduction for OFDM-based systems,” IEEE Trans. Commun., vol. 64, no. 3, pp. 1100–1109, Dec. 2016

    work page 2016

  7. [7]

    RF- PA modeling of PAPR: A precomputed approach to reinforce spectral efficiency,

    J. Galaviz-Aguilar V . Alejandro, T. Cesar, and E. Tlelo-Cuautle, “RF- PA modeling of PAPR: A precomputed approach to reinforce spectral efficiency,”IEEE Access, vol. 8, pp. 138217–138235, Jul. 2020

    work page 2020

  8. [8]

    Joint suppression of PAPR and OOB radiation for OFDM systems,

    S. Liu, Y . Wang, Z. Lian, Y . Su, and Z. Xie, “Joint suppression of PAPR and OOB radiation for OFDM systems,”IEEE Trans. Broadcast., vol. 69, no. 2, pp. 528–537, Feb. 2023

    work page 2023

  9. [9]

    Efficient optimization for large-scale MIMO-OFDM spectral precoding,

    S. Kant, M. Bengtsson, B. Göransson, G. Fodor, and C. Fischione, “Efficient optimization for large-scale MIMO-OFDM spectral precoding,” IEEE Trans. Wireless Commun., vol. 20, no. 9, pp. 5496–5513, Sep. 2021

    work page 2021

  10. [10]

    47 C.F.R. §15.517,

    FCC, “47 C.F.R. §15.517,” https://www.ecfr.gov/current/title-47/part-15/ section-15.517, eCFR, accessed Mar. 29, 2026

    work page 2026

  11. [11]

    47 C.F.R. §96.41,

    FCC, “47 C.F.R. §96.41,” https://www.ecfr.gov/current/title-47/part-96/ section-96.41, eCFR, accessed Mar. 29, 2026

    work page 2026

  12. [12]

    EVM-constrained and mask-compliant MIMO-OFDM spectral precod- ing,

    S. Kant, M. Bengtsson, G. Fodor, B. Göransson, and Carlo C. Fischione, “EVM-constrained and mask-compliant MIMO-OFDM spectral precod- ing,”IEEE Trans. Wireless Commun., vol. 20, no. 1, pp. 590–606, Jan. 2021

    work page 2021

  13. [13]

    Hybrid precoding for mmWave massive MIMO with finite blocklength,

    X. Zhang, L. Xiang, J. Wang, P. Zhu, D.W.K. Ng, and X. Gao, “Hybrid precoding for mmWave massive MIMO with finite blocklength,”IEEE Trans. Commun., vol. 73, no. 8, pp. 6379–6395, Aug. 2025

    work page 2025

  14. [14]

    Joint user selection and hybrid precoder design for massive MIMO systems,

    H. Vaezy and S.D. Blostein, “Joint user selection and hybrid precoder design for massive MIMO systems,”IEEE Trans. Signal Process., vol. 73, pp. 1808–1822, Apr. 2025

    work page 2025

  15. [15]

    Adaptive phase shifters for hybrid beamforming in mmWave systems,

    M. Alouzi, H. Yanikomeroglu, and G. Karabulut Kurt, “Adaptive phase shifters for hybrid beamforming in mmWave systems,”IEEE Trans. Wireless Commun., vol. 24, no. 2, pp. 1104–1116, Feb. 2025

    work page 2025

  16. [16]

    Hybrid precoder and combiner design with low-resolution phase shifters in mmWave MIMO systems,

    Z. Wang, M. Li, Q. Liu, and A. L. Swindlehurst, “Hybrid precoder and combiner design with low-resolution phase shifters in mmWave MIMO systems,”IEEE J. Sel. Topics Signal Process., vol. 12, pp. 256–269, May 2018

    work page 2018

  17. [17]

    Mask compliant precoder for OFDM spectrum shaping,

    A. Tom, A. Sahin, and H. Arslan, “Mask compliant precoder for OFDM spectrum shaping,”IEEE Commun. Lett., vol. 17, no. 3, pp. 447–450, Mar. 2013

    work page 2013

  18. [18]

    Computationally efficient mask-compliant spectral precoder for OFDM cognitive radio,

    R. Kumar and A. Tyagi, “Computationally efficient mask-compliant spectral precoder for OFDM cognitive radio,”IEEE Trans. Cognit. Commun. Netw., vol. 2, no. 1, pp. 15–23, Mar. 2016

    work page 2016

  19. [19]

    Sculpting the multicarrier spectrum: a novel projection precoder,

    J. Van De Beek, “Sculpting the multicarrier spectrum: a novel projection precoder,”IEEE Commun. Lett., vol. 13, no. 12, pp. 881–883, Dec. 2009

    work page 2009

  20. [20]

    Joint spectral- spatial precoders in MIMO-OFDM transmitters,

    T. Taheri, M. Mohamad, R. Nilsson, and J. van de Beek, “Joint spectral- spatial precoders in MIMO-OFDM transmitters,”Signal Process., vol. 172, pp. 107538, Jul. 2020

    work page 2020

  21. [21]

    Linear transmit processing in MIMO communications systems,

    M. Joham, W. Utschick, and J.A. Nossek, “Linear transmit processing in MIMO communications systems,”IEEE Trans. Signal Process., vol. 53, no. 8, pp. 2700–2712, Aug. 2005

    work page 2005

  22. [22]

    A 28-GHz low-power phased-array receiver front-end with 360 ◦ RTPS phase shift range,

    R. Garg and A. S. Natarajan, “A 28-GHz low-power phased-array receiver front-end with 360 ◦ RTPS phase shift range,”IEEE Trans. Microw. Theory Tech., vol. 65, no. 11, pp. 4703–4714, Jun. 2017

    work page 2017

  23. [23]

    A low-loss compact 60-GHz phase shifter in 65-nm CMOS,

    C.W. Byeon and C.S. Park, “A low-loss compact 60-GHz phase shifter in 65-nm CMOS,”IEEE Microw. Wireless Compon. Lett, vol. 27, no. 7, pp. 663–665, Jun. 2017

    work page 2017

  24. [24]

    Robust and low-overhead hybrid beamforming design with imperfect phase shifters in multi-user millimeter wave systems,

    W. Wang, H. Yin, X. Chen, and W. Wang, “Robust and low-overhead hybrid beamforming design with imperfect phase shifters in multi-user millimeter wave systems,”IEEE Access, vol. 8, pp. 74002–74014, May 2020

    work page 2020

  25. [25]

    Robust hy- brid beamforming for outage-constrained multigroup multicast mmWave transmission with phase shifter impairments,

    J. Li, Z. Wang, Y . Zhang, P. Zhu, D. Wang, and X. You, “Robust hy- brid beamforming for outage-constrained multigroup multicast mmWave transmission with phase shifter impairments,”IEEE Syst. J., vol. 17, no. 1, pp. 869–880, Mar. 2023

    work page 2023

  26. [26]

    Optimal channel estimation for hybrid energy beamforming under phase shifter impairments,

    D. Mishra and H. Johansson, “Optimal channel estimation for hybrid energy beamforming under phase shifter impairments,”IEEE Trans. Commun., vol. 67, no. 6, pp. 4309–4325, Jun. 2019

    work page 2019

  27. [27]

    Convergence analysis of the direct extension of ADMM for multiple-block separable convex minimization,

    M. Tao and X. Yuan, “Convergence analysis of the direct extension of ADMM for multiple-block separable convex minimization,”Adv. Comput. Math., vol. 44, no. 3, pp. 773–813, Jun. 2018

    work page 2018

  28. [28]

    D. P. Bertsekas,Nonlinear Programming, Athena Scientific, 3rd ed., 2016

    work page 2016

  29. [29]

    Introduction to multiple antenna communi- cations and reconfigurable surfaces,

    E. Björnson and Ö. Demir, “Introduction to multiple antenna communi- cations and reconfigurable surfaces,” 2024

    work page 2024

  30. [30]

    Further advancements for E-UTRA physical layer aspects,

    3GPP TR 36.814, “Further advancements for E-UTRA physical layer aspects,” Tech. Rep., 3rd Generation Partnership Project (3GPP), Mar. 2017, Release 9, V9.2.0

    work page 2017