REVIEW 3 major objections 6 minor 56 references
Probing the dimuon channel of a Z' boson at the HL-LHC using multivariate analysis
T0 review · 3 major / 6 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read A boosted-decision-tree analysis of the dark Higgs Z' dimuon channel finds a statistical significance of 6.77σ at 500 GeV with the full HL-LHC dataset.
desk verdict A clearly documented HL-LHC sensitivity projection for a known dark Higgs model, but the headline z=6.77 is inflated by optimizing the BDT cut on the same events; worth refereeing with a request for a validation split and systematics. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the trained boosted decision tree (BDT), an ensemble of shallow decision trees that classifies events as signal-like or background-like using five kinematic inputs: the transverse momenta of the two muons, the missing transverse energy, the dimuon invariant mass, and the azimuthal angle between the dimuon system and the missing energy. The analysis scans the BDT response threshold for each benchmark point and takes the cut that maximizes $z = S/\sqrt{S+B}$, where $S$ and $B$ are the expected signal and background counts after the cut. This classifier, trained with five-fold cross-validation, is shown to achieve the largest area under the ROC curve among the three methods compared, and it is the BDT results that produce the quoted significance values.
What would settle it
Apply the same BDT cut to the first 3000 $fb^{{-1}}$ of HL-LHC data and fit the dimuon invariant-mass spectrum around 500 GeV in events with large missing transverse energy; if no excess over the Standard Model prediction appears, the claimed $S=500$ events and $z=6.77$ are refuted.
Extended reading notes
Core claim
The paper's central claim is that the dark Higgs benchmark point BP4, with $M_{Z'}=500$ GeV and $g_{SM}=0.25$, $g_{DM}=1.0$, would be discovered in the dimuon plus missing transverse energy channel at the HL-LHC: after an optimal cut on the boosted decision tree response, the expected signal is $S = 500$ events against a background of $B = 4951$ events, giving $z = S/\sqrt{S+B} = 6.77$ with 3000 $fb^{{-1}}$ at 14 TeV. For BP1 through BP3, the paper reports 5σ discovery at integrated luminosities of 4.3, 18.8, and 175 $fb^{{-1}}$ respectively. For BP5 through BP9, masses 600 to 1000 GeV, the expected significance falls from 2.81 to 0.48, below the discovery threshold. The BDT classifier outperforms the deep neural network and the likelihood estimator in the comparison, so the quoted sensitivities are specific to the boosted decision tree.
Load-bearing premise
The result assumes the fast detector simulation used for both signal and background reproduces the real HL-LHC's muon reconstruction, isolation, and missing-energy response; if real detectors are less efficient at high pileup, the predicted significance would shrink.
Editorial extensions
If this is right
- At $M_{Z'}=500$ GeV, the dark Higgs benchmark BP4 yields a 6.77σ excess in the dimuon plus missing-energy channel with 3000 fb^{-1}, clearing the discovery threshold.
- The lighter benchmarks BP1 through BP3 reach 5σ with only 4.3, 18.8, and 175 fb^{-1} respectively, so the channel is sensitive at modest integrated luminosity for low Z' masses.
- For Z' masses between 600 and 1000 GeV, the expected significance stays between 2.81 and 0.48, so the full HL-LHC dataset is not enough to discover the model in this channel.
- Since the BDT outperforms the DNN and likelihood classifiers on this final state, the reported sensitivities are tied to using the boosted decision tree; the other classifiers would give weaker results.
Reading between the lines
- A direct extension would replace the counting significance $z = S/\sqrt{S+B}$ with a profile-likelihood fit that includes systematic uncertainties on the background shape and acceptance; that would show how much of the 6.77σ survives real-world effects.
- The same BDT recipe, retrained on the dielectron or other leptonic channels, could extend the search and cross-check the dark Higgs interpretation without requiring a new model setup.
- Because BP1 through BP3 need less than 500 fb^{-1} for discovery, early HL-LHC data could already test this model, and the analysis could be re-optimized on the first year of collisions.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents a Monte Carlo study of the dark Higgs model in the mono-Z' portal at the HL-LHC, examining the Z'->mu+mu- plus missing transverse energy signature. Events are generated with MadGraph5_aMC@NLO and Pythia8, passed through Delphes with the CMS pile-up card, and analyzed with TMVA classifiers (BDT, DNN, Likelihood). The BDT is selected as the best classifier, and expected significances are computed for dark Higgs signals with M_Z' between 200 and 1000 GeV at sqrt(s)=14 TeV and L=3000 fb^-1. The central numerical result is a BDT-based significance of z=6.77 for M_Z'=500 GeV (BP4), with lighter benchmark points exceeding 5 sigma and heavier points falling below the discovery threshold.
Significance. If the central numerical claim were robust, the paper would be a useful HL-LHC projection for the dark Higgs dimuon channel, providing a concrete comparison of MVA classifiers and per-benchmark significance predictions. Its strengths include the full MadGraph+Pythia+Delphes simulation chain, five-fold cross-validation in training, an explicit hyperparameter table, and a falsifiable set of benchmark results. However, the quoted significances are computed with a simplified statistical formula that ignores systematic uncertainties, and the BDT cut is chosen to maximize the significance on the same sample used to report it. Both effects bias the headline z values upward, so the paper is best viewed as a phenomenological template that needs additional validation before its discovery claim can be taken at face value.
major comments (3)
- [Section VI, Eq. (3), Fig. 8, Table VIII] The 'optimal cut' on the BDT response is selected by scanning thresholds and choosing the one that maximizes z on the same out-of-fold predictions used to quote z. As a result, z=6.77 is the maximum of a noisy function over many correlated thresholds, and is systematically larger than the expected significance for a pre-specified or independently chosen cut. With S=500 and B=4951 at the quoted cut, Poisson fluctuations at neighboring thresholds are sizable, so this is a first-order effect. The authors should report significances for a cut fixed on an independent validation set, or use a three-way split (training/validation/test) and quote the test-sample significance at the validation-selected cut.
- [Eq. (3) and Section VII] All quoted significances are purely statistical, z=S/sqrt(S+B), with no systematic uncertainty assigned to signal or background rates, acceptances, or shapes. This is load-bearing: a 10-20% background normalization systematic alone moves the BP4 value from 6.8 toward the 5 sigma boundary (roughly 6.5 at 10% and 5.8 at 20%), and the BP5-BP9 values are already below 3 sigma. The paper should either include a nuisance-parameter treatment with correlated systematic uncertainties or clearly label every number as a statistical-only projection, with a matching caveat in the abstract and summary. The final-section sentence deferring systematics to 'future studies' does not adequately qualify the headline discovery claim.
- [Sections IV.A, IV.B and Table VIII] The absolute values of S and B, and therefore the significances, are obtained from Delphes simulation using the CMS Pile-Up configuration card. The paper does not cross-check the resulting muon reconstruction, isolation, and missing transverse energy response against public HL-LHC performance studies or against a full simulation sample, even for one benchmark point. Because the acceptance numbers directly determine the central discovery claim, this fast-simulation assumption should either be validated or assigned a quantitative uncertainty; otherwise the absolute z values inherit an unquantified detector-modeling risk.
minor comments (6)
- [Section IV.A and Table II caption] There are small language slips: 'tabled I' should be 'Table I', and the Table II caption uses 'Pb' where 'pb' is meant.
- [Fig. 4 and surrounding text] The correlation matrix axis labels in Fig. 4 are nearly unreadable due to overlapping text, and the statement that 'most of them are highly uncorrelated' is difficult to reconcile with entries such as the 77-85% correlations visible in the figure. Please clarify the criterion for 'highly uncorrelated' and improve the figure labels.
- [Eq. (2)] The equation for the separation power is typeset confusingly, with the integrand appearing as 'Z ( ˆPs(γ)− ˆPb(γ))2'. Please use a standard definition, e.g., 1/2 * integral((Ps-Pb)^2/(Ps+Pb)) dγ, and define all symbols.
- [Table VI] The DNN layout string 'TANH|128, TANH|128, TANH|128, LINEAR' is not self-explanatory; please specify the layer sizes and activation functions explicitly in the table or in a footnote.
- [Table VIII] The symbol 'NBC' is not defined; please state in the caption that it denotes the number of events after pre-selection but before the BDT cut.
- [Section VI, overtraining discussion] The sentence 'This indicates good training performance for all three classifiers, as expected due to the use of CV' is imprecise: cross-validation reduces overfitting but does not by itself guarantee that training and test distributions match. Please report the KS test p-values used for the overtraining check.
Circularity Check
The headline significance z=6.77 is the maximum of a BDT-threshold scan on the same events used to count S and B, so it is a fitted output rather than an independent prediction; the rest of the derivation is self-contained.
-
fitted input called prediction
[Section VI, after Eq. (3), Fig. 8 and Table VIII]
"Consequently, a cut value is applied to the BDT response for BP4 through BP9 to obtain the corresponding numbers of signal events (S) and background events (B) with L = 3000 fb−1 ... Finally, z is calculated for these six BPs using Eq. 3 [56]. z = S/sqrt(S + B) (3) The applied cut value, also known as optimal cut, is where the maximum z is achieved for the BP as shown in Fig. 8 for BP4."
The reported z is the value of Eq. (3) at the cut chosen by maximizing Eq. (3) over the BDT-response threshold. Thus the quoted significance is, by construction, the maximum of the objective over scanned cuts on the same events, not an independent prediction at a pre-specified selection. The k-fold CV and KS tests only guard against classifier overtraining; they do not protect against this threshold-optimization (look-elsewhere) bias, and no validation split is used for the cut choice. Consequently Table VIII's z values are fitted outputs of the scan, with positive bias from Poisson fluctuations in S and B.
full rationale
The model and couplings are inherited from Ref. [26] and from ATLAS recommendations ([28], [47], [48]); these are inputs, not outputs, and the self-citations [27] and [48] are not load-bearing for the numerical claim. The signal and background samples are generated independently with MadGraph, Pythia, and Delphes, and the BDT classifier performance is externally assessed through ROC/AUC curves. The central weakness is the threshold-selection step: the optimal cut is defined as the cut maximizing z, and the same z is then quoted as the achieved significance. This is the fitted-input-called-prediction pattern, and it affects exactly the claimed discovery (z=6.77 for BP4) and the required-luminosity values derived from it. No equation in the paper reduces to a fitted cross-section, and no load-bearing uniqueness theorem is imported from the authors' prior work; however, the headline significance is not an independently predicted number. Since the central claim depends on this optimized quantity, partial circularity is present. The paper's own closing sentence defers systematic uncertainties to future work, which further weakens the headline number but is not itself a circularity step.
Assumptions & free parameters
free parameters (3)
- g_SM (dark Higgs model coupling to SM) =
0.25
- g_DM (dark Higgs model coupling to dark sector) =
1.0
- Optimal BDT cut =
varies per BP, e.g., 0.2754 for BP4
assumptions (6)
- domain assumption The simplified dark Higgs model with the heavy dark sector mass assumption (M_hD = M_Z' for M_Z' > 125 GeV) is the true signal model.
- domain assumption The cross sections computed by MadGraph5_aMC@NLO v3.5.0 at NLO, combined with Pythia8, are accurate for the signal and backgrounds at sqrt(s)=14 TeV.
- domain assumption Delphes with the CMS pile-up configuration card faithfully approximates the response of the HL-LHC detectors for muons and missing transverse energy.
- domain assumption The list of SM background processes in Table III is the complete relevant background.
- ad hoc to paper The significance formula z = S/sqrt(S+B), with no systematic uncertainties, is adequate to assess discovery potential.
- domain assumption The MVA classifiers are not overtrained and generalize to unseen data based on the KS test and k-fold cross-validation.
Cite this review
Pith. "Pith review of Probing the dimuon channel of a Z' boson at the HL-LHC using multivariate analysis." pith.science (2026). https://pith.science/paper/OM6IIGHR
@misc{pith2026250502739,
author = {Pith},
title = {Pith review of: Probing the dimuon channel of a Z' boson at the HL-LHC using multivariate analysis},
year = {2026},
howpublished = {\url{https://pith.science/paper/OM6IIGHR}},
note = {Machine review of arXiv:2505.02739}
}
abstract
The upcoming upgrade of the existing LHC facility at CERN is known as the High-Luminosity Large Hadron Collider (HL-LHC). It is designed to extend its physics reach by substantially increasing the integrated luminosity. It will enable more precise measurements of the Standard Model (SM) and improve sensitivity to rare events and possible new physics signatures. This study adopts a multivariate analysis (MVA) approach to effectively discriminate the dark Higgs (DH) signal against the dominant SM background. The analysis targets the leptonic decay mode of the $Z'$ boson, focusing on the dimuon final state at $\sqrt{s} = 14,\text{TeV}$ and $3000,\text{fb}^{-1}$ integrated luminosity corresponding to the HL-LHC. The DH signal is examined using the Toolkit for Multivariate Analysis (TMVA), employing and comparing the performance of three classifiers: Boosted Decision Trees (BDT), Deep Neural Networks (DNN), and Likelihood estimators.
Figures
Figures from the paper (4 more)
Reference graph
Works this paper leans on
-
[1]
Bertone, D
G. Bertone, D. Hooper, and J. Silk, Physics Reports405, 279 (2005)
2005
-
[2]
J. L. Feng, Annual Review of Astronomy and Astro- physics 48, 495 (2010)
work page 2010
-
[3]
V. C. Rubin, N. Thonnard, and W. K. J. Ford, Astro- physical Journal 238, 471 (1980)
work page 1980
-
[4]
Y. Sofue and V. Rubin, Annual Review of Astronomy and Astrophysics 39, 137 (2001)
work page 2001
- [5]
-
[6]
J.-P.KneibandP.Natarajan,Astronomy&Astrophysics Review 19, 47 (2011)
work page 2011
-
[7]
Planck Collaboration, Astronomy & Astrophysics 641, A6 (2020)
work page 2020
-
[8]
Hinshawet al., Astrophysical Journal Supplement Se- ries 208, 19 (2013)
G. Hinshawet al., Astrophysical Journal Supplement Se- ries 208, 19 (2013)
work page 2013
Show all 56 references
-
[9]
Particle Data Group, Progress of Theoretical and Exper- imental Physics 2022, 083C01 (2022)
2022
-
[10]
Jungman, M
G. Jungman, M. Kamionkowski, and K. Griest, Physics Reports 267, 195 (1996)
1996
-
[11]
Arcadi, A
G. Arcadi, A. Djouadi, and M. Raidal, Physics Reports 842, 1 (2020)
2020
-
[12]
Mahmoud, J
Y. Mahmoud, J. Kawamura, H. Abdallah, S. Elgammal, and M. T. Hussein, Investigating vector-like leptons de- caying into an electron and missing transverse energy in e+e− collisions with√s = 500, gev at the ilc (2025), published: 04 March 2025
2025
-
[13]
R. D. Peccei and H. R. Quinn, Physical Review Letters 38, 1440 (1977)
1977
-
[14]
Sikivie, Physical Review Letters51, 1415 (1983)
P. Sikivie, Physical Review Letters51, 1415 (1983)
1983
-
[15]
Dodelson and L
S. Dodelson and L. M. Widrow, Physical Review Letters 72, 17 (1994)
1994
-
[16]
Abazajian, G
K. Abazajian, G. M. Fuller, and M. Patel, Physical Re- view D 64, 023501 (2001)
2001
-
[17]
Alexanderet al., Dark sectors 2016 workshop: Com- munity report, arXiv:1608.08632 [hep-ph] (2016)
J. Alexanderet al., Dark sectors 2016 workshop: Com- munity report, arXiv:1608.08632 [hep-ph] (2016)
2016 arXiv
-
[18]
Holdom, Physics Letters B166, 196 (1986)
B. Holdom, Physics Letters B166, 196 (1986)
1986
-
[19]
Aprile et al., Physical Review Letters 121, 111302 (2018)
E. Aprile et al., Physical Review Letters 121, 111302 (2018)
2018
-
[20]
Cui et al., Physical Review Letters 119, 181302 (2017)
X. Cui et al., Physical Review Letters 119, 181302 (2017)
2017
-
[21]
J. M. Gaskins, Contemporary Physics57, 496 (2016)
2016
-
[22]
Boveia and C
A. Boveia and C. Doglioni, Annual Review of Nuclear and Particle Science68, 429 (2018)
2018
-
[23]
Aaboudet al., Physical Review Letters119, 181804 (2017)
M. Aaboudet al., Physical Review Letters119, 181804 (2017)
2017
-
[24]
CMS Collaboration, Phys. Lett. B 716, 30 (2012), arXiv:1207.7235 [hep-ex]
2012 arXiv
-
[25]
ATLAS Collaboration, Phys. Lett. B 716, 1 (2012), arXiv:1207.7214 [hep-ex]
2012 arXiv
-
[26]
Autran, K
M. Autran, K. Bauer, T. Lin, and D. Whiteson, Phys. Rev. D 92, 035007 (2015), arXiv:1504.01386 [hep-ph]
2015 arXiv
-
[27]
Elgammal, M
S. Elgammal, M. Louka, A. Y. Ellithi, and M. T. Hussein, Eur. Phys. J. Plus138, 548 (2023)
2023
-
[28]
ch/record/2857116
ATLAS Collaboration,Search for a new leptonically de- caying neutral vector boson in association with miss- ing transverse energy in proton-proton collisions at√s = 13 TeV with the ATLAS detector , ATLAS- CONF ATLAS-CONF-2023-045 (ATLAS Collaboration, CERN, Geneva, Switzerland...
2023
-
[29]
Apollinari, I
G. Apollinari, I. Béjar Alonso, O. Brüning, P. Fessia, M. Lamont, L. Rossi, and L. Tavian, CERN Yellow Re- ports: Monographs 10.23731/CYRM-2017-004 (2017)
2017 doi
-
[30]
7 (CERN, 2020)
CERN, High-Luminosity Large Hadron Collider (HL- LHC): Technical Design Report, CERN Yellow Reports: Monographs, Vol. 7 (CERN, 2020)
2020
-
[31]
CMS Collaboration, Eur. Phys. J. C 85, 721 (2025), arXiv:2412.17590 [hep-ex]
2025 arXiv
-
[32]
Choudhury, A
A. Choudhury, A. Mondal, and S. Sarkar, European Physical Journal Special Topics233, 2425 (2024)
2024
-
[33]
Bhardwaj, J
A. Bhardwaj, J. Dutta, P. Konar, B. Mukhopadhyaya, and S. K. Rai, Journal of High Energy Physics 2020, 83 (2020), received: 10 July 2020; Revised: 01 Septem- ber 2020; Accepted: 03 September 2020; Published: 13 October 2020
2020
-
[34]
Rana and A
Y. Rana and A. K. Dubey, inProceedings of the XXV DAE-BRNS High Energy Physics (HEP) Symposium 2022, 12–16 December, Mohali, India, Springer Proceed- ings in Physics, Vol. 304, edited by S. Jena, A. Shivaji, V. Bhardwaj, K. Lochan, H. K. Jassal, A. Joseph, and P. Khuswaha (Spr...
2022
- [35]
-
[36]
J.Chang, K.Cheung, J.S.Lee,andJ.Park,Phys.Rev.D 101, 016004 (2020), received: 13 August 2019; published: 3 January 2020. 9
2020
-
[37]
Adhikary, S
A. Adhikary, S. Banerjee, R. K. Barman, B. Bhattacher- jee, and S. Niyogi, Journal of Physics: Conference Series 1690, 012149 (2020)
2020
-
[38]
B. P. Roe, H.-J. Yang, J. Zhu, Y. Liu, I. Stancu, and G. McGregor, Nucl. Instrum. Meth. A543, 577 (2005)
2005
-
[39]
Baldi, P
P. Baldi, P. Sadowski, and D. Whiteson, Nature Com- mun. 5, 4308 (2014), arXiv:1402.4735
2014 arXiv
-
[40]
Cowan, K
G. Cowan, K. Cranmer, E. Gross, and O. Vitells, Eur. Phys. J. C71, 1554 (2011), arXiv:1007.1727
2011 arXiv
-
[41]
Yalcin Kuzu, Journal of Molecular Biology 1277, 134834 (2023)
S. Yalcin Kuzu, Journal of Molecular Biology 1277, 134834 (2023)
2023
-
[42]
Collaboration, Technical design report for the atlas inner tracker pixel detector (2017), cERN-LHCC-2017- 021
A. Collaboration, Technical design report for the atlas inner tracker pixel detector (2017), cERN-LHCC-2017- 021
2017
-
[43]
Collaboration, The phase-2 upgrade of the cms tracker (2017), cERN-LHCC-2017-009
C. Collaboration, The phase-2 upgrade of the cms tracker (2017), cERN-LHCC-2017-009
2017
-
[44]
J. A. et al., MadGraph5_aMC@NLO v3.5.0 (2024), https://launchpad.net/mg5amcnlo
2024
-
[45]
Sjöstrand, S
T. Sjöstrand, S. Mrenna, and P. Z. Skands, Comput. Phys. Commun. 191, 159 (2015)
2015
-
[46]
de Favereau, C
J. de Favereau, C. Delaere, P. Demin, A. Giammanco, V. Lemaitre, A. Mertens, and M. Selvaggi, JHEP 02, 057, arXiv:1307.6346 [hep-ex]
-
[47]
ATLAS Collaboration, JHEP10, 180, arXiv:1807.11471 [hep-ex]
-
[48]
Elgammal, Phys
S. Elgammal, Phys. Rev. D111, 052015 (2025)
2025
-
[49]
Hoecker, P
A. Hoecker, P. Speckmayer, J. Stelzer, J. Ther- haag, E. von Toerne, and H. Voss, arXiv preprint physics/0703039 (2007), arXiv:physics/0703039 [physics.data-an]
2007 arXiv
-
[50]
Brun and F
R. Brun and F. Rademakers, Nucl. Instrum. Meth. A 389, 81 (1997)
1997
-
[51]
Therhaag, in Proceedings of the 35th International Conference of High Energy Physics (ICHEP 2010)(2011) p
J. Therhaag, in Proceedings of the 35th International Conference of High Energy Physics (ICHEP 2010)(2011) p. 510
2011
-
[52]
Kohavi, inProceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI)(1995) pp
R. Kohavi, inProceedings of the 14th International Joint Conference on Artificial Intelligence (IJCAI)(1995) pp. 1137–1145
1995
-
[53]
Arlot and A
S. Arlot and A. Celisse, Statistics Surveys4, 40 (2010)
2010
-
[54]
Refaeilzadeh, L
P. Refaeilzadeh, L. Tang, and H. Liu, inEncyclopedia of Database Systems, edited by L. Liu and M. T. Özsu (Springer US, 2009) pp. 532–538
2009
-
[55]
F. J. Massey, Journal of the American Statistical Asso- ciation 46, 68 (1951)
1951
-
[56]
CMS Collaboration, Journal of Physics G: Nuclear and Particle Physics 49, 025006 (2022)
2022
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.