REVIEW 3 major objections 7 minor 63 references
A Transformer on raw calorimeter cells separates collimated diphoton jets from single photons far better than shower-shape methods and also regresses the diphoton mass.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-10 11:51 UTC pith:FAJQVE2Q
load-bearing objection Solid simulation methods paper: cell-level Transformer clearly beats SSV and other cell models on a hard collimation regime, with usable mass regression and public code; main limit is idealized GEANT4 transfer. the 3 major comments →
Transformer-based machine learning using low-level calorimeter signals for collimated photon identification at collider experiments
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Cell-level machine learning, and in particular a multi-task Transformer that attends over the energy-ordered top-200 calorimeter cells, classifies highly collimated ALP→γγ photon-jets from single photons with an overall test AUC of 0.98 and background rejection of order 470 at 90 % signal efficiency—far above shower-shape BDT/DNN and other cell-level baselines—while the same network regresses the diphoton mass to ~64 MeV resolution, resolving π⁰ and η fakes.
What carries the argument
A Transformer encoder with multi-head self-attention over variable-length cell tokens (energy, transverse coordinates relative to the shower barycentre, and layer), followed by global attention pooling and two task heads that jointly optimise binary classification and LogCosh mass regression.
Load-bearing premise
That the cell-level correlations the Transformer exploits will still be present and useful once the model is moved from an idealised flat-face GEANT4 calorimeter without pile-up, magnetic field or electronics noise onto real collider data and trigger hardware.
What would settle it
Train and evaluate the identical cell-level Transformer on full ATLAS or CMS simulation (or real data) that includes pile-up, magnetic field, dead-material non-uniformities and realistic clustering; if the AUC advantage over shower-shape baselines collapses below ~0.95 or the mass resolution degrades beyond ~100 MeV, the claimed gains do not transfer.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript studies machine-learning classification of highly collimated ALP→γγ photon-jets versus isolated single photons using an ATLAS-like GEANT4 calorimeter model. It compares six architectures: SSV-based BDT and DNN baselines, and cell-level CNN, PFN, Transformer, and MLP Mixer models operating on up to 200 energy-ordered cells (E, x, y, layer). The multi-task Transformer achieves the best inclusive test AUC (0.98) and the strongest background rejection at fixed signal efficiency (Table 3: ~472 at 90% ε_sig), retains useful discrimination down to O(10) MeV ALP masses, and simultaneously regresses the diphoton invariant mass with ~64 MeV resolution, resolving π0 and η peaks. The MLP Mixer is presented as a lower-cost alternative (~3% of Transformer FLOPs) for potential trigger use. Code and samples are released.
Significance. If the reported gains transfer even partially to real reconstruction and trigger environments, the work would meaningfully improve photon identification and sensitivity to light ALP and related photon-jet signatures in a regime (ΔR_γγ ≲ calorimeter cell size) that has been difficult for conventional SSV methods. The systematic six-architecture comparison, mass-binned ROCs, AUC vs (m_a, p_T) maps, multi-seed uncertainties on the top models, and public code/data are clear strengths. The multi-task mass regression from cells is a useful additional handle for π0/η rejection. The main caveat is that all results are obtained in an idealized particle-gun simulation without pileup, electronics noise, magnetic field, or full topological clustering; the authors acknowledge this, but the broader impact claims rest on transfer that is not yet demonstrated.
major comments (3)
- Abstract and §5 claim that cell-level methods “can extend calorimeter-based particle identification … well beyond the capabilities of current conventional techniques.” The supporting evidence (Table 3, Figs. 6–13) is obtained in a highly idealized GEANT4 setup (§2: flat face at η=0, uniform 2.5 X0 Al dead material, no B-field, no pileup, no electronics noise, particle-gun incidence, energy-ordered top-200 cells without full topo-clustering). This limitation is stated but under-weighted relative to the impact language. Please either (i) qualify the abstract/conclusions more tightly to the simulation scope, or (ii) add a short quantitative discussion of which effects (pileup, noise, clustering thresholds, non-uniform material) are most likely to degrade the pairwise cell correlations the Transformer exploits, and what validation path is planned.
- §3.1 / Table 3 comparison fairness: the CNN is restricted to the first three EM layers and a multi-task objective, while the PFN, Transformer, and MLP Mixer use all six layers (including HCAL). The text notes that remaining layers “contribute no improvement” for the CNN, but this is not shown and the input dimensionality therefore differs across cell-level models. For a load-bearing ranking claim, either retrain the CNN with the same six-layer cell set (or show an ablation that HCAL adds nothing for all architectures) or clearly mark the CNN as a reduced-input baseline so the Table 3 ordering is not over-interpreted.
- §4.1 mass regression and π0/η handle: the Transformer reconstructs m_π0 ≈ 172 MeV and m_η ≈ 564 MeV (Fig. 12) with an upward bias comparable to the ~60 MeV resolution, and a small non-zero m_γ bias. The abstract and conclusions present this as “an additional handle in reducing the π0 and η fake photon backgrounds,” but no background-rejection or purity numbers versus a pure classifier cut (or versus SSV-based π0 rejection) are given. A short quantification—e.g., rejection of π0/η samples at fixed single-photon efficiency using the mass head, or a combined score+mass working point—would make this claim load-bearing rather than qualitative.
minor comments (7)
- Eq. (2.1) and surrounding text: ΔR_γγ ≈ 2 m_a / p_T,a is the ultra-collinear approximation; a one-line statement of its validity range for the generated sample would help readers.
- §3.2: the multi-task loss weight L = L_classifier + 4 L_regression is “chosen empirically.” A brief sensitivity check (or statement that AUC is stable under O(1) changes of the weight) would strengthen reproducibility.
- Fig. 8 / Fig. 15: the ΔR_γγ bands are useful; adding the finest cell angular scale (~3×10^{-3}) as a horizontal reference line on the AUC map would make the “sub-cell” regime more immediate.
- Table 2: FLOPs/MACs are quoted for a single inference pass; stating the assumed batch size and whether padding/masking is included would aid FPGA-oriented readers.
- Appendix C / Fig. 17: SSV definitions are said to match ATLAS photon ID plus E_max_cell; a compact table of exact formulas (or a pointer to the ATLAS note equations) would remove any ambiguity for reimplementation.
- Typographical: “V ariables” in the Contents (C Shower Shape V ariables) and occasional spacing issues around π0/η in the abstract PDF rendering.
- §4.3: background rejection for BDT/DNN/CNN/MLP Mixer is given without multi-seed uncertainties, unlike Transformer/PFN. Even a single-seed note or a short stability check would make Table 3 more uniform.
Circularity Check
No significant circularity: standard supervised multi-task ML on independent GEANT4 truth labels with held-out test metrics.
full rationale
The paper's central claims are empirical performance numbers (Transformer test AUC 0.98, background rejection ~472 at 90% signal efficiency, mass resolution 64 MeV) obtained by training classifiers/regressors on simulated calorimeter cells whose labels (ALP vs single-photon; true m_a) are generated independently by GEANT4 particle-gun events. Train/validation/test splits are random 80:10:10; ROC/AUC and residual distributions are evaluated on held-out events and are not algebraically forced by the loss (cross-entropy + LogCosh) or by any fitted constant. Architecture comparisons (BDT/DNN on SSVs vs CNN/PFN/Transformer/MLP-Mixer on cells) are ablations under identical simulation conditions; none of the reported gains reduce by construction to an input definition or a self-cited uniqueness theorem. The sole self-reference is the authors' Zenodo GEANT4 geometry package used to produce the public datasets; this is infrastructure for reproducibility, not a load-bearing premise that the classification or mass-regression results are true by definition. No self-definitional loops, fitted-input-as-prediction, or ansatz-smuggling via citation appear in the derivation chain. The idealized-simulation transfer caveat is an external validity issue, not circularity.
Axiom & Free-Parameter Ledger
free parameters (6)
- Classification vs regression loss weight (Transformer) =
4
- CNN multi-task loss weights =
0.8 / 0.2
- Max cells per event N_cells =
200
- Transformer architecture hyperparameters =
as listed in §3.2
- MLP Mixer embedding and mixer width =
50
- Simulated ALP mass and p_T ranges =
10 MeV–2.5 GeV; 50–300 GeV
axioms (5)
- domain assumption GEANT4 shower simulation with the stated ATLAS-like layered geometry and 2.5 X0 aluminum dead material adequately represents EM shower differences between single photons and collimated diphotons for ranking ML methods.
- domain assumption Energy-ordered selection of at most 200 cells without full topological clustering preserves the discriminating cell-level information.
- domain assumption ALP→γγ kinematics with ΔR_γγ ≈ 2 m_a / p_T,a and prompt decay produce the target photon-jet topology.
- standard math Standard ML training assumptions: i.i.d. train/val/test split, binary cross-entropy / LogCosh objectives, Adam/AdamW optimization converge to useful minima without pathological label leakage.
- domain assumption Shower-shape variables defined as in ATLAS photon ID (plus E_max_cell) are a fair high-level baseline for comparison.
read the original abstract
Electromagnetic calorimeters provide essential information for reconstructing and selecting both Standard Model (SM) and potential beyond the SM physics events at high-energy particle colliders. The fine-grained segmentation of modern calorimeters captures rich information about the internal structure of particle showers, much of which is discarded by conventional high-level reconstruction methods. In this work, we leverage calorimeter cell-level information to classify highly collimated diphoton signatures, arising from the decay of light axion-like particles, from isolated single-photon showers. We systematically compare a range of machine learning architectures, spanning high-level, shower shape variable-based approaches and direct cell-level methods. Cell-level machine learning shows significantly superior classification ability, with a Transformer in particular representing the best performance among six different architectures studied, and an MLP Mixer representing a resource-constrained alternative for potential real-time, trigger-level applications. Beyond classification, the Transformer model developed enables direct invariant mass regression from calorimeter cells, improving the characterization of light resonances and providing an additional handle in reducing the $\pi^0$ and $\eta$ fake photon backgrounds. These results demonstrate that cell-level machine learning methods can extend calorimeter-based particle identification and performance well beyond the capabilities of current conventional techniques.
Reference graph
Works this paper leans on
-
[1]
ATLAS collaboration,ATLAS Liquid Argon Calorimeter: Technical Design Report, Tech. Rep. CERN-LHCC-96-041, CERN, Geneva (1996), DOI
work page 1996
-
[2]
ATLAS collaboration,The ATLAS Experiment at the CERN Large Hadron Collider,JINST 3(2008) S08003
work page 2008
- [3]
-
[4]
Photons, Photon Jets and Dark Photons at 750 GeV and Beyond
B. Dasgupta, J. Kopp and P. Schwaller,Photons, photon jets, and dark photons at 750 GeV and beyond,Eur. Phys. J. C76(2016) [1602.04692]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[5]
L. Aparicio, A. Azatov, E. Hardy and A. Romanino,Diphotons from diaxions,JHEP2016 (2016) [1602.00949]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[6]
S. Knapen, T. Melia, M. Papucci and K.M. Zurek,Rays of light from the LHC,Phys. Rev. D 93(2016) [1512.04928]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[7]
Interpreting the 750 GeV Di-photon Resonance using photon-jets in Hidden-Valley-like models
J. Chang, K. Cheung and C.-T. Lu,Interpreting the 750 GeV diphoton resonance using photon jets in hidden-valley-like models,Phys. Rev. D93(2016) [1512.06671]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[8]
R.D. Peccei and H.R. Quinn,Constraints Imposed by CP Conservation in the Presence of Instantons,Phys. Rev. D16(1977) 1791
work page 1977
-
[9]
R.D. Peccei and H.R. Quinn,CP Conservation in the Presence of Pseudoparticles,Phys. Rev. Lett.38(1977) 1440
work page 1977
-
[10]
Wilczek,Problem of StrongPandTInvariance in the Presence of Instantons,Phys
F. Wilczek,Problem of StrongPandTInvariance in the Presence of Instantons,Phys. Rev. Lett.40(1978) 279
work page 1978
-
[11]
Weinberg,A New Light Boson?,Phys
S. Weinberg,A New Light Boson?,Phys. Rev. Lett.40(1978) 223
work page 1978
-
[12]
K. Mimasu and V. Sanz,ALPs at Colliders,JHEP06(2015) 173 [1409.4792]
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[13]
Collider Probes of Axion-Like Particles
M. Bauer, M. Neubert and A. Thamm,Collider probes of axion-like particles,JHEP2017 (2017) [1708.00443]
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[14]
Feebly-Interacting Particles:FIPs 2020 Workshop Report
P. Agrawal, M. Bauer, J. Beacham, A. Berlin, A. Boyarsky, S. Cebrian et al., Feebly-interacting particles: FIPs 2020 workshop report,Eur. Phys. J. C81(2021) [2102.12143]
work page internal anchor Pith review Pith/arXiv arXiv 2020
-
[15]
Axion-like Particle Search with a Light-Shining-Through-Walls Setup at a $\gamma$-$\gamma$ Collider
Z.-Y. Yan and J. Feng,Axion-like Particle Search with a Light-Shining-Through-Walls Setup at aγ-γCollider,2512.15192
work page internal anchor Pith review Pith/arXiv arXiv
-
[16]
E.W. Lentz, C.R. Boutan, M.S. Taubman and K.L. Gervais,Developing centimeter-scale-cavity arrays for axion dark matter detection in the 100 micro-electron-volt range,JINST21(2026) P04020 [2601.21074]
-
[17]
M.A. Akg¨ um¨ us, N. Salama, J. Egge, E. Garutti, M. Maroudas, L.H. Nguyen et al.,A new limit for axion dark matter with SPACE,JCAP04(2026) 054 [2506.18411]
-
[18]
Axion Dark Matter: What is it and Why Now?
F. Chadha-Day, J. Ellis and D.J.E. Marsh,Axion dark matter: What is it and why now?, Sci. Adv.8(2022) [2105.01406]
work page internal anchor Pith review Pith/arXiv arXiv 2022
-
[19]
D.J.E. Marsh,Axion Cosmology,Phys. Rept.643(2016) 1 [1510.07633]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[20]
M. Dine and W. Fischler,The Not So Harmless Axion,Phys. Lett. B120(1983) 137
work page 1983
-
[21]
L.F. Abbott and P. Sikivie,A Cosmological Bound on the Invisible Axion,Phys. Lett. B120 (1983) 133. – 23 –
work page 1983
-
[22]
J. Preskill, M.B. Wise and F. Wilczek,Cosmology of the Invisible Axion,Phys. Lett. B120 (1983) 127
work page 1983
-
[23]
J. Jaeckel and M. Spannowsky,Probing MeV to 90 GeV axion-like particles with LEP and LHC,Phys. Lett. B753(2016) 482–487
work page 2016
-
[24]
A 750 GeV Diphoton Signal from a Very Light Pseudoscalar in the NMSSM
U. Ellwanger and C. Hugonie,A 750 GeV Diphoton Signal from a Very Light Pseudoscalar in the NMSSM,JHEP(2016) 114 [1602.03344]
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[25]
CMS collaboration,Performance of photon reconstruction and identification with the CMS detector in proton-proton collisions at √s= 8 TeV,JINST10(2015) P08010–P08010
work page 2015
-
[26]
ATLAS collaboration,Photon identification in 2015 ATLAS data, Tech. Rep. ATL-PHYS-PUB-2016-014, CERN, Geneva (2016)
work page 2015
-
[27]
CMS collaboration,Electron and photon reconstruction and identification with the CMS experiment at the CERN LHC,JINST16(2021) P05014
work page 2021
-
[28]
ATLAS collaboration,Measurement of the photon identification efficiencies with the ATLAS detector using LHC Run 2 data collected in 2015 and 2016,Eur. Phys. J. C79(2019) [1810.05087]
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[29]
ATLAS collaboration,Identification of electrons using a deep neural network in the ATLAS experiment, Tech. Rep. ATL-PHYS-PUB-2022-022, CERN, Geneva (2022)
work page 2022
-
[30]
ATLAS collaboration,Search for pairs of highly collimated photon-jets inppcollisions at√s= 13TeV with the ATLAS detector,Phys. Rev. D99(2019) 012008
work page 2019
-
[31]
ATLAS collaboration,Search for short- and long-lived axion-like particles inH→aa→4γ decays with the ATLAS experiment at the LHC,Eur. Phys. J. C84(2024) [2312.03306]
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[32]
ATLAS collaboration,Electron Identification with a Convolutional Neural Network in the ATLAS Experiment, Tech. Rep. ATL-PHYS-PUB-2023-001, CERN, Geneva (2023)
work page 2023
-
[33]
CMS collaboration,Search for New Resonances Decaying to Pairs of Merged Diphotons in Proton-Proton Collisions at √s= 13 TeV,Phys. Rev. Lett.134(2025) 041801
work page 2025
-
[34]
CMS collaboration,Search for Exotic Higgs Boson DecaysH→ AA →4γwith Events Containing Two Merged Diphotons in Proton-Proton Collisions at √s= 13 TeV,Phys. Rev. Lett.131(2023) 101801
work page 2023
-
[35]
CMS collaboration,Reconstruction of decays to merged photons using end-to-end deep learning with domain continuation in the CMS detector,Phys. Rev. D108(2023) [2204.12313]
work page internal anchor Pith review Pith/arXiv arXiv 2023
- [36]
-
[37]
Energy Flow Networks: Deep Sets for Particle Jets
P.T. Komiske, E.M. Metodiev and J. Thaler,Energy flow networks: deep sets for particle jets,JHEP2019(2019) [1810.05165]
work page internal anchor Pith review Pith/arXiv arXiv 2019
-
[38]
X. Ai, W.Y. Feng, S.-C. Hsu, K. Li and C.-T. Lu,Detecting highly collimated photon-jets from Higgs boson exotic decays with deep learning,2401.15690
work page internal anchor Pith review Pith/arXiv arXiv
-
[39]
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez et al.,Attention Is All You Need,1706.03762
work page internal anchor Pith review Pith/arXiv arXiv
-
[40]
ATLAS collaboration,Graph Neural Network Jet Flavour Tagging with the ATLAS Detector, Tech. Rep. ATL-PHYS-PUB-2022-027, CERN, Geneva (2022). – 24 –
work page 2022
- [41]
-
[42]
MLP-Mixer: An all-MLP Architecture for Vision
I. Tolstikhin, N. Houlsby, A. Kolesnikov, L. Beyer, X. Zhai, T. Unterthiner et al., MLP-Mixer: An all-MLP Architecture for Vision,2105.01601
work page internal anchor Pith review Pith/arXiv arXiv
-
[43]
ATLAS collaboration,Technical Design Report for the Phase-II Upgrade of the ATLAS TDAQ System, Tech. Rep. CERN-LHCC-2017-020, ATLAS-TDR-029, CERN, Geneva (2017), DOI
work page 2017
-
[44]
Agostinelli et al.,Geant4– a simulation toolkit,Nucl
S. Agostinelli et al.,Geant4– a simulation toolkit,Nucl. Instrum. Meth. A506(2003) 250
work page 2003
-
[45]
gabrielpmatos/g4-atlas-calorimeter: Datasets for ML Trainings
M. Pitt and G. Matos, “gabrielpmatos/g4-atlas-calorimeter: Datasets for ML Trainings.” Zenodo, 2026. https://zenodo.org/doi/10.5281/zenodo.18825682
-
[46]
ATLAS collaboration,Electron and photon energy calibration with the ATLAS detector using LHC Run 2 data,JINST19(2024) P02009 [2309.05471]
work page internal anchor Pith review Pith/arXiv arXiv 2024
-
[47]
ATLAS collaboration,Electron reconstruction and identification in the ATLAS experiment using the 2015 and 2016 LHC proton–proton collision data at √s= 13TeV,Eur. Phys. J. C 79(2019) 639 [1902.04655]
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[48]
ATLAS collaboration,Topological cell clustering in the ATLAS calorimeters and its performance in LHC Run 1,Eur. Phys. J. C77(2017) 490 [1603.02934]
work page internal anchor Pith review Pith/arXiv arXiv 2017
-
[49]
T. Chen and C. Guestrin,XGBoost: A Scalable Tree Boosting System, inProceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’16, p. 785–794, ACM, Aug., 2016, DOI
work page 2016
-
[50]
PyTorch: An Imperative Style, High-Performance Deep Learning Library
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan et al.,PyTorch: An Imperative Style, High-Performance Deep Learning Library,1912.01703
work page internal anchor Pith review Pith/arXiv arXiv 1912
-
[51]
Adam: A Method for Stochastic Optimization
D.P. Kingma and J. Ba,Adam: A Method for Stochastic Optimization,1412.6980
work page internal anchor Pith review Pith/arXiv arXiv
-
[52]
Spconv: Spatially Sparse Convolution Library
Spconv Contributors, “Spconv: Spatially Sparse Convolution Library.” https://github.com/traveller59/spconv, 2022
work page 2022
-
[53]
Submanifold Sparse Convolutional Networks
B. Graham and L. van der Maaten,Submanifold Sparse Convolutional Networks, 1706.01307
work page internal anchor Pith review Pith/arXiv arXiv
-
[54]
Chollet et al., “Keras.”https://keras.io, 2015
F. Chollet et al., “Keras.”https://keras.io, 2015
work page 2015
-
[55]
TensorFlow: A system for large-scale machine learning
M. Abadi, P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean et al.,TensorFlow: A system for large-scale machine learning,1605.08695
work page internal anchor Pith review Pith/arXiv arXiv
-
[56]
Barr et al.,Salt: Multimodal Multitask Machine Learning for High Energy Physics,J
J. Barr et al.,Salt: Multimodal Multitask Machine Learning for High Energy Physics,J. Open Source Softw.10(2025) 7217
work page 2025
- [57]
-
[58]
Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning
S. Elfwing, E. Uchibe and K. Doya,Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning,1702.03118
work page internal anchor Pith review Pith/arXiv arXiv
-
[59]
On Layer Normalization in the Transformer Architecture
R. Xiong, Y. Yang, D. He, K. Zheng, S. Zheng, C. Xing et al.,On Layer Normalization in the Transformer Architecture,2002.04745
work page internal anchor Pith review Pith/arXiv arXiv 2002
-
[60]
Y. Li, D. Tarlow, M. Brockschmidt and R. Zemel,Gated Graph Sequence Neural Networks, 1511.05493
work page internal anchor Pith review Pith/arXiv arXiv
-
[61]
Statistical Properties of the log-cosh Loss Function Used in Machine Learning
R.A. Saleh and A.K.M.E. Saleh,Statistical Properties of the log-cosh Loss Function Used in Machine Learning,2208.04564. – 25 –
work page internal anchor Pith review Pith/arXiv arXiv
-
[62]
Decoupled Weight Decay Regularization
I. Loshchilov and F. Hutter,Decoupled Weight Decay Regularization,1711.05101
work page internal anchor Pith review Pith/arXiv arXiv
- [63]
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.