REVIEW 1 major objections 1 minor 80 references
Cluster Mass Inference from Galaxy Kinematics
T0 review · 1 major / 1 minor · reviewed 2026-06-27 · grok-4.3
Pith's one-line read A neural network trained on simulations infers cluster masses from galaxy positions and velocities with half the usual scatter.
desk verdict Deep Sets + NPE on Uchuu mocks cuts mass scatter to ~0.1 dex beyond M-sigma, but gains rest entirely on one simulation's fidelity to real clusters. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Permutation-invariant Deep Sets architecture with normalizing-flow posterior estimation that isolates kinematic information beyond velocity dispersion.
What would settle it
Applying the trained model to real observed clusters and checking whether the inferred masses match independent weak-lensing measurements to within the predicted 0.1 dex scatter.
Extended reading notes
Core claim
The central claim is that a permutation-invariant Deep Sets architecture combined with neural posterior estimation via normalizing flows recovers cluster masses by learning explicit residual corrections to the classical M-σ relation, reducing scatter to approximately 0.1 dex in idealized interloper-free cases and maintaining performance in realistic cylindrical observations at masses above 10^14.5 solar masses per h.
Load-bearing premise
The simulation used for training accurately captures how real galaxy positions and velocities relate to true cluster mass.
Editorial extensions
If this is right
- Mass estimates improve enough to tighten cosmological constraints from upcoming cluster surveys.
- Full posterior outputs supply reliable uncertainty quantification for each cluster.
- Performance remains stable against interloper contamination in high-mass systems.
- The kinematic information content is saturated, establishing a baseline for later refinements.
Reading between the lines
- The same set-based architecture could be retrained on other cluster observables such as richness or X-ray temperature to extract complementary information.
- Cross-validation against independent mock catalogs would test whether the learned corrections transfer beyond the training simulation.
- Deployment on wide-field surveys would allow direct tests of whether the reduced scatter improves dark-energy constraints from cluster abundance.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a simulation-based inference pipeline combining a permutation-invariant Deep Sets architecture with neural posterior estimation via normalizing flows to infer galaxy cluster masses from projected phase-space data of member and interloper galaxies. The model is trained on the Uchuu-UniverseMachine simulation to predict residual corrections to the classical M–σ relation, with reported scatter reductions to ~0.1 dex (twofold improvement) in idealized interloper-free cases and comparable high-mass performance (>10^14.5 M_⊙/h) in realistic cylindrical setups.
Significance. If the simulation-based corrections generalize, the approach offers a flexible framework for more accurate mass estimates with reliable uncertainty quantification, leveraging full phase-space information beyond velocity dispersion alone. The explicit residual modeling and permutation-invariant architecture are methodological strengths that could serve as a baseline for future survey analyses.
major comments (1)
- [Abstract] Abstract and evaluation sections: all quantitative claims (including the ~0.1 dex scatter and twofold improvement) are obtained exclusively by training and testing on Uchuu-UniverseMachine mocks; the central claim of applicability to real clusters therefore rests on the untested assumption that the joint distribution p(phase-space, M_true) in this simulation—including galaxy formation physics, orbital distributions, projection effects, and interloper statistics—matches observations sufficiently closely for the learned corrections to remain valid. No cross-simulation validation or comparison to observed cluster samples is reported.
minor comments (1)
- Additional details on training procedure, validation splits, hyperparameter choices, and overfitting diagnostics would strengthen the soundness of the reported performance metrics.
Simulated Author's Rebuttal
We thank the referee for their careful reading and constructive comments on our manuscript. We address the major comment below, acknowledging the scope of our simulation-based study.
read point-by-point responses
-
Referee: [Abstract] Abstract and evaluation sections: all quantitative claims (including the ~0.1 dex scatter and twofold improvement) are obtained exclusively by training and testing on Uchuu-UniverseMachine mocks; the central claim of applicability to real clusters therefore rests on the untested assumption that the joint distribution p(phase-space, M_true) in this simulation—including galaxy formation physics, orbital distributions, projection effects, and interloper statistics—matches observations sufficiently closely for the learned corrections to remain valid. No cross-simulation validation or comparison to observed cluster samples is reported.
Authors: We agree that all reported quantitative results, including the scatter reduction to ~0.1 dex and the twofold improvement, are obtained exclusively from training and testing on Uchuu-UniverseMachine mocks. The manuscript does not include cross-simulation validation or direct comparisons to observed cluster samples. The work is presented as a simulation-based inference framework evaluated in controlled mock settings (both interloper-free and cylindrical), with the abstract and methods sections explicitly stating that the model is trained on this simulation. We do not claim that the learned corrections are directly applicable to real clusters; rather, the results demonstrate the information gain achievable within this simulation's joint distribution of phase-space and mass. This is a genuine limitation, as the validity for observations depends on the simulation's fidelity in galaxy formation, orbits, projections, and interlopers—an assumption not tested here. We will revise the abstract, introduction, and conclusions to more explicitly state that the performance metrics are simulation-specific and to emphasize the need for future cross-validation on other simulations and observational comparisons as next steps. revision: partial
Circularity Check
No significant circularity; performance gain is empirical evaluation on simulation test set
full rationale
The paper trains a permutation-invariant Deep Sets + NPE model on Uchuu-UniverseMachine mocks to output residual corrections to the classical M-σ relation and then measures the resulting scatter reduction (~0.1 dex, twofold improvement) by direct comparison against M-σ on held-out simulation realizations. This is a standard supervised-learning evaluation against an independent baseline on the same external data distribution; no equation reduces the reported improvement to a quantity defined by the model itself, no self-citation chain is load-bearing for the central claim, and no fitted parameter is renamed as a prediction. The derivation chain remains self-contained within the simulation-based framework.
Assumptions & free parameters
assumptions (1)
- domain assumption The Uchuu-UniverseMachine simulation accurately represents the mapping from observed galaxy kinematics to true halo mass in the real universe.
Cite this review
Pith. "Pith review of Cluster Mass Inference from Galaxy Kinematics." pith.science (2026). https://pith.science/paper/5AE65KU6
@misc{pith2026260612938,
author = {Pith},
title = {Pith review of: Cluster Mass Inference from Galaxy Kinematics},
year = {2026},
howpublished = {\url{https://pith.science/paper/5AE65KU6}},
note = {Machine review of arXiv:2606.12938}
}
abstract
The masses of galaxy clusters carry cosmological and astrophysical information. We develop a simulation-based inference pipeline to infer cluster masses from full projected phase-space information of member and interloper galaxies. Our method combines a permutation-invariant Deep Sets architecture with neural posterior estimation using normalizing flows, enabling the recovery of expressive posterior distributions. We train the model to predict residual corrections to the classical $M$--$\sigma$ relation, thus explicitly isolating information beyond velocity dispersion. Using the Uchuu-UniverseMachine simulation, we evaluate the method under both idealized (interloper-free) and realistic (cylindrical) observational setups. In the idealized case, our model reduces the scatter in mass estimates to as low as $\sim 0.1$ dex, representing a twofold improvement over the traditional $M$--$\sigma$ relation. In the cylindrical setup, we achieve comparable performance at the high-mass end ($> 10^{14.5}\,M_\odot/h$), demonstrating robustness against interloper contamination. We demonstrate that set-based simulation-driven inference provides a powerful and flexible framework for galaxy cluster mass estimation, enabling improved accuracy and reliable uncertainty characterization for upcoming large-scale surveys. Our model saturates the kinematic information content and thus suggests a baseline for future studies.
Figures
Figures from the paper (5 more)
Reference graph
Works this paper leans on
-
[1]
The SRG/eROSITA All-Sky Survey: Cosmology Constraints from Cluster Abundances in the Western Galactic Hemisphere. arXiv e-prints , keywords =. doi:10.48550/arXiv.2402.08458 , archivePrefix =. 2402.08458 , primaryClass =
-
[2]
Predicting dark matter halo masses from simulated galaxy images and environments. arXiv e-prints , keywords =. doi:10.48550/arXiv.2407.13735 , archivePrefix =. 2407.13735 , primaryClass =
-
[3]
Inferring the mass content of galaxy clusters with satellite kinematics and Jeans Anisotropic modeling. arXiv e-prints , keywords =. doi:10.48550/arXiv.2407.11721 , archivePrefix =. 2407.11721 , primaryClass =
-
[4]
Masses of Sunyaev-Zel'dovich Galaxy Clusters Detected by The Atacama Cosmology Telescope: Stacked Lensing Measurements with Subaru HSC Year 3 data. arXiv e-prints , keywords =. doi:10.48550/arXiv.2407.08201 , archivePrefix =. 2407.08201 , primaryClass =
-
[5]
How does the velocity anisotropy of halo stars, dark matter and satellite galaxies depend on host halo properties?. arXiv e-prints , keywords =. doi:10.48550/arXiv.2407.14827 , archivePrefix =. 2407.14827 , primaryClass =
-
[6]
A Robust and Efficient Deep Learning Method for Dynamical Mass Measurements of Galaxy Clusters. , keywords =. doi:10.3847/1538-4357/ab4f82 , archivePrefix =. 1902.05950 , primaryClass =
-
[7]
HaloFlow. I. Neural Inference of Halo Mass from Galaxy Photometry and Morphology. , keywords =. doi:10.3847/1538-4357/ad4344 , archivePrefix =. 2310.04503 , primaryClass =
-
[8]
The FLAMINGO Project: An assessment of the systematic errors in the predictions of models for galaxy cluster counts used to infer cosmological parameters. arXiv e-prints , keywords =. doi:10.48550/arXiv.2408.17217 , archivePrefix =. 2408.17217 , primaryClass =
Show all 80 references
-
[9]
, keywords =
The Uchuu-universe machine data set: galaxies in and around clusters. , keywords =. doi:10.1093/mnras/stac3514 , archivePrefix =. 2209.12918 , primaryClass =
- [10]
-
[11]
Astronomy and Computing , keywords =
C ^ 2 -GAME: Classification of cluster galaxy membership with machine learning. Astronomy and Computing , keywords =. doi:10.1016/j.ascom.2023.100743 , archivePrefix =. 2205.01700 , primaryClass =
2023 doi
- [12]
- [13]
- [14]
-
[15]
40th International Conference on Machine Learning , keywords =
Sampling-Based Accuracy Testing of Posterior Estimators for General Inference. 40th International Conference on Machine Learning , keywords =. doi:10.48550/arXiv.2302.03026 , archivePrefix =. 2302.03026 , primaryClass =
-
[16]
Tracing cosmic evolution with clusters of galaxies , author =. Rev. Mod. Phys. , volume =. 2005 , month =. doi:10.1103/RevModPhys.77.207 , url =
2005 doi
- [17]
- [18]
- [19]
-
[20]
, keywords =
The dynamical state and mass-concentration relation of galaxy clusters. , keywords =. doi:10.1111/j.1365-2966.2012.21892.x , archivePrefix =. 1206.1049 , primaryClass =
2012 doi
- [21]
- [22]
-
[23]
, keywords =
Observation of the Coma cluster of galaxies with ROSAT during the all-sky-survey. , keywords =
-
[24]
and Allen, Steven W
Mantz, Adam B. and Allen, Steven W. and Morris, R. Glenn and von der Linden, Anja and Applegate, Douglas E. and Kelly, Patrick L. and Burke, David L. and Donovan, David and Ebeling, Harald , title =. Monthly Notices of the Royal Astronomical Society , volume =. 2016 , month =....
2016 doi
- [25]
-
[26]
, keywords =
Small-Scale Fluctuations of Relic Radiation. , keywords =. doi:10.1007/BF00653471 , adsurl =
-
[27]
Comments on Astrophysics and Space Physics , keywords =
The Observations of Relic Radiation as a Test of the Nature of X-Ray Radiation from the Clusters of Galaxies. Comments on Astrophysics and Space Physics , keywords =
- [28]
- [29]
- [30]
- [31]
-
[32]
, keywords =
The Atacama Cosmology Telescope: A Catalog of >4000 Sunyaev-Zel dovich Galaxy Clusters. , keywords =. doi:10.3847/1538-4365/abd023 , archivePrefix =. 2009.11043 , primaryClass =
2009 doi
- [33]
- [34]
- [35]
-
[36]
Helvetica Physica Acta , year = 1933, month = jan, volume =
Die Rotverschiebung von extragalaktischen Nebeln. Helvetica Physica Acta , year = 1933, month = jan, volume =
1933
- [37]
-
[38]
and Diaferio, Antonaldo and Rines, Kenneth J
Geller, Margaret J. and Diaferio, Antonaldo and Rines, Kenneth J. and Serra, Ana Laura , title =. The Astrophysical Journal , abstract =. 2013 , month =. doi:10.1088/0004-637X/764/1/58 , url =
2013 doi
- [39]
- [40]
-
[41]
, keywords =
Simulation-based inference of dynamical galaxy cluster masses with 3D convolutional neural networks. , keywords =. doi:10.1093/mnras/staa3922 , archivePrefix =. 2009.03340 , primaryClass =
2009 doi
-
[42]
Mass Estimation of Galaxy Clusters with Deep Learning. I. Sunyaev-Zel'dovich Effect. , keywords =. doi:10.3847/1538-4357/aba694 , archivePrefix =. 2003.06135 , primaryClass =
2003 doi
-
[43]
Cosmic Microwave Background Cluster Lensing
Mass Estimation of Galaxy Clusters with Deep Learning II. Cosmic Microwave Background Cluster Lensing. , keywords =. doi:10.3847/1538-4357/ac32d0 , archivePrefix =. 2005.13985 , primaryClass =
2005 doi
-
[44]
, keywords =
Approximate Bayesian Uncertainties on Deep Learning Dynamical Mass Estimates of Galaxy Clusters. , keywords =. doi:10.3847/1538-4357/abd101 , archivePrefix =. 2006.13231 , primaryClass =
2006 doi
-
[45]
Nature Astronomy , keywords =
The dynamical mass of the Coma cluster from deep learning. Nature Astronomy , keywords =. doi:10.1038/s41550-022-01711-1 , archivePrefix =. 2206.14834 , primaryClass =
-
[46]
, keywords =
Benchmarks and explanations for deep learning estimates of X-ray galaxy cluster masses. , keywords =. doi:10.1093/mnras/stad2005 , archivePrefix =. 2303.00005 , primaryClass =
-
[47]
, keywords =
Galaxy cluster mass estimation with deep learning and hydrodynamical simulations. , keywords =. doi:10.1093/mnras/staa3030 , archivePrefix =. 2005.11819 , primaryClass =
2005 doi
-
[48]
arXiv e-prints , keywords =
Estimating Dark Matter Halo Masses in Simulated Galaxy Clusters with Graph Neural Networks. arXiv e-prints , keywords =. doi:10.48550/arXiv.2411.12629 , archivePrefix =. 2411.12629 , primaryClass =
-
[49]
arXiv e-prints , keywords =
HaloFlow II: Robust Galaxy Halo Mass Inference with Domain Adaptation. arXiv e-prints , keywords =. doi:10.48550/arXiv.2603.12380 , archivePrefix =. 2603.12380 , primaryClass =
-
[50]
, keywords =
Machine-learning Cosmology from Void Properties. , keywords =. doi:10.3847/1538-4357/aceaf6 , archivePrefix =. 2212.06860 , primaryClass =
-
[51]
Machine Learning: Science and Technology , keywords =
Predicting the thermal Sunyaev-Zel'dovich field using modular and equivariant set-based neural networks. Machine Learning: Science and Technology , keywords =. doi:10.1088/2632-2153/ac78c2 , archivePrefix =. 2203.00026 , primaryClass =
-
[52]
, keywords =
Quijote-PNG: The Information Content of the Halo Mass Function. , keywords =. doi:10.3847/1538-4357/acfe70 , archivePrefix =. 2305.10597 , primaryClass =
-
[53]
, keywords =
Robust Field-level Likelihood-free Inference with Galaxies. , keywords =. doi:10.3847/1538-4357/acd1e2 , archivePrefix =. 2302.14101 , primaryClass =
-
[54]
Proceedings of the National Academy of Sciences , volume =
Kyle Cranmer and Johann Brehmer and Gilles Louppe , title =. Proceedings of the National Academy of Sciences , volume =. 2020 , doi =
2020
-
[55]
Proceedings of the 36th International Conference on Machine Learning , pages =
Automatic Posterior Transformation for Likelihood-Free Inference , author =. Proceedings of the 36th International Conference on Machine Learning , pages =. 2019 , editor =
2019
-
[56]
Flexible statistical inference for mechanistic models of neural dynamics , url =
Lueckmann, Jan-Matthis and Goncalves, Pedro J and Bassetto, Giacomo and \". Flexible statistical inference for mechanistic models of neural dynamics , url =. Advances in Neural Information Processing Systems , editor =
-
[57]
Fast -free Inference of Simulation Models with Bayesian Conditional Density Estimation , url =
Papamakarios, George and Murray, Iain , booktitle =. Fast -free Inference of Simulation Models with Bayesian Conditional Density Estimation , url =
-
[58]
arXiv e-prints , keywords =
Neural Spline Flows. arXiv e-prints , keywords =. doi:10.48550/arXiv.1906.04032 , archivePrefix =. 1906.04032 , primaryClass =
1906 doi
-
[59]
arXiv e-prints , keywords =
Invertible Generative Modeling using Linear Rational Splines. arXiv e-prints , keywords =. doi:10.48550/arXiv.2001.05168 , archivePrefix =. 2001.05168 , primaryClass =
2001 doi
- [60]
-
[61]
, keywords =
A Deep Redshift Survey of the Perseus Cluster (A426): Spatial Distribution and Kinematics of Galaxies. , keywords =. doi:10.3847/1538-4365/ad390d , archivePrefix =. 2403.19307 , primaryClass =
-
[62]
, keywords =
Dark Energy Survey Year 1 Results: Cosmological constraints from cluster abundances and weak lensing. , keywords =. doi:10.1103/PhysRevD.102.023509 , archivePrefix =. 2002.11124 , primaryClass =
2002 doi
- [63]
- [64]
- [65]
-
[66]
arXiv e-prints , keywords =
Inferring Halo Mass and Scale Radius of Galaxy Clusters Using Convolutional Neural Networks and Uchuu-UniverseMachine Catalogs. arXiv e-prints , keywords =
-
[67]
Zaheer, Manzil and Kottur, Satwik and Ravanbakhsh, Siamak and Poczos, Barnabas and Salakhutdinov, Ruslan and Smola, Alexander , year =. Deep. arXiv e-prints , pages =
- [68]
-
[69]
, keywords =
The Uchuu simulations: Data Release 1 and dark matter halo concentrations. , keywords =. doi:10.1093/mnras/stab1755 , archivePrefix =. 2007.14720 , primaryClass =
2007 doi
- [70]
-
[71]
Robust constraints on neutrino properties
The observed growth of massive galaxy clusters - IV. Robust constraints on neutrino properties. , keywords =. doi:10.1111/j.1365-2966.2010.16794.x , archivePrefix =. 0911.1788 , primaryClass =
2010 doi
- [72]
- [73]
-
[74]
arXiv e-prints , keywords =
Improved Cosmological Constraints from SDSS redMaPPer Clusters via X-ray Follow-up of a Complete Subsample of Systems. arXiv e-prints , keywords =. doi:10.48550/arXiv.1910.13548 , archivePrefix =. 1910.13548 , primaryClass =
1910 doi
-
[75]
, keywords =
Cosmological constraints from the abundance, weak lensing, and clustering of galaxy clusters: Application to the SDSS. , keywords =. doi:10.1051/0004-6361/202348296 , archivePrefix =. 2310.09146 , primaryClass =
-
[76]
, keywords =
Multiprobe cosmology from the abundance of SPT clusters and DES galaxy clustering and weak lensing. , keywords =. doi:10.1103/PhysRevD.111.063533 , archivePrefix =. 2412.07765 , primaryClass =
- [77]
-
[78]
, keywords =
The statistics of CDM halo concentrations. , keywords =. doi:10.1111/j.1365-2966.2007.12381.x , archivePrefix =. 0706.2919 , primaryClass =
2007 doi
-
[79]
, keywords =
Dynamical state for 964 galaxy clusters from Chandra X-ray images. , keywords =. doi:10.1093/mnras/staa2363 , archivePrefix =. 2008.01299 , primaryClass =
2008 doi
- [80]
Reviewed June 27, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.