REVIEW 3 major objections 4 minor 40 references
A 3D convolutional network predicts solar subgrid Reynolds stresses more accurately than standard physics-based closures.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · grok-4.5
2026-07-13 05:24 UTC pith:DWJ6QZAZ
load-bearing objection Solid offline a-priori CNN gains on quiet-Sun Reynolds stresses, but the live-closure claim is still untested. the 3 major comments →
Developing Machine Learning Models of Subgrid Turbulent Transport for Quiet Sun 3D Radiative Hydrodynamic Simulations
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
A 3D convolutional neural network that ingests local averaged velocity cubes and density can reconstruct the six Reynolds stress tensor components of quiet-Sun turbulence more accurately than the Gradient model, the Smagorinsky model (under two coefficient choices), and a multilayer perceptron, delivering average RMSE reductions of about 31 percent on the diagonal components and 8 percent on the off-diagonal components.
What carries the argument
The 3DCNN1.1 architecture: two 3-by-3-by-3 convolutional layers (32 then 64 filters, LeakyReLU) that extract spatial features from the three velocity channels, followed by concatenation of the central density and SoftSign fully-connected layers that output the six stress components; trained after signed-log transformation of the targets.
Load-bearing premise
That accurate offline predictions on filtered high-resolution cubes (and static low-resolution snapshots) will remain accurate once the same network is inserted as a live subgrid closure inside a time-evolving solar simulation.
What would settle it
Insert the trained network as the active subgrid model inside a low-resolution StellarBox run and check whether the resulting large-scale velocity and density statistics, plus the emergent stress distributions, match those of a high-resolution reference simulation better than the same run performed with a Smagorinsky closure.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper develops 3D convolutional neural network (3DCNN) surrogates, along with an MLP baseline, to predict the six components of the Reynolds stress tensor τ_ij from local 3×3×3 averaged velocity fields and central density in quiet-Sun StellarBox radiative hydrodynamic simulations. High-resolution (∼12.5 km) cubes are filtered to ∼50 km effective resolution to generate both inputs and exact targets via the definition τ_ij = 〈u_i u_j〉 − ũ_i ũ_j. After log/signed-log transforms and standardization of the heavily skewed targets, the best architecture (3DCNN1.1 with LeakyReLU) is shown via held-out RMSE, R², PDFs, error histograms, density-binned diagnostics, and low-resolution snapshot tests to outperform the Gradient model, Smagorinsky (Cs=Cc=0.1 and 0.001), and MLP, with average RMSE reductions of ∼31 % on diagonal and ∼8 % on off-diagonal components relative to Gradient (Table 5). The authors conclude that CNNs are a viable candidate for subgrid-scale modeling, while explicitly deferring online coupling into StellarBox.
Significance. If the offline gains translate under live coupling, the work would supply a coefficient-free, data-driven alternative to classical Smagorinsky/Gradient closures for solar convection-zone LES, with clear practical value for multi-scale quiet-Sun modeling. Even as a pure a-priori study the manuscript is carefully executed: physical units are restored after inverted transforms, multiple physics baselines and architecture ablations are reported, and density-binned plus cluster diagnostics expose regime-dependent performance. These elements constitute a solid, reproducible foundation for subsequent a-posteriori tests and are already useful to the solar and LES communities.
major comments (3)
- [Abstract, §1, §5.4] Abstract, §1 and §5.4: the central claim that the 3DCNN is “a viable candidate for modeling subgrid processes and a promising alternative to traditional turbulence models” rests exclusively on a-priori regression accuracy (Table 5, Figs. 9–12). When the same network is applied to genuine low-resolution (∼50 km) fields the predicted stress PDFs systematically compress in the tails (Figs. 13–14). Classical LES literature treats the a-priori/a-posteriori gap as decisive; without at least one online StellarBox integration (or a clear, quantitative statement that the present results do not yet establish live-closure viability) the abstract and conclusion over-reach the evidence that is actually supplied.
- [Table 5, §5.1] Table 5 and §5.1: the headline ∼31 % / ∼8 % RMSE reductions are computed solely against the Gradient model. Against Smagorinsky (Cs=Cc=0.001) the gains are larger, yet that coefficient set is known to under-dissipate; against Cs=Cc=0.1 the diagonal gains shrink. The abstract and conclusion should report the full range of relative improvements (or at least both Smagorinsky settings) so that the claimed superiority is not tied to a single, relatively weak baseline.
- [§3.1, Eq. (5)] §3.1 and Eq. (5): targets are obtained by direct spatial averaging of the high-resolution velocity products. While this is the standard a-priori procedure, the manuscript never quantifies how sensitive the learned mapping is to the precise filter kernel or to the non-overlapping 4×4×4 sub-cube sampling. A short sensitivity test (or an explicit statement that the reported RMSE is filter-specific) is needed before the numbers can be treated as robust estimates of subgrid stress.
minor comments (4)
- [Figs. 1–2] Figure 1 and Figure 2 captions: “normalized units” are defined only later in the text; a one-sentence reminder in the captions would improve readability.
- [§5.7] §5.7: the K-means analysis is performed on a single data cube and uses an arbitrary k=5; the section title already labels it “preliminary,” but the body still presents cluster-wise R² values as if they generalize. Soften the language or move the entire subsection to an appendix.
- [Table 6] Table 6: RMSLE is introduced without definition; a brief formula or reference would help non-ML readers.
- Throughout: occasional typographical inconsistencies (e.g., “Th eAstrophysical Journal”, missing spaces around ×10^n) should be cleaned in production.
Circularity Check
No circularity: supervised regression of independently defined Reynolds stresses against held-out data and external physics baselines.
full rationale
The paper computes Reynolds-stress targets directly from high-resolution velocity products via the standard definition (Eq. 5), trains a 3DCNN (and MLP) to regress those targets from filtered 3 imes3 imes3 velocity+density inputs, and evaluates RMSE/R^{2} on a held-out test set after inverting the log transform. The reported ~31 % / ~8 % improvements (Table 5, abstract) are empirical comparisons against the Gradient model (Eq. 6) and two fixed-coefficient Smagorinsky models (Eqs. 7–9); no free parameter is fitted to force agreement with the claimed gains, and the log/signed-log preprocessing is a conventional variance-stabilizing step whose effect is ablated (Sec. 5.6, Table 6). Self-citations supply only the StellarBox data source and prior solar-simulation context; they do not underwrite uniqueness theorems, ansatzes, or load-bearing mathematical steps. The a-priori / a-posteriori gap noted by the skeptic is a validity limitation of the experimental design, not a circular reduction of the derivation chain. The central claim therefore stands as ordinary supervised learning plus external benchmarking and contains no self-definitional, fitted-input-as-prediction, or self-citation-load-bearing circularity.
Axiom & Free-Parameter Ledger
free parameters (4)
- Smagorinsky coefficients Cs=Cc =
0.1 and 0.001
- CNN learning rate, batch size, filter counts, activation slopes =
lr=0.001, batch=128, alpha=0.01
- Log / signed-log offset and scaling constants for targets =
scale 1e8, offset +1
- K-means cluster count (k=5) =
5
axioms (4)
- domain assumption Reynolds stress is exactly tau_ij = <u_i u_j> - <u_i><u_j> computed on the high-resolution cubes after 4x spatial averaging.
- domain assumption Non-overlapping 4x4x4 sub-cubes sampled every 5 min are statistically independent enough for random train/val/test splits.
- ad hoc to paper Offline regression accuracy on filtered fields is a meaningful indicator of utility as an SGS closure.
- domain assumption Standard LES continuum equations and the compressible Smagorinsky form used by StellarBox remain valid for the quiet-Sun regime studied.
read the original abstract
Numerical modeling of solar plasma dynamics is affected by the resolution of the computational grid. This often requires the estimation of subgrid processes related to the small-scale flow turbulence, as these processes play a critical role in momentum transport and energy dissipation. In this work, we investigate the use of deep learning techniques as surrogate models for subgrid turbulent transport in realistic hydrodynamic simulations of the quiet Sun. We describe the development of a 3D Convolutional Neural Network (CNN) to capture spatial dependencies in 3D velocity fields, leveraging different activation functions, as well as different architectural designs. We specifically focus on the prediction of Reynolds stress tensor components. The resultant model integrates velocity vector components and scalar features, such as plasma density, to enhance prediction accuracy. We compare the 3DCNN model to other types of models, such as a Multilayer Perceptron (MLP) and physics-based Gradient and Smagorinsky models, and show that the final model design reconstructs the Reynolds stress tensor components more accurately. Specifically, a 3DCNN model achieves an average improvement of ~31% on diagonal components and ~8% on the off-diagonal components of the stress tensor. Additionally, we show that applying a logarithmic data transformation of the target stress tensor components, to handle heavily skewed data, improves model performance. Results demonstrate the potential of deep learning, particularly CNNs, to approximate Reynolds stress tensor components for the upper solar convection zone and lower atmosphere, making them a viable candidate for modeling subgrid processes and a promising alternative to traditional turbulence models.
Figures
Reference graph
Works this paper leans on
-
[1]
Gudiksen, B. V., & Carlsson, M. 2023, Astronomy & Astrophysics, 675, A103, doi: 10.1051/0004-6361/202346765 Bell´ ego, C., Benatia, D., & Pape, L. 2022, Dealing with Logs and Zeros in Regression Models, doi: 10.48550/arXiv.2203.11820 43
-
[2]
2010, Astronomische Nachrichten, 331, 636, doi: 10.1002/asna.201011390
Cao, W., Gorceix, N., Coulter, R., et al. 2010, Astronomische Nachrichten, 331, 636, doi: 10.1002/asna.201011390
-
[3]
Cleophas, T. J., & Zwinderman, A. H. 2016, Logarithmic Transformations, a Great Help to Statistical Analyses (Cham: Springer International Publishing), 243–247, doi: 10.1007/978-3-319-27104-0 43
-
[4]
Cole, T. J., & Altman, D. G. 2017, BMJ, 358, doi: 10.1136/bmj.j3683
-
[5]
Germano, M., Piomelli, U., Moin, P., & Cabot, W. H. 1991, Physics of Fluids A, 3, 1760, doi: 10.1063/1.857955
doi:10.1063/1.857955 1991
-
[6]
Gudiksen, B. V., Carlsson, M., Hansteen, V. H., et al. 2011, Astronomy & Astrophysics, 531, A154, doi: 10.1051/0004-6361/201116520
-
[7]
Harris, C. R., Millman, K. J., et al. 2020, Nature, 585, 357, doi: 10.1038/s41586-020-2649-2
-
[8]
He, K., Zhang, X., Ren, S., & Sun, J. 2015, in Proceedings of the IEEE International Conference on Computer Vision (ICCV), 1026–1034, doi: 10.1109/ICCV.2015.123
-
[9]
He, K., Zhang, X., Ren, S., & Sun, J. 2016, in Proceedings of the IEEE conference on computer vision and pattern recognition, 770–778, doi: 10.1109/CVPR.2016.90
-
[10]
Hunter, J. D. 2007, Computing in Science & Engineering, 9, 90, doi: 10.1109/MCSE.2007.55
-
[11]
Mansour, N. N. 2008, The Astrophysical Journal Letters, 684, L51, doi: 10.1086/592042
-
[12]
I., Huang, C., Sitdikov, I., et al
Karpov, P. I., Huang, C., Sitdikov, I., et al. 2022, The Astrophysical Journal, 940, 26, doi: 10.3847/1538-4357/ac88cc
-
[13]
2022, Monthly Weather Review, 150, 2279 , doi: 10.1175/MWR-D-21-0217.1
Khani, S., & Port´ e-Agel, F. 2022, Monthly Weather Review, 150, 2279 , doi: 10.1175/MWR-D-21-0217.1
-
[14]
Kitiashvili, I. N. 2014, Publications of the Astronomical Society of Japan, 66, S8, doi: 10.1093/pasj/psu114
-
[15]
Kitiashvili, I. N., Abramenko, V. I., Goode, P. R., et al. 2013, Physica Scripta Volume T, 155, 014025, doi: 10.1088/0031-8949/2013/T155/014025
-
[16]
Kitiashvili, I. N., Couvidat, S., & Lagg, A. 2015, Th eAstrophysical Journal, 808, 59, doi: 10.1088/0004-637X/808/1/59
-
[17]
Kitiashvili, I. N., Kosovichev, A. G., Mansour, N. N., & Wray, A. A. 2011, Solar Physics, 268, 283, doi: 10.1007/s11207-010-9679-0 —. 2012, The Astrophysical Journal Letters, 751, L21, doi: 10.1088/2041-8205/751/1/L21
-
[18]
Sadykov, V. M., & Guerrero, G. 2023, MNRAS, 518, 504, doi: 10.1093/mnras/stac2946
-
[19]
L., Hannun, A
Maas, A. L., Hannun, A. Y., & Ng, A. Y. 2013, in Proceedings of the 30th International Conference on Machine Learning (ICML), PMLR, 3–8. http://proceedings.mlr.press/v28/maas13.html
2013
-
[20]
S., & Cabot, W
Meneveau, C., Lund, T. S., & Cabot, W. H. 1994, Journal of Fluid Mechanics, 319, 353 . https: //api.semanticscholar.org/CorpusID:122183534 44
1994
-
[21]
2022, Astronomy & Astrophysics, 663, A96, doi: 10.1051/0004-6361/202243439
Vitas, N. 2022, Astronomy & Astrophysics, 663, A96, doi: 10.1051/0004-6361/202243439
-
[22]
1985, Solar Physics, 100, 209, doi: 10.1007/BF00158429
Nordlund, A. 1985, Solar Physics, 100, 209, doi: 10.1007/BF00158429
-
[23]
Olivier, J., Johnson, W. D., & Marshall, G. D. 2008, Annals of Allergy, Asthma & Immunology, 100, 333, doi: 10.1016/S1081-1206(10)60595-9
-
[24]
Panda, J. P. 2021, arXiv e-prints, doi: 10.48550/arXiv.2111.07043
-
[25]
Paszke, A., Gross, S., Massa, F., et al. 2019, PyTorch: An Imperative Style, High-Performance Deep Learning Library, doi: 10.48550/arXiv.1912.01703
-
[26]
2011, Journal of Machine Learning Research, 12, 2825, doi: 10.5555/1953048.2078195
Pedregosa, F., Varoquaux, G., Gramfort, A., et al. 2011, Journal of Machine Learning Research, 12, 2825, doi: 10.5555/1953048.2078195
-
[27]
2020, pandas-dev/pandas: Pandas, doi: 10.5281/zenodo.3509134
Reback, J., et al. 2020, pandas-dev/pandas: Pandas, doi: 10.5281/zenodo.3509134
-
[28]
2018, The Astrophysical Journal, 859, 161, doi: 10.3847/1538-4357/aabba0
Rempel, M. 2018, The Astrophysical Journal, 859, 161, doi: 10.3847/1538-4357/aabba0
-
[29]
Rimmele, T. R., Warner, M., Keil, S. L., et al. 2020, Solar Physics, 295, 172, doi: 10.1007/s11207-020-01736-7
-
[30]
Sadykov, V. M., Kitiashvili, I. N., Kosovichev, A. G., & Wray, A. A. 2021, The Astrophysical Journal, 909, 35, doi: 10.3847/1538-4357/abd9c7
-
[31]
2015, in ICLR, doi: 10.48550/arXiv.1409.1556
Simonyan, K., & Zisserman, A. 2015, in ICLR, doi: 10.48550/arXiv.1409.1556
-
[32]
1963, Monthly Weather Review, 91, 99, doi: 10.1175/1520-0493(1963)091⟨0099: GCEWTP⟩2.3.CO;2
Smagorinsky, J. 1963, Monthly Weather Review, 91, 99, doi: 10.1175/1520-0493(1963)091⟨0099: GCEWTP⟩2.3.CO;2
-
[33]
Stein, R. F., & Nordlund, ˚A. 1998, The Astrophysical Journal, 499, 914, doi: 10.1086/305678 Szanda la, T. 2021, in Bio-inspired Neurocomputing, ed. A. K. Bhoi, P. K. Mallick, C.-M. Liu, & V. E. Balas (Singapore: Springer Singapore), 203–224, doi: 10.1007/978-981-15-5495-7 11
doi:10.1086/305678 1998
-
[34]
Virtanen, P., et al. 2020, Nature Methods, 17, 261, doi: 10.1038/s41592-019-0686-2 V¨ ogler, A., Shelyag, S., Sch¨ ussler, M., et al. 2005, Astronomy & Astrophysics, 429, 335, doi: 10.1051/0004-6361:20041507
-
[35]
Waidele, M., Zhao, J., & Kitiashvili, I. N. 2023, ApJ, 949, 99, doi: 10.3847/1538-4357/accae2
-
[36]
2020, Applied Sciences, 10, doi: 10.3390/app10051897
Wang, Y., Li, Y., Song, Y., & Rong, X. 2020, Applied Sciences, 10, doi: 10.3390/app10051897
-
[37]
Mansour, N. N., & Kosovichev, A. G. 2015, arXiv e-prints, arXiv:1507.07999, doi: 10.48550/arXiv.1507.07999
-
[38]
Mansour, N. N., & Kosovichev, A. G. 2018, Realistic Simulations of Stellar Radiative MHD (Les Ulis: EDP Sciences), 39–62, doi: doi:10.1051/978-2-7598-2196-9.c004
-
[39]
Yamashita, R., Nishio, M., Do, R. K., & Togashi, K. 2018, Insights into Imaging, 9, 611, doi: 10.1007/s13244-018-0639-9 45
-
[40]
2014, in International Conference on Learning Representations, doi: 10.48550/arXiv.1412.6856
Oliva, A. 2014, in International Conference on Learning Representations, doi: 10.48550/arXiv.1412.6856
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.