REVIEW 4 major objections 5 minor 3 cited by
Neural general circulation models optimized to predict satellite-based precipitation observations
T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read Training a hybrid general circulation model directly on satellite-based precipitation observations can make its precipitation climatology, extremes, and diurnal cycle substantially more realistic than conventional GCMs, reanalysis, and a…
desk verdict A real advance in the NeuralGCM program: training a hybrid GCM on satellite precipitation works, the forecast and mean-state claims survive an independent GPCP check, but the extremes and diurnal-cycle wins are only shown against the training target. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the column water budget closure, Eq. (1): $P - E = \frac{1}{g}\int\sum_i \left(\frac{dq}{dt}\right)^{\mathrm{NNtend}}_i p_s\, d\sigma$, with $P$ the learned precipitation rate, $E$ the diagnosed evaporation, and the sum running over water-vapor, cloud-ice, and cloud-liquid tendencies from the learned physics network. A small Encode-Process-Decode network with a ReLU output predicts non-negative precipitation from the atmospheric column plus static embeddings, while the differentiable dynamical core and tendency network evolve the state. Enforcing this budget couples the precipitation loss to the physics network's moisture tendencies, which shifts the model's precipitable-water distribution toward observations and is what allows an observable (rain) to train the unresolved physics without breaking water conservation.
What would settle it
Examine the diagnosed evaporation fields in a long integration and compare them to direct flux observations or to a high-resolution water-budget product; if the fields show grid-scale artifacts that track precipitation errors, or if the model's precipitation skill collapses when the learned moisture tendencies are replaced by a trusted reanalysis budget, the water-budget closure is doing compensating work and the central claim is falsified.
Extended reading notes
Core claim
NeuralGCM was originally a differentiable dynamical core coupled to a learned physical-tendency network trained on ERA5. This paper retrains it end-to-end while adding a compact precipitation network that outputs the hourly precipitation rate, with evaporation then diagnosed as the residual of the column water budget, $P - E = \frac{1}{g}\int\sum_i \left(\frac{dq}{dt}\right)^{\mathrm{NNtend}}_i p_s\, d\sigma$. The precipitation network is trained against 6-hourly IMERG accumulations, while atmospheric state, evaporation, and other fields are trained against ERA5; the specific-humidity loss is down-weighted because ERA5 humidity itself is known to deviate from observations. In 20-year, SST-forced simulations started from 37 initial conditions, every run remains stable, and the model reproduces the IMERG precipitation-rate frequency distribution, annual-maximum daily precipitation (Rx1day), and diurnal phase more closely than ERA5, CMIP6 AMIP and historical runs, and GFDL's X-SHiELD cloud-resolving model. In forecasting, a 50-member NeuralGCM ensemble improves on the 50-member ECMWF ensemble for all 15 forecast days in CRPS, root-mean-square bias, spread-skill ratio, and Brier score at the 0.95 quantile, with the result holding against GPCP, a dataset not used in training.
Load-bearing premise
The load-bearing premise is that the learned physics network's moisture tendencies are accurate enough that the evaporation diagnosed from the column water budget is physically meaningful; if those tendencies merely compensate for the mismatch between ERA5 and IMERG, the precipitation gains could come with unphysical evaporation errors.
Editorial extensions
If this is right
- Training on satellite precipitation removes the need to inherit precipitation biases from reanalysis or high-resolution simulation targets, which is the main route by which current hybrid models pick up errors.
- A coarse 2.8° model can beat the operational ensemble in precipitation forecast skill, implying that resolution is not the only binding constraint for rain prediction and that learned physics can compensate.
- Observation-trained hybrid models can be stable over 20-year climate integrations when the loss is tuned and stability is screened across random seeds.
- The computational speed (about 1200 simulated years per TPU-day) makes large ensembles practical, as demonstrated by 732 twenty-two-year runs used to estimate the sensitivity of annual-maximum precipitation to temperature.
- The same end-to-end recipe can be applied to any observable whose loss can be computed from model output, such as clouds or radiative fluxes.
Reading between the lines
- The two configurations explored here have complementary failure modes—predicted precipitation with diagnosed evaporation creates unrealistic sub-6-hour oscillations, while predicted evaporation with diagnosed precipitation produces negative rain. Enforcing both fields as learned outputs with a hard water-budget constraint and non-negativity is the natural next step and might remove both artifacts.
- The diagnosed-evaporation model shows unrealistic instantaneous evaporation fields (Fig. S21), so a key test is whether the precipitation skill survives when the learned moisture tendencies are replaced by a physically trusted budget; if it does not, the improvement may be partly owed to compensating errors rather than to a better representation of convection.
- Because the model was trained jointly on ERA5 and IMERG with the humidity loss deliberately weakened, the diurnal-cycle improvement is likely attributable mainly to the IMERG precipitation loss; training identical models with and without the precipitation term would make that causal attribution quantitative.
- The reported global sensitivity of annual-maximum precipitation, $4.2\%\,\mathrm{K}^{-1}$, is lower than the $5$\textendash$10\%\,\mathrm{K}^{-1}$ range often quoted, and the authors note resolution suppresses the most extreme tail; running the same training recipe at higher resolution is a direct way to test whether the sensitivity rises toward that range.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents a hybrid neural general circulation model (NeuralGCM) trained end-to-end on satellite-based precipitation observations from IMERG, together with ERA5 atmospheric fields. Precipitation is predicted by a small neural network, and evaporation is diagnosed from the column water budget, so that precipitation is consistent with the model's moisture tendencies. The authors report substantial improvements over CMIP6 models, ERA5, and the X-SHiELD global cloud-resolving model in simulated mean precipitation, extreme precipitation, and diurnal cycle, and also report that a 50-member NeuralGCM ensemble outperforms the ECMWF ensemble in precipitation forecast skill out to 15 days.
Significance. If the claims hold, the paper is a significant advance: it demonstrates that a differentiable GCM can be trained directly on an observational precipitation product, that the resulting model remains stable in multi-decadal simulations, and that it produces competitive or superior precipitation forecasts at 2.8 degrees resolution. The work is supported by extensive evaluation on two datasets (IMERG and GPCP), open code and data availability, and a proof-of-concept large ensemble for extreme-precipitation sensitivity. The central claims, however, are weakened by the fact that the headline metrics for extremes and the diurnal cycle are evaluated only against IMERG, the very dataset used in the training loss, and by the paper's own documentation of unrealistic sub-6-hourly precipitation variability and unrealistic instantaneous evaporation. These issues are acknowledged in the supplementary material but need to be addressed in the main text and through additional independent evaluation.
major comments (4)
- [Results, 'Precipitation extremes and precipitation rate distribution' and 'Diurnal cycle of precipitation'; Figs.] The extreme-precipitation and diurnal-cycle metrics are computed exclusively against IMERG, which is the precipitation product used in the CRPS training loss. The model was optimized to match IMERG precipitation, so its IMERG-based scores are not an independent test of physical accuracy. The paper does provide independent GPCP-based evaluation for mean precipitation (Fig. S15) and forecast skill (Fig. S5), but not for extremes or diurnal phase/amplitude. Since the central claim in the Discussion is that the model 'substantially surpasses' GCMs and ERA5 in 'mean state, extremes, and the diurnal cycle,' the authors should either add GPCP-based evaluation of extremes (e.g., Rx1day or 99.9th percentile, which are computable from GPCP daily data) and diurnal cycle if possible, or explicitly limit the claim to IMERG-defined skill and discuss the risk that IMERG-specific biases (e.g., overestimation of heavy precipitation) are being learned and reported as improvement.
- [Results, 'Diurnal cycle of precipitation'; Figs.] The paper's own text states that 'the diurnal cycle in NeuralGCM exhibits unrealistic features, with certain times of day experiencing significantly more precipitation than others (Figs. 6e-g, S7), likely due to the model being optimized for 6-hourly precipitation accumulation,' and recommends against using this configuration at frequencies higher than 6-hourly. Yet the abstract and Discussion claim 'a more accurate diurnal cycle' and 'substantially surpasses ... the diurnal cycle.' The MAE-based harmonic metrics (Fig. 6a-d) may still favor NeuralGCM, but the model's diurnal precipitation shape is visibly unrealistic at sub-6-hour scales (Fig. 6e-g). The claim should be qualified to distinguish harmonic phase/amplitude skill from the model's unphysical high-frequency variability, and the implications for the 'accurate diurnal cycle' statement should be discussed in the main text.
- [Methods, Eq. (1); Supplementary Eq. (S4); Supplementary Fig. S21] The diagnosed evaporation field E = NN_precip(X) - (1/g)∫∑(dq/dt)_NNtend ps dσ has the potential to be unphysical if the learned moisture tendencies from the physics network carry ERA5 biases. The supplementary material itself shows unrealistic instantaneous evaporation fields for this configuration (Fig. S21). If the precipitation improvement is achieved by compensating, unphysical evaporation errors, the attribution of the improvement to learning from observations is weakened. The authors should validate the diagnosed evaporation more directly, or at least analyze whether the water-budget closure relies on cancellation between the precipitation network and the moisture tendencies. As written, the paper's central mechanism—training precipitation while enforcing column conservation—is not fully supported for the diagnosed evaporation component.
- [Discussion, 'Our work retains some noteworthy limitations'] The statement that 'the stable model was still obtained by training several models with varying random seeds and choosing the most stable one' is a selection procedure that could bias the reported stability. The 37-initial-condition and 732-run stability experiments are impressive and partially mitigate this concern, but the selection procedure and its potential effect on the stability and climate statistics should be described in the Methods and discussed. Without this, the 'remains stable for decadal simulations' claim is presented more strongly than the training procedure warrants.
minor comments (5)
- [Supplementary Figure S24] The caption contains a typo: 'NeruralGCM-evap' should be 'NeuralGCM-evap'.
- [Supplementary Figure S22] The phrase 'Mean absoulute error' should be 'Mean absolute error'.
- [Methods, 'Neural network for predicting precipitation'] The description says the precipitation network predicts precipitation 'at 1-hour intervals,' but the training loss is on 6-hour accumulated precipitation. Clarify whether the network is trained on instantaneous 1-hour rates or on 6-hourly accumulations, since this distinction is relevant to the sub-6-hour precipitation artifacts.
- [Results, 'Precipitation extremes and precipitation rate distribution'] The sentence 'We find similar conclusions when studying the 99.9th percentile (Fig. S22)' would benefit from the numerical MAE reduction for the 99.9th percentile, to match the quantitative context given for Rx1day.
- [Introduction, third paragraph] The phrase 'stochastic training approach of [29]' is slightly ambiguous; it could be read as stochastic gradient descent rather than the rollout-length randomization described later. Consider rewording to 'the training approach of [29], which progressively increases rollout length.'
Circularity Check
Extremes and diurnal-cycle skill are evaluated against IMERG, the very precipitation product used in the CRPS training loss; independent GPCP checks cover only mean state and forecast skill.
-
fitted input called prediction
[Training (p.3-4) and Results: 'Precipitation extremes and precipitation rate distribution' (Fig. 5), 'Diurnal cycle of precipitation' (Fig. 6); Discussion]
"We optimize for ... 6-hour accumulated precipitation (from IMERG). ... We compare the frequency distributions of NeuralGCM, ERA5, and a single CMIP6 model (IPSL-CM6A-LR) to that of IMERG. ... Fig. 6 demonstrates that NeuralGCM more accurately captures the timing of peak diurnal precipitation compared to ERA5 and GFDL AMIP run."
The network parameters are fitted by minimizing CRPS between predicted and IMERG 6-hour accumulated precipitation over 2001-2018. The headline climate statistics — precipitation-rate frequency distribution, Rx1day, 99.9th percentile, and diurnal phase/amplitude (Figs. 5, 6, S16-S18, S22, S23) — are then computed against the same IMERG product over 2002-2014, i.e., largely within the training period. Optimizing a precipitation loss against IMERG makes the model's precipitation distribution resemble IMERG by construction, so reporting superior extremes and diurnal-cycle scores relative to models not trained on IMERG is partly a restatement of the training objective. The paper's independent GPCP checks (Fig. S15 for mean climate; Fig.
full rationale
The paper's central mechanism — training a differentiable hybrid GCM on IMERG precipitation while diagnosing evaporation from the column water budget — is not derivationally circular: evaporation is defined by water conservation (Eq. 1 / Eq. S4), not by the precipitation target, and the GPCP results (a dataset not used in training) independently support the mean-state and forecast improvements. The self-citations to the authors' prior NeuralGCM paper [29] for the differentiable core and training recipe are normal methodology citations to a published, code-released framework; no uniqueness theorem or ansatz is smuggled in through those citations. The substantial circularity concern is narrower but real: the headline claims for extremes and diurnal cycle are evaluated exclusively against IMERG, which is the precipitation product used in the CRPS training loss, over the training period. This is a training-target evaluation, not an independent physical test, so those two aspects of the 'substantially surpasses' claim are partly forced by the fit. Because the mean-state and forecast claims have independent support and the architecture itself is externally grounded, the overall circularity is partial rather than total.
Assumptions & free parameters
free parameters (3)
- Specific humidity loss scaling factor (relative to standard NeuralGCM) =
reduced by factor of 100
- Precipitation and evaporation loss weights =
empirically tuned to ~10% and ~20% of total loss
- Per-grid-point location embedding (8-dim) =
learned during training, 8 values per grid point
assumptions (6)
- domain assumption NeuralGCM differentiable dynamical core solves the large-scale atmospheric dynamics accurately
- standard math Column water budget P - E = integral of NN moisture tendencies (Eq. 1)
- domain assumption IMERG V07 final is an adequate proxy for true precipitation at 2.8 deg and 6-hour accumulations
- domain assumption ERA5 reanalysis is reliable for atmospheric state and evaporation training targets
- domain assumption Prescribed SST and sea ice are adequate for AMIP-style 20-year simulations
- ad hoc to paper The small precipitation network with static embeddings can represent the mapping from column state to precipitation
Cite this review
Pith. "Pith review of Neural general circulation models optimized to predict satellite-based precipitation observations." pith.science (2026). https://pith.science/paper/JEQD7PAT
@misc{pith2026241211973,
author = {Pith},
title = {Pith review of: Neural general circulation models optimized to predict satellite-based precipitation observations},
year = {2026},
howpublished = {\url{https://pith.science/paper/JEQD7PAT}},
note = {Machine review of arXiv:2412.11973}
}
abstract
Climate models struggle to accurately simulate precipitation, particularly extremes and the diurnal cycle. Here, we present a hybrid model that is trained directly on satellite-based precipitation observations. Our model runs at 2.8$^\circ$ resolution and is built on the differentiable NeuralGCM framework. The model demonstrates significant improvements over existing general circulation models, the ERA5 reanalysis, and a global cloud-resolving model in simulating precipitation. Our approach yields reduced biases, a more realistic precipitation distribution, improved representation of extremes, and a more accurate diurnal cycle. Furthermore, it outperforms the mid-range precipitation forecast of the ECMWF ensemble. This advance paves the way for more reliable simulations of current climate and demonstrates how training on observations can be used to directly improve GCMs.
Forward citations
Cited by 3 Pith papers
-
Learning from nature: insights into GraphDOP's representations of the Earth System
GraphDOP, trained purely on meteorological observations, spontaneously forms unified latent representations of Earth system state, viewing effects, and synoptic dynamics.
-
Advancing Seasonal Prediction of Tropical Cyclone Activity with a Hybrid AI-Physics Climate Model
A hybrid ML physics model, NeuralGCM, with persisted SST and sea ice anomalies, yields skillful seasonal forecasts of tropical cyclone frequency in the North Atlantic and East Pacific (r around 0.7 over 1990-2023).
-
The Equilibrium Response of Atmospheric Machine-Learning Models to Uniform Sea Surface Temperature Warming
Under uniform +2 K SST warming, ML atmospheric emulators reproduce precipitation changes but show deficient land warming, upper-tropospheric warming, and radiative responses compared with the AM4 GCM.
Reference graph
Works this paper leans on
-
[1]
Kochkov, D. et al. Neural general circulation models for weather and climate. Nature 1–7 (2024)
work page 2024
-
[2]
Wheeler, M. & Kiladis, G. N. Convectively coupled equatorial waves: Analysis of clouds and temperature in the wavenumber–frequency domain. Journal of the Atmospheric Sciences 56, 374–399 (1999)
work page 1999
-
[3]
Madieros, B. wavenumber-frequency (2023). URL https://github.com/brianpm/ wavenumber frequency
work page 2023
-
[4]
Barnet, C. Sounder sips: Aqua airs ir-only level 3 climcaps : Comprehensive quality control gridded daily v2, greenbelt, md, usa, goddard earth sciences data and information services center (ges disc) (2019). URL https://disc.gsfc.nasa. gov/datasets/SNDRAQIL3CDCCP 2/summary
work page 2019
-
[5]
Kharin, V. V., Zwiers, F. W., Zhang, X. & Wehner, M. Changes in temperature and precipitation extremes in the cmip5 ensemble. Climatic change 119, 345–357 (2013)
work page 2013
-
[6]
Pfahl, S., O’Gorman, P. A. & Fischer, E. M. Understanding the regional pattern of projected future changes in extreme precipitation. Nature Climate Change 7, 423–427 (2017)
work page 2017
-
[7]
Asadieh, B. & Krakauer, N. Y. Global trends in extreme precipitation: climate models versus observations. Hydrology and Earth System Sciences 19, 877–891 (2015)
work page 2015
-
[8]
O’Gorman, P. A. Precipitation extremes under climate change. Current climate change reports 1, 49–59 (2015)
work page 2015
Show all 14 references
-
[9]
Young, G. A. Alternative smoothed bootstraps. J. R. Stat. Soc. Series B Stat. Methodol. 52, 477–484 (1990)
1990
-
[10]
Westra, S., Alexander, L. V. & Zwiers, F. W. Global increasing trends in annual maximum daily precipitation. Journal of climate 26, 3904–3918 (2013)
2013
-
[11]
Lu, J. et al. The robust dynamical contribution to precipitation extremes in idealized warming simulations across model resolutions. Geophysical Research Letters 41, 2971–2978 (2014)
2014
-
[12]
Climate change impact on flood and extreme precipitation increases with water availability
Tabari, H. Climate change impact on flood and extreme precipitation increases with water availability. Scientific reports 10, 13768 (2020)
2020
-
[13]
Huffman, G. J. et al. The new version 3.2 global precipitation climatology project (gpcp) monthly and daily precipitation products. Journal of Climate 36, 7635– 7655 (2023). 28
2023
-
[14]
Huffman, G. J. et al. Integrated multi-satellite retrievals for the global precipi- tation measurement (gpm) mission (imerg). Satellite precipitation measurement: Volume 1 343–353 (2020). 29
2020
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.