REVIEW 3 major objections 5 minor 12 references
Coupled Seasonal Data Assimilation of Sea Ice, Ocean, and Atmospheric Dynamics over the Last Millennium
T0 review · 3 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read A season-by-season data-assimilation scheme reconstructs last-millennium climate with higher verification skill than prior paleo-products while using roughly a quarter of the proxies.
desk verdict First seasonal last-millennium reanalysis with online DA and sea ice, but the pre-instrumental skill claim is thinner than it looks; still a solid contribution worth serious peer review. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The engine is a season-to-season Linear Inverse Model (LIM) whose state vector holds principal components of 2-meter temperature, sea surface temperature, upper-300-meter ocean heat content, and Northern-Hemisphere sea-ice concentration and thickness, trained on last-millennium simulations of two CMIP5 climate models. The LIM supplies the forecast prior for an ensemble square-root Kalman filter with 800 members and no localization; linear proxy system models, calibrated on modern instrumental temperatures in the EOF-truncated space with a diagonal error covariance, map proxies into that prior. The defining mechanism is the seasonal update strategy: a proxy with, say, June–August seasonality updates only the June–August ensemble, while annual-mean proxies are assimilated only once an annual mean can be formed from the seasonal forecasts, so the LIM's memory carries information from proxy-rich summer into proxy-poor winter.
What would settle it
A decisive test would be to run the bootstrap verification while withholding all proxies earlier than 1200 CE; if pre-1200 correlations for non-assimilated proxies collapse toward zero, the claim of consistent skill throughout the last millennium fails. A second, sharper test would compare the DJF temperature field over 1400–1700 against an independent winter-sensitive reconstruction excluded from the proxy database, requiring agreement within the stated ensemble spread.
Extended reading notes
Core claim
The core discovery is that cycling a linear inverse model forward season to season, and assimilating each proxy in the season it actually represents, produces a last-millennium reconstruction whose verified skill exceeds that of earlier paleo-data-assimilation products even though roughly one quarter as many proxies are used. Global-mean correlation against instrumental surface temperature is about 0.54 for annual means (versus 0.47–0.53 for three earlier reconstructions), and the largest edge comes in boreal winter (about 0.43 versus 0.37), a season with few tree-ring records. Reconstructed upper-ocean heat content correlates near 0.2 with an objective ocean analysis, Arctic sea-ice concentration correlates 0.11–0.21 with satellite data, and the Niño3.4 index correlates about 0.78 with a sea-surface-temperature analysis (coefficient of efficiency around 0.55). The paper attributes the winter advantage to the online scheme: summer proxy information persists through the seasonal forecast and updates the prior for data-poor seasons. It also shows that when seasonal proxies are restricted to updating annual means only, the reconstructed global-mean temperature difference between the Medieval Climate Anomaly and the Little Ice Age shrinks from 0.15 °C to 0.10 °C, arguing that the seasonal update is essential for recovering multicentennial variability.
Load-bearing premise
The reconstruction's pre-instrumental skill rests on the assumption that the linear proxy system models calibrated against twentieth-century instrumental temperatures stay valid with the same error statistics throughout 850–1850, so that the mapping from climate state to proxy and the assumed error covariances do not drift over time.
Editorial extensions
If this is right
- If the skill claim is correct, future paleoclimate reanalyses can achieve equal or better verification with substantially smaller proxy networks, cutting the data burden for seasonal reconstructions.
- Seasonal fields for ocean heat content and Arctic sea ice become available across the whole millennium, enabling direct study of seasonal sea-ice evolution and its links to temperature and orbital forcing.
- The millennium-length ENSO reconstruction, verified against four El Niño onset classes in the twentieth century, provides a large sample for studying changes in El Niño diversity and seasonal evolution.
- Because the season-to-season update yields a larger Medieval Climate Anomaly-to-Little Ice Age temperature difference than annual-mean updating, earlier annual reconstructions may have underestimated multicentennial variability by letting summer-biased proxies dilute winter and annual signals.
Reading between the lines
- An extension the authors do not pursue is adding atmospheric circulation or precipitation principal components to the LIM state; the paper's exclusion of high-frequency variables to protect forecast skill suggests this would require a careful balance between state dimension and memory.
- Because the LIM is trained on two CMIP5 models, a natural test is to train the same system on a CMIP6 last-millennium simulation; the paper's claim that CMIP5-to-CMIP6 seasonal variability statistics are similar predicts verification skill would change little.
- The winter-skill advantage is attributed to dynamical memory in the trained LIM, which implies a testable prediction: a model with weaker seasonal memory would show a smaller winter edge, so training the LIM on a model with poorly simulated ENSO persistence should degrade DJF skill more than JJA skill.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces LMR Seasonal, a seasonal-resolution 'online' data assimilation reconstruction of the last millennium. A linear inverse model (LIM) trained on CMIP5 last-millennium simulations provides coupled forecasts of surface temperature, sea surface temperature, upper-ocean heat content, and Northern Hemisphere sea-ice concentration/thickness; an ensemble square-root Kalman filter assimilates PAGES2k v2 proxies with season-specific update timing. The paper claims that this reconstruction achieves the highest correlation skill against instrumental products while using fewer proxies, that verification against held-out proxies demonstrates robust pre-instrumental skill, and that the method captures ENSO evolution and the MCA-LIA contrast better than existing off-line reconstructions.
Significance. If the central claims hold, LMR Seasonal would be a significant advance: it is the first seasonal-resolution, coupled ocean-atmosphere-sea-ice reanalysis of the last millennium, and its online update strategy is a clear methodological improvement over static-prior off-line DA for seasonal-to-interannual memory. The manuscript has concrete strengths: it compares against three established paleo-DA products, verifies variables not directly assimilated (OHC300, sea-ice concentration) against independent observational datasets, and demonstrates sensible ENSO composites. However, the headline comparative claim rests on global-mean correlation differences of 0.01-0.07 without uncertainty estimates, and the pre-instrumental verification using withheld proxies is circular with respect to the stationarity of the proxy system models. These issues make the paper a strong candidate for major revision rather than acceptance in its current form.
major comments (3)
- [§3.1, Figs. 3-4] The abstract and Section 3.1 claim that LMR Seasonal 'achieves the highest correlation skill' compared to other paleo-DA products. The evidence is global-mean correlation differences of 0.01 (vs. LMRv2), 0.04 (vs. PHYDA), and 0.07 (vs. LMR Online) for annual-mean temperature (Fig. 3), and 0.06 (DJF) and 0.01 (JJA) vs. PHYDA (Fig. 4). No confidence intervals, significance tests, or bootstrap estimates are provided for these differences. Given that the verification period 1880-2000 substantially overlaps the PSM calibration period (GISTEMP/ERSST, also 20th-century), these small differences may reflect sampling variability or calibration artifacts. The authors should provide uncertainty bounds on the correlation differences and, where possible, a verification period that does not overlap calibration.
- [§3.2, Eq. (7), Fig. 11] The claim that 'verification against independent proxy records shows that reconstruction skill is robust throughout the last millennium' is not supported by the bootstrap experiment as designed. The 20% withheld proxies are evaluated by forward-modeling them from the reconstructed climate state using the same modern-calibrated PSM (Eq. 7). As the authors correctly note in Section 2.2, the PSMs are linear and calibrated on GISTEMP/ERSST. A multiplicative drift in the true proxy-climate sensitivity is invisible to this procedure: if the calibrated sensitivity is c times the true sensitivity and the assimilated proxies share this bias, the EnKF analysis (Eq. 11 in the low-observation-error limit) underestimates the temperature by roughly 1/c, and the forward model maps this underestimated temperature back to approximately the correct proxy value. Thus high holdout correlation and even high CE do not establish stationarity. The conclusion in Section 3.2 that 'the distribution of correlation values... is very similar, suggesting a robust PSM relationship' is therefore circular. A valid test would require, for example, calibration on one time period and validation on a non-overlapping period, pseudo-proxy experiments in which PSM parameters are perturbed or made time-varying, or comparison against independent non-PSM-based reconstructions.
- [§4, Fig. 13] The paper attributes the MCA-LIA difference (0.15°C) to the seasonal-update strategy based on a single experiment in which seasonal proxies update only the annual mean (0.10°C). No uncertainty estimate is given for either value, yet the conclusion 'our seasonal-update strategy appears to be essential to reconstructing the magnitude of the MCA-LIA difference' depends on the 0.05°C difference being statistically distinguishable from ensemble spread and from natural variability. The authors should report confidence intervals on the MCA-LIA difference for both the seasonal and annual-update experiments and test whether the difference between the two experimental outcomes is significant.
minor comments (5)
- [Fig. 3 caption] The word 'shwon' in the caption is a typo for 'shown'.
- [§2.2, references to supplementary figures] The text states that independent-proxy verification results are 'compare Fig. 11 with Supplementary Fig. S8', but Supplementary Fig. S8 is the Niño3.4 PHYDA comparison, not the proxy-verification figure. The intended cross-reference is likely Supplementary Fig. S9.
- [Throughout] The manuscript inconsistently uses 'El Niño', 'Nino3.4', and 'Niño3.4' (e.g., Figs. 8-10 and text). Please standardize the notation.
- [§2.3] The EnSRF update equations (Eqs. 10-12) are presented for the serial observation update but the text does not specify how observations are ordered or whether the ensemble is re-orthogonalized after each observation; a sentence clarifying the implementation would help reproducibility.
- [Data availability] The data availability statement says the reconstruction data and code 'will be released to the public once this manuscript has been accepted.' For a journal that values reproducibility, releasing code and data at the time of submission (or at least in a preprint repository) would strengthen the paper and allow readers to verify the claims.
Circularity Check
Pre-instrumental proxy verification reuses the modern-calibrated PSMs, so the key stationarity assumption is not independently tested; skill claims are otherwise substantially supported by independent OHC and sea-ice verification.
-
fitted input called prediction
[Abstract; Section 3.2 (Independent Proxy Verification), with Eq. (7) from Section 2.2]
"Verification against independent proxy records shows that reconstruction skill is robust throughout the last millennium. ... For each epoch, the proxies are forward modeled from the reconstructed climate states using the PSM (7) for each proxy, yielding a direct comparison of the LMR Seasonal reconstruction to both the assimilated and independent proxy chronologies."
The withheld-proxy verification is not independent of the PSM calibration. The PSMs (Eq. 7) are fitted to modern GISTEMP/ERSST data (Section 2.2), and the same H is used both in the EnKF update (Eqs. 8-11) and to forward-model the withheld proxies in Section 3.2. If the true pre-instrumental proxy-climate sensitivity differs from the calibrated sensitivity by a factor c, the analysis state is biased by roughly 1/c (low observation-error limit of Eq. 11), and the forward model maps that biased state back through the same biased H, yielding predicted proxy values close to the observed ones. The reported correlation and CE can remain near 1 while the reconstructed temperature is substantially biased.
full rationale
The paper's core machinery—LIM training on CMIP5 last-millennium simulations, EOF truncation, EnKF update, and the seasonal update strategy—is internally consistent and not circular: the LIM forecast skill is tested out-of-sample on the other model (Supplementary Figs. S1–S2), and the seasonal-update vs annual-update experiment (Section 4) is a controlled comparison, not a redefinition. The main circular burden is concentrated in the verification of pre-instrumental skill. Section 3.2 withholds 20% of proxies from assimilation but evaluates them through the same modern-calibrated linear PSMs (Eq. 7) used to produce the reconstruction, so the test cannot detect a common multiplicative bias in the proxy-climate relationship. Instrumental verification (Section 3.1) also overlaps the PSM calibration era and uses correlated instrumental products (GISTEMP/ERSST for calibration vs HadCRUT5/ERA-20C/HadISST for verification), further weakening the independence of the claimed skill. However, the paper provides genuinely independent support that is not circular: OHC300 and sea-ice concentration are not assimilated and yet show positive correlations with EN4 and satellite data (Figs. 5–6), and the ENSO composite comparisons use instrumental data that were not directly used in PSM calibration for those fields. These independent checks justify a moderate circularity score rather than a high one. Overall, the central claim is not reduced to its inputs by construction, but the key stationarity assumption is supported by a holdout test that is partially circular.
Assumptions & free parameters
free parameters (8)
- EOF truncation rank for TAS, TOS, SIT, SIC =
15 PCs each (about 80% variance)
- EOF truncation rank for OHC300 =
30 PCs
- PSM calibration correlation threshold =
0.05
- PSM residual one-year lag autocorrelation threshold =
0.90
- Ensemble size =
800
- LIM integration time step =
6 hours
- LIM lag for training covariance =
3 months
- Bootstrap holdout fraction and epochs =
20%, 50 epochs
assumptions (7)
- domain assumption The coupled climate state follows a stable linear stochastic differential equation with stationary Gaussian noise.
- domain assumption The truncated EOF basis (15 PCs for most variables, 30 for OHC300) captures enough variance for the reconstruction, and truncation error is absorbed by the PSM.
- domain assumption Proxy system models are linear and calibrated on modern instrumental data remain valid over the last millennium.
- domain assumption CCSM4 and MPI-ESM-R last-millennium simulations provide statistics representative of real climate variability from 850 to 1850.
- domain assumption Observation errors of different proxies are uncorrelated, so a diagonal R matrix is sufficient.
- domain assumption An 800-member ensemble has small enough sampling error to proceed without localization.
- domain assumption Objective seasonality assignment identifies the season each proxy represents.
Cite this review
Pith. "Pith review of Coupled Seasonal Data Assimilation of Sea Ice, Ocean, and Atmospheric Dynamics over the Last Millennium." pith.science (2026). https://pith.science/paper/BXH3CMIF
@misc{pith2026250114130,
author = {Pith},
title = {Pith review of: Coupled Seasonal Data Assimilation of Sea Ice, Ocean, and Atmospheric Dynamics over the Last Millennium},
year = {2026},
howpublished = {\url{https://pith.science/paper/BXH3CMIF}},
note = {Machine review of arXiv:2501.14130}
}
read the original abstract
``Online" data assimilation (DA) is used to generate a new seasonal-resolution reanalysis dataset over the last millennium by combining forecasts from an ocean--atmosphere--sea-ice coupled linear inverse model with climate proxy records. Instrumental verification reveals that this reconstruction achieves the highest correlation skill, while using fewer proxies, in surface temperature reconstructions compared to other paleo-DA products, particularly during boreal winter when proxy data are scarce. Reconstructed ocean and sea-ice variables also have high correlation with instrumental and satellite datasets. Verification against independent proxy records shows that reconstruction skill is robust throughout the last millennium. Analysis of the results reveals that the method effectively captures the seasonal evolution and amplitude of El Ni\~{n}o events. Reconstructed seasonal temperature variations are consistent with trends in orbital forcing over the last millennium.
Figures
Figures from the paper (11 more)
Reference graph
Works this paper leans on
-
[1]
Anchukaitis, K. J., and Coauthors, 2017: Last millennium Northern Hemisphere summer temperatures from tree rings: Part II, spatially resolved reconstructions.Quaternary Science Reviews,163, 1–22. Anderson, J. L., 2012: Localization and sampling error correction in ensemble Kalman filter data assimilation.Monthly Weather Review,140 (7), 2359–2371. Blanchar...
work page 2017
-
[4]
Magorian, 1993: Prediction of Niño 3 sea surface temperatures using linear inverse modeling
Penland, C., and T. Magorian, 1993: Prediction of Niño 3 sea surface temperatures using linear inverse modeling. Journal of Climate,6 (6), 1067–1076. Penland, C., and L. Matrosova, 1994: A balance condition for stochastic numerical models with application to the El Niño-Southern Oscillation.Journal of climate,7 (9), 1352–1372. Penland, Cécile and Sardeshm...
work page 1993
-
[11]
Meng, Z., and T. Li, 2024: Why is the Pacific meridional mode most pronounced in boreal spring?Climate Dynamics, 62 (1), 459–471. Meng, Z., F. Zhu, and G. J. Hakim, 2023: Sacpy–A Python Package for Statistical Analysis of Climate.AGU23. Morice, C. P., and Coauthors, 2021: An updated assessment of near-surface temperature change from 1850: The HadCRUT5 dat...
work page 2024
-
[12]
1.00 0.75 0.50 0.25 0.00 0.25 0.50 0.75 1.00 Correlation Figure S9: Same as Figure 11, but for the expert-seasonality based PSM. 32 Last Millennium Reanalysis (LMR) Seasonal ANN DJF MAM JJA SON 0.4 0.3 0.2 0.1 0.0 Mean Trend [ C/kyr] a MPI MPI-DA 95% - 5% ANN D J F M A M J J A S O N 0.4 0.2 0.0 Mean Trend [ C/kyr] b insolation trend 95% - 5% MMM Ann MMM 9...
work page 2012
-
[36]
Wang, B., X. Luo, Y.-M. Yang, W. Sun, M. A. Cane, W. Cai, S.-W. Yeh, and J. Liu, 2019: Historical change of El Niño properties sheds light on future changes of extreme El Niño.Proceedings of the National Academy of Sciences, 116 (45), 22512–22517. Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations.Monthly we...
work page 2019
-
[59]
K., 2022:Reconstructing Arctic Sea Ice in the Instrumental Era
Brennan, M. K., 2022:Reconstructing Arctic Sea Ice in the Instrumental Era. University of Washington. Brennan, M. K., and G. J. Hakim, 2022: Reconstructing Arctic sea ice over the Common Era using data assimilation. Journal of Climate,35 (4), 1231–1247. Briffa, K. R., P. D. Jones, and F. H. Schweingruber, 1992: Tree-ring density reconstructions of summer ...
work page 2022
-
[261]
Huang, B., and Coauthors, 2017: Extended reconstructed sea surface temperature, version 5 (ERSSTv5): upgrades, validations, and intercomparisons.Journal of Climate,30 (20), 8179–8205. Laskar, J., P. Robutel, F. Joutel, M. Gastineau, A. C. Correia, and B. Levrard, 2004: A long-term numerical solution for the insolation quantities of the Earth.Astronomy & A...
work page 2017
-
[499]
26 Last Millennium Reanalysis (LMR) Seasonal a LMR Seasonal (mean = 0.54, Nproxy =
tree.TRW (n=275) tree.MXD (n=61) speleothem.d18O (n=3) marine.diatom (n=1) marine.d18O (n=1) marine.alkenone (n=4) marine.MgCa (n=3) lake.varve_thickness (n=5) lake.reflectance (n=2) lake.midge (n=1) lake.chironomid (n=1) lake.accumulation (n=1) lake.BSi (n=1) ice.melt (n=1) ice.dD (n=7) ice.d18O (n=28) hybrid (n=1) documents (n=3) coral.d18O (n=63) coral...
work page 2000
Show all 12 references
-
[545]
R" and“CE
f LMR Seasonal - LMRv2 (mean = 0.02) g LMR Seasonal - PHYDA (mean = 0.03) h LMR Seasonal - LMR Online (mean = 0.06) 0.9 0.6 0.3 0.0 0.3 0.6 0.9 Correlation (vs. 20C Reanalysis) 0.45 0.30 0.15 0.00 0.15 0.30 0.45 Correlation Difference Figure S6: As in Figure 3, but for the cor...
1900
-
[624]
Emile-Geay, G
Zhu, F., J. Emile-Geay, G. J. Hakim, D. Guillot, D. Khider, R. Tardif, and W. A. Perkins, 2024: cfr (v2024. 1.26): a Python package for climate field reconstruction.Geoscientific Model Development,17 (8), 3409–3431. 23 Last Millennium Reanalysis (LMR) Seasonal Supporting Infor...
2024
-
[747]
Emile-Geay, K
Zhu, F., J. Emile-Geay, K. J. Anchukaitis, N. P. McKay, S. Stevenson, and Z. Meng, 2023: A pseudoproxy emulation of the PAGES 2k database using a hierarchy of proxy system models.Scientific Data,10 (1),
2023
-
[1880]
e Non-assimilated proxies' mean (1880-2000) f Non-assimilated proxies' mean (before
2000
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.