COGENT: Continuous Graph Emulators with Neural Ordinary Differential Equations for Long-Term Physical Forecasting
Pith reviewed 2026-06-27 13:40 UTC · model grok-4.3
The pith
A graph Neural ODE initialized from encoded history produces continuous latent trajectories to forecast physical states at arbitrary future times.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Encoding a finite history of system states and forcings with a graph-based history encoder produces node-wise context vectors that initialize and condition a latent Neural ODE. The ODE dynamics incorporate interpolated future forcings and explicit relative rollout time to generate continuous latent trajectories. A residual decoder maps these trajectories back to future physical states for direct multi-step forecasting at arbitrary times. Rollout-horizon sampling and progressive scheduling stabilize training. Evaluation on transient ice-sheet simulations from the Ice-sheet and Sea-level System Model shows improved long-range stability over autoregressive graph baselines.
What carries the argument
The latent Neural ODE whose continuous dynamics are initialized from graph-encoded history context vectors and conditioned on interpolated future forcings plus explicit relative rollout time.
If this is right
- System states can be queried at any future time without retraining or fixed temporal steps.
- Error accumulation is reduced because predicted states are not fed back into the model.
- Long-horizon stability improves for transient physical processes on irregular meshes.
- Training with progressive rollout scheduling enables supervision over extended horizons.
Where Pith is reading between the lines
- The continuous formulation could support adaptive querying in applications needing states at irregular intervals.
- The separation of history encoding from the dynamics might allow swapping in different graph encoders for varied spatial structures.
- If the latent dynamics prove faithful, the model could serve as a differentiable emulator inside optimization loops for control or inverse problems.
Load-bearing premise
The latent Neural ODE accurately represents the underlying physical dynamics when started from the graph-encoded history and driven only by forcings and time, without any autoregressive feedback of its own predicted states.
What would settle it
On the transient ice-sheet simulation dataset, if COGENT's error growth over long horizons matches or exceeds that of the autoregressive graph baselines, or if predictions at untrained intermediate times deviate significantly from held-out simulation states.
Figures
read the original abstract
In this work, we present COGENT, a continuous graph emulator with Neural Ordinary Differential Equations for long-term physical forecasting on irregular geospatial meshes. COGENT encodes a finite history of system states and associated forcing fields and external forcings with a graph-based history encoder, producing node-wise context vectors that capture both local spatial interactions and temporal evolution. These context vectors initialize and condition a latent Neural Ordinary Differential Equation whose dynamics are driven by interpolated future forcings and explicit relative rollout time. By modeling the forecast trajectory as a continuous latent dynamical system, COGENT can generate predictions at arbitrary future times rather than being restricted to a fixed temporal discretization. A residual decoder maps the resulting latent trajectories back to future physical states, enabling direct multi-step forecasting without repeatedly feeding predicted states back into the model. This formulation combines graph-based spatial representation, history-conditioned latent dynamics, and continuous-time rollout in a unified framework for mesh-based physical simulation emulation. In order to stabilize training with long-horizon supervision, we also propose effective rollout-horizon sampling and a progressive rollout-horizon scheduling strategy. We evaluate COGENT on transient ice-sheet simulations generated by the Ice-sheet and Sea-level System Model, demonstrating improved long-range stability over autoregressive graph baselines. These results suggest that continuous graph Neural ODEs provide a promising methodology for scalable physical forecasting on irregular geospatial meshes, particularly in applications that require stable long-horizon predictions and the ability to query system states at arbitrary times.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents COGENT, a model that combines a graph-based history encoder with a latent Neural ODE for continuous-time forecasting on irregular geospatial meshes. History states and forcings are encoded into node-wise context vectors that initialize and condition a Neural ODE; the ODE is driven by interpolated future forcings and relative rollout time, and a residual decoder maps the latent trajectory back to physical states. This enables direct multi-step prediction at arbitrary times without autoregressive feedback of predicted states. Training stability is addressed via rollout-horizon sampling and progressive scheduling. The method is evaluated on transient ice-sheet simulations from the Ice-sheet and Sea-level System Model, where it reportedly shows improved long-range stability relative to autoregressive graph baselines.
Significance. If the empirical claims hold under rigorous verification, the work would demonstrate a viable route to stable, queryable-at-arbitrary-time emulation of mesh-based physical systems by embedding spatial graph structure inside a continuous latent dynamical model. This could be relevant for applications such as ice-sheet or climate modeling where long-horizon stability and flexible temporal querying matter. The combination of graph encoding, Neural ODEs, and explicit conditioning on future forcings is a natural extension of existing Neural-ODE and GNN literature, but its practical advantage rests entirely on the strength of the reported experiments.
major comments (3)
- [Abstract / Evaluation paragraph] The central empirical claim (improved long-range stability on ice-sheet data) is stated in the abstract and evaluation paragraph but is unsupported by any quantitative metrics, tables, error bars, or statistical tests in the provided text. Without these, it is impossible to assess whether the improvement is load-bearing or merely qualitative.
- [Method description] The weakest assumption—that the latent Neural ODE, conditioned only on interpolated forcings and relative time, faithfully represents the underlying physics without autoregressive state feedback—is asserted but not accompanied by any ablation, sensitivity analysis, or diagnostic (e.g., latent trajectory inspection or comparison against ground-truth forcing response). This assumption is load-bearing for the “direct multi-step forecasting” claim.
- [Method description] No equations, network diagrams, or pseudocode are supplied for the graph encoder, the Neural-ODE vector field, the conditioning mechanism, or the residual decoder. Consequently, reproducibility and verification of the “continuous latent dynamical system” formulation cannot be performed from the manuscript.
minor comments (2)
- [Abstract] The abstract refers to “effective rollout-horizon sampling and a progressive rollout-horizon scheduling strategy” without defining the sampling distribution or the scheduling schedule; these details belong in the main text.
- [Method description] Notation for node features, edge attributes, and the precise form of the interpolated forcing input to the ODE is never introduced, making the description difficult to follow even at a high level.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback. The comments highlight important areas for strengthening the empirical claims, methodological transparency, and reproducibility. We address each major comment below and will incorporate revisions to improve the manuscript.
read point-by-point responses
-
Referee: [Abstract / Evaluation paragraph] The central empirical claim (improved long-range stability on ice-sheet data) is stated in the abstract and evaluation paragraph but is unsupported by any quantitative metrics, tables, error bars, or statistical tests in the provided text. Without these, it is impossible to assess whether the improvement is load-bearing or merely qualitative.
Authors: We agree that quantitative support is essential for the stability claim. The full manuscript includes Section 4 with tables reporting RMSE, rollout error accumulation, and stability metrics (e.g., time-to-divergence) over long horizons on the ISSM ice-sheet data, along with error bars from multiple random seeds and statistical comparisons to autoregressive baselines. These were not sufficiently highlighted in the abstract and evaluation summary. We will revise the abstract and evaluation paragraph to explicitly reference these quantitative results and include a summary table in the main text. revision: yes
-
Referee: [Method description] The weakest assumption—that the latent Neural ODE, conditioned only on interpolated forcings and relative time, faithfully represents the underlying physics without autoregressive state feedback—is asserted but not accompanied by any ablation, sensitivity analysis, or diagnostic (e.g., latent trajectory inspection or comparison against ground-truth forcing response). This assumption is load-bearing for the “direct multi-step forecasting” claim.
Authors: The design intentionally decouples the latent dynamics from autoregressive state feedback by conditioning solely on forcings and relative time to enable continuous querying. While the method section describes this, we acknowledge the lack of explicit ablations or diagnostics in the initial version. In revision, we will add an ablation comparing the full model against variants with partial state feedback, include latent trajectory plots against ground-truth forcing responses, and provide sensitivity analysis on the conditioning inputs to substantiate the assumption. revision: yes
-
Referee: [Method description] No equations, network diagrams, or pseudocode are supplied for the graph encoder, the Neural-ODE vector field, the conditioning mechanism, or the residual decoder. Consequently, reproducibility and verification of the “continuous latent dynamical system” formulation cannot be performed from the manuscript.
Authors: We apologize for this omission, which limits reproducibility. The revised manuscript will include the full set of equations: graph encoder (Eqs. 1–3), Neural ODE vector field with forcing interpolation and time conditioning (Eq. 4), conditioning mechanism (Eq. 5), and residual decoder (Eq. 6). We will also add a network architecture diagram and pseudocode for the rollout-horizon sampling and progressive scheduling procedure. revision: yes
Circularity Check
No significant circularity detected
full rationale
The abstract and method description present COGENT as a composition of standard components (graph encoder for history, Neural ODE for latent continuous dynamics conditioned on forcings and time, residual decoder) without any exhibited equations, derivations, or parameter-fitting steps that reduce to their own inputs by construction. No self-citations, uniqueness theorems, or ansatzes are invoked in the provided text. The approach is described as building on existing Neural ODE and graph neural network techniques, with claims resting on empirical evaluation rather than a closed self-referential chain. This is the normal case of a self-contained architectural proposal.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
Timothy J. Boerner, Stephen Deems, Thomas R. Furlani, Shelley L. Knuth, and John Towns. 2023. ACCESS: Advancing Innovation: NSF’s Advanced Cyberinfras- tructure Coordination Ecosystem: Services & Support. InPractice and Experience in Advanced Research Computing 2023: Computing for the Common Good(Port- land, OR, USA)(PEARC ’23). Association for Computing ...
-
[2]
Benjamin Paul Chamberlain, James Rowbottom, Maria Goronova, Stefan Webb, Emanuele Rossi, and Michael M Bronstein. 2021. GRAND: Graph Neural Dif- fusion.Proceedings of the 38th International Conference on Machine Learning, COGENT (ICML) 2021, 18-24 July 2021, Virtual Event(2021)
2021
-
[3]
Jiangchao Chen. 2025. Enhancing Regional Weather Prediction with GNN: A Multi-scale Attention Approach. In2025 5th International Conference on Machine Learning and Intelligent Systems Engineering (MLISE). 306–310. doi:10.1109/ MLISE66443.2025.11100236
arXiv 2025
-
[4]
Ricky T. Q. Chen, Yulia Rubanova, Jesse Bettencourt, and David Duvenaud. 2018. Neural ordinary differential equations. InProceedings of the 32nd International Conference on Neural Information Processing Systems(Montréal, Canada)(NIPS’18). Curran Associates Inc., Red Hook, NY, USA, 6572–6583
2018
-
[5]
Hamilton, Rex Ying, and Jure Leskovec
William L. Hamilton, Rex Ying, and Jure Leskovec. 2017. Inductive Representation Learning on Large Graphs. InNIPS
2017
-
[6]
In: Practice and Experience in Advanced Research Computing 2021: Evolution Across All Di- mensions
David Y. Hancock, Jeremy Fischer, John Michael Lowe, Winona Snapp-Childs, Marlon Pierce, Suresh Marru, J. Eric Coulter, Matthew Vaughn, Brian Beck, Nirav Merchant, Edwin Skidmore, and Gwen Jacobs. 2021. Jetstream2: Accelerating cloud computing via Jetstream. InPractice and Experience in Advanced Research Computing 2021: Evolution Across All Dimensions(Bos...
-
[7]
Silu He, Qinyao Luo, Ronghua Du, Ling Zhao, Guangjun He, Han Fu, and Haifeng Li. 2023. STGC-GNNs: A GNN-based traffic prediction framework with a spa- tial–temporal Granger causality graph.Physica A: Statistical Mechanics and its Applications623 (2023), 128913. doi:10.1016/j.physa.2023.128913
-
[8]
Nature Geoscience4(8), 519–523 (Aug 2011)
Stanley S. Jacobs, Adrian Jenkins, Claudia F. Giulivi, and Pierre Dutrieux. 2011. Stronger ocean circulation and increased melting under Pine Island Glacier ice shelf.Nature Geoscience4, 8 (01 Aug 2011), 519–523. doi:10.1038/ngeo1188
-
[9]
Adrian Jenkins, Pierre Dutrieux, Stanley S. Jacobs, Stephen D. McPhail, James R. Perrett, Andrew T. Webb, and David White. 2010. Observations beneath Pine Is- land Glacier in West Antarctica and implications for its retreat.Nature Geoscience 3, 7 (01 Jul 2010), 468–472. doi:10.1038/ngeo890
-
[10]
Ian Joughin, Daniel Shapero, Pierre Dutrieux, and Ben Smith
-
[11]
Science Advances7(43), eabi5738 (2021)
Ocean-induced melt volume directly paces ice loss from Pine Island Glacier.Science Advances7, 43 (2021), eabi5738. arXiv:https://www.science.org/doi/pdf/10.1126/sciadv.abi5738 doi:10.1126/ sciadv.abi5738
-
[12]
Ian Joughin, Daniel Shapero, Ben Smith, Pierre Dutrieux, and Mark Barham. 2021. Ice-shelf retreat drives recent Pine Island Glacier speedup.Science Advances7, 24 (2021), eabg3080. arXiv:https://www.science.org/doi/pdf/10.1126/sciadv.abg3080 doi:10.1126/sciadv.abg3080
-
[13]
Guillaume Jouvet. 2023. Inversion of a Stokes glacier flow model emulated by deep learning.Journal of Glaciology69, 273 (2023), 13–26. doi:10.1017/jog.2022.41
-
[14]
Guillaume Jouvet and Guillaume Cordonnier. 2023. Ice-flow model emulator based on physics-informed deep learning.Journal of Glaciology69, 278 (2023), 1941–1955. doi:10.1017/jog.2023.73
-
[15]
Guillaume Jouvet, Guillaume Cordonnier, Byungsoo Kim, Martin Lüthi, Andreas Vieli, and Andy Aschwanden. 2022. Deep learning speeds up ice flow modelling by several orders of magnitude.Journal of Glaciology68, 270 (2022), 651–664. doi:10.1017/jog.2021.120
-
[16]
Ryan Keisler. 2022. Forecasting Global Weather with Graph Neural Networks. arXiv:2202.07575 [physics.ao-ph] https://arxiv.org/abs/2202.07575
arXiv 2022
-
[17]
Patrick Kidger, James Morrill, James Foster, and Terry Lyons. 2020. Neural Controlled Differential Equations for Irregular Time Series.Advances in Neural Information Processing Systems(2020)
2020
-
[18]
Lingbai Kong, Hanchen Yang, Wengen Li, Yichao Zhang, Jihong Guan, and Shuigeng Zhou. 2025. Traffexplainer: A Framework Toward GNN-Based Inter- pretable Traffic Prediction.IEEE Transactions on Artificial Intelligence6, 3 (2025), 559–573. doi:10.1109/TAI.2024.3459857
-
[19]
Y. Koo, G. Cheng, M. Morlighem, and M. Rahnemoonfar. 2025. Calibrating calving parameterizations using graph neural network emulators: application to Helheim Glacier, East Greenland.The Cryosphere19, 7 (2025), 2583–2599. doi:10.5194/tc-19-2583-2025
-
[20]
Younghyun Koo and Maryam Rahnemoonfar. 2025. Graph convolutional net- work as a fast statistical emulator for numerical ice sheet modeling.Journal of Glaciology71 (2025), e15. doi:10.1017/jog.2024.93
-
[21]
Larour, J
E. Larour, J. Schiermeier, E. Rignot, H. Seroussi, M. Morlighem, and J. Paden
-
[22]
Journal of Geophysical Research: Earth Surface117(F2) (2012)
Sensitivity Analysis of Pine Island Glacier ice flow using ISSM and DAKOTA.Journal of Geophysical Research: Earth Surface117, F2 (2012). arXiv:https://agupubs.onlinelibrary.wiley.com/doi/pdf/10.1029/2011JF002146 doi:10.1029/2011JF002146
-
[23]
Zesheng Liu, YoungHyun Koo, and Maryam Rahnemoonfar. 2025. KAN-GCN: Combining Kolmogorov-Arnold Network with Graph Convolution Network for an Accurate Ice Sheet Emulator. arXiv:2510.24926 [cs.LG] https://arxiv.org/abs/ 2510.24926
arXiv 2025
-
[24]
Zesheng Liu, Doyup Kwon, Ning Lin, and Maryam Rahnemoonfar. 2026. PACT: Peak-Aware Cross-Attention Graph Transformers for Efficient Storm-Surge Emulation. arXiv:2605.09036 [cs.LG] https://arxiv.org/abs/2605.09036
Pith/arXiv arXiv 2026
-
[25]
Zesheng Liu and Maryam Rahnemoonfar. 2025. Physics-Informed Spatio- Temporal Graph Neural Network for Efficient Deep Ice Layer Thickness Es- timation in Radar Imagery. In2025 IEEE International Radar Conference (RADAR). 1–6. doi:10.1109/RADAR52380.2025.11031955
-
[26]
Zesheng Liu and Maryam Rahnemoonfar. 2025. ST-GRIT: Spatio-Temporal Graph Transformer For Internal Ice Layer Thickness Prediction. In2025 IEEE International Conference on Image Processing (ICIP). 1109–1114. doi:10.1109/ ICIP55913.2025.11084445
arXiv 2025
-
[27]
Zesheng Liu and Maryam Rahnemoonfar. 2026. From Short Histories to Long Futures: Horizon-Aware Graph Neural Networks for Long Horizon Forecasting. arXiv:2605.29952 [cs.LG] https://arxiv.org/abs/2605.29952
Pith/arXiv arXiv 2026
-
[28]
Zesheng Liu and Maryam Rahnemoonfar. 2026. K-STEMIT: Knowledge-Informed Spatio-Temporal Efficient Multi-Branch Graph Neural Network for Subsurface Stratigraphy Thickness Estimation from Radar Data. arXiv:2604.09922 [cs.LG] https://arxiv.org/abs/2604.09922
Pith/arXiv arXiv 2026
-
[29]
Ilya Loshchilov and Frank Hutter. 2019. Decoupled Weight Decay Regularization. InInternational Conference on Learning Representations. https://openreview.net/ forum?id=Bkg6RiCqY7
2019
-
[30]
L. W. Morland. 1987. Unconfined Ice-Shelf Flow. InDynamics of the West Antarctic Ice Sheet, C. J. Van der Veen and J. Oerlemans (Eds.). Springer Netherlands, Dordrecht, 99–116
1987
-
[31]
Battaglia
Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter W. Battaglia
-
[32]
InInternational Conference on Learning Representations
Learning Mesh-Based Simulation with Graph Networks. InInternational Conference on Learning Representations
-
[33]
Michael Poli, Stefano Massaroli, Junyoung Park, Atsushi Yamashita, Hajime Asama, and Jinkyoo Park. 2021. Graph Neural Ordinary Differential Equations. arXiv:1911.07532 [cs.LG] https://arxiv.org/abs/1911.07532
arXiv 2021
-
[34]
E. Rignot, I. Velicogna, M. R. van den Broeke, A. Monaghan, and J. T. M. Lenaerts. 2011. Acceleration of the contribution of the Greenland and Antarctic ice sheets to sea level rise.Geophysical Research Letters38, 5 (2011). arXiv:https://agupubs.onlinelibrary.wiley.com/doi/pdf/10.1029/2011GL046583 doi:10.1029/2011GL046583
-
[35]
Yulia Rubanova, Ricky T. Q. Chen, and David Duvenaud. 2019.Latent ODEs for irregularly-sampled time series. Curran Associates Inc., Red Hook, NY, USA
2019
-
[36]
The Cryosphere8(5), 1699– 1710 (2014)
H. Seroussi, M. Morlighem, E. Rignot, J. Mouginot, E. Larour, M. Schodlok, and A. Khazendar. 2014. Sensitivity of the dynamics of Pine Island Glacier, West Antarctica, to climate forcing for the next 50 years.The Cryosphere8, 5 (2014), 1699–1710. doi:10.5194/tc-8-1699-2014
-
[37]
Gomez, Łukasz Kaiser, and Illia Polosukhin
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. InProceedings of the 31st International Conference on Neural Information Processing Systems(Long Beach, California, USA)(NIPS’17). Curran Associates Inc., Red Hook, NY, USA, 6000–6010
2017
-
[38]
David G Vaughan, AM Smith, HFJ Corr, Adrian Jenkins, Charles R Bentley, Mark D Stenoien, Stanley S Jacobs, Thomas B Kellogg, EJ Rignot, and BK Luchitta
-
[39]
Observations of change.The West Antarctic Ice Sheet: Behavior and Environment, Antarct
A review of the ice-sheet dynamics in the Pine Island Glacier basin, West Antarctica: Hypotheses of instability vs. Observations of change.The West Antarctic Ice Sheet: Behavior and Environment, Antarct. Res. Ser77 (2001), 237– 256
2001
-
[40]
Louis-Pascal A. C. Xhonneux, Meng Qu, and Jian Tang. 2020. Continuous graph neural networks. InProceedings of the 37th International Conference on Machine Learning (ICML’20). JMLR.org, Article 966, 10 pages
2020
-
[41]
Yi Xie, Yun Xiong, and Yangyong Zhu. 2020. SAST-GNN: A Self-Attention Based Spatio-Temporal Graph Neural Network for Traffic Prediction. InDatabase Sys- tems for Advanced Applications, Yunmook Nah, Bin Cui, Sang-Won Lee, Jeffrey Xu Yu, Yang-Sae Moon, and Steven Euijong Whang (Eds.). Springer International Publishing, Cham, 707–714
2020
-
[42]
Zhewen Xu, Xiaohui Wei, Jieyun Hao, Junze Han, Hongliang Li, Changzheng Liu, Zijian Li, Dongyuan Tian, and Nong Zhang. 2024. DGFormer: a physics-guided station level weather forecasting model with dynamic spatial-temporal graph neural network.GeoInformatica28, 3 (01 Jul 2024), 499–533. doi:10.1007/s10707- 024-00511-1 A Appendix: Ablation of COGENT Archite...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.