REVIEW 17 cited by
WeatherBench 2: A benchmark for the next generation of data-driven global weather models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
WeatherBench 2 is an update to the global, medium-range (1-14 day) weather forecasting benchmark proposed by Rasp et al. (2020), designed with the aim to accelerate progress in data-driven weather modeling. WeatherBench 2 consists of an open-source evaluation framework, publicly available training, ground truth and baseline data as well as a continuously updated website with the latest metrics and state-of-the-art models: https://sites.research.google/weatherbench. This paper describes the design principles of the evaluation framework and presents results for current state-of-the-art physical and data-driven weather models. The metrics are based on established practices for evaluating weather forecasts at leading operational weather centers. We define a set of headline scores to provide an overview of model performance. In addition, we also discuss caveats in the current evaluation setup and challenges for the future of data-driven weather forecasting.
Forward citations
Cited by 17 Pith papers
-
FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale
A purely convolutional, spherical-geometry weather model trained with a combined spatial and spectral CRPS loss delivers GenCast-level skill, IFS-beating accuracy, and stable spectra out to 60 days.
-
RainShift: A Benchmark for Precipitation Downscaling Across Geographies
RainShift is a global benchmark showing that precipitation downscaling models lose up to 30% accuracy when applied to unseen Global South regions, and input quantile mapping recovers some of that loss.
-
Skillful joint probabilistic weather forecasting from marginals
FGN, a neural weather model trained only on per-location forecast scores, produces more accurate global ensemble forecasts than GenCast and captures realistic spatial correlations.
-
DLESyM-Ocean: A Deep Learning Probabilistic Global Model for Simulating Present-Day Upper Ocean and Sea Ice
DLESyM-Ocean is a probabilistic deep learning ocean-sea ice emulator trained with a patch energy score loss that stays stable over multi-year simulations.
-
AS-Bridge: A Bidirectional Generative Framework Bridging Next-Generation Astronomical Surveys
A Brownian-bridge diffusion model learns probabilistic LSST↔Euclid image translation on simulations and uses reconstruction inconsistency to detect strong lenses.
-
ArchesClimate: Probabilistic Decadal Ensemble Generation With Flow Matching
ArchesClimate autoregressively generates 10-year monthly climate states with a flow-matching emulator trained on IPSL-CM6A-LR decadal hindcasts, producing ensembles that match the climate model for some variables.
-
Jigsaw: Training Multi-Billion-Parameter AI Weather Models with Optimized Model Parallelism
An MLP-based weather model called WeatherMixer trains efficiently with a new Jigsaw parallelization scheme that shards data and model across GPUs, reaching 11 PFLOPs on 256 GPUs with 72% scaling efficiency.
-
Finetuning a Weather Foundation Model with Lightweight Decoders for Unseen Physical Processes
A frozen weather foundation model's latent space can be decoded by a small MLP to predict unseen hydrological variables, with accuracy and efficiency strongly favoring this lightweight approach over full fine-tuning.
-
PEAR: Equal Area Weather Forecasting on the Sphere
A transformer weather model operating natively on the equal-area HEALPix grid beats an equiangular-grid counterpart at longer lead times with 2.6x fewer parameters.
-
Atmospheric Predictability Beyond 30 Days with Machine Learning
Optimizing the initial conditions of a machine-learning weather model against reanalysis data cuts 10-day forecast error by 86% and extends the apparent forecast-skill horizon beyond 30 days, though the optimization r...
-
GraphDOP: Towards skilful data-driven medium-range weather forecasts learnt and initialised directly from observations
A graph-neural-network weather model trained only on raw observations produces skillful global forecasts out to five days, with tropical 2-meter temperature forecasts competitive with the operational IFS.
-
ArchesWeather & ArchesWeatherGen: a deterministic and generative model for efficient ML weather forecasting
ArchesWeatherGen, a flow-matching model trained on residuals of a deterministic transformer, generates ensemble forecasts that outperform IFS ENS and NeuralGCM on most WeatherBench headline variables at 1.5 degrees re...
-
Uncertainty Quantification for Regression: A Unified Framework based on kernel scores
Kernel-score divergences define a unified family of regression uncertainty measures whose kernel choice controls robustness, tail sensitivity, and OOD responsiveness.
-
Deep Learning Weather Models for Subregional Ocean Forecasting: A Case Study on the Canary Current Upwelling System
An adapted GraphCast graph neural network trained on satellite sea surface temperature outperforms ConvLSTM and the GLORYS reanalysis for medium-range forecasts in the Canary Current upwelling system.
-
Utilizing Strategic Pre-training to Reduce Overfitting: Baguan -- A Pre-trained Weather Forecasting Model
Baguan shows that a two-frame Siamese masked autoencoder pre-training step reduces overfitting in a plain ViT weather model, improving medium-range forecasts over Pangu-Weather and IFS on the 2018 ERA5 test set.
-
WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks
A multi-modal, multi-scale dataset collection for weather and climate downstream tasks, released with preprocessing code and baseline validations.
-
The Rise of AI in Weather and Climate Information and its Impact on Global Inequality
AI weather and climate tools inherit Northern-controlled data and compute, risking worse forecasts and maladaptation for the Global South rather than democratizing climate information.
Discussion (0). Continue with ORCID to comment.