Pith. sign in

REVIEW 5 cited by

Fixing the Double Penalty in Data-Driven Weather Forecasting Through a Modified Spherical Harmonic Loss Function

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2501.19374 v2 pith:W3WGEISO submitted 2025-01-31 cs.LG physics.ao-ph

classification cs.LGphysics.ao-ph
keywords lossfunctionmodelsdata-drivenweatherattributabledeterministicdouble
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Recent advancements in data-driven weather forecasting models have delivered deterministic models that outperform the leading operational forecast systems based on traditional, physics-based models. However, these data-driven models are typically trained with a mean squared error loss function, which causes smoothing of fine scales through a "double penalty" effect. We develop a simple, parameter-free modification to this loss function that avoids this problem by separating the loss attributable to decorrelation from the loss attributable to spectral amplitude errors. Fine-tuning the GraphCast model with this new loss function results in sharp deterministic weather forecasts, an increase of the model's effective resolution from 1,250km to 160km, improvements to ensemble spread, and improvements to predictions of tropical cyclone strength and surface wind extremes.

Discussion (0). Sign in to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. FourCastNet 3: A geometric approach to probabilistic machine-learning weather forecasting at scale

    cs.LG 2025-07 conditional novelty 7.0 of 10

    A purely convolutional, spherical-geometry weather model trained with a combined spatial and spectral CRPS loss delivers GenCast-level skill, IFS-beating accuracy, and stable spectra out to 60 days.

  2. HRRRCast: a data-driven emulator for regional weather forecasting at convection allowing scales

    physics.ao-ph 2025-07 conditional novelty 6.0 of 10

    A diffusion-based neural network trained on HRRR analysis beats HRRR forecast skill on 20 dBZ composite reflectivity across CONUS and is competitive at 30 dBZ.

  3. Forecast error diagnostics in neural weather models

    physics.ao-ph 2025-06 conditional novelty 6.0 of 10

    Correcting the stratosphere or boundary layer toward reanalysis truth substantially improves mid-latitude medium-range forecasts in a neural weather model; correcting the tropics does not.

  4. Evaluating Extreme Precipitation Forecasts: A Threshold-Weighted, Spatial Verification Approach for Comparing an AI Weather Prediction Model Against a High-Resolution NWP Model

    physics.ao-ph 2025-10 conditional novelty 5.0 of 10

    Combining HiRA neighborhood verification with threshold-weighted CRPS shows that AI-vs-NWP rankings for extreme precipitation depend strongly on neighborhood size.

  5. The Rise of AI in Weather and Climate Information and its Impact on Global Inequality

    physics.ao-ph 2026-03 conditional novelty 4.0 of 10

    AI weather and climate tools inherit Northern-controlled data and compute, risking worse forecasts and maladaptation for the Global South rather than democratizing climate information.

Pith tools