REVIEW 3 major objections 5 minor 4 references
Assessing the economic benefits of space weather mitigation investment decisions: Evidence from Aotearoa New Zealand
T0 review · 3 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash
Pith's one-line read A severe but realistic geomagnetic storm could cost Aotearoa New Zealand up to NZ$8.36 billion in lost GDP, and targeted mitigation can avert a large share of that loss for a tiny investment.
desk verdict A first real NZ economic assessment of GIC-driven outages, but the headline 740:1 benefit-cost claim is internally inconsistent and not reproducible from the text as written. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The argument is carried by a coupled physics-engineering-economic chain. A validated New Zealand GIC model estimates geomagnetically induced currents in the 220 kV and 110 kV transmission network from a worst-case magnetic field model and ground conductivity data; substations whose GIC exposure exceeds 500 A are treated as failing. The resulting outage maps, combined with assumed restoration sequences, are downscaled to local industrial electricity consumption using employment data, producing sector-level 'lost load'. That shock is fed into the Ghosh supply-driven input-output model—a standard economic model that traces how a cut in one sector's supply ripples through other sectors that depend on it—whose inverse matrix propagates the value-added reduction through inter-industry linkages to estimate total and indirect GDP losses. Benefit-cost ratios are then computed by dividing avoided GDP losses by the scenario's investment cost (e.g., NZ$500,000 for switching plus islanding). The 500 A threshold and the hand-assigned restoration curves are the linchpins: every headline number scales with them.
What would settle it
Compare the modelled outage footprints and restoration curves against real logged outages and GIC measurements from the New Zealand grid during moderate storms (e.g., the 2003 Halloween storm): if substations with modelled GIC above 500 A did not actually trip, or if restoration took significantly longer or shorter than the paper's hand-assigned schedules, then the NZ$8.36 billion upper bound and the 740-to-1 benefit-cost ratio would not hold.
Extended reading notes
Core claim
On the paper's own terms, the central discovery is that space weather is a measurable macroeconomic risk for New Zealand, not just a grid-operations problem. In the absence of mitigation, a full six-day national blackout would cost up to NZ$8.36 billion in lost GDP under the percentage-shock method, with approximately 60 percent of that loss arising indirectly through supply-chain linkages; under a more conservative value-of-lost-load survey method, the same scenario still costs NZ$3.41 billion. Even more targeted GIC-informed outage scenarios cost between NZ$3.08 and NZ$3.45 billion (percentage-shock) or NZ$1.28 to NZ$1.44 billion (survey-VoLL). The paper also finds that a research-led operational strategy of optimized switching plus islanding can reduce losses by up to NZ$370 million for an investment of about NZ$500,000, a benefit-cost ratio of 740 to 1, while physical GIC blocking devices achieve returns up to about 80 to 1. Additional unmodelled capital and revenue losses at industrial facilities such as the Tiwai Point aluminium smelter could add more than NZ$1 billion, reinforcing the case for pre-emptive mitigation.
Load-bearing premise
The headline loss and benefit-cost figures are arithmetic consequences of assumed outage maps and restoration timings—most crucially that every substation exposed to more than 500 A of geomagnetically induced current fails, that North Island load shedding is fixed at 20 percent during HVDC loss, and that restoration follows hand-assigned day schedules—so any change in these assumptions changes every headline number proportionally.
Editorial extensions
If this is right
- If the modelling holds, a severe geomagnetic storm without mitigation would cost the New Zealand economy billions of dollars in lost GDP even under the most conservative estimation method (over NZ$3 billion for a full six-day national blackout).
- Operational strategies—optimized switching and islanding—yield higher benefit-cost returns (up to 740 to 1) than physical GIC blocking devices (up to 80 to 1), because the former are very cheap even though they avoid less loss.
- Indirect supply-chain losses make up roughly half to 60 percent of total GDP loss in the worst scenarios, so resilience policy should target inter-industry dependencies, not just direct blackout zones.
- The paper's estimates exclude capital and long-term revenue losses at continuous-process industrial facilities, which could add over NZ$1 billion in a severe event, making the true economic case for mitigation stronger than the headline benefit-cost ratios alone.
- Even the most severe GIC-informed outage scenario with no mitigation leaves losses near NZ$1.5 billion, so the benefits of mitigation remain material under a wide range of storm intensities.
Reading between the lines
- Because the 500 A failure threshold and the restoration curves are assumed rather than measured, the 740-to-1 benefit-cost ratio should be read as conditional: if real storms trip substations at lower GIC levels, the no-mitigation losses and hence the avoided-loss numerator grow, while if the threshold is higher, the ratio shrinks.
- The same coupled GIC-input-output framework could be transplanted to other mid-latitude countries with HVDC interconnectors, where similar load-shedding rules and hydro-based restoration assumptions would yield comparable benefit-cost envelopes.
- A natural validation would be to replace the hand-assigned restoration schedules with durations inferred from historical storms (e.g., the 1989 Quebec blackout and the 2003 Malmö outage) and re-run the GDP calculations; this would show how much of the headline benefit-cost ratio depends on restoration speed.
- The spread between the percentage-shock and survey-based VoLL estimates brackets the likely loss range, but a general-equilibrium model that lets businesses substitute inputs would probably land below the lower bound, so the absolute dollar figures are less certain than the policy recommendation to invest in mitigation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper develops a coupled physics-engineering-economic framework to quantify the macroeconomic impacts of extreme geomagnetic storms on New Zealand. It defines seven disruption and mitigation scenarios, estimates direct and indirect GDP losses using employment-scaled electricity data with two VoLL-based approaches embedded in a Ghosh input-output model, and reports benefit-cost ratios for operational switching, islanding, and GIC blocker investments. The headline claims are a worst-case unmitigated loss of NZ$8.36 billion, a maximum benefit-cost ratio of 740:1 for operational mitigation, and up to 80:1 for GIC blockers.
Significance. If the numbers are correct, this is the first dedicated economic assessment of space weather impacts for New Zealand and a useful application of coupled physical and economic modelling. The paper draws on a validated GIC model, Transpower data, sectorally disaggregated employment and electricity statistics, and compares multiple estimation approaches, which are real strengths. However, the central benefit-cost results are not internally consistent as written, and the headline ratios are directly determined by hand-set scenario assumptions. The contribution would be significant after a careful correction and a transparent sensitivity analysis, but the current manuscript cannot be evaluated on its central claim.
major comments (3)
- [Sections 5.1, 5.2, and 6] The Scenario 5 loss is internally inconsistent. Section 5.1 states that Scenarios 3 through 5 have losses ranging from NZ$3.45 billion to NZ$3.42 billion, which implies Scenario 5 loses NZ$3.42B and therefore avoids only NZ$30M relative to Scenario 3 (a 60:1 benefit-cost ratio on a NZ$500k investment). Section 5.2, however, lists Scenario 5 as NZ$1.28B, described as down 58% from NZ$3.08B, implying an avoided loss of NZ$370M and a 740:1 ratio. The Discussion then assigns NZ$3.42B to Scenario 5 and NZ$3.08B to Scenario 4, and computes a benefit-cost ratio of 370 for Scenario 5 even though 370/0.5 = 740. The abstract, key points, and conclusions all rely on the 740:1 figure. This is a load-bearing arithmetic and labelling error that must be resolved before the paper's central claim can be assessed.
- [Section 4.4, Equations (1)-(4)] The 'percentage shock' method is not fully specified. The text computes sectoral lost load via employment scaling and VoLL in Equations (1)-(4), then states that 'once the percentage of interrupted electricity is determined, the model utilizes a proportional decrease in inter-industry electricity demand,' but it never defines how this percentage is derived from the direct economic loss or how it is applied to the value-added vector in Equation (8). If the direct loss is a VoLL-based welfare measure, using it directly as a proportional reduction in value-added risks mixing welfare accounting with production accounting. The authors should give the explicit algorithm for the percentage shock and clarify how the two methods differ at the implementation level.
- [Section 4.2, Table 1, Figures 4-5] The headline benefit-cost ratios are essentially predetermined by the scenario design. Table 1 fixes the North Island load-shedding fraction at 20% for all advanced scenarios, assigns restoration start days (day 3 or 4) and completion days by hand, and assumes substations above 500 A GIC fail. Because avoided losses scale roughly linearly with outage duration and geographic extent, the reported 740:1 and 80:1 ratios are arithmetic consequences of these assumptions rather than independent estimates. The paper should include a sensitivity analysis over restoration speed, GIC failure threshold, load-shedding fraction, and blocker unit cost, and should state how sensitive the benefit-cost ratios are to each assumption.
minor comments (5)
- [Section 5.1] There is a typo: 'sonstruction' should be 'construction', and the phrase 'a more than >50% reduction' is redundant.
- [Section 6] The Discussion contains 'benefit-cost ration of 370', which should be 'benefit-cost ratio of 370'.
- [Figure 7 caption] The caption reads 'Context of New Zealand's electricity transmission infrastructure' but the figure shows scenario losses; this appears to be copied from Figure 1.
- [Throughout] Currency notation is inconsistent: the paper alternates between 'NZ$' and 'NZD'. Please standardize.
- [Section 4.3 vs Table 1] The narrative for Scenario 5 says 'most regions showing recovery by Day 5,' while Table 1 specifies restoration from day 4 over 3 days and 6 days of North Island load shedding; please reconcile the text with the table.
Circularity Check
No significant circularity: the benefit-cost ratios are conditional arithmetic consequences of explicitly stated scenario assumptions, not fitted predictions or self-citation-derived results.
full rationale
The paper's derivation chain is a conditional scenario analysis rather than a circular one. Direct economic losses are computed from explicit scenario assumptions about which substations fail, how long restoration takes, and how much load is shed (Table 1; Figures 4 and 5), then converted to lost energy via Equations (1)-(3) and to direct losses via sectoral VoLL in Equation (4). Indirect losses follow from the Ghosh input-output model in Equations (5)-(11). Benefit-cost ratios are then arithmetic differences between scenario losses divided by stated investment costs. These ratios are therefore determined by the scenario design choices, but they are not equivalent to those choices by construction in any problematic sense: the scenario assumptions enter as inputs, the GDP losses as outputs, and the relationship is a transparent economic calculation. No fitted parameter is relabelled as a prediction, and no load-bearing conclusion depends on an unverified self-citation. The prior New Zealand GIC model (Mac Manus et al., 2022) is independently validated against observed events, and the economic data come from Stats NZ and Transpower surveys. The paper also explicitly acknowledges dependence on uncertain factors and the exclusion of capital-equipment losses, which supports an honest conditional interpretation. The internal arithmetic inconsistency between Section 5.1, Section 5.2, and the Discussion concerning whether Scenario 5 loses NZ$3.42B or NZ$3.08B, and whether the benefit-cost ratio is 370 or 740, is a reproducibility and correctness concern, not a circularity concern. The central claims therefore do not reduce to their inputs by definition, and no circular steps are found.
Assumptions & free parameters
free parameters (6)
- Substation GIC failure threshold =
>500 A per substation; 250 A per transformer; ~83 A per phase
- North Island load shedding fraction =
20% for 6, 4, or 3 days depending on scenario
- Restoration start and completion days =
Restoration starts day 3 or 4; full restoration by days 3 to 6
- GIC blocking device unit cost =
NZ$2 million per device
- Sectoral VoLL values =
Up to NZ$55,941/MWh for transport
- Electricity intensity per employee =
Sector MWh per employee derived from MBIE and Stats NZ data
assumptions (6)
- domain assumption Direct economic loss measured as lost load times VoLL can be treated as a reduction in sectoral value added in the Ghosh IO model (Equations 4 and 8).
- domain assumption Local electricity consumption by sector scales linearly with sectoral employment (Equations 1 and 2).
- domain assumption Substations with GIC above 500 A fail or are taken offline, based on 250 A per transformer and a 130 degrees C relay threshold.
- domain assumption The Ghosh supply-driven IO model correctly estimates indirect output losses from a value-added shock.
- ad hoc to paper Restoration follows the hand-specified sequences in Figures 4 and 5, with restoration starting day 3 or 4 and full restoration by days 3 to 6 depending on scenario.
- domain assumption The extreme storm magnetic field estimates used to drive the GIC model are a realistic severe but plausible event.
Cite this review
Pith. "Pith review of Assessing the economic benefits of space weather mitigation investment decisions: Evidence from Aotearoa New Zealand." pith.science (2026). https://pith.science/paper/K3CAODIQ
@misc{pith2026250712495,
author = {Pith},
title = {Pith review of: Assessing the economic benefits of space weather mitigation investment decisions: Evidence from Aotearoa New Zealand},
year = {2026},
howpublished = {\url{https://pith.science/paper/K3CAODIQ}},
note = {Machine review of arXiv:2507.12495}
}
read the original abstract
Space weather events pose a growing threat to modern economies, yet their macroeconomic consequences remain underexplored. This study presents the first dedicated economic assessment of geomagnetic storm impacts on Aotearoa New Zealand, quantifying potential gross domestic product (GDP) losses across seven conservative disruption and mitigation scenarios due to an extreme coronal mass ejection (CME). The primary focus is on the damaging impacts of geomagnetically induced currents (GICs) on the electrical power transmission network. We support space weather mitigation investment decisions by providing a first-order approximation of their potential economic benefits, using best-in-class scientific models, via a coupled physics-engineering-economic spatial modelling framework. Recognising uncertainty in the economic interpretation of power outage impacts, we compare four different estimation methods. In the most severe unmitigated scenario, estimated GDP losses reach NZD3.58 billion (0.98 percent of annual GDP). Targeted GIC-informed scenarios still produce material losses, with no mitigation reaching up to NZD1.48 billion (0.41 percent of annual GDP). Mitigation substantially reduces these impacts. Operational strategies, including optimized switching and islanding, achieve benefit-cost ratios as high as 330 to 1, while physical protections such as GIC blocking devices produce returns up to 34.4 to 1. When also acknowledging additional unmodelled impacts, including multi-billion losses in capital equipment and long-term revenue, the economic rationale for pre-emptive mitigation becomes even more pertinent.
Reference graph
Works this paper leans on
-
[1]
Maryland, USA: Abt Associates for the National Oceanic and Atmospheric Administration
Abt Associates (2017) Social and Economic Impacts of Space Weather in the United States. Maryland, USA: Abt Associates for the National Oceanic and Atmospheric Administration. Available at: https://www.weather.gov/news/171212_spaceweatherreport (Accessed: 28 February 2018). Allen, J. et al. (1989) ‘Effects of the March 1989 solar activity’, Eos, Transacti...
-
[9]
Available at: https://doi.org/10.3389/fspas.2022.1017103. Divett, T. et al. (2017) ‘Modeling Geoelectric Fields and Geomagnetically Induced Currents Around New Zealand to Explore GIC in the South Island’s Electrical Transmission Network’, Space Weather, 15(10), pp. 1396–1412. Available at: https://doi.org/10.1002/2017SW001697. Divett, T. et al. (2020) ‘Ge...
arXiv 2017
-
[21]
Available at: https://doi.org/10.1051/swsc/2024015. Mac Manus, D.H. et al. (2022) ‘Geomagnetically Induced Current Model in New Zealand Across Multiple Disturbances: Validation and Extension to Non-Monitored Transformers’, Space Weather, 20(2), p. e2021SW002955. Available at: https://doi.org/10.1029/2021SW002955. Ministry of Business, Innovation & Employm...
-
[264]
Available at: https://doi.org/10.1080/09535314.2022.2137008. Anderson, P.L. and Geckil, I.K. (2003) ‘Northeast blackout likely to reduce US earnings by $6.4 billion’, Anderson Economic Group [Preprint]. Barnes, P.R. and Dyke, J.W.V. (1990) ‘Economic consequences of geomagnetic storms (a summary)’, IEEE Power Engineering Review, 10(11), pp. 3–4. Available ...
arXiv 2003
Reviewed August 6, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.