REVIEW 4 major objections 5 minor 2 references
Valuing Diffuse Global Public Goods from Satellite Constellations: Evidence from GPS and Airline Delays
T0 review · 4 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read Disabling Selective Availability in May 2000 cut airline in-flight delays by 0.617 minutes per flight and produced $268 million in first-year passenger welfare.
desk verdict A transparent but under-identified DiD that quantifies a real gap in the GPS valuation literature; the $268M headline overstates what the paper's own specifications support. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The analysis is carried by a difference-in-differences regression in which the outcome is adddelay (arrival delay minus departure delay), the treated group is all flights in 2000, the control group is all flights in 1999, and a GPS dummy marks flights from May 2 through December 31. The coefficient on the interaction of treated and GPS, reported as -0.617 minutes per flight, is interpreted as the causal effect of the accuracy improvement on in-flight delay. The welfare calculation multiplies the minutes saved by monthly domestic passenger counts and by the federal value-of-travel-time estimate of $28.60 per hour (with lower and upper bounds of $23.80 and $35.60), converting the time saving into dollars.
What would settle it
Run the same difference-in-differences regression with a placebo treatment cutoff, such as May 2, 1999 or any randomly chosen date in the middle of 1999; if the interaction coefficient again lands near -0.6 and is statistically significant, the 0.617-minute estimate is an artifact of seasonal or year-specific variation rather than the Selective Availability change.
Extended reading notes
Core claim
The central discovery is that removing Selective Availability reduced in-flight delays — measured as arrival delay minus departure delay, or adddelay — by an average of 0.617 minutes per flight in the year following the policy change. The estimate comes from a difference-in-differences regression comparing flights in 2000 (the treated group) with flights in 1999 (the control group), before and after May 2, with airport cancellation rates as weather controls. The effect was not uniform: flights over 2,000 miles saved about 2.4 to 2.9 minutes per flight, and the per-flight saving first grew to more than 1.5 minutes in the early months after the change before declining toward the yearly average. The paper interprets the mechanism as pilots using the more accurate signal to adhere more closely to their flight plans.
Load-bearing premise
The estimate rests on the assumption that, without the GPS change, the seasonal pattern of in-flight delays from January through April to May through December would have been the same in 2000 as it was in 1999; with only two years of data this parallel-trends assumption cannot be tested.
Editorial extensions
If this is right
- If the estimate is correct, the $268 million first-year welfare gain from US airline passengers alone exceeds the GPS program's annual appropriation, so the removal of Selective Availability was welfare-enhancing on this margin alone.
- Larger savings on flights over 2,000 miles support the proposed mechanism that more accurate GPS lets pilots follow flight paths more closely, since longer routes have more distance to optimize.
- The per-flight saving was largest in the first few months after the change and then declined toward 0.617 minutes, suggesting pilots and airlines initially captured larger gains before incorporating the improved signal into standard procedures.
- The same method provides a template for pricing GPS disruptions: at 25 minutes of added delay per affected flight, the roughly 41,000 spoofed flights documented in a single month would imply about $110 million in passenger welfare losses.
Reading between the lines
- A natural falsification exercise would be to run the identical regression with a placebo treatment date, such as May 2, 1999; the paper does not provide one, and such a test would reveal how much of the 0.617-minute coefficient reflects ordinary year-to-year seasonal variation.
- The paper's preliminary look at ticket fares suggests airlines may have raised prices after the accuracy improvement; if so, part of the measured welfare gain was captured by producers, and the consumer-surplus figure of $268 million is an upper bound.
- The same difference-in-differences design could be applied to other GPS-reliant activities with time-stamped outcomes, such as maritime transit times or logistics fleets, to test whether the delay reduction is specific to aviation or a more general accuracy effect.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper estimates the welfare effect of the United States' May 2, 2000 decision to disable Selective Availability (SA) on GPS accuracy. Using BTS Airline On-Time Performance data for 1999 and 2000, the author constructs a difference-in-differences design in which 1999 flights serve as the control group and 2000 flights as the treated group, with the 'post' period defined as May 2 through December 31. The outcome is adddelay (arrival delay minus departure delay), and the key coefficient is the interaction in Equation 3, reported as -0.617 minutes per flight in Table 4. The author multiplies this time saving by T-100 passenger counts and DOT value-of-time estimates to obtain a headline welfare gain of $268,123,934 in the first post-treatment year. Additional specifications split the sample by recency to treatment and by flight distance, and the paper extrapolates the method to estimate welfare losses from recent GPS jamming and spoofing incidents.
Significance. If the causal estimate were credible, the paper would fill a genuine gap by quantifying a discrete improvement to a global public good using a natural experiment. The manuscript is transparent about data sources, uses public microdata, and applies an externally supplied value of time rather than fitting welfare parameters internally. The historical policy episode is well-motivated and the aviation channel is plausible. However, the central identification assumption is untestable with the two years of data used, and the paper's own estimates across alternative windows are mutually inconsistent by a factor of roughly three. Because the headline welfare number depends on selecting the most disaggregated specification, the quantitative contribution cannot currently be distinguished from specification search and annual seasonal drift.
major comments (4)
- [Eq. (3) and Table 5] The identifying assumption for the difference-in-differences coefficient is that the seasonal pattern of adddelay from January-April to May-December was identical in 1999 and 2000, since 1999 serves as the sole control year. This assumption is untestable with only two years of data, and the paper's own estimates contradict it. The interaction coefficient in Table 5 is -0.434 for the 1-month window, -1.508 for the 2-month window, -1.687 for the 3-month window, -1.185 for the 4-month window, and -0.617 for the full year. These specifications all estimate essentially the same first-year treatment effect under a stable seasonal baseline, so a 3.5-fold range indicates that year-over-year baseline shifts are month-specific rather than constant. The author should provide a placebo test using 1998 versus 1999 with the same May 2 cutoff, or another falsification exercise, before the coefficient can be interpreted causally.
- [Sec. 4.2 and Appendix C.4] The headline welfare estimate of $268,123,934 is not the estimate from the pre-specified full-year regression in Table 4 ($183,464,122) but the largest estimate among four sets of welfare computations, produced by the most granular specification in Appendix C.4 in which coefficients vary by month and distance group. The paper reports $183M, $248M, $204M, and $268M for four scenarios and selects the maximum as the central result, without a principled model-selection rule or pre-registration. This selection materially inflates the headline number; the abstract's 'at least $268 million' is therefore not supported by the full set of estimates.
- [Sec. 4.1, Table 6, and Fig. 4] The mechanism story is not independently tested. The paper interprets the large coefficients for flights over 2000 miles (e.g., -2.883 minutes in Table 6) and the non-monotonic recency pattern as evidence that pilots used improved GPS to adhere to flight plans, with a post-hoc 'learning then regulation' narrative in Section 4.1. No data on GPS receiver equipage, pilot training, or route changes are presented, and the same pattern could arise from distance-specific seasonal shocks or from the extreme sensitivity of the estimates to the chosen window. The mechanism should either be tested with auxiliary data or presented explicitly as speculation.
- [Sec. 3.1] The paper acknowledges the absence of a natural control group ('Due to the lack of a second United States to use as a control'), yet the entire research design relies on the assumption that 1999 is a valid counterfactual for 2000. The two-year structure means any year-specific shock that differentially affects the May-December period (weather, fuel prices, air traffic volume, or airline scheduling practices) is absorbed into the interaction term. The author's assertion that 'it appears that there was not a significant alteration in how air travel operated' is not supported by any evidence; this is a load-bearing point that needs direct testing or a bounding exercise.
minor comments (5)
- [Fig. 1] The claim that the graph 'appears to show more pronounced valleys and peaks before GPS SA was disabled' is not supported by simple visual inspection; a formal seasonality comparison would be needed to substantiate this.
- [Table 3] Table 3 does not list the control-period dates for the recency-based regressions; the text should specify that the control periods are the corresponding calendar windows in 1999.
- [Table 14] In the May '00 row, the 2000-2500 miles entry reads '8 1.361', which appears to be a typographical error for '-1.361' based on the corresponding estimate in Table 15; please correct.
- [Sec. 4.1] The text reports p values 'less than 0.00'; this should be written as p < 0.001 or with exact values, since p values cannot be zero.
- [Appendix C.4] The welfare calculation for the 'most specific' specification replaces one insignificant coefficient with a distance-based coefficient, but the choice of replacement specification is not justified; this should be documented and justified.
Circularity Check
No circularity: the welfare estimate is a product of an externally observed policy event, public flight data, and independent DOT time valuations.
full rationale
The paper's derivation is self-contained in the relevant sense. The treatment is an external policy event (Selective Availability disabled on May 2, 2000), the outcome is the constructed variable adddelay = arrival delay - departure delay from public BTS data, and Equation 3 estimates a difference-in-differences coefficient beta3 on the treated x GPS interaction. The welfare calculation multiplies this coefficient by T-100 passenger counts and the DOT's 2003 value-of-travel-time estimate ($28.60/hour), all external inputs. Nothing in the chain defines the estimated effect in terms of the welfare total or vice versa: the $268 million figure is arithmetic applied to an independently estimated coefficient, not a fitted parameter relabeled as a prediction. The window-specific and distance-specific regressions revisit the same identification strategy but do not reduce to their inputs by construction; they are alternative estimates, and the acknowledged limitations (lack of a natural control, weather proxied by cancellations, possible rent capture by airlines) are identification or external-validity concerns, not circularity. Citations to Weeden and Buchholz are background or acknowledged assistance and are not load-bearing for the central result. No self-citation chain or uniqueness theorem is invoked to force the choice of model. Accordingly, no circular step was found.
Assumptions & free parameters
assumptions (4)
- domain assumption Parallel trends in adddelay between the control year 1999 and treated year 2000 for the seasonal component
- domain assumption The difference between arrival and departure delay (adddelay) isolates in-flight delays relevant to GPS accuracy
- domain assumption Airlines and pilots were able to benefit from improved GPS within the study window
- domain assumption DOT's value of travel time ($28.60/hour in 2000 dollars) approximates passengers' marginal willingness to pay for reduced flight time
Cite this review
Pith. "Pith review of Valuing Diffuse Global Public Goods from Satellite Constellations: Evidence from GPS and Airline Delays." pith.science (2026). https://pith.science/paper/IMTRVTYK
@misc{pith2026250608209,
author = {Pith},
title = {Pith review of: Valuing Diffuse Global Public Goods from Satellite Constellations: Evidence from GPS and Airline Delays},
year = {2026},
howpublished = {\url{https://pith.science/paper/IMTRVTYK}},
note = {Machine review of arXiv:2506.08209}
}
abstract
This paper studies the welfare impact of discrete improvements to global public goods in the context of the Global Positioning System (GPS). Specifically, I find that by disabling Selective Availability in May, 2000, and thus significantly increasing the accuracy of GPS, the United States generated at least \$268 million (2000 dollars) of additional welfare gains. To quantify this welfare impact, I apply a difference-in-differences model to the Bureau of Transportation Statistics's Airline On-Time Performance Data in the years 1999 and 2000. I use this model to estimate the time saved per flight attributable to the improved GPS and multiply these time savings by the number of passengers in the ensuing year and their values of time. I conclude by estimating the economic loss from current threats to the provision of satellite-based global public goods.
Figures
Figures from the paper (1 more)
Reference graph
Works this paper leans on
-
[1]
2025 legislative session: Budget information — washington department of fish & wildlife . (n.d.). Retrieved February 9, 2025, from https://wdfw.wa.gov/about/administration/ budget/update Airline on-time performance data. (n.d.). https://www.transtats.bts.gov/DatabaseInfo.asp? QO VQ=EFD&Yv0x=D Blatt, B. (2024). Airlines are padding flight times. it’s not y...
-
[2]
There were only 7 flights with negative air times. These negative flight times are most likely an error in reporting and due to the small number of affected flights relative to the size of the dataset, it would not affect the results of the study to remove them. Without the removed flights, the minimum arrival delay changed to -989. This value appears ill...
work page 1999
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.