REVIEW 3 major objections 5 minor 35 references
Estimating the Causal Effect of Redlining on Present-day Air Pollution
T0 review · 3 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read This paper establishes that, under its assumptions, 1930s redlining grades had a causal effect on 2010 nitrogen dioxide concentrations, with D-grade areas exposed to 0.87 ppb more NO2 than A-grade areas.
desk verdict First causal take on redlining and air pollution, but the spatial-confounding extension of the identification theorem has a real gap that needs fixing before the headline NO2 estimate is supported. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is a latent factor model with proxy variables: Equations (1)–(3) tie the outcome $Y_{ij}$, binary treatment $A_{ij}$, and three proxies $W_{ij}$ to a shared non-spatial latent confounder $U_{ij}$ and a spatial process $Z_{ij}$. Assumption 5 applies the Anderson–Rubin factor-analysis condition ($p \ge 2q+1$) so the loading matrix $\Lambda = \alpha_{wu}\Sigma_{u|a}^{1/2}$ is identified up to rotation, and the covariance equations (6)–(9) then determine $\theta$ uniquely. Spatial confounding is absorbed by B-spline (piecewise polynomial) expansions of $Z_{ij}$ with the spline ratio selected by the Watanabe–Akaike information criterion, and uncertainty is propagated through Bayesian Markov chain Monte Carlo.
What would settle it
Re-estimate the model with percentage Black population also entering the treatment and outcome equations directly; if the D-A $\mathrm{NO}_2$ estimate moves outside the reported 95% credible interval (0.67–1.08 ppb), the proxy-only assumption is contradicted.
Extended reading notes
Core claim
The paper's central claim is that the association between historical redlining grades and present-day air pollution survives causal scrutiny once unmeasured socioeconomic status and spatial dependence are accounted for. Using 1940 Census unemployment, mean house rent, and percentage Black population as proxies for a latent socioeconomic factor, and a B-spline spatial process for spatial confounding, the authors show in Theorem 1 that the average treatment effect $\theta$ is identifiable under Assumptions 1–5. At the application level, the estimated D-A effect on $\mathrm{NO}_2$ is 0.87 ppb (95% CI 0.67–1.08), with smaller and mostly non-significant effects on $\mathrm{PM}_{2.5}$; city-level random effects reproduce the pattern, and Los Angeles and Atlanta show the strongest effects for both pollutants.
Load-bearing premise
The whole result rests on the premise that the three 1940 census measures are just noisy windows onto an unmeasured concept—socioeconomic status—and do not themselves influence redlining grades or today's pollution beyond that concept.
Editorial extensions
If this is right
- D-grade redlined areas bear a statistically significant 0.87 ppb higher $\mathrm{NO}_2$ exposure than A-grade areas after adjustment, and the effect increases monotonically from B-A to C-A to D-A.
- The long-term effect on $\mathrm{PM}_{2.5}$ is weak, with the D-A credible interval including zero, consistent with any historical PM effect having decayed by 2010.
- City-specific estimates show no protective NO2 effects anywhere, with Los Angeles and Atlanta showing the strongest harmful effects for both pollutants.
- The identification theorem extends the proxy-variable strategy to spatial settings, so similar historical policy questions with sparse covariates can be addressed with the same template.
Reading between the lines
- Beyond the paper: an implication the paper leaves implicit is that if percent Black population directly influenced grading decisions or later disinvestment, the estimated D-A effect blends the causal effect of the grade itself with the causal effect of racial discrimination, so the 0.87 ppb figure is best read as a combined legacy.
- Beyond the paper: the NO2/PM2.5 contrast points to highway traffic as the likely mediator, so re-running the model with present-day traffic density or road proximity as an intermediate variable should absorb part of the NO2 effect.
- Beyond the paper: the method transfers naturally to other HOLC-era outcomes such as heat exposure, flood risk, or current mortgage denial rates, where the same 1940 Census proxies and spatial structure apply.
- Beyond the paper: comparing the constant-effect and random-effect estimates suggests averaging hides meaningful city heterogeneity, so a boundary-discontinuity robustness check targeted at smaller cities would be most informative.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a latent-factor spatial causal model to estimate the long-term effect of 1930s HOLC redlining grades on 2010 NO2 and PM2.5 concentrations. Using 1940 Census unemployment, house rent, and percentage of Black population as proxies for an unobserved socioeconomic status factor, the authors model treatment and outcome equations with both a non-spatial latent confounder U and a spatial process Z, prove identifiability of the treatment effect under stated assumptions, and estimate the model by Bayesian MCMC. The headline application result is that historically D-graded neighborhoods have 0.87 ppb higher NO2 (95% CI: 0.67 to 1.08) than A-graded areas, with smaller PM2.5 differences. Simulations compare the proposed latent adjustment with outcome regression using proxies and with no adjustment.
Significance. If the identification argument were valid for the spatial model, the paper would make a useful contribution: it combines proxy-based adjustment for unmeasured non-spatial confounding with explicit spatial confounding in a causal framework, and it addresses an important environmental-justice question with a transparent structural model. The strengths are the explicit assumptions, the nontrivial moment-based identification proof in the non-spatial case, the extensive simulation study, and the careful reporting of uncertainty. The main weakness is that the proof of Theorem 1 does not actually cover the spatial model used in the application, and the paper's claim that the proof 'remains the same' after adding spatial terms is not correct. Because the application and simulations include spatial confounding, this gap is load-bearing for the central causal claim.
major comments (3)
- [Section 4, paragraph after Eq. (9)] The claim that the proof 'remains the same' when the spatial process Z is added is not supported. Because A in Eq. (2) is a function of both U and Z, U and Z are dependent conditional on A even if they are independent marginally under Assumption 4: conditioning on A induces a collider/selection effect. Consequently Cov(W,Z|A)=α_wu Cov(U,Z|A) in the updated Eq. (7) is a nonzero, unidentified nuisance function, and E(Z|A) in the updated Eq. (9) is not identified from the observed W moments or from the spline basis without additional restrictions. The updated system therefore does not close for θ. Theorem 1, as proved, covers only the model with α_yz=α_az=0. Since the application and the simulations include Z in both treatment and outcome, the central identification claim does not cover the setting in which the headline estimates are produced. The authors should either prove identification under an additional assumption (e.g., W⊥Z|A or a parametric, identified model for E(Z|A)) or explicitly restrict Theorem 1 to the non-spatial model and treat the spatial analysis as relying on prior sensitivity.
- [Section 7 and Web Appendix C, multiple-treatment and random-effect extensions] The application estimates three treatment indicators (B-A, C-A, D-A) in a single model and also a random-effects version with city-specific θ_i. Theorem 1 and the moment equations in Section 4 are derived for a single binary treatment with constant θ. The paper does not state the identification conditions for the multi-treatment or random-effect variants, so it is unclear whether the proxy-based factor identification carries over to those models. This should be stated explicitly and, if necessary, proved or supported by additional simulation under the exact model used.
- [Assumption 3 and Eq. (3), proxy exclusion restriction] The exclusion restriction that the percentage of Black population affects HOLC grading and present-day pollution only through latent SES is especially strong. The historical HOLC maps were explicitly based on racial composition, so a direct path from W_3 to A is plausible. If such a path exists, Eq. (3) is misspecified and the estimate of θ is biased. The manuscript provides no sensitivity analysis or overidentification test for this restriction. I recommend adding a sensitivity analysis that allows a direct effect of W_3 on A or Y and reports how θ changes.
minor comments (5)
- [Abstract] The phrase 'traditional methods fails' should be 'traditional methods fail'.
- [Section 4, Eq. (8)] The intercept in E(W|A) is a vector α_w, not the scalar α_a printed in the equation.
- [Table 1, case (4)] The WAIC value of 110 for Latent Adjustment in case (4) is implausibly lower than the neighboring entries (which are around 1083-1485); please check whether digits are missing.
- [Section 6.1] The phrase 'The others cases modify the base case' should be 'The other cases modify the base case'.
- [Section 1.1] The phrase 'with a emphasis' should be 'with an emphasis'.
Circularity Check
No circular derivation: the factor-model identification is a genuine moment-based argument; the spatial-confounding extension is an identification gap, not a circular reduction.
full rationale
The paper's central claim is that theta is identifiable from observed covariances among proxies, treatment, and outcome via Anderson-Rubin factor analysis. Equations (6)-(9) are moment conditions; theta is recovered from the product alpha_yu^T E(U|A) after identifying alpha_wu and E(U|A) up to compatible rotations. This is not equivalent to assuming theta: no parameter is defined in terms of the target effect, and the application reports a fitted treatment effect rather than predicting a quantity from the effect itself. The only self-citations (Reich et al. 2021; Giffin et al. 2021) are background literature reviews and are not load-bearing for Theorem 1, which rests on Anderson and Rubin (1956) and on Miao et al. (2023) / Kang et al. (2023), none of which are authored by the present authors. One substantive concern is flagged but is not circular: Section 4 states 'Equation (7) and (9) will be updated as below, while the method proof and conclusion remain the same' when spatial Z is added. Because A is generated by both U and Z, conditioning on A induces U-Z dependence, so Cov(W,Z|A) and E(Z|A) are unidentified nuisance functions; the updated equations are not closed for theta. This is an omitted proof / identification gap in the spatial extension, not a reduction of the result to its inputs by construction. Consistently with the review rules, that concern is a correctness risk rather than circularity, and it does not raise the circularity score.
Assumptions & free parameters
free parameters (2)
- Latent factor dimension q =
q = 1 implied by p = 3 proxies under Assumption 5 (not explicitly stated)
- Spline ratio r =
60% (WAIC-selected)
assumptions (6)
- domain assumption SUTVA: no interference between units and no multiple versions of treatment.
- domain assumption Latent ignorability: treatment is independent of potential outcomes given U and Z.
- ad hoc to paper The structural linear factor model in Equations (1)-(3) holds, with independent errors and Z independent of U.
- standard math Anderson-Rubin factor identification conditions: after deleting any row of Lambda, two disjoint rank-q submatrices remain.
- domain assumption The spatial confounder Z can be approximated by integrated 2D cubic B-splines over each city.
- ad hoc to paper Proxy validity: 1940 unemployment, house rent, and percentage of Black population measure SES and have no direct effect on treatment or outcome.
invented entities (2)
-
Non-spatial latent confounder U (latent SES)
-
Spatial latent process Z (spline coefficients)
Cite this review
Pith. "Pith review of Estimating the Causal Effect of Redlining on Present-day Air Pollution." pith.science (2026). https://pith.science/paper/VZ2V3LME
@misc{pith2026250116958,
author = {Pith},
title = {Pith review of: Estimating the Causal Effect of Redlining on Present-day Air Pollution},
year = {2026},
howpublished = {\url{https://pith.science/paper/VZ2V3LME}},
note = {Machine review of arXiv:2501.16958}
}
abstract
Recent studies have shown associations between redlining policies (1935-1974) and present-day fine particulate matter (PM$_{2.5}$) and nitrogen dioxide (NO$_2$) air pollution concentrations. In this paper, we reevaluate these associations using spatial causal inference. Redlining policies enacted in the 1930s, so there is very limited documentation of pre-treatment covariates. Consequently, traditional methods fails to sufficiently account for unmeasured confounders, potentially biasing causal interpretations. By integrating historical redlining data with 2010 PM$_{2.5}$ and NO$_2$ concentrations, our study aims to discern whether a causal link exists. Our study addresses challenges with a novel spatial and non-spatial latent factor framework, using the unemployment rate, house rent and percentage of Black population in 1940 U.S. Census as proxies to reconstruct pre-treatment latent socio-economic status. We establish identification of a causal effect under broad assumptions, and use Bayesian Markov Chain Monte Carlo to quantify uncertainty. Our analysis indicates that historically redlined neighborhoods are exposed to notably higher NO$_2$ concentration. In contrast, the disparities in PM$_{2.5}$ between these neighborhoods are less pronounced. Among the cities analyzed, Los Angeles, CA, and Atlanta, GA, demonstrate the most significant effects for both NO$_2$ and PM$_{2.5}$.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
- [1]
-
[2]
Anderson, T. and Rubin, H. (1956) Statistical inference in factor analysis. In Proceedings of the Berkeley Symposium on Mathematical Statistics and Probability, 111. University of California Press
work page 1956
-
[3]
Bound, J., Jaeger, D. A. and Baker, R. M. (1995) Problems with instrumental variables estimation when the correlation between the instruments and the endogenous explanatory variable is weak. Journal of the American statistical association, 90, 443--450
work page 1995
-
[4]
Davis, M. L., Neelon, B., Nietert, P. J., Burgette, L. F., Hunt, K. J., Lawson, A. B. and Egede, L. E. (2021) Propensity score matching for multilevel spatial data: accounting for geographic confounding in health disparity studies. International Journal of Health Geographics, 20, 1--12
work page 2021
-
[5]
L., Neelon, B., Nietert, P
Davis, M. L., Neelon, B., Nietert, P. J., Hunt, K. J., Burgette, L. F., Lawson, A. B. and Egede, L. E. (2019) Addressing geographic confounding through spatial propensity scores: a study of racial disparities in diabetes. Statistical Methods in Medical Research, 28, 734--748
2019
-
[6]
Dupont, E., Wood, S. N. and Augustin, N. H. (2022) Spatial+: a novel approach to spatial confounding. Biometrics, 78, 1279--1290
work page 2022
-
[7]
Fishback, P. V., LaVoice, J., Shertzer, A. and Walsh, R. (2020) The HOLC maps: How race and poverty influenced real estate professionals’ evaluation of lending risk in the 1930s. Tech. rep., National Bureau of Economic Research
work page 2020
-
[8]
Gelman, A., Hwang, J. and Vehtari, A. (2014) Understanding predictive information criteria for Bayesian models. Statistics and computing, 24, 997--1016
work page 2014
Show all 35 references
-
[9]
J., Yang, S
Giffin, A., Reich, B. J., Yang, S. and Rappold, A. G. (2021) Instrumental variables, spatial confounding and interference. arXiv preprint arXiv:2103.00304
2021 arXiv
-
[10]
and Ogburn, E
Gilbert, B., Datta, A. and Ogburn, E. (2021) Approaches to spatial confounding in geostatistics. arXiv preprint arXiv: 2112.14946
2021 arXiv
-
[11]
L., Reich, B
Guan, Y., Page, G. L., Reich, B. J., Ventrucci, M. and Yang, S. (2023) Spectral adjustment for spatial confounding. Biometrika, 110, 699--719
2023
-
[12]
E., Schley, K
Haschka, R. E., Schley, K. and Herwartz, H. (2020) Provision of health care services and regional diversity in germany: Insights from a Bayesian health frontier analysis with spatial dependencies. The European Journal of Health Economics, 21, 55--71
2020
-
[13]
T., Johansson, F
Jerzak, C. T., Johansson, F. and Daoud, A. (2023) Integrating earth observation data into causal inference: challenges and opportunities. arXiv preprint arXiv:2301.12985
2023 arXiv
-
[14]
H., Pitkowsky, Z., Argenio, K., Quinn, J
Jung, K. H., Pitkowsky, Z., Argenio, K., Quinn, J. W., Bruzzese, J.-M., Miller, R. L., Chillrud, S. N., Perzanowski, M., Stingone, J. A. and Lovinsky-Desir, S. (2022) The effects of the historical practice of residential redlining in the united states on recent temporal trends...
2022
-
[15]
and Antonelli, J
Kang, S., Franks, A. and Antonelli, J. (2023) Sensitivity analysis with multiple treatments and multiple outcomes with applications to air pollution mixtures. arXiv preprint arXiv:2311.12252
2023 arXiv
-
[16]
Kim, S.-Y., Bechle, M., Hankey, S., Sheppard, L., Szpiro, A. A. and Marshall, J. D. (2020) Concentrations of criteria pollutants in the contiguous us, 1979--2015: Role of prediction model parsimony in integrated empirical geographic regression. PloS one, 15, e0228535
2020
-
[17]
and Wang, L
Kong, D., Yang, S. and Wang, L. (2019) Multi-cause causal inference with unmeasured confounding and binary outcome. arXiv: Methodology
2019
-
[18]
and Pearl, J
Kuroki, M. and Pearl, J. (2014) Measurement bias and effect restoration in causal inference. Biometrika, 101, 423--437
2014
-
[19]
M., Morello-Frosch, R., Marshall, J
Lane, H. M., Morello-Frosch, R., Marshall, J. D. and Apte, J. S. (2022) Historical redlining is associated with present-day air pollution disparities in US cities. Environmental Science & Technology Letters, 9, 345--350
2022
-
[20]
Lipsitch, M., Tchetgen, E. T. and Cohen, T. (2010) Negative controls: a tool for detecting confounding and bias in observational studies. Epidemiology (Cambridge, Mass.), 21, 383
2010
-
[21]
Miao, W., Hu, W., Ogburn, E. L. and Zhou, X.-H. (2023) Identifying effects of multiple treatments in the presence of unmeasured confounding. Journal of the American Statistical Association, 118, 1953--1967
2023
-
[22]
and Tchetgen, E
Miao, W., Shi, X. and Tchetgen, E. T. (2018) A confounding bridge approach for double negative control inference on causal effects. arXiv preprint arXiv:1808.04945
2018 arXiv
-
[23]
K., Winling, L
Nelson, R. K., Winling, L. and et al. (2023) Mapping inequality: Redlining in new deal america. https://dsl.richmond.edu/panorama/redlining. Digital Scholarship Lab, University of Richmond
2023
-
[24]
and Zigler, C
Papadogeorgou, G., Choirat, C. and Zigler, C. M. (2019) Adjusting for unmeasured spatial confounding with distance adjusted propensity score matching. Biostatistics, 20, 256--272
2019
-
[25]
J., Yang, S., Guan, Y., Giffin, A
Reich, B. J., Yang, S., Guan, Y., Giffin, A. B., Miller, M. J. and Rappold, A. (2021) A review of spatial causal inference methods for environmental and epidemiological applications. International Statistical Review, 89, 605--634
2021
-
[26]
Rubin, D. B. (1976) Inference and missing data. Biometrika, 63, 581--592
1976
-
[27]
Schnell, P. M. and Papadogeorgou, G. (2020) Mitigating unobserved spatial confounding when estimating the effect of supermarket access on cardiovascular disease deaths. arXiv preprint arXiv:1907.12150
2020 arXiv
-
[28]
and Yang, Y
Shao, R., Derudder, B. and Yang, Y. (2022) Metro accessibility and space-time flexibility of shopping travel: A propensity score matching analysis. Sustainable Cities and Society, 87, 104204
2022
-
[29]
W., Hirsch, A
Tustin, A. W., Hirsch, A. G., Rasmussen, S. G., Casey, J. A., Bandeen-Roche, K. and Schwartz, B. S. (2017) Associations between unconventional natural gas development and nasal and sinus, migraine headache, and fatigue symptoms in pennsylvania. Environmental Health Perspective...
2017
-
[30]
Accessed: 2024-08-22
US EPA (2023 a ) Overview of Nitrogen Dioxide (NO _2 ) Air Quality in the United States \\ https://www.epa.gov/system/files/documents/2023-06/NO2_2022.pdf . Accessed: 2024-08-22
2023
-
[31]
Accessed: 2024-08-22
--- (2023 b ) Overview of Particulate Matter (PM) Air Quality in the United States \\ https://www.epa.gov/system/files/documents/2023-06/PM_2022.pdf . Accessed: 2024-08-22
2023
-
[32]
Accessed: 2024-05-20
--- (2024) Timeline of particulate matter (pm) national ambient air quality standards (naaqs) \\ https://www.epa.gov/pm-pollution/ \\ timeline-particulate-matter-pm-national-ambient-air-quality \\ -standards-naaqs. Accessed: 2024-05-20
2024
-
[33]
and Wang, X
Yang, S., Zeng, D. and Wang, X. (2020) Improved inference for heterogeneous treatment effects using real-world data subject to hidden confounding. arXiv preprint arXiv:2007.12922
2020 arXiv
-
[34]
, " * write output.state after.block = add.period write newline
ENTRY address author booktitle chapter edition editor howpublished institution journal key month note number organization pages publisher school series title type url volume year label extra.label sort.label short.list INTEGERS output.state before.all mid.sentence after.senten...
-
[35]
write newline
" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.