Two Layers of Instability in Causal Estimation
Pith reviewed 2026-06-26 12:52 UTC · model grok-4.3
The pith
Many standard causal point estimators act as discontinuous summaries of multimodal distributions over structural causal models.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Many standard point estimates can be read as point summaries of multimodal distributions over the space of structural causal models. As such, estimators can jump discontinuously in the data distribution. This defines a taxonomy of estimators that admits a decision-theoretic reading: stability depends on whether the implicit loss function an estimator optimizes is aligned with the causal effect itself. Specifically, inverse propensity weighted estimators and regression estimators are examples of discontinuous summaries, while explicit posterior means and medians are shown to be continuous.
What carries the argument
Multimodal distribution over structural causal models consistent with the observed data, with point summaries that can be discontinuous functions of the data distribution.
If this is right
- Inverse propensity weighted estimators produce discontinuous causal effect estimates as functions of the data distribution.
- Regression estimators produce discontinuous causal effect estimates as functions of the data distribution.
- Explicit posterior means and medians produce continuous causal effect estimates as functions of the data distribution.
- Estimator stability depends on alignment between the estimator's implicit loss and the target causal effect.
Where Pith is reading between the lines
- Practitioners facing potential multimodality in the space of causal models may prefer posterior means or medians over IPW or regression for smoother behavior under small data perturbations.
- The same taxonomy could be applied to other point estimators not examined here to classify their continuity properties.
- Simulation studies could generate sequences of data distributions approaching a discontinuity boundary to measure jump sizes for different estimators.
Load-bearing premise
The space of structural causal models consistent with the observed data distribution induces multimodal distributions over the estimators under consideration.
What would settle it
A pair of arbitrarily close data distributions where an inverse propensity weighted estimator or regression estimator produces markedly different causal effect values while a posterior mean or median does not.
Figures
read the original abstract
There is a precise sense in which drawing causal inferences from observational data is hard, even when identifiability is assumed. In particular, Robins and Ritov (1997) and Robins et al. (2003) showed that causal effects can be discontinuous as a function of the data distribution: two arbitrarily close data distributions might correspond to different causal effects. This is a fact independent of the choice of estimator; however, not all estimators are equally unstable. Our contribution is to surface a second layer of instability that depends on the choice of estimator. We show that many standard point estimates can be read as point summaries of multimodal distributions over the space of structural causal models. As such, estimators can jump discontinuously in the data distribution. This defines a taxonomy of estimators that admits a decision-theoretic reading: stability depends on whether the implicit loss function an estimator optimizes is aligned with the causal effect itself. Specifically, inverse propensity weighted estimators and regression estimators are examples of discontinuous summaries, while explicit posterior means and medians are shown to be continuous.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript claims that causal effect estimation from observational data exhibits two layers of instability. The first layer is intrinsic: causal effects can be discontinuous functions of the data distribution P (citing Robins and Ritov 1997; Robins et al. 2003). The second layer is estimator-dependent: many standard point estimators are point summaries of multimodal distributions over the space of structural causal models (SCMs) consistent with P. This induces discontinuities for estimators such as inverse propensity weighting (IPW) and regression estimators, while explicit posterior means and medians are continuous. The resulting taxonomy admits a decision-theoretic reading in which stability depends on alignment between the estimator's implicit loss and the causal effect itself.
Significance. If the formalization and continuity arguments hold, the work supplies a principled taxonomy of estimators by stability and a decision-theoretic lens on why certain summaries are robust to small perturbations in P. This could inform estimator selection in applied causal inference and clarifies that instability is not solely a property of the identification problem. The explicit contrast between discontinuous summaries (IPW, regression) and continuous ones (posterior mean/median) is a clear contribution.
major comments (2)
- [§4] §4, the construction of the multimodal distribution over SCMs: the manuscript must specify the measure on the space of SCMs and how multimodality is induced from the observed P under standard identifiability assumptions; without an explicit construction or example, the claim that IPW corresponds to a discontinuous summary cannot be verified.
- [Theorem 5.3] Theorem 5.3 (continuity of posterior median): the argument that the median commutes with limits in the space of distributions over SCMs requires showing that the topology on the SCM space ensures no mode-crossing discontinuities; the current sketch appears to assume this without proof.
minor comments (2)
- [Abstract] The abstract states that 'explicit posterior means and medians are shown to be continuous' but does not name the topology or metric on the space of distributions over SCMs; this should be stated in the introduction.
- [§2] Notation for the space of SCMs and the induced distribution is introduced informally in §2; a short formal definition would improve readability.
Simulated Author's Rebuttal
We thank the referee for the careful reading and constructive comments. The two major comments identify places where the presentation of the multimodal construction and the continuity argument can be strengthened with additional detail. We address each below.
read point-by-point responses
-
Referee: [§4] §4, the construction of the multimodal distribution over SCMs: the manuscript must specify the measure on the space of SCMs and how multimodality is induced from the observed P under standard identifiability assumptions; without an explicit construction or example, the claim that IPW corresponds to a discontinuous summary cannot be verified.
Authors: We agree that an explicit construction would make the argument easier to verify. In the revised manuscript we will add a self-contained example in §4 that defines a finite discrete measure on the space of SCMs (uniform prior over a small collection of linear SCMs that induce the same observational distribution P but different causal effects). This example will show how the posterior is multimodal and why the IPW functional selects a mode that jumps discontinuously while the posterior mean does not. revision: yes
-
Referee: [Theorem 5.3] Theorem 5.3 (continuity of posterior median): the argument that the median commutes with limits in the space of distributions over SCMs requires showing that the topology on the SCM space ensures no mode-crossing discontinuities; the current sketch appears to assume this without proof.
Authors: The referee is correct that the current sketch is brief. We will expand the proof of Theorem 5.3 to explicitly verify that, under the weak topology on the space of probability measures over SCMs (induced by the weak topology on the observational distributions), the cumulative distribution function of the causal effect is continuous in the parameter P. This rules out mode-crossing discontinuities for the median under the maintained identifiability assumptions. The revised version will contain the expanded argument. revision: yes
Circularity Check
No significant circularity
full rationale
The paper's first layer of instability is imported from external citations (Robins and Ritov 1997; Robins et al. 2003) and is not derived internally. The second layer is obtained by observing that point estimators are summaries of the induced distribution over SCMs consistent with P, then checking which summaries (means/medians vs. others) commute with limits; this taxonomy follows directly from the algebraic properties of the summary functions and does not reduce to any fitted parameter, self-definition, or self-citation chain. No load-bearing step equates a claimed result to its own inputs by construction.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.