pith. sign in

arxiv: 2212.10406 · v4 · submitted 2022-12-20 · 📊 stat.ME · stat.AP

GEEPERs: Principal Stratification using Principal Scores and Stacked Estimating Equations

Pith reviewed 2026-05-24 10:01 UTC · model grok-4.3

classification 📊 stat.ME stat.AP
keywords principal stratificationcausal inferencenoncomplianceprincipal scoresestimating equationsone-way noncompliancesandwich estimator
0
0 comments X

The pith

A new principal effect estimator for one-way noncompliance uses principal scores and stacked estimating equations.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper develops an estimator for causal effects among compliers in randomized studies where some participants do not receive the treatment as assigned. This is done for cases of one-way noncompliance identified by a binary indicator. The approach relies on principal scores, which are the probabilities of being a complier, and solves for the effects using stacked estimating equations. These can be implemented with ordinary regression methods, avoiding the need for complex models or distributional assumptions. Simulations indicate greater robustness than existing methods, and the method is demonstrated on real data from an educational intervention.

Core claim

The central claim is that principal causal effects can be consistently estimated using principal scores from a binary compliance indicator and stacked estimating equations, which are solved via conventional regression techniques without requiring distributional assumptions on the data.

What carries the argument

Principal scores (estimated probabilities of compliance) combined with stacked estimating equations to identify principal effects under one-way noncompliance.

If this is right

  • Estimates are obtained using standard regression software.
  • Standard errors are computed with a specialized sandwich estimator.
  • The method shows greater robustness in simulations compared to popular alternatives.
  • Applicable to settings like educational interventions with partial uptake.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • This could lower the barrier for applied researchers to conduct principal stratification analyses.
  • If the binary indicator accurately captures compliance, it may generalize to other one-way noncompliance scenarios beyond education.
  • Extensions might include adapting the stacked equations for multi-level or longitudinal data.

Load-bearing premise

The analysis assumes one-way noncompliance that is cleanly identified by a single binary indicator.

What would settle it

Observing that the estimator produces biased results in a setting with two-way noncompliance or when the binary indicator does not perfectly identify compliance status would falsify the identification claim.

read the original abstract

Principal stratification is a framework for making sense of causal effects conditioned on variables that may themselves have been affected by the treatment. For instance, in an evaluation of an educational intervention, some subjects in the treatment group may not fully utilize the intervention, and researchers may be interested in how this subgroup is affected. Most principal stratification estimators rely on strong structural or modeling assumptions and often require advanced statistical training to fit and evaluate, making them inaccessible to many applied researchers. In this paper, we introduce a new principal effect estimator for one-way noncompliance based on a binary indicator. Estimates may be computed using conventional regression methods (though the standard errors require a specialized sandwich estimator) and do not rely on distributional assumptions. We present a simulation study that demonstrates the novel method's greater robustness compared to popular alternatives and illustrate the method through a real-data analysis.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

2 major / 0 minor

Summary. The manuscript introduces GEEPERs, a new estimator for principal effects under one-way noncompliance identified by a binary indicator. The approach constructs principal scores and uses stacked estimating equations that can be fit via conventional regression, with standard errors obtained from a specialized sandwich estimator; it claims to avoid distributional assumptions. Robustness is asserted via simulation comparisons to existing methods, and the approach is illustrated on real data.

Significance. If the identification and estimation arguments hold, the method would lower the barrier to principal stratification by allowing use of standard regression software, which could increase adoption in applied fields such as education and clinical trials where noncompliance is common.

major comments (2)
  1. [Abstract] Abstract: the claim that the estimator 'does not rely on distributional assumptions' and is 'more robust' cannot be evaluated because the abstract (and available description) supplies no details on model specification, the precise form of the stacked equations, data exclusion rules, or the derivation of the sandwich estimator.
  2. The identification of principal effects requires that the binary indicator cleanly partitions the treatment arm into compliers and never-takers under one-way noncompliance. The manuscript must explicitly state this monotonicity/measurement assumption and demonstrate that violations (misclassification or two-way noncompliance) do not invalidate the principal-score construction and consistency of the estimator.

Simulated Author's Rebuttal

2 responses · 1 unresolved

We thank the referee for their comments. We respond to each major comment below, indicating planned revisions where appropriate.

read point-by-point responses
  1. Referee: [Abstract] Abstract: the claim that the estimator 'does not rely on distributional assumptions' and is 'more robust' cannot be evaluated because the abstract (and available description) supplies no details on model specification, the precise form of the stacked equations, data exclusion rules, or the derivation of the sandwich estimator.

    Authors: The manuscript provides these details in Sections 2 (principal scores and stacked equations) and 3 (sandwich variance derivation), with data considerations addressed in the application. We agree the abstract is too concise to support the claims and will revise it to briefly reference the regression-based implementation and absence of distributional assumptions. revision: yes

  2. Referee: The identification of principal effects requires that the binary indicator cleanly partitions the treatment arm into compliers and never-takers under one-way noncompliance. The manuscript must explicitly state this monotonicity/measurement assumption and demonstrate that violations (misclassification or two-way noncompliance) do not invalidate the principal-score construction and consistency of the estimator.

    Authors: We will add an explicit statement of the monotonicity assumption in the introduction and methods. We cannot demonstrate that violations do not invalidate the estimator, as they would invalidate identification; the revised manuscript will instead highlight this as a core assumption and limitation. revision: partial

standing simulated objections not resolved
  • Demonstrate that violations of the monotonicity assumption do not invalidate the principal-score construction and estimator consistency

Circularity Check

0 steps flagged

No circularity: estimator derived from standard GEE and principal score identification under stated one-way noncompliance assumption

full rationale

The paper introduces GEEPERs as a regression-based estimator for principal effects under one-way noncompliance identified by a binary indicator. It relies on conventional regression methods plus a sandwich variance estimator and explicitly avoids distributional assumptions. No quoted equations or steps reduce the target principal effects to fitted quantities by construction, nor does the derivation chain rest on self-citations whose content is itself unverified or on ansatzes smuggled from prior work. The identification argument is conditioned on the binary indicator cleanly partitioning strata, which is presented as an explicit modeling restriction rather than a hidden tautology. The simulation study and real-data example are external benchmarks, not internal fits renamed as predictions. The derivation is therefore self-contained against external statistical machinery.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

Abstract provides insufficient detail to enumerate specific free parameters or invented entities; the approach relies on the domain assumption of one-way noncompliance with a binary indicator.

axioms (1)
  • domain assumption One-way noncompliance identified by a binary indicator
    The estimator targets principal effects under this specific noncompliance structure as stated in the abstract.

pith-pipeline@v0.9.0 · 5677 in / 1176 out tokens · 19765 ms · 2026-05-24T10:01:49.497992+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.