REVIEW 3 major objections 4 minor 28 references
Efficient Estimation under Multiple Missing Patterns via Balancing Weights
T0 review · 3 major / 4 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read This paper proves that a sequentially balanced weighting estimator is semiparametrically efficient for parameters defined by moment equations under non-monotone, missing-not-at-random patterns.
desk verdict Solid extension of pattern-graph missing-data estimation; the efficiency bound looks right, but a real proof gap in Lemma H.8 means the efficiency claim is not yet fully supported. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing device is a recursive factorization of propensity odds along paths in a pattern graph, a directed acyclic graph whose vertices are missingness patterns and whose edges encode the identifying assumption that a pattern's unobserved variables follow the same conditional distribution as a mixture over its parents. For a missingness pattern $r$, the odds of seeing pattern $r$ rather than the complete case is $Q_r(l)=O_r(l[r])\sum_{s\in \mathrm{Pa}(r)} Q_s(l)$, with $Q_{1^d}=1$, where $O_r(l[r])$ is the local odds of pattern $r$ versus its parents given observed variables. The sequential balancing loss $L_r\{O_r(l[r];\alpha_r),R\}=1_{R=1^d}O_r(l[r];\alpha_r)\hat Q_{\mathrm{Pa}(r)}(l)-1_{R=r}\log O_r(l[r];\alpha_r)$ is minimized at each pattern in increasing missingness order, which enforces empirical balance between pattern $r$ and reweighted complete cases and controls error accumulation along the factorization. The final weights $\hat w(L)=\sum_{r\in\mathcal R}\hat Q_r(L)$ are inserted into the weighted estimating equation.
What would settle it
Construct a data-generating process satisfying the pattern-graph identification assumptions but with one propensity odds $O_r(l[r])$ unbounded above, e.g., $P(R\in\mathrm{Pa}(r)|l[r])$ decaying exponentially in an observed covariate; then run the sequential balancing estimator on many replications and check whether the fitted weights develop heavy tails and whether the coverage of 95% confidence intervals degrades, which would refute the uniformity claim on which efficiency rests.
Extended reading notes
Core claim
Under the identifying assumptions of a regular pattern graph, the paper establishes that the estimator $\hat\theta_N$ obtained by solving $\frac{1}{N}\sum_{i: R_i=1^d} \hat w(L_i)\psi_{\theta}(L_i)=0$ with $\hat w(L)=\sum_{r\in\mathcal R}\hat Q_r(L)$ is consistent for $\theta_0$ and satisfies $N^{1/2}(\hat\theta_N-\theta_0)\to_d N(0,D_{\theta_0}^{-1}V_{\theta_0}D_{\theta_0}^{-\top})$, where $D_{\theta_0}$ is the derivative of the moment and $V_{\theta_0}$ is the variance of the efficient influence function. The paper shows this variance coincides with the asymptotic variance bound for all regular estimators derived in Theorem 4.2, so the estimator attains semiparametric efficiency.
Load-bearing premise
The entire consistency and efficiency argument rests on uniform overlap: for each missing pattern the true propensity odds $O_r(l[r])$ must be bounded away from zero and infinity on the support of $l[r]$, and the complete-case probability must also be bounded away from zero, so no pattern pairing becomes arbitrarily rare.
Editorial extensions
If this is right
- The estimator reaches the same asymptotic variance lower bound as any regular estimator, so under the stated assumptions no imputation or augmented IPW strategy can improve first-order efficiency.
- Because the sequential loss uses complete cases directly in every pattern's optimization, the weight estimators avoid extrapolating odds models to the complete-case region, which the paper argues removes a source of instability.
- The method extends balancing-weight estimation from the single-parent CCMV assumption to general regular pattern graphs with multiple parents and to generalized mixture coefficients.
- Simulations show reductions in bias and mean squared error relative to entropy and local balancing weights, including settings where the identifying pattern graph is misspecified.
- A consistent sandwich variance estimator accompanies the estimator, so confidence intervals and hypothesis tests can be constructed in practice.
Reading between the lines
- A natural extension beyond the paper is to causal effect estimation with multiple versions of treatment or noncompliance patterns, since target causal contrasts can be written as moment equations.
- The efficiency result implies that when the overlap assumption holds, the choice between imputation and weighted estimation is second-order; practical gains would come from stability and computation, where the sequential weights may dominate.
- A diagnostic extension: evaluate the empirical balance condition for each pattern's basis functions; large imbalance under the fitted weights would signal that either the pattern graph or the overlap assumption is untenable.
- One could test the overlap assumption indirectly by monitoring the distribution of fitted weights on complete cases; weights diverging toward infinity for a non-negligible fraction of observations would flag a violation.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper studies estimation of parameters defined by moment equations when data have multiple non-monotone missing patterns and missingness is not at random. Building on pattern graphs and the authors' prior work on balancing weights, it proposes a sequential balancing loss that estimates the propensity odds O_r sequentially from complete cases, constructs weights ŵ = Σ_r Q̂_r, and solves a weighted estimating equation. The paper derives a semiparametric efficiency bound (Theorem 4.2), claims consistency and semiparametric efficiency of the sequential estimator (Theorem 4.3), and presents simulations and a real-data application. The theoretical development relies on a long appendix with empirical-process and bracketing-number arguments, including sieve approximations and several technical lemmas.
Significance. The intended contribution is significant: if Theorem 4.3 were rigorously established, the paper would provide a computationally simple, stable, and efficient estimator for a flexible class of MNAR/pattern-mixture models, extending the pattern-graph framework from density/imputation settings to general estimating equations. The efficiency-bound calculation in Theorem 4.2 is nontrivial, and the bracketing-number lemmas (H.12-H.15) are potentially reusable. The simulations show improvements over entropy and local balancing. However, the central asymptotic proof currently has a load-bearing gap and an apparent mismatch with the algorithm actually proposed, so the efficiency claim is not yet supported.
major comments (3)
- [Appendix F (proof of Theorem D.4)] The decomposition at the start of the proof of Theorem D.4 is not the decomposition for θ_seq as defined in Algorithm 1. The proof writes P̂_N ψ_θ − E{ψ_θ(L)} = Σ_{r∈R} [N^{-1}Σ_i 1_{R_i=1_d} O_r(L[r]_i; α̂[r]) ψ_θ(L_i) − E{1_{R_i=r} ψ_θ(L)}]. But Algorithm 1 defines weights as ŵ = Σ_r Q̂_r, with Q̂_r = Ô_r Σ_{s∈Pa(r)} Q̂_s, so the complete-case weighted sum contains products of odds along paths, not the single factors Ô_r. Unless O_r is redefined to mean Q_r, which the paper does not do, the proof establishes asymptotic normality for a different estimator, and the influence function displayed at the end of Appendix F is not the V_θ of Theorem 4.2 for a nontrivial pattern graph. This mismatch directly undermines Theorem 4.3 as stated.
- [Appendix H, Lemma H.8] The proof of Lemma H.8 asserts the key balancing-error bound sup_θ |√N S^r_{θ,3}| ≤ λ{γ√K_r + 2(1−γ)√PEN2(Φ_r^T α̂[r])}√PEN2(Φ_r^T β^r_θ) and then concludes op(1). The inequality is never derived, and the notation PEN2 and γ is not defined anywhere in the paper. No argument shows that √PEN2(Φ_r^T β^r_θ) is uniformly bounded in a way that makes the product negligible, nor is the dependence on the recursive estimator Q̂_Pa(r) controlled. Since S^r_{θ,3} is precisely the balancing error that the sequential loss is designed to enforce, this is a load-bearing gap in the proof of Theorem D.4 and, consequently, in the efficiency claim of Theorem 4.3.
- [Assumptions D.1.A and Theorem 4.3] The uniform-overlap condition c_0 ≤ O_r(l[r]) ≤ C_0 in Assumption D.1.A is used at several load-bearing points, including Theorem D.2, Lemmas H.4-H.5, and the proof of Theorem D.4, but it involves distributions of missing variables and cannot be verified from the observed data alone. The manuscript should state explicitly that the efficiency guarantee is conditional on this assumption and should provide a sensitivity analysis or a diagnostic for the overlap condition in the simulations; otherwise the practical scope of Theorem 4.3 is unclear.
minor comments (4)
- [Section 5 (Simulation)] The text says that the local estimations 'fail in around 5% dataset' under the simulation setting; please define what constitutes failure, for example non-convergence, extreme estimated weights, or undefined estimates.
- [Section 6 and Figure 5] Figure 5 labels patterns with six digits (e.g., 111111, 111101) while the analysis reports five predictors; please reconcile the dimensions of the patterns with the variables used.
- [Algorithm 1] The 'Input' line describes {1_{R_i=1_d} Q̂_Pa(r)(L_i)} as input, but these quantities are produced by earlier recursive steps; please rephrase to indicate that they are available from previous stages of the algorithm.
- [References] The reference to Dong, Wong, and Chan (2024) is listed as 'Balancing method for non-monotone missing data' without a publication venue; if this is a preprint or dissertation chapter, please indicate its status.
Circularity Check
No significant circularity: the efficiency bound is derived, and the proposed estimator is shown to attain it through a standard influence-function expansion.
full rationale
I walked the derivation chain from the identifying assumptions (pattern graphs, mixture coefficients, recursive odds), through the weighted estimating equations, the efficiency bound (Theorem 4.2), and the asymptotic expansion for the proposed estimator (Theorems D.4 and 4.3). The efficiency bound is derived from standard semiparametric pathwise-differentiability arguments citing Newey (1990) and Bickel et al. (1993), not assumed as an input. The influence function in the asymptotic normality proof is explicitly the variance of the weighted estimator's influence function, and the residual terms S^r_{theta,1}, S^r_{theta,2}, S^r_{theta,3} are shown to be o_p(N^{-1/2}) under the stated conditions, so the estimator attains the derived bound. The self-citations to Dong et al. (2024) and Chen (2022) are contextual: they describe prior balancing weights and pattern graphs, but the central consistency and efficiency argument is self-contained and does not reduce to those citations. The skeptical concern about Lemma H.8 is a possible proof gap because the balancing-error inequality is asserted rather than fully derived; however, that is a technical completeness issue, not circularity. The inequality is not equivalent to the conclusion by construction, and no fitted parameter is renamed as a prediction, no uniqueness theorem is imported from the authors' own prior work, and no ansatz is smuggled in solely via citation. Therefore no significant circularity is found.
Assumptions & free parameters
free parameters (3)
- Penalty tuning parameter λ (with per-coordinate weights t_k) =
chosen by cross-validation in simulations; theory requires λ = o(1/sqrt(K_r N_r))
- Basis functions Φ_r(l[r]) for each pattern =
user-specified; simulations use six splines of degree up to four per continuous variable and indicators for discrete…
- Simulation DGP polynomial degree for true propensity odds =
degrees up to four
assumptions (6)
- domain assumption Regular pattern graph identifying assumption: for each missing pattern r, p(l̄_r | l[r], R=r) = Σ_{s∈Pa(r)} C_{s,r}(l[r]) p(l̄_r | l[r], R=s).
- domain assumption Overlap and boundedness: c0 ≤ O_r(l[r]) ≤ C0 for all r and l[r] (Assumption D.1.A).
- domain assumption Unique minimizer of the population sequential loss (Assumption D.1.B).
- ad hoc to paper Sieve approximation rates: O_r and u_rθ are approximable by basis functions at rates μ1, μ2 > 1/2 (Assumptions D.1.D and D.3.A).
- standard math Standard semiparametric efficiency and empirical process theory (Newey 1990; Bickel et al. 1993; Van der Vaart 2000).
- domain assumption Bracketing entropy conditions on the propensity odds class M_r and estimating function class H (Assumptions D.3.B and D.3.C).
Cite this review
Pith. "Pith review of Efficient Estimation under Multiple Missing Patterns via Balancing Weights." pith.science (2026). https://pith.science/paper/UYUCAFK2
@misc{pith2026250413467,
author = {Pith},
title = {Pith review of: Efficient Estimation under Multiple Missing Patterns via Balancing Weights},
year = {2026},
howpublished = {\url{https://pith.science/paper/UYUCAFK2}},
note = {Machine review of arXiv:2504.13467}
}
read the original abstract
As one of the most commonly seen data challenges, missing data, in particular, multiple, non-monotone missing patterns, complicates estimation and inference due to the fact that missingness mechanisms are often not missing at random, and conventional methods cannot be applied. Pattern graphs have recently been proposed as a tool to systematically relate various observed patterns in the sample. We extend its scope to the estimation of parameters defined by moment equations, including common regression models, via solving weighted estimating equations with weights constructed using a sequential balancing approach. These novel weights are carefully crafted to address the instability issue of the straightforward approach based on local balancing. We derive the efficiency bound for the model parameters and show that our proposed method, albeit relatively simple, is asymptotically efficient. Simulation results demonstrate the superior performance of the proposed method, and real-data applications illustrate how the results are robust to the choice of identification assumptions.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[1]
Begun, J. M., W. J. Hall, W.-M. Huang, and J. A. Wellner (1983). Information and asymptotic efficiency in parametric-nonparametric models. The Annals of Statistics\/ 11\/ (2), 432--452
work page 1983
-
[2]
Bhattacharya, R., D. Malinsky, and I. Shpitser (2020). Causal inference under interference and network uncertainty. In Uncertainty in Artificial Intelligence , pp.\ 1028--1038. PMLR
work page 2020
-
[3]
Bickel, P. J., C. A. Klaassen, P. J. Bickel, Y. Ritov, J. Klaassen, J. A. Wellner, and Y. Ritov (1993). Efficient and adaptive estimation for semiparametric models , Volume 4. Springer
1993
-
[4]
Burns, W. J., E. Peters, and P. Slovic (2012). Risk perception and the economic crisis: A longitudinal study of the trajectory of perceived risk. Risk Analysis: An International Journal\/ 32\/ (4), 659--677
work page 2012
-
[5]
Chen, X. (2007). Large sample sieve estimation of semi-nonparametric models. Handbook of econometrics\/ 6 , 5549--5632
2007
-
[6]
Chen, X., H. Hong, and A. Tarozzi (2008). Semiparametric efficiency in gmm models with auxiliary data. The Annals of Statistics\/ 36\/ (2), 808--843
work page 2008
-
[7]
Chen, Y.-C. (2022). Pattern graphs: a graphical approach to nonmonotone missing data. The Annals of Statistics\/ 50\/ (1), 129--146
work page 2022
-
[8]
Dong, J., R. K. W. Wong, and K. C. G. Chan (2024). Balancing method for non-monotone missing data
work page 2024
Show all 28 references
-
[9]
Fan, J., K. Imai, I. Lee, H. Liu, Y. Ning, and X. Yang (2022). Optimal covariate balancing conditions in propensity score estimation. Journal of Business & Economic Statistics\/ 41\/ (1), 97--110
2022
-
[10]
Horowitz, J. L. and E. Mammen (2004). Nonparametric estimation of an additive model with a link function. The Annals of Statistics\/ 32\/ (6), 2412 -- 2443
2004
-
[11]
Ibragimov, I. A. and R. Z. Has' Minskii (2013). Statistical estimation: asymptotic theory , Volume 16. Springer Science & Business Media
2013
-
[12]
Little, R. J. (1993). Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association\/ 88\/ (421), 125--134
1993
-
[13]
Mohan, K. and J. Pearl (2021). Graphical models for processing missing data. Journal of the American Statistical Association\/ 116\/ (534), 1023--1037
2021
-
[14]
Michiels, M
Molenberghs, G., B. Michiels, M. G. Kenward, and P. J. Diggle (1998). Monotone missing data and pattern-mixture models. Statistica Neerlandica\/ 52\/ (2), 153--161
1998
-
[15]
Bhattacharya, and I
Nabi, R., R. Bhattacharya, and I. Shpitser (2020). Full law identification in graphical models of missing data: Completeness results. In International conference on machine learning , pp.\ 7153--7163. PMLR
2020
-
[16]
Newey, W. K. (1990). Semiparametric efficiency bounds. Journal of applied econometrics\/ 5\/ (2), 99--135
1990
-
[17]
Newey, W. K. (1997). Convergence rates and asymptotic normality for series estimators. Journal of econometrics\/ 79\/ (1), 147--168
1997
-
[18]
Robins, J. M. (1997). Non-response models for the analysis of non-monotone non-ignorable missing data. Statistics in medicine\/ 16\/ (1), 21--37
1997
-
[19]
Rubin, D. B. (1976). Inference and missing data. Biometrika\/ 63\/ (3), 581--592
1976
-
[20]
Shpitser, I. (2016). Consistent estimation of functions of data missing non-monotonically and not at random. Advances in Neural Information Processing Systems\/ 29
2016
-
[21]
Tchetgen, E. J. T., L. Wang, and B. Sun (2018). Discrete choice models for nonmonotone nonignorable missing data: Identification and inference. Statistica Sinica\/ 28\/ (4), 2069
2018
-
[22]
Molenberghs, B
Thijs, H., G. Molenberghs, B. Michiels, G. Verbeke, and D. Curran (2002). Strategies to fit pattern-mixture models. Biostatistics\/ 3\/ (2), 245--265
2002
-
[23]
Troxel, A. B., D. P. Harrington, and S. R. Lipsitz (1998). Analysis of longitudinal data with non-ignorable non-monotone missing values. Journal of the Royal Statistical Society: Series C (Applied Statistics)\/ 47\/ (3), 425--438
1998
-
[24]
Van der Vaart, A. W. (2000). Asymptotic statistics , Volume 3. Cambridge university press
2000
-
[25]
Wellner, J. et al. (2013). Weak convergence and empirical processes: with applications to statistics . Springer Science & Business Media
2013
-
[26]
Wong, R. K. and K. C. G. Chan (2018). Kernel-based covariate functional balancing for observational studies. Biometrika\/ 105\/ (1), 199--213
2018
-
[27]
Zhao, Q. (2019). Covariate balancing propensity score by tailored loss functions. The Annals of Statistics\/ 47\/ (2), 965--993
2019
-
[28]
Zubizarreta, J. R. (2015). Stable weights that balance covariates for estimation with incomplete outcome data. Journal of the American Statistical Association\/ 110\/ (511), 910--922
2015
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.