REVIEW 3 major objections 4 minor 1 cited by
Under parallel growths, the counterfactual untreated vector of categorical counts for the treated group is identified in closed form, along with its total and shares.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-04 10:04 UTC pith:I2I6VAPA
load-bearing objection The core 2x2 identification is sound and worth knowing, but the paper overclaims: the abstract promises asymptotics and a pre-trends test that are not in the manuscript, and Theorem 2's partial-identification bounds for the compositional effect are actually wrong. the 3 major comments →
Compositional difference-in-differences
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The paper's central claim is Theorem 1: under common support and parallel growths, the counterfactual untreated quantity for each category in the treated, post-treatment cell is q_N11(c_k) = exp(log q_N10(c_k) + log q_N01(c_k) - log q_N00(c_k)); the counterfactual total is the sum of these quantities, and the counterfactual shares are the normalized quantities. This makes the counterfactual distribution point-identified in closed form and always a valid probability vector. The paper defines two target parameters: the growth treatment effect on the treated (GTT), a proportional effect on category and total counts, and the compositional treatment effect on the treated (CTT), a normalized vecto
What carries the argument
The load-bearing object is the parallel growths assumption: log q_1,1 - log q_1,0 = log q_0,1 - log q_0,0 componentwise. It is a multiplicative parallel-trends condition that is scale-invariant, keeps counterfactual counts positive, and, through the log-odds transformation, makes the implied share evolution a parallel shift in the simplex under its standard compositional geometry. The assumed equality on log-counts also transfers to equality of changes in expected utilities in a random-utility model, so relative preferences evolve in parallel absent treatment. This single assumption carries all the identification: once it is imposed, the closed-form formula follows by algebra.
Load-bearing premise
The load-bearing premise is that, absent treatment, every outcome category grows or shrinks by the same proportional rate in the treated and control groups; if that shared-log-growth condition fails, the closed-form counterfactual and all treatment-effect estimates built on it are not identified.
What would settle it
Use two or more pre-treatment periods and compute the cross-group log-count gap for each category: log q_1,t(c_k) - log q_0,t(c_k). If that gap drifts or trends across pre-treatment periods in the early-voting or RGGI data, or in a placebo 'treatment' period, parallel growths is contradicted and Theorem 1's counterfactual will be systematically off. A formal pre-trend test of Assumption 2 on either application, or on simulated data generated with heterogeneous growth rates, would settle the claim.
If this is right
- If parallel growths holds in a 2x2 design, counterfactual totals and shares are identified without estimating a full discrete-choice model, and all counterfactual shares lie inside the probability simplex.
- The same construction extends to staggered adoption either with never-treated units or with not-yet-treated units as controls, giving cohort-by-time counterfactual quantities and totals.
- When pre-treatment growth differentials are bounded, the closed-form point estimates become sharp bounds on GTT and CTT, so imperfectly parallel trends need not destroy the analysis.
- A synthetic version reweights control groups to match the treated group's pre-treatment log trajectory, yielding treatment effects on both margins in panel settings.
- In the reported applications, early voting raises turnout by about 4.4% and the Democratic vote share by 0.92 percentage points, while RGGI's first compliance period reduces total generation by up to 13.6% and moves generation from coal and oil toward gas and nuclear rather than renewables.
Where Pith is reading between the lines
- A natural extension not pursued in the paper is to apply the same log-ratio construction to count outcomes with zeros or measurement error, adding a trimming or smoothing step to keep the exponential formula defined.
- Because the share counterfactual equals a softmax of a linear expression, CoDiD estimates can be compared directly with multinomial-logit difference-in-differences coefficients; disagreement between the two would reveal where functional form rather than sampling noise matters.
- A testable placebo extension is to apply the formula to pairs of pre-treatment periods, treating one as a fake post-period; systematic bias there would show how sensitive the counterfactual is to departures from parallel growths.
- The breadth of the partial-identification bounds depends on the researcher's choice of weights across pre-treatment periods, so a data-driven weight-selection rule would be a natural complement to the paper's convex-hull relaxation.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes CoDiD, a difference-in-differences method for categorical outcomes. Under a 'parallel growths' assumption (Assumption 2: equal pre/post log-quantity changes across groups), Theorem 1 gives a closed-form counterfactual quantity vector, total, and shares. The paper interprets this assumption in a random-utility model and in Aitchison geometry, and extends the framework to partial identification under relaxed assumptions (Theorem 2), staggered adoption (Theorem 3), and a synthetic control analog. Two empirical applications illustrate the method. The central point-identification algebra is correct, but the advertised partial-identification bounds, asymptotic distribution, and pre-trends test are either absent or incorrect in the current manuscript.
Significance. If limited to Theorem 1 and Proposition 2, the paper makes a useful and clean contribution: log-linear parallel trends for counts yield counterfactual shares that respect the simplex and connect naturally to multinomial logit. The closed-form nature, with no fitted parameters in the identification step, is a genuine strength. However, the additional advertised results—sharp partial identification, joint asymptotic distribution, and a pre-trends test—are not delivered correctly or at all. As it stands, the manuscript's significance is substantially below the abstract's claims, though the central identification formula is worth publishing after a major revision.
major comments (3)
- [Section 2.1, Theorem 2] The CTT partial-identification set is not sharp and can exclude the true counterfactual. Under Assumption 3, the identified set for q^N_{1,1} is the box Π_k [b_min(c_k), b_max(c_k)], so the identified set of counterfactual shares is {q/Σq : b_min ≤ q ≤ b_max}. Theorem 2 instead writes s ∈ ℓ^{-1}({r ∈ R^{p-1} : log b_min(c_k) ≤ r_k ≤ log b_max(c_k)}). But r_k = log(s_k/s_p) = log(q_k/q_p), and q_p appears in the denominator. The box constraint on q does not imply log b_min(c_k) ≤ r_k ≤ log b_max(c_k). For p=2 with b_min=(1,2), b_max=(2,4), the true counterfactual share s_1 lies in [0.2, 0.5], whereas the theorem's characterization gives r_1 ∈ [log 1, log 2] = [0, log 2], i.e. s_1 ∈ [1/3, 2/3], which excludes true values such as s_1 = 0.25. Since the abstract explicitly promises 'sharp partial identification bounds', this is a load-bearing error. The set should be characterized directly as
- [Abstract / Sections 1–5, Appendix C] The abstract promises 'the joint asymptotic distribution of all treatment-effect estimators under multinomial sampling' and 'a pre-trends test'. Neither appears in the body or appendices. The only inference procedure is a parametric bootstrap (Appendix C), with no theorem on the joint limiting distribution and no formal pre-trends test anywhere. The empirical sections rely on visual inspection of pre-treatment log-trend plots (Figures 6–8, 10). This is a substantial gap between what is advertised and what is delivered. The author should either add the missing theoretical results or revise the abstract to reflect the actual content.
- [Section 2.3, synthetic CoDiD] The GTT formula in the synthetic CoDiD extension appears inconsistent with the parallel-growths identifying assumption. Under parallel growths, the counterfactual treated post quantity is q_T,pre × (q_C,post / q_C,pre), so the growth treatment effect should be GTT = q_T,post × q_C,pre / (q_T,pre × q_C,post) − 1. The displayed formula, 'GTT = q_treated,post / (q_treated,pre + q_control,post − q_control,pre) − 1', is an additive DiD on the exp-smoothed quantities, not a proportional-growth effect. If this is a typographical error from equation formatting, it should be corrected; as written, it undermines the synthetic control extension.
minor comments (4)
- [Appendix A.2, proof of Proposition 1] Typo in the last display: 'log q^N_{g1}(c_k)−log q^N_{g1}(c_k)' should read 'log q^N_{g1}(c_k)−log q^N_{g0}(c_k)'.
- [Section 1.3, Proposition 3 and proof A.4] The proposition states π^N_{1,1} ⊖ π^N_{1,0} = π^N_{0,1} ⊖ π^N_{0,0}, but the proof begins by analyzing π^N_{1,1} ⊖ π^N_{0,1} = π^N_{1,0} ⊖ π^N_{0,0}. These are algebraically equivalent under the log-odds characterization, but the notation should be aligned to avoid confusion.
- [Section 1.1.1, equation (1)] The display 'π^N_{1,1} ⊖ π^N_{1,1}' appears to be a typo; the compositional difference for the control group should be π^N_{0,1} ⊖ π^N_{0,0}.
- [General] The paper would benefit from a careful proofreading pass for notation and equation formatting; several displays are garbled or have inconsistent subscripts (e.g., Section 2.3, Theorem 2's b_min/b_max definitions).
Circularity Check
No significant circularity: Theorem 1 follows by direct algebra from Assumption 2; the only minor tautological step is the RUM 'justification' in Proposition 1, which restates Assumption 2 in utility notation.
specific steps
-
self definitional
[Section 1.2, Proposition 1; Appendix A.2]
"V N_gt(c_k)=μ^N_gt(c_k)−log(Σ_k e^{μ^N_gt(c_k)}) + log(S^N_gt). ... Proposition 1 (Implication for expected utilities). Under assumptions 1 and the RUM model assumptions, assumption 2 is equivalent to parallel trends of expected utilities: E[U^N_11(c_k)]−E[U^N_10(c_k)] = E[U^N_01(c_k)]−E[U^N_00(c_k)] ∀ c_k∈Ȳ."
Given q^N_gt(c_k)=π^N_gt(c_k) S^N_gt and π^N_gt(c_k)=e^{μ^N_gt(c_k)}/Σ_j e^{μ^N_gt(c_j)}, the paper's decomposition makes E[U^N_gt(c_k)] = log q^N_gt(c_k)+γ (up to the Gumbel mean). Thus Eq. (6) is exactly Assumption 2 after adding/subtracting the constant γ. The RUM section therefore restates parallel growths as 'parallel trends in expected utilities' rather than providing an independent micro-foundation. This is an interpretive equivalence by construction, not an input to Theorem 1; the main identification result remains direct algebra from Assumption 2.
full rationale
The central identification claim is not circular. Theorem 1 is a one-line algebraic rearrangement of Assumption 2 (parallel growths) followed by normalization; no parameter is fitted to the treated post-treatment outcome and then relabeled as a prediction. The share-space formula (10), the log-odds implication (Proposition 2), the compositional-difference interpretation (Proposition 3), and the Aitchison-geometry reading (Proposition 4) are all algebraic restatements of the same log-translation logic, not independent sources of the result. There is no load-bearing self-citation chain: the paper cites external prior work (Aitchison, Callaway-Sant'Anna, Arkhangelsky et al., Ban-Kédagni, etc.) and does not invoke a uniqueness theorem by the present author to force its choice. The only mildly circular element is Proposition 1's RUM 'justification,' where the expected-utility decomposition is set up so that parallel growths and parallel expected-utility trends are the same equation; this is a non-load-bearing interpretation. Separately, Theorem 2's claimed sharp CTT bounds appear to treat log-quantity bounds as log-odds bounds, which is a correctness/validity concern rather than a circularity concern, so it is not scored here. Score 1 reflects the minor tautological RUM restatement; the paper's main derivation is self-contained.
Axiom & Free-Parameter Ledger
axioms (6)
- domain assumption Assumption 1: common support and strictly positive category quantities for all untreated potential outcomes
- ad hoc to paper Assumption 2: parallel growths, log qN_1,1 - log qN_1,0 = log qN_0,1 - log qN_0,0 componentwise
- domain assumption Random utility model with i.i.d. type-1 extreme value errors
- domain assumption Multinomial sampling model for inference
- ad hoc to paper Assumption 3: post-treatment log-difference lies in the convex hull of weighted pre-treatment log-differences
- domain assumption Assumptions 4-6: irreversibility and parallel growths to never-treated or not-yet-treated cohorts
read the original abstract
Many causal questions concern vectors of quantities across mutually exclusive categories, votes by party, employment by status, generation by energy source, where both the shares and the total matter. Standard practice runs a separate linear difference-in-differences (DiD) on each share, which violates the simplex constraint, cannot describe reallocation across categories, and is silent on the total. This paper develops Compositional Difference-in-Differences (CoDiD). For the share margin, parallel trends in log-odds identify the counterfactual composition in closed form, always inside the simplex, and admit two readings: parallel evolution of relative utilities in a random-utility model, and parallel trajectories in the Aitchison geometry of the simplex. Strengthening the assumption to parallel growth in log-counts jointly identifies effects on shares and on the total, and reveals a composition adjustment factor, the ratio of inclusive-value growth across groups, that corrects the aggregation bias of log-total DiD. I derive the joint asymptotic distribution of all treatment-effect estimators under multinomial sampling, provide a pre-trends test, and obtain sharp partial identification bounds when pre-treatment growth differentials are only bounded. Applying CoDiD to early voting in the 2008 U.S.\ presidential election, I find a $4.4\%$ increase in turnout and a $0.92$ percentage-point increase in the Democratic vote share.
Figures
Forward citations
Cited by 1 Pith paper
-
Compositional Synthetic Controls
For outcomes that are shares summing to one, the paper estimates counterfactuals as weighted geometric means of donor compositions in log-odds space, with weights fit before treatment.
Reference graph
Works this paper leans on
-
[1]
Aitchison
J. Aitchison. The statistical analysis of compositional data. Journal of the Royal Statistical Society: Series B (Methodological), 44 0 (2): 0 139--160, 1982
1982
-
[2]
Aitchison
J. Aitchison. Relative variation diagrams for describing patterns of compositional variability. Mathematical Geology, 22 0 (4): 0 487--511, 1990
1990
-
[3]
Aitchison
J. Aitchison. On criteria for measures of compositional difference. Mathematical Geology, 24 0 (4): 0 365--379, 1992
1992
-
[4]
Aitchison
J. Aitchison. Simplicial inference. In M. A. G. Viana and D. S. P. Richards, editors, Algebraic Methods in Statistics and Probability, volume 287 of Contemporary Mathematics, pages 1--22. American Mathematical Society, Providence, Rhode Island, 2002
2002
-
[5]
Arkhangelsky, S
D. Arkhangelsky, S. Athey, D. A. Hirshberg, G. W. Imbens, and S. Wager. Synthetic difference-in-differences. American Economic Review, 111 0 (12): 0 4088--4118, 2021
2021
-
[6]
K. F. Arnold, L. Berrie, P. W. Tennant, and M. S. Gilthorpe. A causal inference perspective on the analysis of compositional data. International journal of epidemiology, 49 0 (4): 0 1307--1313, 2020
2020
-
[7]
Athey and G
S. Athey and G. W. Imbens. Identification and inference in nonlinear difference-in-differences models. Econometrica, 74 0 (2): 0 431--497, 2006
2006
-
[8]
A. Baker, B. Callaway, S. Cunningham, A. Goodman-Bacon, and P. H. Sant'Anna. Difference-in-differences designs: A practitioner's guide. arXiv preprint arXiv:2503.13323, 2025
Pith/arXiv arXiv 2025
-
[9]
K. Ban and D. K \'e dagni. Robust difference-in-differences models. arXiv preprint arXiv:2211.06710, 2022
Pith/arXiv arXiv 2022
-
[10]
Barceló-Vidal, J
C. Barceló-Vidal, J. A. Martín-Fernández, and V. Pawlowsky-Glahn. Mathematical foundations of compositional data analysis. In G. Ross, editor, Proceedings of the Sixth Annual Conference of the International Association for Mathematical Geology, Cancun, Mexico, 2001. CD-ROM
2001
-
[11]
S. T. Berry, C. Cox, and P. Haile. Selective turnout, voting policy, and partisan bias: Evidence from multi-level data. Technical report, National Bureau of Economic Research, 2025
2025
-
[12]
Billheimer, P
D. Billheimer, P. Guttorp, and W. F. Fagan. Statistical interpretation of species composition. Journal of the American Statistical Association, 96 0 (456): 0 1205--1214, 2001
2001
-
[13]
Bonhomme and U
S. Bonhomme and U. Sauder. Recovering distributions in difference-in-differences models: A comparison of selective and comprehensive schooling. The Review of Economics and Statistics, 93 0 (2): 0 479--494, 2011. ISSN 00346535, 15309142
2011
-
[14]
Cafri, W
G. Cafri, W. Wang, P. H. Chan, and P. C. Austin. A review and empirical comparison of causal inference methods for clustered observational data with application to the evaluation of the effectiveness of medical devices. Statistical Methods in Medical Research, 28 0 (10-11): 0 3142--3162, 2019
2019
-
[15]
Callaway and T
B. Callaway and T. Li. Quantile treatment effects in difference in differences models with panel data. Quantitative Economics, 10 0 (4): 0 1579--1618, 2019
2019
-
[16]
Callaway and P
B. Callaway and P. H. Sant’Anna. Difference-in-differences with multiple time periods. Journal of Econometrics, 2020. ISSN 0304-4076
2020
-
[17]
Callaway and P
B. Callaway and P. H. Sant’Anna. Difference-in-differences with multiple time periods. Journal of econometrics, 225 0 (2): 0 200--230, 2021
2021
-
[18]
Callaway, T
B. Callaway, T. Li, and T. Oka. Quantile treatment effects in difference in differences models under dependence restrictions and with only two time periods . Journal of Econometrics, 206 0 (2): 0 395--413, 2018
2018
-
[19]
De Chaisemartin and X
C. De Chaisemartin and X. d’Haultfoeuille. Two-way fixed effects and differences-in-differences with heterogeneous treatment effects: A survey. The econometrics journal, 26 0 (3): 0 C1--C30, 2023
2023
-
[20]
J. J. Egozcue, V. Pawlowsky-Glahn, G. Mateu-Figueras, and C. Barcelo-Vidal. Isometric logratio transformations for compositional data analysis. Mathematical geology, 35 0 (3): 0 279--300, 2003
2003
- [21]
-
[22]
J. A. Graves, C. Fry, J. M. McWilliams, and L. A. Hatfield. Difference-in-differences for categorical outcomes. Health Services Research, 57 0 (3): 0 681--692, 2022
2022
-
[23]
M. J. Hamilton. Chapter 1 lie groups and lie algebras: Basic concepts. In Mathematical Gauge Theory: With Applications to the Standard Model of Particle Physics, pages 3--82. Springer, 2017
2017
-
[24]
Havnes and M
T. Havnes and M. Mogstad. Is universal child care leveling the playing field? Journal of Public Economics, 127: 0 100--114, 2015. ISSN 0047-2727. The Nordic Model
2015
-
[25]
J. L. Horowitz. Bootstrap methods in econometrics. Annual Review of Economics, 11 0 (1): 0 193--224, 2019
2019
-
[26]
M. Lechner. The estimation of causal effects by difference-in-difference methods. Foundations and Trends® in Econometrics, 4 0 (3): 0 165--224, 2011. ISSN 1551-3076
2011
-
[27]
C. F. Manski and J. V. Pepper. How do right-to-carry laws affect crime rates? coping with ambiguity using bounded-variation assumptions. Review of Economics and Statistics, 100 0 (2): 0 232--244, 2018
2018
-
[28]
McFadden
D. McFadden. Conditional logit analysis of qualitative choice behavior. 1972
1972
-
[29]
McFadden
D. McFadden. The measurement of urban travel demand. Journal of public economics, 3 0 (4): 0 303--328, 1974
1974
-
[30]
McFadden
D. McFadden. Modelling the choice of residential location. 1977
1977
-
[31]
B. D. Meyer, W. K. Viscusi, and D. Durbin. Workers' compensation and injury duration: evidence from a natural experiment, 1990
1990
-
[32]
difference-in-differences
P. A. Puhani. The treatment effect, the cross difference, and the interaction term in nonlinear “difference-in-differences” models. Economics Letters, 115 0 (1): 0 85--87, 2012
2012
-
[33]
Rambachan and J
A. Rambachan and J. Roth. An honest approach to parallel trends. Working Paper, 2020
2020
-
[34]
Roth and P
J. Roth and P. Sant'Anna. When is parallel trends sensitive to functional form? Unpublished Manuscript, 2021
2021
-
[35]
J. Roth, P. H. Sant’Anna, A. Bilinski, and J. Poe. What’s trending in difference-in-differences? a synthesis of the recent econometrics literature. Journal of Econometrics, 235 0 (2): 0 2218--2244, 2023
2023
-
[36]
E. J. Tchetgen Tchetgen, C. Park, and D. B. Richardson. Universal difference-in-differences for causal inference in epidemiology. Epidemiology, 35 0 (1), 2024
2024
-
[37]
W. Torous, F. Gunsilius, and P. Rigollet. An optimal transport approach to causal inference. arXiv preprint arXiv:2108.05858, 2021
Pith/arXiv arXiv 2021
-
[38]
K. E. Train. Discrete choice methods with simulation. Cambridge university press, 2009
2009
-
[39]
J. M. Wooldridge. Simple approaches to nonlinear difference-in-differences with panel data. The Econometrics Journal, 26 0 (3): 0 C31--C66, 2023
2023
-
[40]
J. Yan. The impact of climate policy on fossil fuel consumption: Evidence from the regional greenhouse gas initiative (rggi). Energy Economics, 100: 0 105333, 2021
2021
-
[41]
Y. Zhou, D. Kurisu, T. Otsu, and H.-G. M \"u ller. Geodesic difference-in-differences. arXiv preprint arXiv:2501.17436, 2025
Pith/arXiv arXiv 2025
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.