REVIEW 2 major objections 4 minor 42 references
The Estimand Framework and Causal Inference: Complementary not Competing Paradigms
T0 review · 2 major / 4 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read The ICH E9(R1) estimand framework and causal inference define the same target effect and should be used together.
desk verdict Clear conceptual paper showing ICH E9(R1) and causal estimands map onto each other for four of the five intercurrent-event strategies; the unillustrated 'while on treatment' case is a revision-level gap, not a rejection. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The mapping between ICH intercurrent-event (IE) strategies and causal inference concepts is the load-bearing object. The paper identifies treatment policy with the effect of assignment, hypothetical with an intervention that sets post-baseline variables to specified values, composite with a redefined outcome that incorporates the event (with a penalty value), while-on-treatment with measuring the outcome only until the event, and principal stratum with the effect in the subpopulation that would or would not experience the event under both treatments. This correspondence is what allows the paper to claim that a single target effect can be expressed in either framework, and that the frameworks are complementary.
What would settle it
Take a real trial with an intercurrent event that is not a well-defined intervention, such as death as a competing risk for a quality-of-life endpoint, and try to write the ICH treatment-policy and hypothetical estimands as causal estimands in the paper's notation; if the formulations diverge or one is inexpressible, the claimed complementarity fails for that class of events.
Extended reading notes
Core claim
The central claim is that 'estimand' in ICH E9(R1) and 'estimand' in causal inference denote essentially the same target: a comparison, in a specified population, of potential outcomes under specified treatment conditions. The paper demonstrates this by formulating the same clinical questions in both languages for three trials: the treatment-policy strategy matches the causal estimand that leaves post-baseline variables unintervened on; the hypothetical strategy matches a causal estimand that intervenes to set those variables (e.g., no discontinuation, no rescue); the composite strategy matches redefining the outcome as a mixture of the natural outcome and a penalty value; and the principal-stratum strategy matches conditioning on potential event status. The paper concludes that the two frameworks are complementary and encourages practitioners familiar with one to learn the other.
Load-bearing premise
The complementarity claim rests on the assumption that every intercurrent event can be mapped onto a causal concept—an intervenable post-baseline variable or a principal stratum—and for some events, such as death, that mapping may not be well defined.
Editorial extensions
If this is right
- A trial team can present the ICH five-component table to stakeholders and the corresponding potential-outcome expression to statisticians, keeping both audiences clear.
- Adding a causal graph to an ICH estimand makes the assumed relationships between treatment, intercurrent events, and outcome explicit rather than implicit.
- The hypothetical strategy, read causally, is an effect under a specified intervention on adherence and rescue use, directly linking it to per-protocol effect definitions.
- Principal-stratum estimands, the paper notes, are only estimable under strong and untestable assumptions, a point the ICH text does not spell out.
- Adopting both vocabularies should reduce the confusion that arises when the single word 'estimand' is used in two partially overlapping senses.
Reading between the lines
- The mapping works most cleanly for intercurrent events that can be framed as interventions; for terminal events like death, the causal language would need new machinery, suggesting the complementarity may be narrower than stated.
- The paper's accessibility claim is untested; a survey asking clinical trialists to interpret both formulations would provide direct evidence for or against it.
- A practical by-product could be a translation guide that pairs each ICH strategy with its causal estimand notation, going beyond the three examples given here.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper compares the ICH E9(R1) estimands framework with the causal inference framework, using three clinical trial examples (diabetes, nasal polyps, COVID-19) to show how each can define estimands that address intercurrent events. The authors argue that, despite differences in form and precision, the two paradigms are complementary: the ICH framework provides a structured, descriptive approach for communicating trial objectives, while causal inference offers mathematical precision and explicit assumptions via potential outcomes and DAGs. They conclude that both can quantify a population-based summary of a target effect and encourage practitioners to use both frameworks in combination.
Significance. If the central claim holds, the paper provides a valuable didactic bridge between two important statistical frameworks, helping trialists and statisticians understand when and how ICH E9(R1) estimands correspond to causal estimands. Its strengths are the worked examples covering treatment policy, hypothetical, composite, and principal stratum strategies; the explicit acknowledgment of ambiguity in the ICH guidance; and the balanced discussion of limitations such as the untestable assumptions for principal strata and the arbitrariness of composite penalty values. The paper does not contain new mathematical results, but it offers a clear and practical framework for cross-communication, which is of genuine use to the clinical trials community.
major comments (2)
- [§3, §6.1, §7] The paper defines five intercurrent-event strategies in §3 but never revisits the "while on treatment" strategy in any of the examples, which cover only treatment policy, hypothetical, composite, and principal stratum strategies. The conclusion in §7 asserts broadly that both paradigms "can be used to quantify a population-based summary of a target effect on an outcome for a given population," and §6.1 states that an IE is conceptually the same as a post-baseline mediator or time-varying treatment. Without a discussion of how the while-on-treatment strategy maps to a causal estimand—for example, via dynamic treatment regimes or principal stratification—the complementarity claim is wider than the demonstrated evidence. Please add such a discussion or explicitly qualify the conclusion to the strategies actually illustrated.
- [§3, §6.1] The proposed mapping between intercurrent events and mediators or time-varying treatments is presented as "reasonably intuitive" and general, but it does not obviously accommodate death as an intercurrent event, which the paper itself lists in §3 as an important IE in some trials. When death occurs before the outcome measurement, the outcome is undefined in the usual sense, and neither a mediator nor a time-varying treatment description applies without additional structural assumptions or a composite or principal-stratum formulation. The paper should acknowledge this limitation and either provide a worked example involving death or temper the general claim that all IEs can be identified with causal-inference constructs.
minor comments (4)
- [§4.1] The individual causal effect is written as Y(a=1) – Y(a=1) and later as E[Y(a=1) – Y(a=1)]; these should be Y(a=1) – Y(a=0) and E[Y(a=1) – Y(a=0)]. This appears to be a simple typo, but it occurs in the central definition of the causal effect.
- [§5.1.2] The notation E[Y(a=1, D, R)] is nonstandard because D and R are random variables, not fixed values. Consider writing E[Y(a=1)] directly or explicitly defining Y(a, d, r) with fixed d and r and using language such as "with D and R taking their natural values under each assignment."
- [§6.1] The claim that the ICH estimand is "likely to be more accessible to clinical trialists without formal causal and mathematical training" is an empirical assertion that is not supported by evidence in the manuscript. Please either cite supporting literature or present this as the authors' opinion rather than an established fact.
- [§5.3.2] The phrase "assumptions about the casual relationships" should read "assumptions about the causal relationships."
Circularity Check
No significant circularity: the paper translates ICH estimands into causal estimands via external examples rather than deriving its conclusion from its own definitions.
full rationale
This is a comparative and interpretive paper, not a derivation chain. The central claim that the ICH E9(R1) and causal inference frameworks are complementary is supported by worked examples (PIONEER 1, SYNAPSE, COVID-19) in which each ICH estimand is paired with a causal estimand using standard potential-outcome notation. The causal estimands are constructed to express the same clinical questions as the ICH estimands; this is an explicit translation exercise, not a hidden identity imposed by definition. The paper does not fit parameters and then call them predictions, does not invoke a uniqueness theorem, and does not rely on self-citations to establish its main conclusion. The only self-citations (e.g., Keene 2018 on the arbitrariness of a penalty value, Drury et al. on estimation methods, Keene 2023 on adherence terminology) are background or estimation references and are not load-bearing for the complementarity thesis. The interpretive mapping of intercurrent events to post-baseline mediators or time-varying treatments is presented as an intuitive connection and illustrated with examples; even if it is incomplete for some strategies such as 'while on treatment', that is a scope limitation, not circularity. The paper is self-contained against external benchmarks and its conclusion is an assessment of the exhibited correspondences rather than a restatement of its inputs.
Assumptions & free parameters
assumptions (2)
- domain assumption Potential outcomes exist for each individual under each treatment, and consistency, positivity, and exchangeability hold.
- domain assumption The ICH E9(R1) framework is an authoritative external standard for defining estimands in clinical trials.
Cite this review
Pith. "Pith review of The Estimand Framework and Causal Inference: Complementary not Competing Paradigms." pith.science (2026). https://pith.science/paper/YC54AB4W
@misc{pith2026241212380,
author = {Pith},
title = {Pith review of: The Estimand Framework and Causal Inference: Complementary not Competing Paradigms},
year = {2026},
howpublished = {\url{https://pith.science/paper/YC54AB4W}},
note = {Machine review of arXiv:2412.12380}
}
read the original abstract
The creation of the ICH E9 (R1) estimands framework has led to more precise specification of the treatment effects of interest in the design and statistical analysis of clinical trials. However, it is unclear how the new framework relates to causal inference, as both approaches appear to define what is being estimated and have a quantity labelled an estimand. Using illustrative examples, we show that both approaches can be used to define a population-based summary of an effect on an outcome for a specified population and highlight the similarities and differences between these approaches. We demonstrate that the ICH E9 (R1) estimand framework offers a descriptive, structured approach that is more accessible to non-mathematicians, facilitating clearer communication of trial objectives and results. We then contrast this with the causal inference framework, which provides a mathematically precise definition of an estimand, and allows the explicit articulation of assumptions through tools such as causal graphs. Despite these differences, the two paradigms should be viewed as complementary rather than competing. The combined use of both approaches enhances the ability to communicate what is being estimated. We encourage those familiar with one framework to appreciate the concepts of the other to strengthen the robustness and clarity of clinical trial design, analysis, and interpretation.
Reference graph
Works this paper leans on
-
[1]
E9(R1) (2019) Addendum on Estimands and Sensitivity Analysis in Clinical Trials
ICH. E9(R1) (2019) Addendum on Estimands and Sensitivity Analysis in Clinical Trials.. https://www.ich.org/page/efficacy-guidelines; 2019. [Accessed 06-12-2024]
work page 2019
-
[2]
Mallinckrodt CH, Bell J, Liu G, et al. Aligning estimators with estimands in clinical trials: Putting the ICH E9(R1) guidelines into practice. Ther. Innov. Regul. Sci.. 2020;54(2):353–364. doi: 10.1007/s43441-019-00063-9
-
[3]
Marking 2-years of new thinking in Clinical Trials: The estimand journey
Fletcher C, Hefting N, Wright M, et al. Marking 2-years of new thinking in Clinical Trials: The estimand journey. Ther. Innov. Regul. Sci.. 2022;56(4):637–650. doi: 10.1007/s43441-022-00402-3
-
[4]
Cro S, Kahan BC, Rehal S, et al. Evaluating how clear the questions being investigated in randomised trials are: systematic review of estimands. BMJ. 2022;378:e070146. doi: 10.1136/bmj-2022-070146
-
[5]
ICH. E9(R1) Training Material.. https://database.ich.org/sites/default/files/E9%28R1%29%20Training%20Material%20-%20PDF_0.pdf; 2020. [Accessed 06-12-2024]
work page 2020
-
[6]
Hernan MA, Robins JM. Causal inference: What if. Boca Raton, FL: CRC Press, 2024
work page 2024
-
[7]
Aroda VR, Rosenstock J, Terauchi Y , et al. PIONEER 1: Randomized clinical trial of the efficacy and safety of oral semaglutide monotherapy in comparison with placebo in patients with type 2 diabetes. Diabetes Care. 2019;42(9):1724–1732. doi: 10.2337/dc19-0749
-
[8]
Han JK, Bachert C, Fokkens W, et al. Mepolizumab for chronic rhinosinusitis with nasal polyps (SYNAPSE): a randomised, double-blind, placebo-controlled, phase 3 trial. Lancet Respir. Med.. 2021;9(10):1141–1153. doi: 10.1016/S2213-2600(21)00097-7
Show all 42 references
-
[9]
Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine.N
Baden LR, El Sahly HM, Essink B, et al. Efficacy and safety of the mRNA-1273 SARS-CoV-2 vaccine.N. Engl. J. Med.. 2021;384(5):403–416. doi: 10.1056/NEJMoa2035389
2021 doi
-
[10]
https://www.ncbi.nlm.nih.gov/books/NBK209902/; 2010
National Research Council (US) Panel on Handling Missing Data in Clinical Trials: The Prevention and Treatment of Missing Data in Clinical Trials.. https://www.ncbi.nlm.nih.gov/books/NBK209902/; 2010. [Accessed 06-12-2024]
2010
-
[11]
Common pitfalls in statistical analysis: Intention-to-treat versus per-protocol analysis.Perspect
Ranganathan P, Pramesh CS, Aggarwal R. Common pitfalls in statistical analysis: Intention-to-treat versus per-protocol analysis.Perspect. Clin. Res.. 2016;7(3):144–146. doi: 10.4103/2229-3485.184823
2016
-
[12]
Beyond the intention-to-treat in comparative effectiveness research
Hernán MA, Hernández-Díaz S. Beyond the intention-to-treat in comparative effectiveness research. Clin. Trials. 2012;9(1):48–55. doi: 10.1177/1740774511420743
2012 doi
-
[13]
Statistical considerations in the intent-to-treat principle.Control
Lachin JM. Statistical considerations in the intent-to-treat principle.Control. Clin. Trials.2000;21(3):167–189. doi: 10.1016/s0197-2456(00)00046- 5
2000 doi
-
[14]
Intent-to-treat analysis versus as-treated analysis
Ellenberg JH. Intent-to-treat analysis versus as-treated analysis. Drug Inf. J.. 1996;30(2):535–544. doi: 10.1177/009286159603000229 The Estimands Framework and Causal Inference: Complementary not Competing Paradigms 13
1996 doi
-
[15]
Principles and recommendations for incorporating estimands into clinical study protocol templates
Lynggaard H, Bell J, Lösch C, et al. Principles and recommendations for incorporating estimands into clinical study protocol templates. Trials. 2022;23(1):685. doi: 10.1186/s13063-022-06515-2
2022 doi
-
[16]
Treatment policy estimands for recurrent event data using data collected after cessation of randomised treatment
Roger JH, Bratton DJ, Mayer B, Abellan JJ, Keene ON. Treatment policy estimands for recurrent event data using data collected after cessation of randomised treatment. Pharm. Stat.. 2019;18(1):85–95. doi: 10.1002/pst.1910
2019 doi
-
[18]
Guizzaro L, Pétavy F, Ristl R, Gallo C. The use of a variable representing compliance improves accuracy of estimation of the effect of treatment allocation regardless of discontinuation in trials with incomplete follow-up. Stat. Biopharm. Res.. 2021;13(1):119–127. doi: 10.1080...
2021
-
[19]
Estimation of a treatment policy estimand for time to event data using data collected post discontinuation of randomised treatment
Hartley B, Drury T, Lettis S, Mayer B, Keene ON, Abellan JJ. Estimation of a treatment policy estimand for time to event data using data collected post discontinuation of randomised treatment. Pharm. Stat.. 2022;21(3):612–624. doi: 10.1002/pst.2189
2022 doi
-
[20]
Standard and reference-based conditional mean imputation
Wolbers M, Noci A, Delmar P, Gower-Page C, Yiu S, Bartlett JW. Standard and reference-based conditional mean imputation. Pharm. Stat.. 2022;21(6):1246–1257. doi: 10.1002/pst.2234
2022 doi
-
[21]
Statistical methods for handling missing data to align with treatment policy strategy.Pharm
Wang Y , Tu W, Kim Y , et al. Statistical methods for handling missing data to align with treatment policy strategy.Pharm. Stat.. 2023;22(4):650–670. doi: 10.1002/pst.2299
2023 doi
-
[23]
Estimation of treatment policy estimands for continuous outcomes using off-treatment sequential multiple imputation
Drury T, Abellan JJ, Best N, White IR. Estimation of treatment policy estimands for continuous outcomes using off-treatment sequential multiple imputation. Pharm. Stat.. 2024;23(6):1144–1155. doi: 10.1002/pst.2411
2024 doi
-
[24]
Estimation methods for estimands using the treatment policy strategy; a simulation study based on the PIONEER 1 Trial
Bell J, Drury T, Mütze T, et al. Estimation methods for estimands using the treatment policy strategy; a simulation study based on the PIONEER 1 Trial. ArXiv. 2024. doi: 10.48550/arXiv.2402.12850
-
[25]
Hypothetical estimands in clinical trials: A unification of causal inference and missing data methods
Olarte Parra C, Daniel RM, Bartlett JW. Hypothetical estimands in clinical trials: A unification of causal inference and missing data methods. Stat. Biopharm. Res.. 2023;15(2):421–432. doi: 10.1080/19466315.2022.2081599
2023
-
[26]
Causal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin DB. Causal Inference Using Potential Outcomes: Design, Modeling, Decisions. Journal of the American Statistical Association. 2005;100(469):322–331. doi: 10.1198/016214504000001880
2005 doi
-
[27]
An Introduction to Causal Inference
Pearl J. An Introduction to Causal Inference. The International Journal of Biostatistics. 2010;6(2). doi: 10.2202/1557-4679.1203
2010
-
[28]
Interview with Judea Pearl
Pearl J. Interview with Judea Pearl. Observational Studies. 2022;8(2):23–36. doi: 10.1353/obs.2022.0007
2022
-
[29]
Interview with Jamie Robins
Robins J. Interview with Jamie Robins. Observational Studies. 2022;8(2):37–76. doi: 10.1353/obs.2022.0008
2022
-
[30]
Interview with Don Rubin
Rubin D. Interview with Don Rubin. Observational Studies. 2022;8(2):77–94. doi: 10.1353/obs.2022.0009
2022
-
[31]
Dynamic Treatment Regimes: Statistical Methods for Precision Medicine
Tsiatis AA, Davidian M, Holloway ST, Laber EB. Dynamic Treatment Regimes: Statistical Methods for Precision Medicine . Chapman and Hall/CRC, 2019
2019
-
[32]
Causal Diagrams for Epidemiologic Research
Greenland S, Pearl J, Robins JM. Causal Diagrams for Epidemiologic Research. Epidemiology. 1999;10(1):37–48. doi: 10.1097/00001648- 199901000-00008
1999 doi
-
[33]
Strategies for composite estimands in confirmatory clinical trials: Examples from trials in nasal polyps and steroid reduction
Keene ON. Strategies for composite estimands in confirmatory clinical trials: Examples from trials in nasal polyps and steroid reduction. Pharmaceutical Statistics. 2018;18(1):78–84. doi: 10.1002/pst.1909
2018 doi
-
[34]
Translating questions to estimands in randomized clinical trials with intercurrent events
Stensrud MJ, Dukes O. Translating questions to estimands in randomized clinical trials with intercurrent events. Statistics in Medicine. 2022;41(16):3211–3228. doi: 10.1002/sim.9398
2022 doi
-
[35]
Principal stratum strategy: Potential role in drug development.Pharmaceutical Statistics
Bornkamp B, Rufibach K, Lin J, et al. Principal stratum strategy: Potential role in drug development.Pharmaceutical Statistics. 2021;20(4):737–751. doi: 10.1002/pst.2104
2021 doi
-
[36]
Causal Inference and Estimands in Clinical Trials
Lipkovich I, Ratitch B, Mallinckrodt CH. Causal Inference and Estimands in Clinical Trials. Statistics in Biopharmaceutical Research. 2020;12(1):54–67. doi: 10.1080/19466315.2019.1697739
2020
-
[37]
https://psiweb.org/docs/default-source/default-document-library/daniel-scharfstein-slides.pdf?sfvrsn=28c8dedb_ 0.; 2017
Estimands and Causal Inference. https://psiweb.org/docs/default-source/default-document-library/daniel-scharfstein-slides.pdf?sfvrsn=28c8dedb_ 0.; 2017. [Accessed 13Nov2024]
2017
-
[38]
Defining estimands in clinical trials: A unified procedure
Han S, Zhou X. Defining estimands in clinical trials: A unified procedure. Statistics in Medicine. 2023;42(12):1869–1887. doi: 10.1002/sim.9702
2023 doi
-
[39]
RoB 2: a revised tool for assessing risk of bias in randomised trials.BMJ
Sterne JAC, Savovi´c J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials.BMJ. 2019:l4898. doi: 10.1136/bmj.l4898
2019 doi
-
[40]
Per-Protocol Analyses of Pragmatic Trials
Hernán MA, Robins JM. Per-Protocol Analyses of Pragmatic Trials. New England Journal of Medicine. 2017;377(14):1391–1398. doi: 10.1056/nejmsm1605385
2017 doi
-
[41]
Wiley, 2019
Higgins JP, Thomas J, Chandler J, et al., eds.Cochrane Handbook for Systematic Reviews of Interventions. Wiley, 2019
2019
-
[42]
Adherence, per-protocol effects, and the estimands framework
Keene O. Adherence, per-protocol effects, and the estimands framework. Pharmaceutical Statistics. 2023;22(6):1141–1144. doi: 10.1002/pst.2326
2023 doi
-
[43]
Principles for Defining Estimands in Clinical Trials—A Proposal
Mütze T, Bell J, Englert S, et al. Principles for Defining Estimands in Clinical Trials—A Proposal. Pharmaceutical Statistics. 2024. doi: 10.1002/pst.2432
2024 doi
-
[44]
The attributable estimand: A new approach to account for intercurrent events.Pharmaceutical Statistics
Darken P, Nyberg J, Ballal S, Wright D. The attributable estimand: A new approach to account for intercurrent events.Pharmaceutical Statistics. 2020;19(5):626–635. doi: 10.1002/pst.2019
2020 doi
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.