Pith. sign in

REVIEW 3 major objections 7 minor 79 references

Subgroups built only from pretreatment covariates give statistically indistinguishable held-out utilities across algorithms, while targeting different patients; the paper concludes method choice should rest on interpretability and allocatio

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

T0 review · deepseek-v4-flash

2026-08-01 14:01 UTC pith:D2Q7QS6L

load-bearing objection A methodologically careful negative result: clustering choices barely move held-out utility but substantially change who gets targeted; the missing piece is sensitivity analysis for unmeasured confounding. the 3 major comments →

arxiv 2607.26521 v1 pith:D2Q7QS6L submitted 2026-07-29 cs.LG

From Unsupervised Subgroups to Hypothetical State-Intervention Policies: An Evaluation of Selected Subgrouping Methods in Observational Health Data

classification cs.LG
keywords unsupervised subgroup discoverybudget-constrained policy prioritizationdoubly robust policy evaluationobservational health datacausal discoveryfuzzy C-meansBayesian Gaussian mixturesstate-shift policy
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

This paper asks whether patient subgroups discovered only from pre-treatment characteristics—with no exposure, outcome, or estimated effect information—can serve as the units of a budget-constrained health policy. It runs five unsupervised clustering methods and one supervised treatment-effect-based tree through the same pipeline: cluster on pre-treatment covariates, rank clusters by predicted benefit times eligible size, allocate a 70% budget, and evaluate the fixed policy on a held-out cohort with a doubly robust estimator for a one-way risk-state shift. Across three risk-factor contrasts, estimated utilities are nearly equal: every paired 95% bootstrap confidence interval for policy-risk differences includes zero, and no pairwise comparison survives multiplicity adjustment. Yet the methods often prioritize substantially different individuals, with targeted-person overlap dropping to about 0.51 in one comparison. The paper's central conclusion is that, if this pattern holds, the choice of subgrouping algorithm should rest on interpretability, allocation composition, and stability rather than on point-estimated utility.

Core claim

The central claim is that phenotype-first subgroups can serve as interpretable policy units in observational data, with an important qualification: method choice does not materially change estimated aggregate policy value. In representative splits, the highest ungated utility point estimates were 0.799 for the BMI policy using a Bayesian Gaussian mixture, 0.735 for the glucose policy using hard or membership-weighted fuzzy C-means, and 0.775 for the smoking-history policy using K-means; the supervised treatment-effect-guided tree never consistently beat the unsupervised methods. Paired bootstrap comparisons on the same evaluation individuals gave confidence intervals that all included zero,

What carries the argument

The load-bearing machinery is the selective one-way state-shift policy combined with an intervention-specific doubly robust estimator. For a chosen budget, each subgroup receives a shift probability between 0 and 1: fully selected clusters get 1, unselected clusters get 0, and the boundary cluster gets the fraction of its eligible members covered. The evaluated score adds a propensity-weighted residual to the outcome-regression prediction, and is averaged over the overlap-restricted held-out cohort. Subgroup ranking is driven by the discovery-side 'gain'—estimated mean benefit times eligible cluster size—computed after clustering on pre-treatment covariates only, with the cluster rule frozen

Load-bearing premise

The estimates recover true policy risk only if, conditional on the covariates chosen via causal discovery, the untreated-state outcome is independent of the adverse-state indicator (no unmeasured confounding), positivity and consistency hold, and missingness is completely at random.

What would settle it

Run the same pipeline on a semi-synthetic version of the two cohorts with known individual treatment effects generated from a hidden confounder that affects both the state and the outcome. If any method with a clearly different allocation has true utility outside the other methods' bootstrap intervals, or if estimated utilities separate by more than the paired intervals, the paper's flat-surface conclusion fails in that setting.

Watch this falsifier. Get emailed when new claim-graph text bears on it.

If this is right

  • If method choice barely moves utility, then reported utility differences across algorithms should not drive deployment; decisions should weight subgroup interpretability, allocation composition, and stability across data splits.
  • Effect-guided subgroup construction is not guaranteed to improve budgeted policy utility even when it improves within-group effect homogeneity.
  • Safety gating is a value judgment: a conservative lower-confidence-bound gate can produce a no-shift policy, while partial pooling stays close to ungated allocation; the right choice depends on intervention risk.
  • Similar estimated utility does not imply similar targeting, so policy reports should include allocation-overlap metrics, not just mean utility.
  • All policy values are conditional on causal identification, so external, longitudinal, or prospective validation is required before deployment.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The fixed 70% budget is generous, making most policies resemble the shift-all-eligible reference; a lower budget, such as 20-30%, would likely widen utility differences and test whether the flat policy-value surface is an artifact of the abundant capacity.
  • If the flat surface persists across budgets, then the practical policy choice becomes distributional: since different algorithms select different patient sets, a decision-maker could choose among nearly equal policies using equity, clinical-profile, or implementation criteria.
  • The paper conditions on one causal graph; propagating uncertainty over the discovered graph into the policy-value intervals would broaden them and further weaken any apparent method differences, which is a natural next test.
  • Because the analysis uses complete cases only, informative missingness could bias all utilities; graph-aware imputation and re-running the comparisons would check whether the no-difference conclusion survives.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 7 minor

Summary. The paper proposes an end-to-end framework for constructing budget-constrained, hypothetical state-shift policies from unsupervised subgroups that are defined on pre-treatment covariates, and evaluates it on PIMA (BMI and glucose contrasts) and NHANES (smoking-history contrast). The subgrouping methods compared are K-means, three FCM variants, Bayesian GMM, and a supervised CATE-tree comparator; policies are formed under ungated allocation, an Empirical Bernstein safety gate, or hierarchical Bayesian pooling. The central empirical claim is that methods with statistically indistinguishable held-out doubly robust utilities can nevertheless prioritize substantially different individuals, and that no subgrouping algorithm consistently dominates in paired bootstrap comparisons after Holm adjustment.

Significance. If the result holds, the paper makes a practically useful point: when aggregate policy utilities are flat across subgrouping algorithms, method choice should be driven by subgroup interpretability, allocation composition, and stability. The evaluation design has genuine strengths: a discovery/evaluation split, a cross-fitted doubly robust estimator (Eq. 42–44), paired bootstrap comparisons on common resamples, Holm multiplicity adjustment, multiple split seeds, and unusually explicit caveats about causal assumptions. The tables are internally consistent (utility = 1 − risk throughout), and the paper does not oversell point-estimate leaders. However, the headline claim that subgroups are constructed 'without using exposure, outcome, or estimated treatment-effect information' is weakened by an upstream causal-discovery covariate-selection step that appears to use the full dataset, and the central flat-utility conclusion is not accompanied by a sensitivity analysis for unmeasured confounding or informative missingness.

major comments (3)
  1. [§0.2, Algorithm 1 Step 1, Abstract] The causal-discovery-informed covariate selection appears to be performed before the discovery/evaluation split and uses the outcome variable (e.g., diabetes status, sleep disturbance) to infer the graph from which clustering and adjustment variables are chosen. The split described in §0.10 protects the clustering and ranking steps but not this upstream step. Thus the abstract's claim that subgroups are built 'without using exposure, outcome, or estimated treatment-effect information' is overstated, and the construction-to-evaluation chain is not fully non-circular. Please either re-run the CSD/domain selection using only the discovery cohort, or provide a sensitivity analysis demonstrating that the selected covariate and adjustment sets are stable under discovery-only estimation, and qualify the wording of the claim.
  2. [§0.5, Eqs. 40–44; Limitations] All reported utilities and the central flat-utility conclusion pass through the doubly robust estimator in Eqs. 40–44, whose identification relies on conditional exchangeability given L, positivity, consistency, and—because of complete-case analysis—MCAR. The paper explicitly acknowledges these assumptions but provides no sensitivity analysis quantifying how strong unmeasured confounding or informative missingness would need to be to change the cross-method comparisons. Since different policies place different shift probabilities on different clusters, the bias from a shared inadequate adjustment set would not be constant across policies, so the observed flat utility surface could in principle be an artifact of that shared misspecification. A concrete sensitivity analysis (e.g., E-values or latent-confounder perturbation) is needed to make the empirical claim robust.
  3. [§0.4.1, Eqs. 21–22] The effective-sample-size adaptation of the Empirical Bernstein bound for weighted FCM is explicitly acknowledged to be 'rather than an exact application' and is interpreted as a conservative admission score. That is a reasonable practical choice, but the earlier statement that the collection of bounds 'is intended to hold simultaneously with probability at least 1−δ' is not guaranteed under the weighted effective-sample-size modification. The paper should state clearly that the family-wise error guarantee applies only to the unweighted hard-assignment case, and that the weighted version is an approximation whose operating characteristics are not formally established.
minor comments (7)
  1. [§0.2] Typos and grammar: 'the figure 2 shows', 'the graph learnt', and similar informal phrasing appear; please standardize to formal journal style.
  2. [§0.5, Eq. 44] The augmentation term in Eq. 44 is not derived. A short derivation or an explicit statement of the relevant result in Wen et al. (2023) would help readers verify that this score is doubly robust for the selective one-way shift estimand under the stated nuisance-model conditions.
  3. [§0.13–0.15, Tables 3, 8, 13] The term 'utility' is used for 1 − risk, which is a risk complement rather than an economic utility. Please clarify once that no cost or benefit beyond the outcome is modeled, so 'utility' should not be read as a welfare measure.
  4. [Table 13] The FCM weighted EB-gated variant has a slightly higher point utility (0.7715) than the corresponding ungated policy (0.7714), which is an exception to the general statement that EB gating is always more conservative. The text describing this table should acknowledge this exception explicitly.
  5. [§0.17, Figures 13–18] The split-seed sensitivity analysis uses only four seeds. Given the small datasets and the known instability of clustering solutions, four seeds is a limited check; the paper should state that this is exploratory and not a formal stability guarantee.
  6. [Algorithm 1, Step 8] The random boundary-cluster selection introduces an additional source of allocation variability, but the overlap metrics are computed from realized binary selections. The paper should state whether the reported overlaps are averaged over boundary-selection seeds, and how sensitive the Jaccard values are to this random draw.
  7. [General] No code or detailed data-availability statement is provided. Making the analysis code and preprocessing scripts available would materially improve reproducibility, especially for the exact MCA dimension retention and the CSD ensemble construction.

Circularity Check

0 steps flagged

No significant circularity: subgroup construction is separated from benefit estimation and held-out evaluation by explicit discovery/evaluation splits.

full rationale

The paper's derivation chain is deliberately anti-circular: clustering is fit only on pre-treatment covariates in the discovery cohort (Algorithm 1, Steps 4-5), benefit scores are computed afterward and only for ranking (Step 6), and the policy is frozen before being evaluated on the held-out evaluation cohort with a separate doubly robust estimator (Steps 8-9). The evaluation utilities in Tables 3, 8, and 13 are not algebraic transforms of the discovery-side benefit scores; they are computed from out-of-sample pseudo-outcomes with cross-fitted nuisance functions. Eq. 40-45 identify the policy risk under explicit conditional exchangeability, positivity, and consistency assumptions; this is an identifying assumption, not a tautology. The paper repeatedly flags the dependence of its conclusions on the adequacy of the adjustment set and on the absence of unmeasured confounding, and it explicitly treats the causal-discovered graphs as 'potential causal structures' rather than confirmed graphs. The reuse of the authors' prior CSD procedure (ref [11]) provides the adjustment set but is not a derivation that reduces the central claim to its own input; it is an external methodological dependency that the paper discloses. The null pairwise comparisons and flat utility surface are empirical findings, not consequences of equation substitution. No step was found in which a prediction is equivalent by construction to a fitted parameter or in which the load-bearing argument reduces to a self-citation.

Axiom & Free-Parameter Ledger

8 free parameters · 8 axioms · 0 invented entities

The central claim leans on a standard observational-causal stack the paper itself enumerates: conditional exchangeability given the graph-informed adjustment set, positivity (trimmed), consistency/no-interference, and MCAR for complete cases. Two pipeline choices carry much of the weight: the adequacy of the adjustment set derived from the self-cited ensemble causal-discovery procedure (ref [11]), and the logistic-GLM benefit model that generates cluster rankings. Hand-chosen constants (K via silhouette, m=1.7, q=0.70, π0=0.90, δ=0.05, α=0.05, 7 MCA dimensions) set the granularity and conservatism of every comparison. No new entities are postulated; the state shift is a target estimand, not a mechanism.

free parameters (8)
  • Number of clusters K = K=3 (BMI), 4 (glucose), 6 (smoking)
    Selected by maximizing K-means silhouette on the discovery cohort only; held fixed across methods. Data-dependent choice shaping subgroup granularity and all downstream comparisons (Table 1).
  • FCM fuzziness parameter m = 1.7
    Fixed a priori from the fuzzy-clustering literature (range 1.5-2.5), stated as untuned; affects membership weights and soft benefit summaries (Eq. 4, 9-11).
  • Intervention budget q = 0.70
    Hand-chosen standardized capacity constraint; the paper notes it is not clinically optimized and that results may change under other budgets (§0.9).
  • Bayesian gate threshold π0 = 0.90
    Hand-chosen posterior probability threshold for cluster admission (Eq. 32-34).
  • EB gate total error δ = 0.05
    Standard choice; allocated Bonferroni-style as δ/K across clusters (Eq. 21-22).
  • Overlap trimming α = 0.05
    Propensity trimming threshold defining the evaluation population (Eq. 43); alters the estimand to the overlap-restricted population.
  • Retained MCA dimensions (NHANES) = 7
    Selected via Greenacre-adjusted inertia (Benzécri-Greenacre correction); the Euclidean representation affects all NHANES clustering results (§0.1).
  • Hierarchical prior hyperparameters = σ_μ, σ_τ, ν (weakly informative)
    Normal and Half-Student-t priors on the pooling gate (Eq. 29-30); weakly informative, listed for completeness.
axioms (8)
  • domain assumption Conditional exchangeability: potential outcomes under the lower-risk state are independent of observed state given the adjustment set L (no unmeasured confounding)
    Entered at Eq. 40-41 identifying R(πq); the paper's Limitations section explicitly conditions all utility estimates on this and on the adequacy of the causal-discovered adjustment set.
  • domain assumption Positivity/overlap of the state probability within the adjustment set (trimmed at α=0.05)
    Required for the propensity-weighted DR score (Eq. 43-44); the evaluation target is redefined to the overlap-restricted population.
  • domain assumption Consistency and no interference of the hypothetical state shift
    Stated at Eq. 39-40 and in Limitations; the state shift from T=1 to T=0 maps to defined potential outcomes.
  • domain assumption Missing Completely At Random for complete-case analysis
    Admitted in Limitations: restricting to complete cases imposes MCAR and may induce selection bias.
  • domain assumption The ensemble causal-discovery graphs (data-driven + domain-augmented) identify plausible pretreatment covariates and adjustment variables
    Causal discovery (ref [11] procedure) is a design-stage input treated as fixed; the paper explicitly treats graphs as 'only potential causal structures,' not confirmed graphs (§0.2, Fig. 3).
  • domain assumption Benefit scores from logistic GLMs adequately approximate the state-contrast (no unmodeled nonlinear response patterns)
    Step 3 of Algorithm 1; flagged as a limitation citing Maronge et al. — nonlinearity could distort rankings.
  • ad hoc to paper Effective-sample-size adaptation of the empirical-Bernstein bound behaves as a conservative admission score
    Acknowledged in §0.4.1 as 'not an exact application of the original theorem'; the gate's decisions (e.g., glucose EB → no-shift) depend on this approximation.
  • domain assumption Hardening rules (max-membership, MAP, or stochastic sampling) map fuzzy/probabilistic clusters to operational decisions
    FCM weighted variant uses soft estimates with hard deployment (Eq. 10 vs 13), an estimation-deployment mismatch the authors flag as an important limitation.

pith-pipeline@v1.3.0-daily-deepseek · 35903 in / 18720 out tokens · 171399 ms · 2026-08-01T14:01:09.798538+00:00 · methodology

0 comments
read the original abstract

Conventional subgroup analyses can yield unstable and difficult-to-interpret conclusions, especially in observational biomedical data where each individual is observed under only one exposure state, true individual treatment effects are unavailable, and causal structure is uncertain. We investigate whether subgroups constructed from pretreatment characteristics, without using exposure, outcome, or estimated treatment-effect information, can serve as interpretable units for budget-constrained policy prioritization. We propose a framework combining causal-discovery-informed covariate selection, discovery-evaluation sample splitting, inductive unsupervised clustering, uncertainty-aware subgroup selection, and held-out doubly robust policy evaluation. We compare K-means, hard, membership-weighted, and stochastic Fuzzy C-means, Bayesian Gaussian mixture models, and a supervised causal-forest-derived CATE-tree comparator. Policies are evaluated under a 70% budget for hypothetical obesity-to-non-obesity and elevated-to-lower-glucose state shifts in the PIMA Indians Diabetes dataset and for a lifetime-smoking-history contrast in NHANES. The highest estimated ungated utilities were 0.799 for the BMI policy using Bayesian GMM, 0.735 for the glucose policy using hard or membership-weighted FCM, and 0.775 for the smoking-history policy using K-means. All paired 95% confidence intervals for policy-risk differences included zero, and no comparison remained statistically significant after Holm adjustment. Bayesian pooling generally preserved ungated allocations, whereas Empirical Bernstein gating was more conservative. Policies with similar estimated utility could nevertheless prioritize different individuals. The findings should be interpreted as assumption-dependent decision-support evidence for hypothetical state contrasts rather than proof of intervention benefit.

Figures

Figures reproduced from arXiv: 2607.26521 by Bulent Yener, Vasundhara Acharya.

Figure 1
Figure 1. Figure 1: Discovery and evaluation sample sizes for the representative discovery–evaluation split used in the main analysis. Eligible discovery and eligible evaluation counts denote individuals in the adverse or modifiable state for the corresponding hypothetical shift. Eligible counts may vary slightly across alternative split seeds. 0.10 Discovery/Evaluation Split A discovery–evaluation split is implemented to red… view at source ↗
Figure 2
Figure 2. Figure 2: NHANES: Representative outputs of the ensemble causal-structure discovery procedure used for pretreatment covariate selection. The figure is included to illustrate the causal-structure discovery workflow used for pretreatment covariate selection in the present policy-learning pipeline. Representative PC, hill-climbing (BDeu), and FGES graphs compared to our preliminary weighted ensemble (bottom-left). Fina… view at source ↗
Figure 3
Figure 3. Figure 3: PIMA: (A) Weighted ensemble causal graph learned from observational data , with edge labels denoting composite confidence. (B) Constraint-corrected ensemble graph obtained by post-processing (A) to enforce basic clinical ordering constraints (such as Age has no parents and Outcome has no children). The ensemble recovers several clinically plausible relations (e.g., BMI→SkinThickness and Glucose→Insulin), b… view at source ↗
Figure 4
Figure 4. Figure 4: Glucose Policy: Summary of representative-split held-out policy utility. For each subgrouping method, the highest observed held-out utility in the representative discovery–evaluation split is displayed. Points denote estimated policy utility, and horizontal bars denote bootstrap 95% confidence intervals. Open diamonds denote the no-shift and shift-all-eligible reference policies. An open square identifies … view at source ↗
Figure 5
Figure 5. Figure 5: Glucose policy: Paired bootstrap comparisons of held-out full-population policy risk. The dashed line denotes zero difference. Holm-adjusted p-values are shown in the right-hand column. All confidence intervals included zero, and no comparison remained statistically detectable after Holm adjustment [PITH_FULL_IMAGE:figures/full_fig_p018_5.png] view at source ↗
Figure 6
Figure 6. Figure 6: BMI Policy: Summary of representative-split held-out policy utility. For each subgrouping method, the highest observed held-out utility in the representative discovery–evaluation split is displayed. Points denote estimated policy utility, and horizontal bars denote bootstrap 95% confidence intervals. Open diamonds denote the no-shift and shift-all-eligible reference policies. An open square identifies the … view at source ↗
Figure 7
Figure 7. Figure 7: BMI policy: Paired bootstrap comparisons of held-out full-population policy risk. Points show paired risk differences, defined as Policy A risk minus Policy B risk, and horizontal bars show paired 95% bootstrap confidence intervals. The dashed line denotes zero difference. Holm-adjusted p-values are shown in the right-hand column. All confidence intervals included zero, and no comparison remained statistic… view at source ↗
Figure 8
Figure 8. Figure 8: Smoking Policy: Summary of representative-split held-out policy utility. For each subgrouping method, the highest observed held-out utility in the representative discovery–evaluation split is displayed. Points denote estimated policy utility, and horizontal bars denote bootstrap 95% confidence intervals. Open diamonds denote the no-shift and shift-all-eligible reference policies. An open square identifies … view at source ↗
Figure 9
Figure 9. Figure 9: Smoking policy: Paired bootstrap comparisons of held-out policy risk. The dashed line denotes zero difference. Holm-adjusted p-values are shown in the right-hand column. All confidence intervals included zero, and no comparison remained statistically detectable after Holm adjustment [PITH_FULL_IMAGE:figures/full_fig_p021_9.png] view at source ↗
Figure 11
Figure 11. Figure 11: BMI policy: Paired bootstrap comparisons of the supervised CATE-tree policy with the unsupervised subgroup policies. The dashed vertical line denotes no risk difference. All confidence intervals included zero, and none of the supervised-versus-unsupervised comparisons was statistically significant after multiplicity adjustment [PITH_FULL_IMAGE:figures/full_fig_p022_11.png] view at source ↗
Figure 12
Figure 12. Figure 12: Smoking policy: Paired bootstrap comparisons of the supervised CATE-tree policy with the unsupervised subgroup policies. The dashed vertical line denotes no risk difference. All confidence intervals included zero, and none of the supervised-versus-unsupervised comparisons was statistically significant after multiplicity adjustment. 22/41 [PITH_FULL_IMAGE:figures/full_fig_p022_12.png] view at source ↗
Figure 13
Figure 13. Figure 13: Glucose Policy:Split-seed sensitivity of policy utility across four discovery/evaluation splits for the glucose policy experiment. Bars show the mean held-out policy utility across split seeds, and horizontal error bars show standard deviation across seeds. The ungated unsupervised subgrouping methods produced similar mean utilities, with K-means, weighted FCM, and Bayesian GMM yielding the highest mean v… view at source ↗
Figure 14
Figure 14. Figure 14: Glucose policy: Visual summary of the mean pairwise Jaccard overlap among the fixed ungated subgroup policies across the examined discovery–evaluation split seeds. Cells report the mean Jaccard overlap, with the standard deviation shown below the mean. The diagonal equals one by definition [PITH_FULL_IMAGE:figures/full_fig_p030_14.png] view at source ↗
Figure 15
Figure 15. Figure 15: BMI policy : Split-seed sensitivity of held-out policy utility across four discovery/evaluation splits. Bars show the mean policy utility across split seeds, and horizontal error bars show the standard deviation across seeds. The ungated unsupervised subgrouping methods produced broadly similar utilities, while Bayesian GMM achieved the highest mean utility among the evaluated methods. Bayesian pooling cl… view at source ↗
Figure 16
Figure 16. Figure 16: BMI policy: Visual summary of the mean pairwise Jaccard overlap among the fixed ungated subgroup policies across four discovery–evaluation split seeds. Cells report the mean overlap, with the standard deviation shown below the mean. The diagonal equals one by definition [PITH_FULL_IMAGE:figures/full_fig_p031_16.png] view at source ↗
Figure 17
Figure 17. Figure 17: Smoking-history policy : Split-seed sensitivity of held-out policy utility across four discovery/evaluation splits. Bars show the mean policy utility across split seeds, and horizontal error bars show the standard deviation across seeds.The ungated unsupervised methods produced broadly similar mean utilities, with K-means attaining the highest mean utility, closely followed by hard and stochastic FCM . Ba… view at source ↗
Figure 18
Figure 18. Figure 18: Smoking-history policy: Visual summary of the mean pairwise Jaccard overlap among the fixed ungated subgroup policies across the examined discovery–evaluation split seeds. Cells report the mean Jaccard overlap, with the standard deviation shown below the mean. The diagonal equals one by definition [PITH_FULL_IMAGE:figures/full_fig_p033_18.png] view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

79 extracted references · 5 linked inside Pith

  1. [1]

    & Imbens, G

    Athey, S. & Imbens, G. Recursive partitioning for heterogeneous causal effects.Proc. Natl. Acad. Sci.113, 7353–7360 (2016)

  2. [2]

    & Athey, S

    Wager, S. & Athey, S. Estimation and inference of heterogeneous treatment effects using random forests.J. Am. Stat. Assoc.113, 1228–1242 (2018). 3.Holland, P. W. Statistics and causal inference.J. Am. statistical Assoc.81, 945–960 (1986). 4.Hill, J. L. Bayesian nonparametric modeling for causal inference.J. Comput. Graph. Stat.20, 217–240 (2011)

  3. [5]

    Shalit, U., Johansson, F. D. & Sontag, D. Estimating individual treatment effect: generalization bounds and algorithms. InInternational conference on machine learning, 3076–3085 (PMLR, 2017)

  4. [6]

    R., Sekhon, J

    Künzel, S. R., Sekhon, J. S., Bickel, P. J. & Yu, B. Metalearners for estimating heterogeneous treatment effects using machine learning.Proc. national academy sciences116, 4156–4165 (2019)

  5. [7]

    C., Taylor, J

    Foster, J. C., Taylor, J. M. & Ruberg, S. J. Subgroup identification from randomized clinical trial data.Stat. medicine30, 2867–2880 (2011)

  6. [8]

    Lindeman, N. I.et al.Updated molecular testing guideline for the selection of lung cancer patients for treatment with targeted tyrosine kinase inhibitors: guideline from the college of american pathologists, the international association for the study of lung cancer, and the association for molecular pathology.Arch. pathology & laboratory medicine142, 321...

  7. [9]

    Sepulveda, A. R.et al.Molecular biomarkers for the evaluation of colorectal cancer: guideline from the american society for clinical pathology, college of american pathologists, association for molecular pathology, and american society of clinical oncology.Am. journal clinical pathology147, 221–260 (2017)

  8. [10]

    C., Louis, T

    Henderson, N. C., Louis, T. A., Wang, C. & Varadhan, R. Bayesian analysis of heterogeneous treatment effects for patient-centered outcomes research.Heal. Serv. Outcomes Res. Methodol.16, 213–233 (2016)

  9. [11]

    Acharya, V ., Yener, B., Fields, M. C. & Marcuse, L. V . Understanding the impact of epilepsy and depression on sleep disorder: Beyond associations. In2025 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), 1–7 (IEEE, 2025)

  10. [12]

    M., Rothwell, P

    Kent, D. M., Rothwell, P. M., Ioannidis, J. P., Altman, D. G. & Hayward, R. A. Assessing and reporting heterogeneity in treatment effects in clinical trials: a proposal.Trials11, 85 (2010)

  11. [13]

    J., Hayward, R

    Dahabreh, I. J., Hayward, R. & Kent, D. M. Using group data to treat individuals: understanding heterogeneous treatment effects in the age of precision medicine and patient-centred evidence.Int. journal epidemiology45, 2184–2193 (2016)

  12. [14]

    & Fernandez-Val, I

    Chernozhukov, V ., Demirer, M., Duflo, E. & Fernandez-Val, I. Generic machine learning inference on heterogeneous treatment effects in randomized experiments, with an application to immunization in india. Tech. Rep., National Bureau of Economic Research (2018)

  13. [15]

    & Kennedy, E

    Kim, K., Kim, J. & Kennedy, E. H. Causal k-means clustering.J. Royal Stat. Soc. Ser. B: Stat. Methodol.qkag068 (2026)

  14. [16]

    & Yang, S

    Wang, Z., Ayer, T. & Yang, S. Causal clustering for conditional average treatment effects estimation and subgroup discovery. In2025 IEEE EMBS International Conference on Biomedical and Health Informatics (BHI), 1–11 (IEEE, 2025)

  15. [17]

    Bellavia, A.et al.Unsupervised clustering approach to assess heterogeneity of treatment effects across patient phenotypes in randomized clinical trials.Contemp. Clin. Trials148, 107778 (2025)

  16. [18]

    Sinha, P.et al.Comparison of machine learning clustering algorithms for detecting heterogeneity of treatment effect in acute respiratory distress syndrome: a secondary analysis of three randomised controlled trials.EBioMedicine74(2021)

  17. [19]

    K.et al.Identification of acute kidney injury subphenotypes with differing molecular signatures and responses to vasopressin therapy.Am

    Bhatraju, P. K.et al.Identification of acute kidney injury subphenotypes with differing molecular signatures and responses to vasopressin therapy.Am. journal respiratory critical care medicine199, 863–872 (2019)

  18. [20]

    Zampieri, F. G.et al.Heterogeneous effects of alveolar recruitment in acute respiratory distress syndrome: a machine learning reanalysis of the alveolar recruitment for acute respiratory distress syndrome trial.Br. journal anaesthesia123, 88–95 (2019)

  19. [21]

    & Meir, R

    Derbeko, P., El-Yaniv, R. & Meir, R. Explicit learning curves for transduction and application to clustering and compression algorithms.J. Artif. Intell. Res.22, 117–142 (2004)

  20. [22]

    & Terami, A

    Miyamoto, S. & Terami, A. Inductive vs. transductive clustering using kernel functions and pairwise constraints. In2011 11th International Conference on Intelligent Systems Design and Applications, 1258–1264 (IEEE, 2011). 38/41

  21. [23]

    neural information processing systems16(2003)

    Bengio, Y .et al.Out-of-sample extensions for lle, isomap, mds, eigenmaps, and spectral clustering.Adv. neural information processing systems16(2003)

  22. [24]

    & Al-Khassaweneh, M

    Stewart, G. & Al-Khassaweneh, M. An implementation of the hdbscan* clustering algorithm.Appl. Sci.12, 2405 (2022). 25.Nie, X. & Wager, S. Quasi-oracle estimation of heterogeneous treatment effects.Biometrika108, 299–319 (2021)

  23. [26]

    R., Murray, J

    Hahn, P. R., Murray, J. S. & Carvalho, C. M. Bayesian regression tree models for causal inference: Regularization, confounding, and heterogeneous effects (with discussion).Bayesian Analysis15, 965–1056 (2020). 27.Souto, H. G. & Neto, F. L. K-fold causal bart for cate estimation.arXiv preprint arXiv:2409.05665(2024)

  24. [28]

    & Van Der Laan, M

    Bibaut, A., Malenica, I., Vlassis, N. & Van Der Laan, M. More efficient off-policy evaluation through regularized targeted learning. InInternational Conference on Machine Learning, 654–663 (PMLR, 2019). 29.Athey, S. & Wager, S. Policy learning with observational data.Econometrica89, 133–161 (2021)

  25. [30]

    & Robins, J

    Bang, H. & Robins, J. M. Doubly robust estimation in missing data and causal inference models.Biometrics61, 962–973 (2005). 31.Dudík, M., Langford, J. & Li, L. Doubly robust policy evaluation and learning.arXiv preprint arXiv:1103.4601(2011)

  26. [32]

    & Tetenov, A

    Kitagawa, T. & Tetenov, A. Who should be treated? empirical welfare maximization methods for treatment choice. Econometrica86, 591–616 (2018)

  27. [33]

    & Zhou, Z

    Kallus, N., Mao, X., Wang, K. & Zhou, Z. Doubly robust distributionally robust off-policy evaluation and learning. In International Conference on Machine Learning, 10598–10632 (PMLR, 2022)

  28. [34]

    & Ghavamzadeh, M

    Thomas, P., Theocharous, G. & Ghavamzadeh, M. High-confidence off-policy evaluation. InProceedings of the AAAI Conference on Artificial Intelligence, vol. 29 (2015)

  29. [35]

    & Wang, Z

    Jin, Y ., Ren, Z., Yang, Z. & Wang, Z. Policy learning “without” overlap: Pessimism and generalized empirical bernstein’s inequality.The Annals Stat.53, 1483–1512 (2025)

  30. [36]

    F., Cole, S

    Schisterman, E. F., Cole, S. R. & Platt, R. W. Overadjustment bias and unnecessary adjustment in epidemiologic studies. Epidemiology20, 488–495 (2009). 37.VanderWeele, T. J. Principles of confounder selection: Tj vanderweele.Eur. journal epidemiology34, 211–219 (2019)

  31. [38]

    Hernán, M. A. & Taubman, S. L. Does obesity shorten life? the importance of well-defined interventions to answer causal questions.Int. journal obesity32, S8–S14 (2008)

  32. [39]

    & Shen, Q

    Su, P., Shang, C. & Shen, Q. A hierarchical fuzzy cluster ensemble approach and its application to big data clustering.J. Intell. & Fuzzy Syst.28, 2409–2421 (2015)

  33. [40]

    W., Everhart, J

    Smith, J. W., Everhart, J. E., Dickson, W. C., Knowler, W. C. & Johannes, R. S. Using the adap learning algorithm to forecast the onset of diabetes mellitus. InProceedings of the annual symposium on computer application in medical care, 261 (1988). 41.Greenacre, M. J.Theory and Applications of Correspondence Analysis(Academic Press, 1984)

  34. [42]

    Greenacre, M. J. & Blasius, J. (eds.)Multiple Correspondence Analysis and Related Methods(Chapman and Hall/CRC, 2006). 43.Abdi, H. & Valentin, D. Multiple correspondence analysis.Encycl. Meas. Stat.(2007)

  35. [44]

    & Meulman, J

    Lombardo, R. & Meulman, J. J. Multiple correspondence analysis via polynomial transformations of ordered categorical variables.J. Classif.27, 191–210 (2010)

  36. [45]

    & Greenacre, M

    Nenadi´c, O. & Greenacre, M. Correspondence analysis in r, with two- and three-dimensional graphics: The ca package.J. Stat. Softw.20, 1–13 (2007)

  37. [46]

    Florensa, D.et al.Use of multiple correspondence analysis and k-means to explore associations between risk factors and likelihood of colorectal cancer: Cross-sectional study.J. Med. Internet Res.24, e29056 (2022)

  38. [47]

    S., Santos, N

    Costa, P. S., Santos, N. C., Cunha, P., Cotter, J. & Sousa, N. The use of multiple correspondence analysis to explore associations between categories of qualitative variables in healthy ageing.J. aging research2013, 302163 (2013)

  39. [48]

    clinical epidemiology63, 638–646 (2010)

    Sourial, N.et al.Correspondence analysis is a useful tool to uncover the relationships among categorical variables.J. clinical epidemiology63, 638–646 (2010)

  40. [49]

    Violán, C.et al.Multimorbidity patterns with k-means nonhierarchical cluster analysis.BMC family practice19, 108 (2018). 39/41

  41. [50]

    Hwang, H., Dillon, W. R. & Takane, Y . An extension of multiple correspondence analysis for identifying heterogeneous subgroups of respondents.Psychometrika71, 161–171 (2006)

  42. [51]

    & van der Schaar, M

    Kyono, T., Zhang, Y ., Bellot, A. & van der Schaar, M. Miracle: Causally-aware imputation via learning missing data mechanisms. InConference on Neural Information Processing Systems(NeurIPS) 2021(2021)

  43. [52]

    An anytime algorithm for causal inference

    Spirtes, P. An anytime algorithm for causal inference. InInternational Workshop on Artificial Intelligence and Statistics, 278–285 (PMLR, 2001)

  44. [53]

    & Xing, E

    Zheng, X., Dan, C., Aragam, B., Ravikumar, P. & Xing, E. Learning sparse nonparametric dags. InInternational conference on artificial intelligence and statistics, 3414–3425 (Pmlr, 2020)

  45. [54]

    & Textor, J

    Ankan, A. & Textor, J. A simple unified approach to testing high-dimensional conditional independences for categorical and ordinal data. InProceedings of the AAAI Conference on Artificial Intelligence, vol. 37, 12180–12188 (2023)

  46. [55]

    M., Peters, J

    Hoyer, P., Janzing, D., Mooij, J. M., Peters, J. & Schölkopf, B. Nonlinear causal discovery with additive noise models. Adv. neural information processing systems21(2008)

  47. [56]

    cardiovascular medicine9, 939103 (2022)

    Cheng, W.et al.Age-related changes in the risk of high blood pressure.Front. cardiovascular medicine9, 939103 (2022)

  48. [57]

    journal endocrinology175, R231–R245 (2016)

    Li, P.et al.Mechanisms in endocrinology: parity and risk of type 2 diabetes: a systematic review and dose-response meta-analysis.Eur. journal endocrinology175, R231–R245 (2016)

  49. [58]

    Ruiz-Alejos, A.et al.Skinfold thickness and the incidence of type 2 diabetes mellitus and hypertension: an analysis of the peru migrant study.Public health nutrition23, 63–71 (2020)

  50. [59]

    A., Anderson, S

    Emdin, C. A., Anderson, S. G., Woodward, M. & Rahimi, K. Usual blood pressure and risk of new-onset diabetes: evidence from 4.1 million adults and a meta-analysis of prospective studies.J. Am. Coll. Cardiol.66, 1552–1562 (2015)

  51. [60]

    K., Lee, H

    Fazeli, P. K., Lee, H. & Steinhauser, M. L. Aging is a powerful risk factor for type 2 diabetes mellitus independent of body mass index.Gerontology66, 209–210 (2020)

  52. [61]

    & Glymour, C

    Spirtes, P. & Glymour, C. An algorithm for fast recovery of sparse causal graphs.Soc. science computer review9, 62–72 (1991)

  53. [62]

    & Peng, J

    Wang, R. & Peng, J. Learning directed acyclic graphs via bootstrap aggregating.arXiv preprint arXiv:1406.2098(2014)

  54. [63]

    & Glymour, C

    Ramsey, J., Glymour, M., Sanchez-Romero, R. & Glymour, C. A million variables and more: the fast greedy equivalence search algorithm for learning high-dimensional graphical causal models, with an application to functional magnetic resonance images.Int. journal data science analytics3, 121–129 (2017)

  55. [64]

    Some methods for classification and analysis of multivariate observations

    MacQueen, J. Some methods for classification and analysis of multivariate observations. InProceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability, vol. 1, 281–297 (University of California Press, 1967)

  56. [65]

    Dunn, J. C. A fuzzy relative of the isodata process and its use in detecting compact well-separated clusters.J. Cybern.3, 32–57 (1973). 66.Bezdek, J. C.Pattern Recognition with Fuzzy Objective Function Algorithms(Plenum Press, New York, 1981)

  57. [67]

    C., Ehrlich, R

    Bezdek, J. C., Ehrlich, R. & Full, W. Fcm: The fuzzy c-means clustering algorithm.Comput. & Geosci.10, 191–203, DOI: 10.1016/0098-3004(84)90020-7 (1984). 68.Wu, K.-L. Analysis of parameter selections for fuzzy c-means.Pattern Recognit.45, 407–415 (2012)

  58. [69]

    & Jensen, O

    Schwämmle, V . & Jensen, O. N. A simple and fast method to determine the parameters for fuzzy c–means cluster analysis. Bioinformatics26, 2841–2848 (2010). 70.Wu, Q., Zhu, Z. & Zhang, A. R. Statistical inference for fuzzy clustering (2026). 2601.02656

  59. [71]

    Zhao, Y .et al.Mapping phenotypic heterogeneity and cardiometabolic risk in obesity using a tree-based dimensionality reduction framework.J. Transl. Medicine24, 401 (2026)

  60. [72]

    Rasmussen, C. E. The infinite gaussian mixture model. InAdvances in Neural Information Processing Systems, vol. 12, 554–560 (MIT Press, 2000). 73.Blei, D. M. & Jordan, M. I. Variational inference for dirichlet process mixtures.Bayesian Analysis1, 121–144 (2006)

  61. [74]

    & Pontil, M

    Maurer, A. & Pontil, M. Empirical bernstein bounds and sample variance penalization.arXiv preprint arXiv:0907.3740 (2009)

  62. [75]

    & Yajima, M

    Gelman, A., Hill, J. & Yajima, M. Why we (usually) don’t have to worry about multiple comparisons.J. research on educational effectiveness5, 189–211 (2012). 40/41 76.Gelman, A. Prior distributions for variance parameters in hierarchical models.Bayesian Analysis1, 515–533 (2006)

  63. [77]

    Polson, N. G. & Scott, J. G. On the half-cauchy prior for a global scale parameter.Bayesian Analysis7, 887–902 (2012). 78.Morris, C. N. Parametric empirical bayes inference: Theory and applications.J. Am. Stat. Assoc.78, 47–55 (1983)

  64. [79]

    Wen, L., Marcus, J. L. & Young, J. G. Intervention treatment distributions that depend on the observed treatment process and model double robustness in causal survival analysis.Stat. methods medical research32, 509–523 (2023). 80.Purnell, J. Q. Definitions, classification, and epidemiology of obesity (2015). 81.Bansal, N. Prediabetes diagnosis and treatme...

  65. [82]

    W., Ware, J

    Wang, R., Lagakos, S. W., Ware, J. H., Hunter, D. J. & Drazen, J. M. Statistics in medicine—reporting of subgroup analyses in clinical trials.New Engl. J. Medicine357, 2189–2194 (2007). 83.Hall, P. & Wilson, S. R. Two guidelines for bootstrap hypothesis testing.Biometrics757–762 (1991). 84.Holm, S. A simple sequentially rejective multiple test procedure.S...

  66. [86]

    & Gensler, H

    Aickin, M. & Gensler, H. Adjusting for multiple testing when reporting research results: the bonferroni vs holm methods. Am. journal public health86, 726–728 (1996)

  67. [87]

    Étude comparative de la distribution florale dans une portion des alpes et des jura.Bull Soc Vaudoise Sci Nat 37, 547–579 (1901)

    Jaccard, P. Étude comparative de la distribution florale dans une portion des alpes et des jura.Bull Soc Vaudoise Sci Nat 37, 547–579 (1901)

  68. [88]

    Powers, D. M. Evaluation: from precision, recall and f-measure to roc, informedness, markedness and correlation.arXiv preprint arXiv:2010.16061(2020)

  69. [89]

    & Boulesteix, A.-L

    Ullmann, T., Hennig, C. & Boulesteix, A.-L. Validation of cluster analysis results on validation data: A systematic framework.Wiley Interdiscip. Rev. Data Min. Knowl. Discov.12, e1444 (2022)

  70. [90]

    C., Taylor, J

    Foster, J. C., Taylor, J. M. & Ruberg, S. J. Subgroup identification from randomized clinical trial data.Stat. medicine30, 2867–2880 (2011). 91.Pedregosa, F.et al.Scikit-learn: Machine learning in python.J. machine Learn. research12, 2825–2830 (2011). 92.Warner, J.et al.Jdwarner/scikit-fuzzy: Scikit-fuzzy 0.5. 0.Zenodo(2024). 93.Halford, M. Prince

  71. [94]

    https://github.com/py-why/EconML (2019)

    Battocchi, K.et al.EconML: A Python Package for ML-Based Heterogeneous Treatment Effects Estimation. https://github.com/py-why/EconML (2019). Version 0.x

  72. [95]

    Sci.9, DOI: 10.7717/peerj-cs.1516 (2023)

    Abril-Pla, O.et al.PyMC: A modern and comprehensive probabilistic programming framework in Python.PeerJ Comput. Sci.9, DOI: 10.7717/peerj-cs.1516 (2023). 96.Zheng, Y .et al.Causal-learn: Causal discovery in python.J. Mach. Learn. Res.25, 1–8 (2024). 97.Ankan, A. & Textor, J. Pgmpy: a python toolkit for bayesian networks.J. Mach. Learn. Res.25, 1–8 (2024)....

  73. [99]

    Goodman, L. A. Exploratory latent structure analysis using both identifiable and unidentifiable models.Biometrika61, 215–231 (1974)

  74. [100]

    Extensions to the k-means algorithm for clustering large data sets with categorical values.Data mining knowledge discovery2, 283–304 (1998)

    Huang, Z. Extensions to the k-means algorithm for clustering large data sets with categorical values.Data mining knowledge discovery2, 283–304 (1998)

  75. [101]

    Jama295, 1152–1160 (2006)

    Piaggio, G.et al.Reporting of noninferiority and equivalence randomized trials: an extension of the consort statement. Jama295, 1152–1160 (2006)

  76. [102]

    M., D HULING, J

    Maronge, J. M., D HULING, J. & Chen, G. A reluctant additive model framework for interpretable nonlinear individualized treatment rules.The annals applied statistics17, 3384 (2023)

  77. [103]

    & Veeramachaneni, K

    Zytek, A., Arnaldo, I., Liu, D., Berti-Equille, L. & Veeramachaneni, K. The need for interpretable features: Motivation and taxonomy.ACM SIGKDD Explor. Newsl.24, 1–13 (2022)

  78. [104]

    & Vichi, M

    Fordellone, M. & Vichi, M. Multiple correspondence k-means: simultaneous versus sequential approach for dimension reduction and clustering. InData Science and Social Research: Epistemology, Methods, Technology and Applications, 81–95 (Springer, 2017)

  79. [105]

    & Livny, M

    Zhang, T., Ramakrishnan, R. & Livny, M. Birch: an efficient data clustering method for very large databases.ACM sigmod record25, 103–114 (1996). 41/41