Pith. sign in

REVIEW 4 major objections 4 minor 13 references

Nonlinear Causal Discovery for Grouped Data

T0 review · 4 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read The causal graph of a grouped additive noise model is identifiable when a differential-equation condition holds, and a new two-step algorithm recovers it.

desk verdict Grouped ANM identifiability is conditional on an uncharacterized Condition 1, but the MURGS pruning method is a real contribution and worth referee time. read the letter →

arxiv 2506.05120 v1 pith:EFW2MXYD submitted 2025-06-05 stat.ML cs.LGstat.ME

classification stat.MLcs.LGstat.ME MSC 62H2262G0862J07
keywords groupedcausaldiscoveryadditivenoisemodelsrandomvectorsidentifiabilitysparseHSICindependencetestRESITMURGS
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tackles causal discovery when the causal entities are groups of variables, such as brain regions or production-line process cells, rather than individual scalars. It claims that for grouped additive noise models, where each group's noise vector is independent of other groups but may be dependent within the group, the causal graph is identifiable from the observational distribution provided a differential-equation condition fails to hold. On the algorithmic side, it introduces GroupRESIT-MURGS, a two-phase procedure that first recovers a causal order by regressing each group on the rest and testing independence with the Hilbert-Schmidt criterion, then prunes edges using a new multi-response group sparse additive model. The paper reports that the method outperforms grouped versions of PC, GraN-DAG, and LiNGAM in simulations, and on real assembly-line data it recovers a graph with only one edge contradicting the known process order.

What carries the argument

The load-bearing object is Condition 1, a tensor-valued differential equation written in terms of the log-densities and the Jacobian and Hessian tensors of the group regression function; identifiability holds exactly when the triple $(f_g, P_{X_j}, P_{X_g})$ does not satisfy it, because satisfying it is what permits an additive noise representation in the reverse direction. The estimation machinery is the two-phase GroupRESIT pipeline: multi-output neural network regressions combined with HSIC independence tests to identify sink nodes, followed by MURGS, which penalizes a sum of sup-norms over response coordinates and a group-lasso-type norm over parent groups, and whose optimization uses a derived closed-form soft-thresholding backfitting update.

What would settle it

A concrete test would be to construct a smooth vector-valued GANM whose triple is known to solve Eq. (3), generate data from it, and show that the reverse orientation also admits an additive noise fit, causing GroupRESIT-MURGS to return the wrong direction; alternatively, computing the Lebesgue measure of the set of triples satisfying Eq. (3) and finding it to be generic would show the identifiability theorem covers almost no models.

Watch

Extended reading notes

Core claim

The paper's central claim is that grouped additive noise models (GANMs) are identifiable: when each group $X_g$ is generated from its parent groups by a smooth nonlinear function plus a noise vector, with noise vectors independent across groups, the direction of causation is read off from the joint distribution. The proof proceeds by showing that any backward model of the same form forces the triple of the regression function, the marginal density of the cause, and the noise density to satisfy a specific tensor differential equation, Condition 1. Ruling out that equation makes the causal direction unique for each bivariate pair, and conditioning on non-descendants lifts the result to full DAGs. The paper further contributes MURGS, a sparse additive model whose penalty zeroes out whole parent groups, fit by a closed-form soft-thresholding block-coordinate update.

Load-bearing premise

The identifiability theorem applies only when Condition 1 holds, yet the paper does not characterize which functions and densities satisfy that differential equation, gives no examples of it, and does not argue that it is generic; the supplementary text explicitly leaves the role of group sizes for future work.

Editorial extensions

If this is right

  • Causal order among groups can be learned without reducing groups to scalar summaries or treating members as independent scalars.
  • MURGS can serve as a plug-in pruning module for other order-based causal discovery methods on grouped data.
  • The identifiability theory extends the scalar ANM results of Hoyer et al. and Peters et al. to vector-valued settings, so future work on nonlinear causal discovery with grouped variables can build on this foundation.
  • On real production-line data, the method yields a graph that is almost entirely consistent with the known sequential order of process cells, indicating practical value for manufacturing quality control.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper does not assess how often Condition 1 holds; a reader should suspect that identifiability may fail for generic unbalanced group sizes, since the tensor contractions in Eq. (3) change with the dimensions of the groups.
  • MURGS's penalty structure could be transferred to time-series or conditional independence settings where groups are lagged versions of the same variables, though the paper does not explore this.
  • The practical caveat in the paper's own remark, that HSIC values are comparable only when dimensions and scales match, suggests that the Phase I ordering may be unstable when groups have very different sizes; testing this would require a dedicated simulation study.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper extends nonlinear additive noise model (ANM) causal discovery from scalar random variables to groups of random vectors. It defines the group additive noise model (GANM), states a condition (Condition 1) under which causal directions in a bivariate GANM are identifiable (Theorem 2.1), and sketches an extension to full graphs (Corollary 1). On the algorithmic side, the paper proposes GroupRESIT, a two-phase procedure: the causal order is estimated by multi-output neural network regression followed by HSIC-based sink identification, and the DAG is pruned by MURGS, a newly proposed multi-response group sparse additive model with a block-coordinate descent/backfitting algorithm and a closed-form soft-thresholding update. The method is evaluated on synthetic GANM data against several baselines and on assembly-line manufacturing data with a partially known cell order.

Significance. If the identifiability theory is made fully rigorous, the paper would be a useful extension of ANM identifiability to multivariate groups and would provide a practical algorithm for grouped causal discovery. The paper has clear strengths: a publicly available implementation, a closed-form block update for a genuinely useful multi-response sparse additive model, evaluation with order- and intervention-oriented metrics (AAID/OAID) in addition to standard edge-based metrics, and a real-data application with a partial ground-truth ordering that checks edge orientation. The main caveat is that the central identifiability theorem is conditional on an uncharacterized premise, and the empirical comparison omits the most directly relevant group-level baselines; these issues need to be addressed before the headline claims are fully supported.

major comments (4)
  1. [§2.2, Condition 1 and Theorem 2.1] Theorem 2.1 is logically conditional: it establishes identifiability only when the triple (f_g, P_Xj, P_Xg) does not satisfy Eq. (3). The paper does not characterize the set of triples satisfying Condition 1, does not give a single example of a model that satisfies or violates it, and the Remark after Eq. (3) explicitly defers the effect of group sizes to future work. Since the simulation models in Section 4 use Gaussian-process link functions and multivariate log-normal noise, and the manufacturing data is not checked against Eq. (3), the theorem's premise is not verified for any model used in the paper. In particular, the dimensions d_j and d_g determine the number of tensor equations in (3), so one cannot simply infer from the scalar ANM that Condition 1 is generic. Please provide a genericity argument, nontrivial examples (including cases where Eq. (3) holds), or an explicit verification that the simulation settings satisfy Condition 1; otherwise the claim that causal directions are identifiable in the group setting is not supported for the settings studied.
  2. [Corollary 1 and Appendix A.2] The proof of Corollary 1 is too sketchy and appears internally inconsistent. It invokes 'Proposition 29 in Peters et al. [2014]' without stating it, and it invokes 'Lemma 2 in Peters et al. [2011]' without stating or verifying its hypotheses. More seriously, the proof says 'For any s=(q,r)' and 'we can choose any s', whereas the corollary's hypothesis only asserts existence of some realization x_S with positive density. The third component of the conditional triple is written as P_Xj rather than P_{X_j | X_S = x_S}, and the phrase 'the conditional distribution of X_S has strictly positive density' appears to refer to the wrong distribution. The extension from the bivariate theorem to the multivariate graph therefore needs to be reworked with precise conditioning notation and a complete proof.
  3. [§3.3, Theorem 3.1] The closed-form update in Theorem 3.1 is derived under the assumption E[f_{g,h'}^{(k)} | X_h^{(g)}] = 0 for h' ≠ h, which the paper calls crucial. The paper does not discuss whether this assumption holds for the function classes used in Algorithm 3, and Algorithm 4 applies the same update regardless. Consequently, there is no theorem guaranteeing that the algorithm converges to the MURGS minimizer for the data-generating processes in Section 4. The authors should either state conditions on the smoother and function space under which the assumption is satisfied, provide convergence guarantees for the general case, or explicitly frame Theorem 3.1 as an approximate update and justify its use.
  4. [§4, Experiments] The experimental comparison does not include the most relevant existing group-level causal discovery baselines, such as the groupwise methods of Wahl et al. [2023] or the grouped LiNGAM of Entner and Hoyer [2012] (the latter appears only in the real-data section, not in the synthetic benchmarks). Given the paper's claim of 'superior performance compared with several other causal discovery algorithms', the absence of these group-specific competitors weakens the empirical contribution. Please add at least one such baseline to the synthetic study, or justify why it is not applicable.
minor comments (4)
  1. [Abstract and Section 1] The abstract and introduction state that 'in general, the causal directions can be identified in the group setting'; this should be qualified to models satisfying Condition 1.
  2. [§3.3, Theorem 3.1 and Algorithm 3] In the definition of m*, the displayed formula uses m* on the right-hand side ('Σ_{l=1}^{m*}') where the running variable m should appear; the same typo appears in Theorem 3.1 and Algorithm 3. Please correct to Σ_{l=1}^m.
  3. [Appendix B, proof of Proposition 1] The sentence 'choosing u(k) and v_h(k) as above guarantees that Σ|u|(k) ≤ 1 and Σ|u|(k) ≤ 1' repeats the same condition; the second inequality should concern the vector v^{(k)}, e.g., Σ_h (v_h^{(k)})^2 ≤ 1.
  4. [§4, Results] All performance numbers are averages over 20 runs, but Figures 3 and 4 do not show variability; since the supplementary material contains boxplots, please report confidence intervals or spread in the main text for at least the headline AAID comparison.

Circularity Check

0 steps flagged · score 1.0 of 10

No substantive circularity: Condition 1 is a genuine non-genericity premise bridged to identifiability by proof in Appendix A.1, and MURGS is validated on freshly simulated data; self-citations are non-load-bearing.

full rationale

The central identifiability claim is not circular: Condition 1 is an explicit non-exceptionality premise whose content is the negation of differential equation (3), and the Appendix A.1 proof derives that any backward GANM representation forces Eq. (3); hence failure of Eq. (3) rules out the backward model, which is exactly the identifiability conclusion. The naming in Definition 4 (calling such models identifiable bivariate GANM) makes Theorem 2.1 read as a tautology, but the mathematical implication is genuinely proved rather than assumed, so this is presentational rather than collapse of the derivation. The explicit deferral after Eq. (3) (group size analysis deferred to future work) and absence of examples or genericity argument mean Condition 1 is uncharacterized, and Corollary 1's conditional premises are never verified for Section 4 simulation models or manufacturing data; this is a load-bearing coverage gap for applicability claims, but not circular reasoning. MURGS is derived from KKT stationary conditions in Appendix B and evaluated against ground-truth graphs on independently generated GANM data; no parameter is fitted to target output and then reported as prediction. Self-citations are contextual or methodological and non-load-bearing; the load-bearing prior results (Hoyer et al., 2008; Peters et al., 2011, 2014; Rockafellar and Wets, 1998; Fornasier and Rauhut, 2008) are external. Per the hard rule that a paper self-contained against external benchmarks receives score 0-2, the honest finding is minimal circularity, so the score is 1.

Assumptions & free parameters 1 free parameters · 7 assumptions · 0 invented entities

The central identifiability claims depend on a stack of modeling assumptions: causal sufficiency, causal minimality, acyclicity, positive densities, and the uncharacterized Condition 1. The MURGS closed-form update additionally assumes within-group conditional uncorrelatedness. No invented entities are introduced.

free parameters (1)
  • lambda (MURGS regularization) = selected via GCV
    Controls the group-sparsity penalty in MURGS; chosen from data by generalized cross-validation, not from the causal target, so it is a tuning parameter rather than a fitted constant.
assumptions (7)
  • domain assumption Causal sufficiency: no latent confounders (joint independence of noise groups)
    Assumed in Definition 2; if violated, the identifiability and algorithm may fail.
  • domain assumption Causal minimality: all functions non-constant in every argument
    Definition 3; needed to rule out marginal independence with a non-empty DAG.
  • domain assumption Acyclicity of G0
    Definition 1/2; DAG assumption.
  • domain assumption Noise groups have strictly positive densities; additive noise with same dimension
    Definition 2 and Condition 1 rely on log-densities and Hessians.
  • domain assumption Function class F subset C^3 with nonzero second or third partial derivatives
    Stated before Condition 1; needed for the tensor differential equation.
  • ad hoc to paper Condition 1 holds: relevant triples do not satisfy Eq. (3)
    The identifiability theorems are conditional on this; the paper does not characterize when it holds.
  • ad hoc to paper Within-group conditional uncorrelatedness: E[f_{g,h'}^{(k)}|X_h^{(g)}]=0 for h' != h
    Assumed in Theorem 3.1 for the closed-form backfitting update; acknowledged as crucial by the authors.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Nonlinear Causal Discovery for Grouped Data." pith.science (2026). https://pith.science/paper/EFW2MXYD

@misc{pith2026250605120,
  author       = {Pith},
  title        = {Pith review of: Nonlinear Causal Discovery for Grouped Data},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EFW2MXYD}},
  note         = {Machine review of arXiv:2506.05120}
}
read the original abstract

Inferring cause-effect relationships from observational data has gained significant attention in recent years, but most methods are limited to scalar random variables. In many important domains, including neuroscience, psychology, social science, and industrial manufacturing, the causal units of interest are groups of variables rather than individual scalar measurements. Motivated by these applications, we extend nonlinear additive noise models to handle random vectors, establishing a two-step approach for causal graph learning: First, infer the causal order among random vectors. Second, perform model selection to identify the best graph consistent with this order. We introduce effective and novel solutions for both steps in the vector case, demonstrating strong performance in simulations. Finally, we apply our method to real-world assembly line data with partial knowledge of causal ordering among variable groups.

Figures

Figures reproduced from arXiv: 2506.05120 by the authors.

Figure 1
Figure 1. An example of a grouped additive noise model [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Overview of MURGS notation. the superscript (k) selects the respective entry within the response group. To facilitate feature selection, we introduce a regularization functional that encourages a common spar￾sity pattern shared by both predictor and response group elements. Provided we have found such a functional we remove spuri￾ous edges among possible parents g ∈ paGπ (j) to obtain a set of relevant edges E π = {… view at source ↗
Figure 3
Figure 3. Performance of the algorithms under varying di [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Simulation results based on 20 repetitions. nonparametric independence tests proves highly effective in estimating a causal order, provided that the sample size is sufficiently large. Moreover, MURGS demonstrates a robust capability for feature selection even in the pr…
Figure 5
Figure 5. Figure 5: Learned causal edges from the real-world dataset [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Feature selection capability of MURGS. Node size is [PITH_FULL_IMAGE:figures/full_fig_p020_6.png]
Figure 7
Figure 7. Figure 7: Learned causal edges from the real-world dataset using [PITH_FULL_IMAGE:figures/full_fig_p021_7.png]
Figure 8
Figure 8. Figure 8: Learned causal edges from the real-world dataset using [PITH_FULL_IMAGE:figures/full_fig_p021_8.png]
Figure 9
Figure 9. Figure 9: Learned causal edges from the real-world dataset using [PITH_FULL_IMAGE:figures/full_fig_p021_9.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

13 extracted references · 11 canonical work pages

  1. [8]

    cc/paper_files/paper/2007/file/ 42e7aaa88b48137a16a1acd04ed91125-Paper

    URL https://proceedings.neurips. cc/paper_files/paper/2007/file/ 42e7aaa88b48137a16a1acd04ed91125-Paper. pdf. Han Liu, Larry Wasserman, and John Lafferty. Nonpara- metric regression and classification with joint sparsity constraints. In D. Koller, D. Schuurmans, Y . Bengio, and L. Bottou, editors,Advances in Neural Information Processing Systems, volume 2...

  2. [13]

    Matej Vukovi´c and Stefan Thalmann

    URL https://proceedings.mlr.press/ v177/uemura22a.html. Matej Vukovi´c and Stefan Thalmann. Causal discovery in manufacturing: A structured literature review.Journal of Manufacturing and Materials Processing, 6(1), 2022. doi: 10.3390/jmmp6010010. URL https://www.mdpi. com/2504-4494/6/1/10. Jonas Wahl, Urmi Ninad, and Jakob Runge. Vector causal inference b...

  3. [36]

    Pekka Parviainen and Samuel Kaski

    URL https://www.sciencedirect.com/ science/article/pii/S0896627316310091. Pekka Parviainen and Samuel Kaski. Learning structures of Bayesian networks for variable groups.Internat. J. Approx. Reason., 88:110–127, 2017. doi: 10.1016/j.ijar. 2017.05.006. URL https://doi.org/10.1016/ j.ijar.2017.05.006. Jonas Peters and Peter Bühlmann. Structural intervention...

  4. [2006]

    Exact block-wise optimization in group lasso and sparse group lasso for linear regression

    URL https://proceedings.neurips. cc/paper_files/paper/2006/file/ 0afa92fc0f8a9cf051bf2961b06ac56b-Paper. pdf. Kenneth A. Bollen.Structural equations with latent variables. Wiley Series in Probability and Mathe- matical Statistics: Applied Probability and Statistics. John Wiley & Sons, Inc., New York, 1989. doi: 10. 1002/9781118619179. URL https://doi.org/...

  5. [2007]

    cc/paper_files/paper/2007/file/ 3a0772443a0739141292a5429b952fe6-Paper

    URL https://proceedings.neurips. cc/paper_files/paper/2007/file/ 3a0772443a0739141292a5429b952fe6-Paper. pdf. Konstantin Göbler, Tobias Windisch, Mathias Drton, Tim Pychynski, Martin Roth, and Steffen Sonntag. causalAssembly: Generating realistic production data for benchmarking causal discovery. In Francesco Locatello and Vanessa Didelez, editors,Proceed...

  6. [2008]

    cc/paper_files/paper/2008/file/ f7664060cc52bc6f3d620bcedc94a4b6-Paper

    URL https://proceedings.neurips. cc/paper_files/paper/2008/file/ f7664060cc52bc6f3d620bcedc94a4b6-Paper. pdf. D. Janzing, P. Hoyer, and B. Schölkopf. Telling cause from effect based on high-dimensional observations. InPro- ceedings of the 27th International Conference on Ma- chine Learning, pages 479–486, Madison, WI, USA,

  7. [2009]

    URL https: //doi.org/10.1145/1553374.1553470

    doi: 10.1145/1553374.1553470. URL https: //doi.org/10.1145/1553374.1553470. Sahand N. Negahban, Pradeep Ravikumar, Martin J. Wain- wright, and Bin Yu. A unified framework for high- dimensional analysis of M-estimators with decompos- able regularizers.Statist. Sci., 27(4):538–557, 2012. doi: 10.1214/12-STS400. URL https://doi.org/10. 1214/12-STS400. Stefan...

  8. [2010]

    Genta Kikuchi and Shohei Shimizu

    Max-Planck-Gesellschaft, International Machine Learning Society. Genta Kikuchi and Shohei Shimizu. Structure learning for groups of variables in nonlinear time-series data with location-scale noise. In Erich Kummerfeld, Sisi Ma, Eric Rawls, and Bryan Andrews, editors,Proceedings of the 2023 Causal Analysis Workshop Series, volume 223 of Proceedings of Mac...

Show all 13 references
  1. [2018]

    I+ λ p dg ∥f (k1) g ∥ Idg # f (k1) g =QR (k1) g , from which we obtain the group SpAM result discussed by Yin et al. [2012], i.e., f (k1) g =

    URL https://proceedings.neurips. cc/paper_files/paper/2018/file/ e347c51419ffb23ca3fd5050202f9c3d-Paper. pdf. Jakob Zscheischler, Dominik Janzing, and Kun Zhang. Test- ing whether linear equations are causal: a free proba- bility theory approach. InProceedings of the Twenty- S...

  2. [2020]

    URL https://www.sciencedirect.com/ science/article/pii/S016622362030165X

    doi: https://doi.org/10.1016/j.tins.2020.07.001. URL https://www.sciencedirect.com/ science/article/pii/S016622362030165X. Sébastien Lachapelle, Philippe Brouillard, Tristan Deleu, and Simon Lacoste-Julien. Gradient-based neural dag learning. InInternational Conference on Lear...

  3. [2022]

    URL https://proceedings.mlr.press/ v162/rolland22a.html. P. K. Rubenstein*, S. Weichwald*, S. Bongers, J. M. Mooij, D. Janzing, M. Grosse-Wentrup, and B. Schölkopf. Causal consistency of structural equation models. InProceedings of the 33rd Conference on Un- certainty in Artif...

  4. [2024]

    Daniel Greenfeld and Uri Shalit

    URL https://proceedings.mlr.press/ v236/gobler24a.html. Daniel Greenfeld and Uri Shalit. Robust learning with the Hilbert-schmidt independence criterion. In Hal Daumé III and Aarti Singh, editors,Proceedings of the 37th Interna- tional Conference on Machine Learning, volume 11...

  5. [3768]

    URL https://proceedings

    PMLR, 2020. URL https://proceedings. mlr.press/v119/greenfeld20a.html. Arthur Gretton, Olivier Bousquet, Alex Smola, and Bern- hard Schölkopf. Measuring statistical dependence with Hilbert-Schmidt norms. InAlgorithmic learning the- ory, volume 3734 ofLecture Notes in Comput. S...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.