Pith. sign in

REVIEW 4 major objections 4 minor 63 references

Score-based Generative Modeling for Conditional Independence Testing

T0 review · 4 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read Score-based generative models can generate valid null-hypothesis samples for conditional independence testing, delivering asymptotic Type I error control and strong power.

desk verdict A well-executed diffusion-based CI test with strong experiments, but the headline Type I error theorem doesn't cover the implemented algorithm because the proof requires a sample split that Algorithm 1 does not perform. read the letter →

arxiv 2505.23309 v1 pith:VNVIL6KM submitted 2025-05-29 cs.LG cs.AI

classification cs.LGcs.AI MSC 62G1062G2062H15
keywords conditionalindependencetestingscore-basedgenerativemodelscorematchingLangevindynamicsTypeIerrorcontrolgoodness-of-fithigh-dimensionalstatistics
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to show that score-based generative models can be turned into a conditional independence test. It trains a conditional score function by sliced score matching, uses Langevin dynamics to draw X values that preserve the X–Z relationship while breaking the X–Y link, and then compares the observed test statistic with the distribution of statistics from those generated null samples. The paper proves an asymptotic Type I error bound, and it adds a goodness-of-fit stage so a user can check whether the generated samples resemble the data. If correct, this gives a stable, high-dimensional-capable alternative to GAN-based conditional independence tests.

What carries the argument

The carrying object is the conditional score, $\nabla_x \log p(x\mid z)$, estimated by a conditional sliced score matching objective $J_\theta$ that avoids computing the trace of a Hessian. Langevin dynamics conditional sampling then updates $x^{(b)}_{(k+1)h} = x^{(b)}_{kh} + h\, s(x^{(b)}_{kh}, z; \theta) + \sqrt{2h}\, \xi_{kh}$, producing null triples that are conditionally independent of $Y$ given $Z$. Exchangeability of the resulting sequence, via the representation theorem for exchangeable sequences, is what turns a rank comparison of statistics into a valid $p$-value.

What would settle it

Simulate data from a true conditional density that is demonstrably outside the MLP family, for example a sharp multimodal mixture, set $H_0$ true, and run SGMCIT with large $n$; if the empirical Type I error at $\alpha = 0.05$ exceeds 0.05 by more than sampling error in many replicates, the bound in Theorem 5.4 does not hold under misspecification.

Watch

Extended reading notes

Core claim

The central claim is that sampling from an estimated conditional score is enough to make conditional randomization tests valid in high dimensions. Under the null $X \perp\!\!\perp Y \mid Z$, the generated triples $(X^{(b)}, Y, Z)$ are exchangeable with the observed triple when the score model is accurate; the paper proves that the total-variation error of the generated conditional distribution vanishes in probability as $n$ grows (Theorem 5.3), and therefore the Type I error satisfies $P(p\text{-value} \le \alpha \mid H_0) \le \alpha + o_p(1)$ (Theorem 5.4). The same machinery yields an interpretable two-sample goodness-of-fit check of the generated samples. The paper's experiments report Type I error near the nominal level with high power across benchmark, high-dimensional confounder, and chain-structured settings.

Load-bearing premise

Everything rests on Assumption 4: the true joint density must be exactly inside the parametric family $\{p(x,z;\theta)\}$ that the MLP score model represents, and no argument shows that real conditional densities are.

Editorial extensions

If this is right

  • Under $H_0$ and Assumptions 1–10, the $p$-value exceeds $\alpha$ with probability at most $\alpha + o_p(1)$, so large-sample Type I error control holds.
  • Any chosen statistic $\rho$ can be plugged in; exchangeability of generated triples makes the rank-based $p$-value valid whenever the generated distribution matches the true conditional.
  • The goodness-of-fit stage lets a practitioner detect when generated samples are not trustworthy enough for the test result to be reliable.
  • In the reported experiments, SGMCIT holds Type I error near 0.05 while GAN-based GCIT and DGCIT inflate it, and it maintains power in the 100-dimensional confounder setting.
  • The method is computationally light compared with kernel-based tests at large sample sizes, according to the runtime measurements reported in the paper.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • One implicit extension is that the same conditional score estimator could serve any conditional randomization test, not only the specific rank statistics used here.
  • The goodness-of-fit stage is a practical safety check, but it cannot repair a misspecified score family; a nonparametric or noise-perturbed score estimator might relax the well-specified assumption.
  • A concrete testable extension: apply SGMCIT to a chain-structured causal graph with nonlinear conditional densities to see whether Type I error remains controlled when the MLP family is far from the truth.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. The paper proposes SGMCIT, a conditional independence testing method that trains a sliced conditional score-matching model on (X,Z) pairs, generates null-hypothesis samples of X given Z via Langevin dynamics, checks the generated samples with a goodness-of-fit stage, and computes a Monte Carlo p-value by comparing the statistic on observed triples with statistics on generated triples. The authors claim asymptotic Type I error control (Theorem 5.4) and strong power, supported by score-consistency and total-variation error bounds, and they report experiments on synthetic and real datasets showing favorable performance against several existing CI tests, including GAN-based methods and a concurrent diffusion-based method.

Significance. If the theoretical guarantees held for the implemented algorithm, the paper would make a useful contribution: it would provide a generative-model-based CI test with a principled score-matching training objective, an interpretable goodness-of-fit check, and a formal asymptotic Type I error bound, while avoiding GAN training instability. The paper also provides code and compares against a broad set of baselines, which is a practical strength. However, the central validity claim currently has a load-bearing gap between the theory and the algorithm: the proof requires a train/test split that Algorithm 1 does not perform, and the parametric identifiability assumption is not satisfied by the implemented MLP score model. These issues must be resolved before the claimed guarantees can be considered established.

major comments (4)
  1. [§5, Theorem 5.4; Appendix E; Algorithm 1] The proof of the Type I error bound assumes that the score model is trained on a separate sample of size N and the CI test is run on an independent sample of size n (Appendix E, first paragraph: "we separate the samples used in the previous stage of generative modeling from the samples used in the CI test"). Algorithm 1, however, trains the score model on the full dataset D (Line 2) and computes the p-value on the same D (Line 9). Consequently, the generated triples (X^(b),Y,Z) depend on the observed X through the estimated parameter theta-hat, so the conditional independence used in Proposition D.1 and Lemma E.1 does not hold. The exchangeability argument requires the score function to be fixed before seeing the test data; when theta-hat is fitted to D, the map from initialization noise to X^(b) is a function of X, and the representation-theorem step in Proposition D.1 no longer applies. This gap is load-bearing: Theorem 5.4's conclusion P(p-value <= alpha | H0) <= alpha + o_p(1) is not a valid consequence for SGMCIT as implemented. The authors should either modify Algorithm 1 to use a sample split (train on a subset, test on the remaining data) and state the theorem for that version, or provide a different argument that justifies the exchangeability of the implemented procedure.
  2. [Assumption 4 and Theorem 5.2; §6/F.2] Assumption 4 requires the parametric family {p(x,z;theta)} to be well-specified, i.e., the true joint density equals p(x,z;theta*) for some theta*. The actual score model is a three-layer MLP with 64 hidden units (Appendix F.2), and no argument is given that the true conditional densities lie in this family. Under misspecification, Lemma 5.1's equivalence L_theta = 0 iff theta = theta* and the consistency Theorem 5.2 collapse, and the total-variation bound of Theorem 5.3 and the Type I error bound of Theorem 5.4 inherit the failure. Even if the practitioner interprets the MLP as a flexible approximation rather than an exact parametric model, the stated theorems do not cover that case. The paper should either prove the results under a misspecification-aware assumption (e.g., bounding the approximation error in the score or in TV distance), or explicitly restrict the theoretical claims to cases where the model class is exactly specified and clarify that the experiments do not verify this condition.
  3. [Theorem C.2 and Eq. (34)] The proof of Theorem C.2 (and hence Theorem 5.3) contains a probabilistic step that is not justified as written. From the pointwise convergence s(x,z;theta-hat) -> s(x,z;theta*) in probability, Eq. (34) asserts that the event E_{x~p(x|z)}[||s(x,z;theta*) - s(x,z;theta-hat)||^2] <= eps_c^2 has probability tending to 1. Pointwise convergence does not imply convergence of the L2 expectation without additional uniform integrability or dominated-convergence-type conditions, which are neither stated nor proved. This step is needed to conclude that the score estimation error satisfies Assumption C.3 asymptotically, and the gap should be repaired with a precise regularity condition (e.g., uniform integrability of the squared score error under p(x|z)) or a different argument based on the actual convergence mode established in Theorem 5.2.
  4. [§4.2, Algorithm 1, Lines 5-6] The goodness-of-fit stage is described as checking whether the generated samples are 'good enough', but no formal decision rule is specified, and the p-value in Eq. (10) is computed regardless of the GOF outcome. Since the GOF stage is presented as a key practical safeguard for the validity of the CI test, the paper should define a precise rule (e.g., reject the CI test as unreliable if an MMD-based p-value is below a threshold), and state what guarantee, if any, the GOF stage provides when it is used as a filtering step. Without a formal rule, the claim that the GOF stage 'ensures the validity of generated samples' is not supported.
minor comments (4)
  1. [Throughout] There are several typos and notational inconsistencies: 'Exchangeablility' in the title of Proposition 4.1 and Appendix D; 'signifiance level' in Appendix E; 'squre' in several figure labels; 'CDCCIT' instead of 'CDCIT' in Figure 17; and the notation [B] is used before it is defined in the main text (it is defined only in a footnote and in Appendix A). The paper should be carefully proofread.
  2. [Theorem 5.4 and Appendix E] Theorem 5.4 states the Type I error bound 'as n -> infinity', but the proof in Appendix E uses N for the training sample size and n for the test sample size and concludes convergence 'as N -> infinity'. The limit variable is inconsistent with the theorem statement, and this is not merely cosmetic because Algorithm 1 uses the same data for both roles. The authors should align the notation and state clearly which sample size drives the asymptotics in the implemented version.
  3. [§4.1 and Fig. 1] The paper does not specify the value of B, the number of generated null-sample sets, in the main text or in Appendix F. Since the p-value resolution and the exchangeability argument depend on B, this hyperparameter should be reported for reproducibility.
  4. [Appendix E, Eq. (47)] The derivation of the total-variation term uses the phrase 'based on the property that (x, x^(1), ..., x^(B)) is independent of each other'; this is imprecise. The independence should refer to the conditional independence of the vectors given (Y,Z), and the equality should be stated with the appropriate conditional distributions. Clarifying this would improve readability without changing the result.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the Type I error bound is assembled from external score-matching and Langevin convergence results plus a standard exchangeability/rank argument, and no fitted quantity is renamed as a prediction.

full rationale

The derivation chain is self-contained rather than circular. Lemma 5.1 and Theorem 5.2 import sliced-score-matching consistency from Song et al. [49]; Theorem 5.3 imports Langevin/log-Sobolev convergence from Lee et al. [23]; Proposition D.3 is the standard exchangeability/rank bound for p-values. None of these citations is by the present authors, and none assumes the target Type I error conclusion. The goodness-of-fit stage is a heuristic diagnostic and is not used to define the p-value in Eq. (10). The only in-scope concern is a proof-implementation mismatch: Appendix E proves the Type I error bound under a train/test split ('we separate the samples used in the previous stage of generative modeling from the samples used in the CI test'), whereas Algorithm 1 trains the score model on the full dataset D (line 2) and computes rho(D) on the same D (line 9). This means the exchangeability premise of Proposition D.1 is not guaranteed for the implemented procedure, so Theorem 5.4's conclusion does not follow for Algorithm 1 as written. That is a validity/correctness gap, not circularity: the theorem's conclusion is not assumed in its premises, and no fitted parameter is renamed as a prediction. The authors' self-citations [33-35] appear only as related work and are not load-bearing.

Assumptions & free parameters 4 free parameters · 8 assumptions · 0 invented entities

The central claim rests on standard score-matching assumptions, strong model-family assumptions including well-specification, positivity, smoothness, and log-Sobolev inequalities, and an unstated train and test separation for the p-value exchangeability. No invented physical or mathematical entities are introduced. Practical hyperparameters h, T, m, and B are chosen by hand rather than derived from the theorem's constants.

free parameters (4)
  • Langevin step size h = 0.1
    Chosen by hand; the theorem requires h = epsilon^2 / (2720 d_x L^2 C_LS), which depends on unknown constants that are not estimated.
  • Langevin time horizon T (number of steps) = 200 steps
    Chosen by hand; the theorem requires T = 4 C_LS ln(2K/epsilon^2), so the fixed value may not satisfy the TV bound for all conditional distributions.
  • Projection count m = 1
    Chosen to balance variance and computational cost; the paper states m = 1 is already good but gives no theoretical justification.
  • Number of null sample sets B = not reported in main text
    Algorithm input that sets p-value granularity and cost; the paper does not state the value used in experiments.
assumptions (8)
  • domain assumption Assumption 4: the model family {p(x,z;theta)} is well-specified, so p(x,z) = p(x,z;theta*) for some theta*.
    Needed for Lemma 5.1 and Theorem 5.2; the actual three-layer MLP is not shown to contain the true density.
  • domain assumption Assumption 5: p(x,z;theta) > 0 for all theta and all (x,z).
    Used in Lemma 5.1 and Lemma B.2 to convert score equality into density equality.
  • domain assumption Assumption 9: log p(x|z) is C^1 and L_z-smooth in x with L_z >= 1.
    Required for the Langevin dynamics TV bound in Theorem 5.3 and Theorem C.1.
  • domain assumption Assumption 10: each p(x|z) satisfies a log-Sobolev inequality with constant C_{z,LS} >= 1.
    Required for polynomial convergence of Langevin dynamics; multimodal or heavy-tailed conditionals may fail this.
  • domain assumption Assumption C.3: the score estimate is L2-accurate, E_x[||grad log p(x|z) - s(x,z;theta_hat)||^2] <= epsilon_z^2.
    Used in Theorem C.1; Theorem C.2 attempts to derive it from pointwise consistency, but the proof relies on uniform convergence that is not fully established.
  • ad hoc to paper Training data for the score model is independent of the samples used to compute the test statistic.
    Appendix E explicitly separates N training and n test samples, but Algorithm 1 and the synthetic experiments do not state such a split; without it, Proposition 4.1 exchangeability is not justified.
  • standard math Diaconis-Freedman representation theorem for finite exchangeable sequences.
    Used in Proposition 4.1 and Proposition D.1 to conclude exchangeability from conditionally i.i.d. generation.
  • standard math Lee et al. [23] convergence result for score-based generative models with L2-accurate scores.
    Imported as the core error bound for the Langevin sampling stage in Theorem C.1.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Score-based Generative Modeling for Conditional Independence Testing." pith.science (2026). https://pith.science/paper/VNVIL6KM

@misc{pith2026250523309,
  author       = {Pith},
  title        = {Pith review of: Score-based Generative Modeling for Conditional Independence Testing},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/VNVIL6KM}},
  note         = {Machine review of arXiv:2505.23309}
}
read the original abstract

Determining conditional independence (CI) relationships between random variables is a fundamental yet challenging task in machine learning and statistics, especially in high-dimensional settings. Existing generative model-based CI testing methods, such as those utilizing generative adversarial networks (GANs), often struggle with undesirable modeling of conditional distributions and training instability, resulting in subpar performance. To address these issues, we propose a novel CI testing method via score-based generative modeling, which achieves precise Type I error control and strong testing power. Concretely, we first employ a sliced conditional score matching scheme to accurately estimate conditional score and use Langevin dynamics conditional sampling to generate null hypothesis samples, ensuring precise Type I error control. Then, we incorporate a goodness-of-fit stage into the method to verify generated samples and enhance interpretability in practice. We theoretically establish the error bound of conditional distributions modeled by score-based generative models and prove the validity of our CI tests. Extensive experiments on both synthetic and real-world datasets show that our method significantly outperforms existing state-of-the-art methods, providing a promising way to revitalize generative model-based CI testing.

Figures

Figures reproduced from arXiv: 2505.23309 by the authors.

Figure 1
Figure 1. The framework of conditional independence testing with score-based generative modeling. [PITH_FULL_IMAGE:figures/full_fig_p004_1.png] view at source ↗
Figure 2
Figure 2. Left: The visualization results for the marginal [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Results of conditional independence tests on benchmark datasets. [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (13 more)
Figure 5
Figure 5. Figure 5: Left: Results in the high-dimensional confounder [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: CI testing results on real data. Left: Visualization [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]
Figure 7
Figure 7. Figure 7: The visualization results of SGMCIT for the marginal distribution of [PITH_FULL_IMAGE:figures/full_fig_p017_7.png]
Figure 8
Figure 8. Figure 8: The visualization results of GCIT for the marginal distribution of [PITH_FULL_IMAGE:figures/full_fig_p017_8.png]
Figure 9
Figure 9. Figure 9: The visualization results of DGCIT for the marginal distribution of [PITH_FULL_IMAGE:figures/full_fig_p017_9.png]
Figure 10
Figure 10. Figure 10: The visualization results of GCIT, DGCIT and SGMCIT for the marginal distribution of [PITH_FULL_IMAGE:figures/full_fig_p017_10.png]
Figure 11
Figure 11. Figure 11: Additional results of conditional independence tests for Cases 1 and 2 on benchmark datasets. [PITH_FULL_IMAGE:figures/full_fig_p018_11.png]
Figure 12
Figure 12. Figure 12: Additional results of conditional independence tests for Cases 3 and 4 on benchmark datasets. [PITH_FULL_IMAGE:figures/full_fig_p018_12.png]
Figure 13
Figure 13. Figure 13: Results of running time. Left: The results w.r.t. the sample size. Right: The results w.r.t. the dimension of [PITH_FULL_IMAGE:figures/full_fig_p018_13.png]
Figure 14
Figure 14. Figure 14: Additional results of CI tests. (a) Additional results of CI tests for Cases 1 and 2 on benchmark datasets. (b) Additional [PITH_FULL_IMAGE:figures/full_fig_p020_14.png]
Figure 15
Figure 15. Figure 15: The visualization results of SGMCIT and CDCIT for the distribution of [PITH_FULL_IMAGE:figures/full_fig_p020_15.png]
Figure 16
Figure 16. Figure 16: Visualization results of SGMCIT and CDCIT on real data with 50000 sample size. [PITH_FULL_IMAGE:figures/full_fig_p020_16.png]
Figure 17
Figure 17. Figure 17: Results of running time of CDCIT and SGMCIT (Ours). Left: The results w.r.t. the sample size. Right: The results w.r.t. [PITH_FULL_IMAGE:figures/full_fig_p020_17.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

63 extracted references · 51 canonical work pages

  1. [1]

    Martin Arjovsky, Soumith Chintala, and Léon Bottou. 2017. Wasserstein genera- tive adversarial networks. In International conference on machine learning . PMLR, ACM, 214–223

  2. [2]

    Mona Azadkia and Sourav Chatterjee. 2021. A simple measure of conditional dependence. The Annals of Statistics 49, 6 (2021), 3070–3102

  3. [3]

    Alexis Bellot and Mihaela van der Schaar. 2019. Conditional independence testing using generative adversarial networks. Advances in neural information processing systems 32 (2019), 2202–2211

  4. [4]

    Thomas B Berrett, Yi Wang, Rina Foygel Barber, and Richard J Samworth. 2020. The conditional permutation test for independence while controlling for con- founders. Journal of the Royal Statistical Society Series B: Statistical Methodology 82, 1 (2020), 175–197

  5. [5]

    Zhanrui Cai, Runze Li, and Yaowu Zhang. 2022. A distribution free conditional independence test with applications to causal discovery. Journal of Machine Learning Research 23, 85 (2022), 1–41

  6. [6]

    Emmanuel Candes, Yingying Fan, Lucas Janson, and Jinchi Lv. 2018. Panning for gold:‘model-X’knockoffs for high dimensional controlled variable selection. Journal of the Royal Statistical Society Series B: Statistical Methodology 80, 3 (2018), 551–577

  7. [7]

    Krzysztof Chalupka, Pietro Perona, and Frederick Eberhardt. 2018. Fast condi- tional independence test for vector variables with large sample sizes. arXiv 2018. arXiv preprint arXiv:1804.02747 (2018)

  8. [8]

    Kacper Chwialkowski, Heiko Strathmann, and Arthur Gretton. 2016. A kernel test of goodness of fit. In International conference on machine learning . PMLR, ACM, 2606–2615

Show all 63 references
  1. [9]

    JJ Daudin. 1980. Partial association measures and an application to qualitative regression. Biometrika 67, 3 (1980), 581–590

  2. [10]

    Persi Diaconis and David Freedman. 1980. Finite exchangeable sequences. The Annals of Probability 8, 6 (1980), 745–764

  3. [11]

    Gary Doran, Krikamol Muandet, Kun Zhang, and Bernhard Schölkopf. 2014. A Permutation-Based Kernel Conditional Independence Test.. In UAI. AUAI, 132– 141

  4. [12]

    Arthur Gretton, Karsten M Borgwardt, Malte J Rasch, Bernhard Schölkopf, and Alexander Smola. 2012. A kernel two-sample test. The Journal of Machine Learning Research 13, 1 (2012), 723–773

  5. [13]

    Arthur Gretton, Kenji Fukumizu, Zaid Harchaoui, and Bharath K Sriperumbudur

  6. [14]

    Arthur Gretton, Kenji Fukumizu, Choon Teo, Le Song, Bernhard Schölkopf, and Alex Smola. 2007. A kernel statistical test of independence. Advances in neural information processing systems 20 (2007), 585–592

  7. [15]

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in neural information processing systems 33 (2020), 6840–6851

  8. [16]

    Zhen Huang, Nabarun Deb, and Bodhisattva Sen. 2022. Kernel partial correla- tion coefficient—a measure of conditional dependence. The Journal of Machine Learning Research 23, 1 (2022), 9699–9756

  9. [17]

    Martin Huber and Blaise Melly. 2015. A test of the conditional independence assumption in sample selection models. Journal of Applied Econometrics 30, 7 (2015), 1144–1168

  10. [18]

    Aapo Hyvärinen and Peter Dayan. 2005. Estimation of non-normalized statistical models by score matching. Journal of Machine Learning Research 6, 4 (2005), 695–709

  11. [19]

    Adel Javanmard and Mohammad Mehrabi. 2021. Pearson chi-squared conditional randomization test. arXiv preprint arXiv:2111.00027 (2021)

  12. [20]

    Wittawat Jitkrittum, Heishiro Kanagawa, and Bernhard Schölkopf. 2020. Testing goodness of fit of conditional density models with kernels. In Conference on Uncertainty in Artificial Intelligence. PMLR, AUAI, 221–230

  13. [21]

    Wittawat Jitkrittum, Wenkai Xu, Zoltán Szabó, Kenji Fukumizu, and Arthur Gretton. 2017. A linear-time kernel goodness-of-fit test. Advances in Neural Information Processing Systems 30 (2017), 261–270

  14. [22]

    Zhifeng Kong, Wei Ping, Jiaji Huang, Kexin Zhao, and Bryan Catanzaro. 2020. Diffwave: A versatile diffusion model for audio synthesis. arXiv preprint arXiv:2009.09761 (2020)

  15. [23]

    Holden Lee, Jianfeng Lu, and Yixin Tan. 2022. Convergence for score-based generative modeling with polynomial complexity.Advances in Neural Information Processing Systems 35 (2022), 22870–22882

  16. [24]

    Chun Li and Xiaodan Fan. 2020. On nonparametric conditional independence tests for continuous variables. Wiley Interdisciplinary Reviews: Computational Statistics 12, 3 (2020), e1489

  17. [25]

    Shuai Li, Ziqi Chen, Hongtu Zhu, Christina Dan Wang, and Wang Wen. 2023. Nearest-neighbor sampling based conditional independence testing. In Proceed- ings of the AAAI Conference on Artificial Intelligence , Vol. 37. AAAI, 8631–8639

  18. [26]

    Shuai Li, Yingjie Zhang, Hongtu Zhu, Christina Dan Wang, Hai Shu, Ziqi Chen, Zhuoran Sun, and Yanfeng Yang. 2023. K-Nearest-Neighbor Local Sampling Based Conditional Independence Testing. In Thirty-seventh Conference on Neural Information Processing Systems. MIT Press, 23321–2...

  19. [27]

    David Lopez-Paz, Philipp Hennig, and Bernhard Schölkopf. 2013. The randomized dependence coefficient. Advances in neural information processing systems 26 (2013), 1–9

  20. [28]

    Nikolas Mittag. 2018. A Nonparametric k-Sample Test of Conditional Independence. Technical Report. Working paper of CERGE-EI, Prague, Czech Republic

  21. [29]

    Junhyung Park and Krikamol Muandet. 2020. A measure-theoretic approach to kernel conditional mean embeddings. Advances in neural information processing systems 33 (2020), 21247–21259

  22. [30]

    Roman Pogodin, Namrata Deka, Yazhe Li, Danica J Sutherland, Victor Veitch, and Arthur Gretton. 2022. Efficient conditionally invariant representation learning. arXiv preprint arXiv:2212.08645 (2022)

  23. [31]

    Felipe Maia Polo, Yuekai Sun, and Moulinath Banerjee. 2023. Conditional inde- pendence testing under model misspecification. arXiv preprint arXiv:2307.02520 (2023)

  24. [32]

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen

  25. [33]

    Yixin Ren, Yewei Xia, Hao Zhang, Jihong Guan, and Shuigeng Zhou. 2024. Effi- ciently Learning Significant Fourier Feature Pairs for Statistical Independence Testing. In The Thirty-eighth Annual Conference on Neural Information Processing Systems. MIT Press

  26. [34]

    Yixin Ren, Yewei Xia, Hao Zhang, Jihong Guan, and Shuigeng Zhou. 2024. Learn- ing Adaptive Kernels for Statistical Independence Tests. In International Confer- ence on Artificial Intelligence and Statistics . PMLR, JMLR, 2494–2502

  27. [35]

    Yixin Ren, Hao Zhang, Yewei Xia, Jihong Guan, and Shuigeng Zhou. 2023. Multi-level wavelet mapping correlation for statistical dependence measure- ment: methodology and performance. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 37. AAAI, 6499–6506

  28. [36]

    Gareth O Roberts and Richard L Tweedie. 1996. Exponential convergence of Langevin distributions and their discrete approximations. Bernoulli 2, 3 (1996), 341–363

  29. [37]

    Jakob Runge. 2018. Conditional independence testing based on a nearest-neighbor estimator of conditional mutual information. In International Conference on Arti- ficial Intelligence and Statistics . PMLR, JMLR, 938–947

  30. [38]

    Meyer Scetbon, Laurent Meunier, and Yaniv Romano. 2022. An asymptotic test for conditional independence using analytic kernel embeddings. In International Conference on Machine Learning . PMLR, ACM, 19328–19346

  31. [39]

    Rajat Sen, Ananda Theertha Suresh, Karthikeyan Shanmugam, Alexandros G Dimakis, and Sanjay Shakkottai. 2017. Model-powered conditional independence test. Advances in neural information processing systems 30 (2017), 2955–2965

  32. [40]

    Rajen D Shah and Jonas Peters. 2020. The hardness of conditional independence testing and the generalised covariance measure. (2020)

  33. [41]

    Tianhong Sheng and Bharath K Sriperumbudur. 2019. On distance and kernel measures of conditional independence. arXiv preprint arXiv:1912.01103 (2019)

  34. [42]

    Chengchun Shi, Tianlin Xu, Wicher Bergsma, and Lexin Li. 2021. Double genera- tive adversarial networks for conditional independence testing. The Journal of Machine Learning Research 22, 1 (2021), 13029–13060

  35. [43]

    Hongjian Shi, Mathias Drton, and Fang Han. 2021. On Azadkia-Chatterjee’s conditional dependence coefficient. arXiv preprint arXiv:2108.06827 (2021)

  36. [44]

    Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli

  37. [45]

    Yang Song and Prafulla Dhariwal. 2023. Improved techniques for training consis- tency models. arXiv preprint arXiv:2310.14189 (2023)

  38. [46]

    Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. 2023. Consistency models. arXiv preprint arXiv:2303.01469 (2023)

  39. [47]

    Yang Song, Conor Durkan, Iain Murray, and Stefano Ermon. 2021. Maximum like- lihood training of score-based diffusion models. Advances in Neural Information Processing Systems 34 (2021), 1415–1428

  40. [48]

    Yang Song and Stefano Ermon. 2019. Generative modeling by estimating gradients of the data distribution. Advances in neural information processing systems 32 (2019), 11918–11930

  41. [49]

    Yang Song, Sahaj Garg, Jiaxin Shi, and Stefano Ermon. 2020. Sliced score matching: A scalable approach to density and score estimation. In Uncertainty in Artificial Intelligence. PMLR, 574–584

  42. [50]

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. 2020. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456 (2020)

  43. [51]

    Peter Spirtes, Clark Glymour, and Richard Scheines. 1993. Causation, prediction, and search. MIT press

  44. [52]

    Eric V Strobl, Kun Zhang, and Shyam Visweswaran. 2019. Approximate kernel- based conditional independence tests for fast non-parametric causal discovery. Journal of Causal Inference 7, 1 (2019), 20180017

  45. [53]

    Pascal Vincent. 2011. A connection between score matching and denoising autoencoders. Neural computation 23, 7 (2011), 1661–1674

  46. [54]

    Xueqin Wang, Wenliang Pan, Wenhao Hu, Yuan Tian, and Heping Zhang. 2015. Conditional distance correlation. J. Amer. Statist. Assoc. 110, 512 (2015), 1726– 1734

  47. [55]

    Andrew Warren. 2021. Wasserstein conditional independence testing. arXiv preprint arXiv:2107.14184 (2021)

  48. [56]

    Li Wenliang, Danica J Sutherland, Heiko Strathmann, and Arthur Gretton. 2019. Learning deep kernels for exponential family densities. InInternational Conference on Machine Learning. PMLR, ACM, 6737–6746

  49. [57]

    Yanfeng Yang, Shuai Li, Yingjie Zhang, Zhuoran Sun, Hai Shu, Ziqi Chen, and Renming Zhang. 2025. Conditional diffusion models based conditional indepen- dence testing. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 39. 22020–22028

  50. [58]

    Hao Zhang, Shuigeng Zhou, and Jihong Guan. 2018. Measuring conditional independence by independent residuals: theoretical results and application in causal discovery. In Proceedings of the AAAI Conference on Artificial Intelligence , Vol. 32. AAAI, 2029–2036

  51. [59]

    Kun Zhang, Jonas Peters, Dominik Janzing, and Bernhard Schölkopf. 2012. Kernel- based conditional independence test and application in causal discovery. arXiv preprint arXiv:1202.3775 (2012)

  52. [60]

    converge in distri- bution

    Qinyi Zhang, Sarah Filippi, Seth Flaxman, and Dino Sejdinovic. 2017. Feature-to- feature regression for a two-step conditional independence test. (2017). The Appendix is organized as follows: • Section A: List of Symbols and Notations. • Section B: Proof of Conditional Sliced ...

  53. [2009]

    Advances in neural information processing systems 22 (2009), 673–681

    A fast, consistent kernel two-sample test. Advances in neural information processing systems 22 (2009), 673–681

  54. [2015]

    In International conference on machine learning

    Deep unsupervised learning using nonequilibrium thermodynamics. In International conference on machine learning . PMLR, ACM, 2256–2265

  55. [2022]

    arXiv preprint arXiv:2204.06125 1, 2 (2022), 3

    Hierarchical text-conditional image generation with clip latents. arXiv preprint arXiv:2204.06125 1, 2 (2022), 3

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.