REVIEW 3 major objections 6 minor 41 references
Scalable Bayesian structure learning of directed acyclic graphs via Laplace approximation, with an application to breast cancer gene expression networks
T0 review · 3 major / 6 minor · reviewed 2026-07-14 · grok-4.5
Pith's one-line read A closed-form Laplace score lets Bayesian DAG learning use heavier-tailed Normal–Gamma priors and still contract on the true skeleton at clinical sample sizes.
desk verdict Solid closed-form non-conjugate DAG score with honest diagnostics; the n-dependent α is a real but acknowledged soft spot, not a collapse of the math. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The Laplace-approximated node-marginal score (Theorem 1, Eq. 8): the large-argument asymptotic of the modified Bessel function that arises as the exact GIG integral of the Normal–Gamma node model; it supplies both the practical MH score and the analytic control used for the contraction theorem.
What would settle it
On synthetic Gaussian DAGs with known ground truth, at moderate n and q, replace the n-dependent shape by a small fixed shape and check whether the Laplace score still recovers higher skeleton F1/MCC than the conjugate Normal–Inverse-Gamma baseline and the continuous-optimisation benchmarks; if the advantage disappears or the posterior fails to contract, the central practical claim fails.
Extended reading notes
Core claim
Under the non-conjugate Normal–Gamma prior on the modified Cholesky parameterisation, the node-marginal likelihood is of generalised inverse-Gaussian form and therefore equals a modified Bessel function of the second kind; its leading large-argument asymptotic is a closed-form Laplace score that can be used for Metropolis–Hastings structure learning, and the induced posterior contracts on the true skeleton at the near-optimal rate sqrt(log q / n).
Load-bearing premise
The default prior shape is allowed to grow with sample size so that the Bessel argument stays in the large-argument regime; if a fixed small shape is required, the approximation quality and Occam balance that the theory and defaults rely on are no longer guaranteed by construction.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper develops a Laplace-approximated node-marginal score for Bayesian DAG structure learning under a non-conjugate Normal–Gamma prior on the modified Cholesky factors of the precision matrix. It shows that the exact node-marginal is a modified Bessel function of the second kind arising from a generalised inverse-Gaussian integral, derives the leading large-argument Laplace form (Theorem 1, Eq. 8), identifies exact GIG posteriors for conditional variances, and embeds the score in a Metropolis–Hastings sampler with a DAG-probit extension for binary outcomes. Asymptotic results give per-sample Laplace accuracy (Theorem 3) and skeleton posterior contraction at rate √(log q / n) (Theorem 4). Simulations compare against CPNIG, BGe, PC, GES, NOTEARS, and DAGMA; applications cover the Sachs protein network and a DAG-probit analysis of Wisconsin Diagnostic Breast Cancer (WDBC) nuclear morphometry features, reporting CV ROC-AUC 0.94.
Significance. If the technical claims hold, the paper supplies a practical closed-form score for a heavier-tailed non-conjugate coefficient prior that has previously required expensive numerical integration, together with uniform asymptotic control and exact GIG sampling of variances. Strengths include honest documentation of score non-equivalence (Table 1), mid-bin miscalibration (Table 11), local-move ESS collapse at larger q (Tables 12–14), mixed q=40 outcomes, and fair hyperparameter sweeps for continuous baselines (Table 5). The micro-benchmark establishing that exact Bessel evaluation is stable and essentially free (Table 2) is useful and correctly demotes Laplace to an analytic rather than computational device. The contribution is complementary to continuous-optimisation DAG learners and to order/partition MCMC, and the score is stated to transfer unchanged into those samplers.
major comments (3)
- Section 3 sets the default shape α = n + q − max_j p_j − 2 so that α^D_j ≍ n and the Bessel order ν_j stays commensurate with z_j ≍ n^{1/2}. Theorems 1 and 3 and the Occam balance of Eq. (8) rely on this large-argument regime; Appendix A.3 explicitly uses the n-dependent rule when controlling ν_j relative to z_j. The manuscript acknowledges that n-dependent α is a device for approximation quality rather than a fixed belief prior, and states only that results are “qualitatively unchanged” under fixed α = q+1. No table or figure reports F1/MCC/SHD, relative Laplace error, or posterior edge probabilities under fixed α at the same (q,n) cells as Tables 3–7 and 6. Because the reported gains over CPNIG/NOTEARS/DAGMA and the finite-sample behaviour of the score are load-bearing for the central claim, a quantitative fixed-α sensitivity analysis (same metrics and cells) is needed before the pract
- The title and keywords frame an application to “breast cancer gene expression networks,” and Section 7 (limitations) refers to “highlighted genes” and candidate biomarkers. The actual application in Section 6.2 is the WDBC nuclear morphometry features (radius, perimeter, concave points, etc.) under a DAG-probit model, not gene-expression data; Sachs (Section 6.1) is protein signalling. References 30–31 and 39–42 on breast-cancer gene signatures appear unused in the reported analyses. This is an internal inconsistency that misstates the empirical contribution and should be corrected throughout (title, abstract framing if needed, keywords, Discussion), with any gene-expression analysis either restored with full results or removed cleanly.
- Abstract and Introduction claim improvement over PC, GES, NOTEARS, and DAGMA “at sample sizes typical of clinical cohorts.” Tables 3–4 and 5 show this is only partly true: at q=20 nCPNG leads, but at q=40 NOTEARS attains higher F1 in several cells when it converges, and DAGMA is best at q=40, n=200. The paper reports these mixed outcomes in the body, which is commendable, but the abstract’s unqualified superiority claim should be aligned with the nuanced ranking (e.g., strongest at moderate n and smaller q; competitive rather than uniformly superior at q=40).
minor comments (6)
- Section 3.2 and Table 2 correctly recommend the exact Bessel score as default; ensure all reported simulation and real-data results state explicitly whether exact or Laplace was used (the text says exact for reported results, but Algorithm 1 still writes the Laplace form (8)).
- Table 1 and the score-equivalence discussion are valuable; consider moving a one-sentence pointer into the abstract or introduction so readers expecting BGe-style equivalence are not surprised.
- Figure 1’s plateau is well explained as sampler mixing at fixed budget; adding ESS or acceptance rate on the same panel would make the diagnosis self-contained.
- Proposition 2’s rate degradation by I_Φ is useful; a short numerical illustration at the WDBC prevalence (already computed as ≈0.58) could sit next to Table 18.
- Minor typography: missing spaces in several compound words in the front matter (e.g., “applicationtobreastcancer”, “node-marginallikelihood”); standardise “Normal–Gamma” vs “Normal-Gamma” hyphenation.
- Data availability is clear; if code for the nCPNG score and Algorithm 1 will be released, state the repository in the final version to support the reproducibility claims made for baselines.
Circularity Check
No significant circularity: the GIG/Bessel node-marginal and Laplace score follow from the stated Normal–Gamma prior and Gaussian likelihood; asymptotics and simulations are against external ground truth. The n-dependent α is a non-standard prior device, not a definitional loop.
full rationale
The derivation chain is self-contained. The node-marginal integral (Eq. 7) is obtained by integrating the Gaussian likelihood (1) against the Normal–Gamma prior (4)–(5); it is exactly GIG and equals a modified Bessel K_ν. Theorem 1 retains the leading large-argument asymptotic of that Bessel function to produce the closed-form score (8); the relative error is the standard O(z^{-1}) remainder, not a fitted residual. Theorems 3–4 then apply uniform Laplace control, KL separation between the true DAG and competitors, and a Chernoff bound on the structural prior (3) to obtain skeleton contraction at √(log q / n) against an external true graph D_0. Simulation data are generated from independent linear-Gaussian SEMs with random coefficients; real-data evaluation uses the external Sachs consensus network and held-out WDBC folds. Self-citations (conjugate CPNIG baseline, order-MCMC literature) are comparative or orthogonal, not load-bearing uniqueness claims. The only non-standard element is the default α = n + q − max_j p_j − 2, which the authors themselves flag as making the prior a device for keeping ν_j and z_j in the large-argument regime rather than a pure fixed belief prior. That choice conditions the quality of the Laplace expansion and Occam balance, but it does not make the score equal its target by construction, nor does any reported F1/MCC/AUC reduce to a fitted input renamed as prediction. Hence circularity is absent; the n-dependent hyperparameter is a methodological caveat, not a circular step.
Assumptions & free parameters
free parameters (5)
- prior scale g
- shape hyperparameter α (n-dependent default)
- edge-inclusion probability π
- continuous-baseline λ and magnitude thresholds
- median-probability threshold 0.5
assumptions (6)
- domain assumption Observations follow a linear-Gaussian SEM with precision Markov w.r.t. a DAG (modified Cholesky form).
- standard math Large-argument expansion of K_ν(z) is valid uniformly for the relevant (ν,z) regime with z ≍ n^{1/2}.
- domain assumption True DAG has bounded maximum in-degree M < ∞ (or slowly growing under Remark 1).
- ad hoc to paper Skeleton prior is orientation-invariant Bernoulli on undirected edges; orientation comes from likelihood/probit only.
- domain assumption Probit threshold θ_0 has flat improper prior; posterior propriety needs ≥1 success and failure.
- standard math Local single-edge MH proposals with Hastings correction target the correct structure posterior.
invented entities (2)
-
nCPNG prior (non-conjugate Normal–Gamma on modified Cholesky)
independent evidence
-
DAG-probit model
independent evidence
Cite this review
Pith. "Pith review of Scalable Bayesian structure learning of directed acyclic graphs via Laplace approximation, with an application to breast cancer gene expression networks." pith.science (2026). https://pith.science/paper/LXS5764G
@misc{pith2026260710222,
author = {Pith},
title = {Pith review of: Scalable Bayesian structure learning of directed acyclic graphs via Laplace approximation, with an application to breast cancer gene expression networks},
year = {2026},
howpublished = {\url{https://pith.science/paper/LXS5764G}},
note = {Machine review of arXiv:2607.10222}
}
abstract
Structure learning of directed acyclic graphs (DAGs) from observational data is a foundational task in causal discovery and is widely used to infer regulatory networks from medical and genomic measurements. The Bayesian formulation quantifies model uncertainty and admits prior biological knowledge, but its practical use has been hampered by the super-exponential growth of the DAG space and by the intractability of the node-marginal likelihood under flexible, non-conjugate priors. Existing closed-form solutions are largely confined to the conjugate Normal--Inverse-Gamma prior. We develop a Laplace-approximated Bayesian scoring function for the non-conjugate Normal--Gamma prior on the modified Cholesky parameterisation of the precision matrix, embed it in a Metropolis--Hastings sampler over DAGs, and couple the latent Gaussian network to a binary clinical outcome through a probit link. We show that the node-marginal integral is of generalised inverse-Gaussian form, so that its exact value is a modified Bessel function of the second kind and the proposed scoring function is its leading large-argument asymptotic; the posterior of each conditional variance is likewise generalised inverse-Gaussian and is sampled exactly. In simulation, the proposed prior improves on the conjugate baseline and on the PC, greedy-equivalence-search, NOTEARS, and DAGMA benchmarks at sample sizes typical of clinical cohorts. On two real datasets, the Sachs protein-signalling network, scored against its validated consensus graph, and the Wisconsin Diagnostic Breast Cancer data, the method recovers known structure and, through the DAG-probit extension, predicts malignancy from nuclear morphometry with a cross-validated ROC-AUC of $0.94$ using a sparse, interpretable set of direct predictors.
Reference graph
Works this paper leans on
-
[1]
Oxford: Oxford University Press; 1996
Lauritzen SL.Graphical Models. Oxford: Oxford University Press; 1996
1996
-
[2]
Cambridge: Cambridge University Press; 2000
Pearl J.Causality: Models, Reasoning, and Inference. Cambridge: Cambridge University Press; 2000
2000
-
[3]
Being Bayesian about network structure.Mach Learn
Friedman N, Koller D. Being Bayesian about network structure.Mach Learn. 2003;50:95-125
2003
-
[4]
Causal protein-signaling networks derived from multiparameter single-cell data.Science
Sachs K, Perez O, Pe’er D, Lauffenburger DA, Nolan GP. Causal protein-signaling networks derived from multiparameter single-cell data.Science. 2005;308(5721):523-529
2005
-
[5]
In:BiomedicalImageProcessingandBiomedicalVisualization.Proc.SPIE1905.1993:861-870
StreetWN,WolbergWH,MangasarianOL.Nuclearfeatureextractionforbreasttumordiagnosis. In:BiomedicalImageProcessingandBiomedicalVisualization.Proc.SPIE1905.1993:861-870
arXiv 1993
-
[6]
New York: Academic Press; 1973:239-273
RobinsonRW.Counting labeledacyclicdigraphs.In:Harary F,ed.NewDirectionsin theTheory of Graphs. New York: Academic Press; 1973:239-273
1973
-
[7]
A Bayesian method for the induction of probabilistic networks from data.Mach Learn
Cooper GF, Herskovits E. A Bayesian method for the induction of probabilistic networks from data.Mach Learn. 1992;9:309-347
1992
-
[8]
Parameter priors for directed acyclic graphical models and the charac- terization of several probability distributions.Ann Statist
Geiger D, Heckerman D. Parameter priors for directed acyclic graphical models and the charac- terization of several probability distributions.Ann Statist. 2002;30(5):1412-1440
2002
Show all 41 references
-
[9]
Learning Markov equivalence classes of directed acyclic graphs: an objective Bayes approach.Stat Med
Castelletti F, Consonni G, Della Vedova ML, Peluso S. Learning Markov equivalence classes of directed acyclic graphs: an objective Bayes approach.Stat Med. 2020;39(30):4745-4766
2020
-
[11]
Posterior graph selection and estimation consistency for high- dimensional Bayesian DAG models.Ann Statist
Cao X, Khare K, Ghosh M. Posterior graph selection and estimation consistency for high- dimensional Bayesian DAG models.Ann Statist. 2019;47(1):319-348
2019
-
[12]
BCDAG: an R package for Bayesian structure and causal learning of Gaussian DAGs
Castelletti F, Mascaro A. BCDAG: an R package for Bayesian structure and causal learning of Gaussian DAGs. arXiv:2201.12003. 2022
2022 arXiv
-
[13]
Wishart distributions: Advances in theory with Bayesian applicationJournal of Multivariate Analysis
Bekker A, van Niekerk J, Arashi M. Wishart distributions: Advances in theory with Bayesian applicationJournal of Multivariate Analysis. 2017;155:272-283
2017
-
[14]
DAGs with NO TEARS: continuous optimization for structure learning
Zheng X, Aragam B, Ravikumar P, Xing EP. DAGs with NO TEARS: continuous optimization for structure learning. In:Advances in Neural Information Processing Systems; 2018
2018
-
[15]
In:Advances in Neural Information Processing Systems; 2020:17943-17954
NgI,GhassamiA,ZhangK.OntheroleofsparsityandDAGconstraintsforlearninglinearDAGs. In:Advances in Neural Information Processing Systems; 2020:17943-17954
2020
-
[16]
In:Advances in Neural Information Processing Systems; 2022
BelloK,AragamB,RavikumarP.DAGMA:learningDAGsviaM-matricesandalog-determinant acyclicity characterization. In:Advances in Neural Information Processing Systems; 2022
2022
-
[17]
DAGs with no curl: an efficient DAG structure learning approach
Yu Y, Gao T, Yin N, Ji Q. DAGs with no curl: an efficient DAG structure learning approach. In: Proceedings of the 38th International Conference on Machine Learning; 2021:12156-12166
2021
-
[18]
Truncated matrix power iteration for differentiable DAG learning
Zhang Z, Ng I, Gong M, Liu Y, Gong C, Bello K. Truncated matrix power iteration for differentiable DAG learning. In:Advances in Neural Information Processing Systems; 2022
2022
-
[19]
TriOpt: a scalable algorithm for linear causal discovery
Joy RA, Zheleva E. TriOpt: a scalable algorithm for linear causal discovery. arXiv:2605.17465. 2026
2026 arXiv
-
[20]
Learning directed acyclic graphs via bootstrap aggregating
Wang R, Peng J. Learning directed acyclic graphs via bootstrap aggregating. arXiv:1406.2098. 2014
-
[21]
DAGBagM: learning directed acyclic graphs of mixed vari- ables with an application to identify protein biomarkers for treatment response in ovarian cancer
Chowdhury S, Wang R, Yu Q, et al. DAGBagM: learning directed acyclic graphs of mixed vari- ables with an application to identify protein biomarkers for treatment response in ovarian cancer. BMC Bioinformatics. 2022;23:321
2022
-
[22]
Optimal structure identification with greedy search.J Mach Learn Res
Chickering DM. Optimal structure identification with greedy search.J Mach Learn Res. 2002;3:507-554
2002
-
[23]
A transformational characterization of equivalent Bayesian network structures
Chickering DM. A transformational characterization of equivalent Bayesian network structures. In:ProceedingsoftheEleventhConferenceonUncertaintyinArtificialIntelligence(UAI).Morgan Kaufmann; 1995:87-98
1995
-
[24]
Estimating high-dimensional directed acyclic graphs with the PC- algorithm.J Mach Learn Res
Kalisch M, Bühlmann P. Estimating high-dimensional directed acyclic graphs with the PC- algorithm.J Mach Learn Res. 2007;8:613-636
2007
-
[25]
Identifiability of Gaussian structural equation models with equal error variances.Biometrika
Peters J, Bühlmann P. Identifiability of Gaussian structural equation models with equal error variances.Biometrika. 2014;101(1):219-228
2014
-
[26]
2009;71(2):319-392
RueH,MartinoS,ChopinN.ApproximateBayesianinferenceforlatentGaussianmodelsbyusing integrated nested Laplace approximations.J R Stat Soc Series B. 2009;71(2):319-392
2009
-
[27]
NAZARIET AL 31
SpokoinyV.Dimension-freeboundsfortheLaplaceapproximation.BayesianAnal.2025;20(1):1- 28. NAZARIET AL 31
2025
-
[28]
Lecture Notes in Statistics, vol
Jørgensen B.Statistical Properties of the Generalized Inverse Gaussian Distribution. Lecture Notes in Statistics, vol. 9. New York: Springer; 1982
1982
-
[29]
Generating generalized inverse Gaussian random variates.Stat Comput
Hörmann W, Leydold J. Generating generalized inverse Gaussian random variates.Stat Comput. 2014;24(4):547-557
2014
-
[30]
Strong time dependence of the 76-gene prognostic signature for node-negativebreastcancerpatientsintheTRANSBIGmulticenterindependentvalidationseries
Desmedt C, Piette F, Loi S, et al. Strong time dependence of the 76-gene prognostic signature for node-negativebreastcancerpatientsintheTRANSBIGmulticenterindependentvalidationseries. Clin Cancer Res. 2007;13(11):3207-3214
2007
-
[31]
Gene expression profiling in breast cancer: understanding the molecularbasisofhistologicgradetoimproveprognosis.JNatlCancerInst.2006;98(4):262-272
Sotiriou C, Wirapati P, Loi S, et al. Gene expression profiling in breast cancer: understanding the molecularbasisofhistologicgradetoimproveprognosis.JNatlCancerInst.2006;98(4):262-272
2006
-
[32]
BeingBayesian aboutnetwork structure:aBayesian approachto structure discovery in Bayesian networks.Mach Learn
Friedman N,KollerD. BeingBayesian aboutnetwork structure:aBayesian approachto structure discovery in Bayesian networks.Mach Learn. 2003;50:95-125
2003
-
[33]
2004;5:549-573
KoivistoM,SoodK.ExactBayesianstructurediscoveryinBayesiannetworks.JMachLearnRes. 2004;5:549-573
2004
-
[34]
Partition MCMC for inference on acyclic digraphs.J Am Stat Assoc
Kuipers J, Moffa G. Partition MCMC for inference on acyclic digraphs.J Am Stat Assoc. 2017;112(517):282-299
2017
-
[35]
Addendum on the scoring of Gaussian directed acyclic graphical models.Ann Statist
Kuipers J, Moffa G, Heckerman D. Addendum on the scoring of Gaussian directed acyclic graphical models.Ann Statist. 2014;42(4):1689-1691
2014
-
[36]
2019;47(6):3413-3437
LeeK,LeeJ,LinL.Minimaxposteriorconvergenceratesandmodelselectionconsistencyinhigh- dimensional DAG models based on sparse Cholesky factors.Ann Statist. 2019;47(6):3413-3437
2019
-
[37]
Lasso meets horseshoe: a survey.Statist Sci
Bhadra A, Datta J, Polson NG, Willard B. Lasso meets horseshoe: a survey.Statist Sci. 2019;34(3):405-427
2019
-
[38]
arXiv:1109.4371
Ben-DavidE,LiT,MassamH,RajaratnamB.High-dimensionalBayesianinferenceforGaussian directed acyclic graph models. arXiv:1109.4371. 2015
2015 arXiv
-
[39]
Interleukin-8 in breast cancer progression.J Interferon Cytokine Res
Todorović-Raković N, Milovanović J. Interleukin-8 in breast cancer progression.J Interferon Cytokine Res. 2013;33(10):563-570
2013
-
[40]
Recent advances reveal IL-8 signaling as a potential key to targeting breast cancer stem cells.Breast Cancer Res
Singh JK, Simões BM, Howell SJ, Farnie G, Clarke RB. Recent advances reveal IL-8 signaling as a potential key to targeting breast cancer stem cells.Breast Cancer Res. 2013;15(4):210
2013
-
[41]
2014;8(7):1278-1289
CallariM,MusellaV,DiBuduoE,etal.Subtype-dependentprognosticrelevanceofaninterferon- induced pathway metagene in node-negative breast cancer.Mol Oncol. 2014;8(7):1278-1289
2014
-
[42]
Prognostic characterization of OAS1/OAS2/OAS3/OASL in breast cancer.BMC Cancer
Zhang Y, Yu C. Prognostic characterization of OAS1/OAS2/OAS3/OASL in breast cancer.BMC Cancer. 2020;20:575
2020
Reviewed July 14, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.