REVIEW 4 major objections 5 minor 27 references
The paper claims that a single latent-variable model can jointly reproduce tumor-volume trajectories, dropout patterns, and genetic conditioning in patient-derived xenograft data, while recovering treatment-effect parameters consistent with
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
An EB-VAE with a hazard-augmented decoder jointly models tumor growth and dropout, and genetic conditioning modestly improves held-out predictions in melanoma and breast cancer PDX data.
T0 review reviewed 2026-08-02 challenge →
load-bearing objection Useful extension of EB-VAE to joint longitudinal/dropout modeling, but the headline genetic gain is not cleanly identified because the with-genetics prior is trained under a different procedure than the baseline. the 4 major comments →
Multimodal Empirical Bayes Variational Autoencoders for Joint Longitudinal and Time-to-Event Modeling
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
Core claim
The central claim is that the EB-VAE framework — latent individual effects k_i inferred by an amortized encoder, regularized by an empirical Bayes prior p_ψ(k|x), and decoded by a neural ODE or a hybrid exponential-growth model — can also carry the time-to-event process. The paper augments the decoder with a hazard head that adds cumulative hazard H_i(t) as a state variable, so the joint likelihood over (y_i, τ_i, δ_i) couples growth and dropout through the same latent variables. On PDX tumor data, the joint model's prior predictive simulations fell inside the observed percentiles in treatment-stratified VPCs and KM-VPCs for held-out individuals, while the hybrid decoder's post-hoc treatment
What carries the argument
The mechanism is the latent individual effect k_i shared by the longitudinal decoder and the hazard: the decoder is a differential equation in (z_i(t), H_i(t)) where H_i is cumulative dropout hazard, so the time-to-event likelihood is integrated into the ELBO. The empirical Bayes prior p_ψ(k|x) is conditioned on treatment (and, in a second stage, on genetic indicators through a KL-trained shift model), which is what lets the model borrow strength across individuals and treatments. The treatment-effect decomposition in Eq. 1 — prior means written as baseline growth minus monotherapy and combination-interaction terms — is what turns the latent population distribution into interpretable NLME-li
Load-bearing premise
The load-bearing premise is that the 13% (melanoma) and 11% (breast cancer) RMSE improvements come from the genetic information itself, but the genetics-conditioned prior was trained with an extra second-stage, KL-only optimization that the treatment-only baseline did not receive — so any part of the improvement could be an artifact of that extra optimization rather than of the DNA.
What would settle it
Take the already-trained treatment-only model, run the identical second-stage KL-only training with the genetic indicator vectors replaced by random binary vectors (or by permutations of the real ones across individuals), and measure RMSE on held-out individuals. If RMSE drops by roughly the same 13%/11%, the genetic signal is an artifact of the extra optimization; if it stays flat, the genetic effect is real and attributable to the covariates.
If this is right
- The framework subsumes the classic two-step pharmacometric workflow (longitudinal NLME plus separate survival model) into one joint latent-variable model, so dropout and tumor dynamics inform each other automatically.
- Hybrid decoders preserve interpretability: treatment-effect parameters can be extracted post hoc from the learned prior means, giving a bridge between neural models and classical population modeling.
- If the treatment-holdout results generalize, models trained on a diverse set of monotherapies and combinations can predict tumor trajectories under unseen regimens without retraining.
- Genetic conditioning lowers out-of-sample RMSE, and the stability-selection scheme turns the model into a hypothesis generator that ranks candidate biomarkers (e.g., BRAF V600E, NRAS, NF1, MDM2) for further study.
Where Pith is reading between the lines
- The paper's genetic result is confounded: the genetics-conditioned prior is trained in a second stage with a KL-only objective, while the treatment-only baseline is the stage-1 prior. A fair experiment would retrain the treatment-only prior with the same two-stage protocol and genetic inputs permuted; if the RMSE gain persists, it is genetic, if not, it is optimization artifact.
- The framework's hazard augmentation is endpoint-agnostic, so the same decoder state could carry progression, survival, or other clinical events beyond dropout — a natural extension the paper mentions only implicitly.
- Because most of the genetic benefit appears at early time points, the model suggests genetics mostly sharpens initial trajectory predictions; an untested corollary is that later-time predictions would benefit more from combining genetics with continuous molecular readouts rather than binary alteration indicators.
- The authors themselves label the genetic experiment a proof-of-concept restricted to two tumor types, so the 13%/11% improvements should be read as scoped to melanoma and breast cancer PDX data, not as a general claim about all solid tumors.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper extends the empirical Bayes variational autoencoder (EB-VAE) framework to jointly model longitudinal tumor-volume trajectories and time-to-event dropout, and further incorporates genomic covariates through a two-stage prior adaptation. The authors evaluate two decoder formulations (fully neural NODE and hybrid exponential-growth plus NODE hazard) on patient-derived xenograft (PDX) data from cutaneous melanoma and breast cancer. They report that the hybrid decoder recovers treatment-effect parameters broadly consistent with previous NLME estimates, that the joint model reproduces tumor-volume and dropout distributions in held-out individuals, and that genetic conditioning improves individual-level prior predictions. The paper also uses stability selection to rank genetic indicators, identifying plausible candidates such as BRAF V600E, NRAS, NF1, and MDM2.
Significance. If the claims hold, the EB-VAE framework would be a useful contribution to pharmacometric machine learning: it provides a single probabilistic framework for longitudinal dynamics, informative dropout, treatment effects, and high-dimensional genomic covariates, while retaining a mechanistic interpretation via the hybrid decoder. The paper makes good use of standard pharmacometric diagnostics (VPCs, KM-VPCs, pcVPCs) and includes treatment-holdout and multi-treatment training experiments that go beyond simple reconstruction. The hybrid parameter recovery, although approximate, is a valuable bridge between amortized variational inference and classical NLME models. However, the headline genetics claim is not currently supported by a controlled comparison, and there are internal inconsistencies in the reported parameter values. The core methodological machinery is promising and the experimental design is largely appropriate, but the genetics result requires re-analysis before the paper's central claims can be accepted.
major comments (4)
- [§2.5, §3.3, Table 4] The claim that genetic conditioning improves prior predictions rests on a confounded comparison. The genetics-conditioned prior is trained post hoc with a KL-only objective after freezing the encoder, decoder, and stage-1 prior, while the treatment-only baseline is trained jointly through the full ELBO. The two models differ in both covariate conditioning and optimization procedure, so the RMSE gain (Table 4: CM 161.4→140.0, BC 131.5→117.1) cannot be attributed to genetic information. A matched control is needed: e.g., train a treatment-only prior with the same two-stage KL-only objective, or train the genetics-conditioned prior end-to-end, or permute genetic labels. Without this, the abstract's statement that genetic conditioning improved predictions is unsupported.
- [§2.1, Appendix C] Genetic information is linked at the PDX-model level, and the model includes a learned PDX-model embedding. If cross-validation splits individuals (mice/trajectories) rather than PDX models, trajectories from the same PDX model can appear in both training and test sets, allowing the embedding or the shared genetic vector to memorize model-specific characteristics. The manuscript does not state that all trajectories of a given PDX model are confined to one fold. If this is the case, the genetics improvement could be at least partly an artifact of leakage. The authors should clarify the split and preferably report results with PDX-model-level cross-validation.
- [§3.1, Table 2, Table 3] There is an internal inconsistency in the hybrid parameter recovery. The text reports monotherapy parameters for LEE011, encorafenib, and binimetinib as 0.0372, 0.0340, and 0.0212, compared with reference values 0.0444, 0.0393, and 0.0090. However, Table 3 lists the same estimates as net growth rates and gives the encorafenib reference as 0.0462, while Table 2 reports different drug-effect parameters (a_LEE011=0.0458, a_encorafenib=0.0490, a_binimetinib=0.0618) with reference values 0.0156, 0.0138, 0.051. These tables and the text use 'parameter' inconsistently and cannot all be correct. This needs to be reconciled before the 'broadly consistent' recovery claim can be assessed.
- [§3.3, Table 4, Figure 5] The genetics comparison reports mean RMSE improvements of 13.3% and 11.0% over five runs each, but no uncertainty intervals or paired significance tests are provided. Given the high variance typical of small PDX cohorts and the confounded training procedure, a permutation test or bootstrap confidence interval for the RMSE difference is necessary. The histograms in Figure 5 are descriptive only and do not establish that the improvement is systematic across subjects beyond the aggregate means.
minor comments (5)
- [§3.2] The text refers to 'Figure 7' for the KM-VPC/pcVPC comparison, but the main-text figure is numbered Figure 3; Figure 7 appears in the supplementary material. Please correct the cross-reference.
- [§3.4] Typo: 'benfit' should be 'benefit'.
- [§3.1 and Table 3] The reference values for encorafenib differ between the text (0.0393) and Table 3 (0.0462). Also clarify whether 'monotherapy parameter' means the net growth rate or the drug-effect coefficient a_j; the notation in Eq. (1) suggests the latter, but the results are reported in a mixed way.
- [Appendix C] Please state explicitly whether the learned PDX-model embedding is trained per PDX model and whether it is used in the genetics experiments; its role is not described in the main text and its interaction with cross-validation should be clarified.
- [General] The manuscript lacks a data and code availability statement. Given the complexity of the training procedure and the importance of the two-stage genetic adaptation, providing code would substantially aid reproducibility.
Circularity Check
No circular derivation: hybrid parameter recovery is a post-hoc mapping of fitted prior means to an external benchmark, and the genetics comparison is an empirical held-out evaluation.
full rationale
The paper's derivation chain does not reduce any predicted quantity to a fitted input by construction. The hybrid treatment-effect parameters are explicitly post hoc: 'these treatment-effect parameters are not explicit decoder parameters during training. They are instead obtained post hoc by solving the linear system implied by Eq. 1 using the treatment-specific prior means.' The comparison with [19] is an external published NLME benchmark, not a training target, so 'broadly consistent' is a validation statement rather than a circular derivation. The joint model's dropout component enters through a standard hazard log-likelihood term in the ELBO (Section 2.3), and the genetics-conditioned prior is trained in a second stage against the fixed encoder posterior via KL (§2.5); the resulting held-out RMSE improvement is an empirical result, not an algebraic identity. The self-citations [18,19] supply the base framework and a literature reference, but neither is invoked as a uniqueness theorem or as a constraint that forces the reported values. The main weakness — that the with-genetics and treatment-only priors differ in both conditioning and training procedure — is a validity/confounding concern, which the paper partly acknowledges ('The two-stage genetic adaptation used here was introduced to stabilize learning'), not a circularity.
Axiom & Free-Parameter Ledger
free parameters (5)
- Latent dimensionality of ki =
1 or 2 (per dataset)
- Number of genetic programs =
6
- Genetic indicator set =
463 binary indicators
- Treatment-specific prior means μ_a =
estimated from data per treatment arm
- Naive dropout threshold =
1500 mm3
axioms (6)
- domain assumption Longitudinal and event processes are conditionally independent given latent individual effect k_i
- standard math Hazard and survival functions follow standard survival model S(t)=exp(-H(t)) with time-dependent hazard λ, and dropout time simulated by exponential threshold
- domain assumption Hybrid decoder uses exponential tumor growth dz/dt = k z
- domain assumption Treatment effects enter the prior mean linearly with pairwise interactions only (Eq. 1)
- ad hoc to paper The encoder posterior qφ(k|y,x) is a good enough approximation to the true posterior that a genetics-conditioned prior trained to match it will improve predictions
- domain assumption PDX data are representative and dropout is informative
invented entities (2)
-
genetic programs
no independent evidence
-
PDX-model embedding
no independent evidence
Cite this review
Pith. "Pith review of Multimodal Empirical Bayes Variational Autoencoders for Joint Longitudinal and Time-to-Event Modeling." pith.science (2026). https://pith.science/paper/ZWI6WBT3
@misc{pith2026260713984,
author = {Pith},
title = {Pith review of: Multimodal Empirical Bayes Variational Autoencoders for Joint Longitudinal and Time-to-Event Modeling},
year = {2026},
howpublished = {\url{https://pith.science/paper/ZWI6WBT3}},
note = {Machine review of arXiv:2607.13984}
}
read the original abstract
Longitudinal tumor measurements, dropout information, and genetic covariates provide complementary information about treatment response, but integrating these data sources within a single population modeling framework remains challenging. We extend the empirical Bayes variational autoencoder (EB-VAE) framework to joint longitudinal and time-to-event modeling and evaluate it on tumor growth data. The framework represents inter-individual variability using latent individual effects regularized by a covariate-conditioned empirical Bayes prior, while a decoder maps these latent effects to tumor-volume trajectories. To account for informative dropout, the decoder was augmented with a hazard model, yielding joint predictions of tumor growth and time to dropout. We further compared fully neural and hybrid semi-mechanistic decoder formulations and incorporated genomic covariates through a genetics-conditioned prior adaptation. The hybrid decoder recovered treatment-effect parameters broadly consistent with previously reported nonlinear mixed-effects estimates, while achieving prior predictive performance comparable to the neural decoder. The joint model reproduced both tumor-volume distributions and dropout patterns in held-out individuals, and genetic conditioning improved individual-level prior predictions in both cutaneous melanoma and breast cancer experiments. Stability selection identified several biologically plausible genetic indicators, including alterations in BRAF, NRAS, NF1, and MDM2. These results demonstrate that EB-VAE provides a flexible probabilistic framework for combining neural dynamics, mechanistic structure, time-to-event modeling, and high-dimensional covariates in pharmacometric applications.
Figures
Reference graph
Works this paper leans on
-
[1]
Joint modelling of longitudinal and repeated time-to-event data using nonlinear mixed-effects models and the stochastic approximation expectation–maximization algorithm,
C. Mbogning, K. Bleakley, and M. Lavielle, “Joint modelling of longitudinal and repeated time-to-event data using nonlinear mixed-effects models and the stochastic approximation expectation–maximization algorithm,”Journal of Statistical Computation and Simulation, vol. 85, no. 8, pp. 1512–1528, 2015
2015
-
[2]
Translational pharmacoki- netic/pharmacodynamic modeling of tumor growth inhibition supports dose-range se- lection of the anti–pd-1 antibody pembrolizumab,
A. Lindauer, C. R. Valiathan, K. Mehta,et al., “Translational pharmacoki- netic/pharmacodynamic modeling of tumor growth inhibition supports dose-range se- lection of the anti–pd-1 antibody pembrolizumab,”CPT: Pharmacometrics & Systems Pharmacology, vol. 6, no. 1, pp. 11–20, 2017
2017
-
[3]
Model-based prediction of phase iii overall survival in colorectal cancer on the basis of phase ii tumor dynamics,
L. Claret, P. Girard, P. M. Hoff,et al., “Model-based prediction of phase iii overall survival in colorectal cancer on the basis of phase ii tumor dynamics,”Journal of Clinical Oncology, vol. 27, no. 25, pp. 4103–4108, 2009
2009
-
[4]
Multi-omics approaches to disease,
Y. Hasin, M. Seldin, and A. Lusis, “Multi-omics approaches to disease,”Genome biology, vol. 18, no. 1, p. 83, 2017. 16
2017
-
[5]
High-throughput screening using patient-derived tumor xenografts to predict clinical trial drug response,
H. Gao, J. M. Korn, S. Ferretti, J. E. Monahan, Y. Wang, M. Singh, C. Zhang, C. Schnell, G. Yang, Y. Zhang,et al., “High-throughput screening using patient-derived tumor xenografts to predict clinical trial drug response,”Nature medicine, vol. 21, no. 11, pp. 1318– 1325, 2015
2015
-
[6]
Nonlinear mixed effects models for repeated measures data,
M. J. Lindstrom and D. M. Bates, “Nonlinear mixed effects models for repeated measures data,”Biometrics, vol. 46, no. 3, pp. 673–687, 1990
1990
-
[7]
A review of mixed-effects models of tumor growth and effects of anticancer drug treatment used in population analysis,
B. Ribba, N. H. Holford, P. Magni,et al., “A review of mixed-effects models of tumor growth and effects of anticancer drug treatment used in population analysis,”CPT: Pharmacometrics & Systems Pharmacology, vol. 3, no. 5, p. e113, 2014
2014
-
[8]
A novel method based on unbiased correlations tests for covariate selection in nonlinear mixed effects models: the COSSAC approach,
G. Ayral, J.-F. Si Abdallah, C. Magnard, and J. Chauvin, “A novel method based on unbiased correlations tests for covariate selection in nonlinear mixed effects models: the COSSAC approach,”CPT: Pharmacometrics & Systems Pharmacology, vol. 10, no. 4, pp. 318–329, 2021
2021
-
[9]
Covariate modeling in pharmacometrics: general points for consideration,
K. Sanghavi, J. Ribbing, J. A. Rogers, M. A. Ahmed, M. O. Karlsson, N. Holford, E. Chasseloup, M. Ahamadi, K. G. Kowalski, S. Cole,et al., “Covariate modeling in pharmacometrics: general points for consideration,”CPT: Pharmacometrics & Systems Pharmacology, vol. 13, no. 5, pp. 710–728, 2024
2024
-
[10]
Neural-ODE for pharmacokinetics modeling and its advantage to alternative machine learning models in predicting new dosing regimens,
J. Lu, K. Deng, X. Zhang, G. Liu, and Y. Guan, “Neural-ODE for pharmacokinetics modeling and its advantage to alternative machine learning models in predicting new dosing regimens,”iScience, vol. 24, no. 7, 2021
2021
-
[11]
Low-dimensional neural ordinary differential equations accounting for inter-individual variability implemented in Monolix and NONMEM,
D. S. Br¨ am, B. Steiert, M. Pfister, B. Steffens, and G. Koch, “Low-dimensional neural ordinary differential equations accounting for inter-individual variability implemented in Monolix and NONMEM,”CPT: Pharmacometrics & Systems Pharmacology, vol. 14, no. 1, pp. 5–16, 2025
2025
-
[12]
Z. Li, M. Prague, R. Thi´ ebaut, and Q. Clairon, “Variational autoencoder for inference of nonlinear mixed effect models based on ordinary differential equations,”arXiv preprint arXiv:2601.17400, 2026
arXiv 2026
-
[13]
Phar- macometrics and machine learning partner to advance clinical data analysis,
G. Koch, M. Pfister, I. Daunhawer, M. Wilbaux, S. Wellmann, and J. E. Vogt, “Phar- macometrics and machine learning partner to advance clinical data analysis,”Clinical Pharmacology & Therapeutics, vol. 107, no. 4, pp. 926–933, 2020
2020
-
[14]
The evolution of nonlinear mixed effects modeling in pharmacometrics: toward AI-based variational autoencoders,
J. Rohleff, G. Koch, and J. Schropp, “The evolution of nonlinear mixed effects modeling in pharmacometrics: toward AI-based variational autoencoders,”Journal of Pharmacokinetics and Pharmacodynamics, vol. 53, p. 37, 2026
2026
-
[15]
Neural ordinary differential equations,
R. T. Chen, Y. Rubanova, J. Bettencourt, and D. K. Duvenaud, “Neural ordinary differential equations,”Advances in Neural Information Processing Systems, vol. 31, 2018
2018
-
[16]
Auto-encoding variational Bayes,
D. P. Kingma and M. Welling, “Auto-encoding variational Bayes,”arXiv preprint arXiv:1312.6114, 2013
Pith/arXiv arXiv 2013
-
[17]
An introduction to variational autoencoders,
D. P. Kingma and M. Welling, “An introduction to variational autoencoders,”Foundations and Trends in Machine Learning, vol. 12, no. 4, pp. 307–392, 2019
2019
-
[18]
The empirical Bayes variational autoencoder – a neural ODE approach for population modeling in pharmacology,
M. Baaz, A. Sj¨ oberg, and M. Jirstrand, “The empirical Bayes variational autoencoder – a neural ODE approach for population modeling in pharmacology,”CPT: Pharmacometrics & Systems Pharmacology, vol. 15, no. 7, p. e70280, 2026. 17
2026
-
[19]
Optimized scaling of translational factors in oncology: from xenografts to RECIST,
M. Baaz, T. Cardilin, F. Lignet, and M. Jirstrand, “Optimized scaling of translational factors in oncology: from xenografts to RECIST,”Cancer Chemotherapy and Pharmacology, vol. 90, no. 3, pp. 239–250, 2022
2022
-
[20]
Convergence of a stochastic approximation version of the em algorithm,
B. Delyon, M. Lavielle, and E. Moulines, “Convergence of a stochastic approximation version of the em algorithm,”The Annals of Statistics, vol. 27, no. 1, pp. 94–128, 1999
1999
-
[21]
C. M. Bishop,Pattern Recognition and Machine Learning. New York: Springer, 2006
2006
-
[22]
The COSMIC cancer gene census: describing genetic dysfunction across all human cancers,
Z. Sondka, S. Bamford, C. G. Cole, S. A. Ward, I. Dunham, and S. A. Forbes, “The COSMIC cancer gene census: describing genetic dysfunction across all human cancers,” Nature Reviews Cancer, vol. 18, no. 11, pp. 696–705, 2018
2018
-
[23]
Stability selection,
N. Meinshausen and P. B¨ uhlmann, “Stability selection,”Journal of the Royal Statistical Society Series B: Statistical Methodology, vol. 72, no. 4, pp. 417–473, 2010
2010
-
[24]
Prediction-corrected visual predictive checks for diagnosing nonlinear mixed-effects models,
M. Bergstrand, A. C. Hooker, J. E. Wallin, and M. O. Karlsson, “Prediction-corrected visual predictive checks for diagnosing nonlinear mixed-effects models,”The AAPS Journal, vol. 13, pp. 143–151, 2011
2011
-
[25]
BRAF V600E in cancer: Exploring structural complexities, mutation profiles, and pathway dysregulation,
J. Bharti, P. Gogu, S. K. Pandey, A. Verma, J. P. Yadav, A. K. Singh, P. Kumar, A. R. Dwivedi, and P. Pathak, “BRAF V600E in cancer: Exploring structural complexities, mutation profiles, and pathway dysregulation,”Experimental Cell Research, vol. 446, no. 1, p. 114440, 2025
2025
-
[26]
MDM2/MDM4 amplification and CDKN2A deletion in metastatic melanoma and glioblastoma multiforme may have implications for targeted therapeutics and immunotherapy,
T. E. Arnoff and W. S. El-Deiry, “MDM2/MDM4 amplification and CDKN2A deletion in metastatic melanoma and glioblastoma multiforme may have implications for targeted therapeutics and immunotherapy,”American Journal of Cancer Research, vol. 12, no. 5, p. 2102, 2022
2022
-
[27]
Signal pathways of melanoma and targeted therapy,
W. Guo, H. Wang, and C. Li, “Signal pathways of melanoma and targeted therapy,”Signal transduction and targeted therapy, vol. 6, no. 1, p. 424, 2021. Appendix A Detailed Evaluation Procedures Models were evaluated using both prior and posterior predictive simulations, depending on the objective of the analysis. Prior predictive simulations were used to as...
2021
This paper was first reviewed by deepseek-v4-flash on August 2, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.