REVIEW 2 major objections 5 minor 30 references
A censoring-aware target interface for tabular foundation models in survival prediction
T0 review · 2 major / 5 minor · reviewed 2026-07-13 · grok-4.5
Pith's one-line read Jackknife pseudo-RMST targets convert right-censored survival outcomes into ordinary regression labels so tabular foundation models can predict restricted event-free time without survival-specific training.
desk verdict Solid methods bridge: jackknife pseudo-RMST as a portable target interface for frozen tabular foundation models, with known-truth recovery and honest multi-backbone benchmarks. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
Jackknife pseudo-RMST targets: patient-level labels Zi(τ) = n θ̂τ(D) − (n−1) θ̂τ(D−i) formed from the full-sample and leave-one-out Kaplan–Meier RMST estimators. They convert a fold-level censored-data functional into regression responses whose conditional expectation approximates conditional RMST, so standard tabular regression becomes a meaningful horizon-specific survival task.
What would settle it
Build a controlled simulation with known conditional RMST but informative censoring (censoring depends on unobserved factors tied to the event). If pseudo-RMST targets then fail to cut oracle RMST error relative to naive min(Y,τ) labels and discrimination collapses, the claim that this target interface is a general portable bridge fails in that regime.
Extended reading notes
Core claim
SurvFM-RMST establishes that censoring can be handled through a target interface: jackknife pseudo-observations for RMST at a prespecified horizon turn right-censored follow-up into patient-level regression responses, so interchangeable tabular foundation-model backbones can perform horizon-specific restricted event-free-time prediction without survival-specific fine-tuning, risk-set losses, or new survival-output heads. Controlled simulations with known conditional RMST and a target-definition ablation support that the pseudo-RMST construction is substantive rather than cosmetic, and public-data benchmarks show competitive discrimination and RMST-scale error across several backbones, with r
Load-bearing premise
The method assumes that leave-one-out RMST pseudo-labels act as usable noisy patient-level targets for true restricted mean survival time when censoring is independent of the event process and finite-sample risk sets are not too thin.
Editorial extensions
If this is right
- Censored survival tables can be fed to existing tabular foundation-model regressors by changing only the outcome construction, not the backbone architecture.
- Horizon-specific RMST predictions give restricted event-free-time outputs on the original time scale that can stratify held-out patients into ordered risk groups with event enrichment.
- The survival-specific component becomes a reusable target recipe, so multiple tabular backbones can be swapped under the same censoring-aware interface.
- Pseudo-RMST labels outperform naive restricted observed-time and event-only labels for recovering known conditional RMST.
- Relative model ranking remains endpoint-, horizon-, and constraint-dependent, so validation inside the intended setting still decides backbone choice.
Reading between the lines
- The same target-side pattern could be applied to competing risks by building pseudo-observations for cause-specific restricted mean time or cumulative incidence, extending the interface without redesigning foundation backbones.
- If the interface is truly portable, it should also drop into classical tabular regressors and AutoML stacks, not only foundation models—a low-cost check of how much of the gain is the target versus the backbone.
- Refreshing pseudo-RMST at successive landmarks as new covariates arrive would test whether the static interface can become a lightweight route to time-updated prognosis.
- A diagnostic that flags thin risk sets or near-informative censoring before target construction would be a practical guardrail for the load-bearing assumption.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces SurvFM-RMST, a target-interface framework that converts right-censored survival outcomes into jackknife pseudo-observation labels for restricted mean survival time (RMST) at a fixed horizon τ, then feeds those labels to interchangeable tabular foundation-model backbones (TabPFN-v3, TabICL, TabDPT, TabH2O, MITRA) for ordinary horizon-specific regression without survival-specific fine-tuning or new output heads. Controlled simulations with known conditional RMST (24 settings, five replicates) show accurate oracle recovery and a same-backbone ablation in which pseudo-RMST targets reduce oracle RMSE and improve Uno’s C-index relative to min(Y,τ) and event-only labels. On 36 eligible static SurvSet datasets the SurvFM backbones are competitive with RMST-regression and classical survival comparators on discrimination and tau-normalized IPCW RMST error, with performance varying by horizon, endpoint and practical constraints; predicted-RMST tertiles also separate held-out Kaplan–Meier trajectories and enrich events. The authors position the contribution as a portable censoring-aware interface rather than a universally superior survival model.
Significance. If the results hold, the paper supplies a practical, theory-grounded route for applying existing tabular foundation models to right-censored biomedical data without redesigning their architectures or losses. The combination of known-truth oracle recovery, a clean same-backbone target ablation, multi-backbone public benchmarks with explicit denominators, and transparent practical profiles (column limits, runtimes, reduced-training ranks) is stronger evidence than is typical for early foundation-model survival adaptations. The work is complementary to survival-native and representation-side approaches and is likely to be useful to methodologists and applied groups that already rely on TabPFN-style tools. Scope limitations (static covariates, fixed horizons, eligible SurvSet subset, fixed hyperparameters) are stated clearly and do not erase the portability claim.
major comments (2)
- Methods §4.3, Eq. (7) and the target-ablation design (Results 2.2, Fig. 2d): the central portability claim rests on the classical approximation E{Zi(τ;D)|Xi=x}=μτ(x)+op(1) under independent/non-informative censoring. The same-backbone ablation already shows clear gains over naive targets, and the authors clip labels to [0,τ], but the manuscript still lacks a finite-sample diagnostic (e.g., bias of leave-one-out RMST as a function of risk-set size or censoring rate) that would let readers judge when the approximation is adequate. A short simulation or real-data sensitivity panel quantifying this would strengthen the load-bearing premise without changing the framework.
- Results 2.4–2.5 and Methods §4.11–4.12: public-data conclusions are drawn from an eligible static SurvSet subset (36 of 77 screened) plus a limited tau80 scalability sensitivity on 11 scale-excluded datasets. While denominators and non-imputation are reported carefully, the main text still risks over-generalization (“competitive \ldots across 36 eligible static SurvSet datasets”). Explicitly framing the benchmark as a static, size- and dimensionality-filtered subset in the abstract and Results opening, and stating that dynamic/longitudinal/competing-risk settings remain out of scope, would keep the claim proportionate to the evidence.
minor comments (5)
- Figure 2a caption notes a zoomed error axis; the main text should also flag that full-range tails appear only in Supplementary Fig. 1a so readers do not misread dispersion.
- Methods §4.5–4.6 list package versions and fixed hyperparameters; a single compact table of all backbone and comparator configurations would improve reproducibility scanning.
- The distinction between oracle conditional-RMST RMSE and realized restricted-time error (Eqs. 11–12) is clear in Methods but could be restated briefly when first used in Results 2.2.
- Supplementary Table 6 design-choice audits are appropriately scoped as non-main, but a one-sentence pointer in the Discussion would help readers locate them.
- Minor notation consistency: both Zi(τ;D) and zi(τ) appear; standardizing on one form would reduce friction.
Circularity Check
No significant circularity: oracle RMST recovery and same-backbone target ablation are independent of the fitted backbones; classical pseudo-observation theory is external.
full rationale
SurvFM-RMST's central claim is that jackknife pseudo-RMST targets form a portable interface for frozen tabular backbones. The derivation chain is: (i) define conditional RMST μ au(x) (Eq. 2); (ii) construct jackknife Zi( au;D) from KM-RMST (Eqs. 5–6); (iii) invoke classical pseudo-observation theory that E{Zi|Xi=x}=μ au(x)+op(1) under independent censoring (Eq. 7, citing Andersen et al.); (iv) regress Zi with interchangeable tabular backbones; (v) evaluate against known conditional RMST in simulation and against external SurvSet comparators. Step (iii) is an asymptotic approximation from the literature, not a self-definition. Simulation oracle RMSE uses the known data-generating μ au, independent of any fitted model. The target ablation holds the backbone fixed and varies only the label, so gains for pseudo-RMST over min(Y, au) and event-only targets are not forced by construction. Public benchmarks use external datasets and standard survival/RMST baselines. No fitted parameter is renamed as a prediction, no uniqueness theorem is imported from the authors, and no self-citation is load-bearing for the interface claim. The only mild loop is the usual methods-paper framing that the interface works because the evaluations show it works; that does not make the results circular. Score 1 reflects that ordinary self-contained methods paper structure, not a reduction of the claim to its inputs.
Assumptions & free parameters
free parameters (4)
- restriction horizon τ (tau50/tau80/tau90 quantiles of training uncensored events)
- pseudo-RMST and prediction clipping to [0,τ]
- fixed backbone and comparator hyperparameters (e.g., RF 200 trees, TabICL n_estimators=8, DeepSurv architecture)
- SurvSet eligibility filters (static, size, dimensionality, loading/runtime constraints)
assumptions (5)
- domain assumption Independent or non-informative censoring and regularity conditions under which jackknife pseudo-observations target conditional RMST.
- domain assumption E{Zi(τ;D)|Xi=x}=μτ(x)+op(1): pseudo-observations approximate conditional RMST asymptotically, not as a finite-sample identity.
- standard math Conditional RMST equals the optimal squared-error regression target for min(T,τ) under complete observation.
- domain assumption Kaplan–Meier RMST functional on the training fold is an adequate plug-in for jackknife target construction.
- ad hoc to paper Static baseline covariates and a single fixed horizon suffice for the intended prediction task; no longitudinal/dynamic/competing-risk structure is required.
invented entities (1)
-
SurvFM-RMST target-interface framework
independent evidence
Cite this review
Pith. "Pith review of A censoring-aware target interface for tabular foundation models in survival prediction." pith.science (2026). https://pith.science/paper/WOQ7PM65
@misc{pith2026260709577,
author = {Pith},
title = {Pith review of: A censoring-aware target interface for tabular foundation models in survival prediction},
year = {2026},
howpublished = {\url{https://pith.science/paper/WOQ7PM65}},
note = {Machine review of arXiv:2607.09577}
}
read the original abstract
Time-to-event prediction from tabular patient data is central to prognosis and biomedical decision support, but right-censored follow-up prevents direct use of ordinary regression labels. Tabular foundation models offer reusable prediction machinery for modest heterogeneous datasets, yet they generally assume fully observed outcomes. We introduce SurvFM-RMST, a censoring-aware target-interface framework that converts survival outcomes into jackknife pseudo-observation targets for restricted mean survival time, enabling multiple tabular backbones to perform horizon-specific RMST regression without survival-specific fine-tuning. In controlled simulations with known conditional RMST, SurvFM-RMST recovered restricted event-free time accurately, and pseudo-RMST targets outperformed naive restricted observed-time and event-only targets. Across 36 eligible static SurvSet datasets, SurvFM backbones were competitive with established survival and RMST-regression comparators, though relative performance varied by endpoint, horizon and practical constraints. Predicted RMST further stratified held-out patients into groups with ordered observed event-free time and event enrichment. Overall, the results support pseudo-RMST target construction as a portable interface between censored survival data and tabular foundation-model prediction.
Figures
Reference graph
Works this paper leans on
-
[1]
D. R. Cox. Regression models and life-tables.Journal of the Royal Statistical Society: Series B, 34(2):187–202, 1972
1972
-
[2]
Ishwaran, U
H. Ishwaran, U. B. Kogalur, E. H. Blackstone, and M. S. Lauer. Random survival forests.The Annals of Applied Statistics, 2(3):841–860, 2008
2008
-
[3]
van der Laan
Torsten Hothorn, Peter Bühlmann, Sandrine Dudoit, Annette Molinaro, and Mark J. van der Laan. Survival ensembles.Biostatistics, 7(3):355–373, 2006
2006
-
[4]
Katzman, Uri Shaham, Alexander Cloninger, Jonathan Bates, Tingting Jiang, and Yuval Kluger
Jared L. Katzman, Uri Shaham, Alexander Cloninger, Jonathan Bates, Tingting Jiang, and Yuval Kluger. DeepSurv: personalized treatment recommender system using a Cox propor- tional hazards deep neural network.BMC Medical Research Methodology, 18:24, 2018
2018
-
[5]
Time-to-event prediction with neural net- works and Cox regression.Journal of Machine Learning Research, 20(129):1–30, 2019
Håvard Kvamme, Ørnulf Borgan, and Ida Scheel. Time-to-event prediction with neural net- works and Cox regression.Journal of Machine Learning Research, 20(129):1–30, 2019
2019
-
[6]
Lin, and Ziyi Li
Yue Lyu, Xuelin Huang, Steven H. Lin, and Ziyi Li. SuperSurv: A unified framework for machine learning ensembles in survival analysis. bioRxiv preprint, 2026. Preprint
2026
-
[7]
Accurate predictions on small data with a tabular foundation model.Nature, 637:319–326, 2025
Noah Hollmann, Samuel Müller, Lennart Purucker, Arjun Krishnakumar, Max Körfer, Shi Bin Hoo, Robin Tibor Schirrmeister, and Frank Hutter. Accurate predictions on small data with a tabular foundation model.Nature, 637:319–326, 2025. 31
2025
-
[8]
Da In Kim, Wei Siang Lai, and Kelly W. Zhang. Tabular foundation models can do survival analysis, 2026
2026
Show all 30 references
-
[9]
Survival in-context: Amortized bayesian survival analysis via prior-fitted networks, 2026
Dmitrii Seletkov, Paul Hager, Georgios Kaissis, Rickmer Braren, Daniel Rueckert, and Raphael Rehms. Survival in-context: Amortized bayesian survival analysis via prior-fitted networks, 2026
2026
-
[10]
Krishnan
Shi-ang Qi, Vahid Balazadeh, Michael Cooper, Russell Greiner, and Rahul G. Krishnan. Sur- vivalPFN: Amortizing survival prediction via in-context bayesian inference, 2026
2026
-
[11]
SurvPFN: Towards foundation models for survival predictions, 2026
Samuel Böhm, Lennart Purucker, Frank Hutter, and Pascal Schlosser. SurvPFN: Towards foundation models for survival predictions, 2026. Accepted at the ICML 2026 Workshop on Foundation Models for Structured Data
2026
-
[12]
Staying alive: Uncensored survival analysis with tabular foundation models, 2026
Mariana Vargas Vieyra. Staying alive: Uncensored survival analysis with tabular foundation models, 2026
2026
-
[13]
Learning patient-specific cancer survival distributions as a sequence of dependent regressors
Chun-Nam Yu, Russell Greiner, Hsiu-Chin Lin, and Vickie Baracos. Learning patient-specific cancer survival distributions as a sequence of dependent regressors. InAdvances in Neural Information Processing Systems, volume 24, 2011
2011
-
[14]
Zame, Jinsung Yoon, and Mihaela van der Schaar
Changhee Lee, William R. Zame, Jinsung Yoon, and Mihaela van der Schaar. DeepHit: A deep learning approach to survival analysis with competing risks. InProceedings of the AAAI Conference on Artificial Intelligence, volume 32, 2018
2018
-
[15]
Tabular foundation models for clinical survival analysis via survival-aware adap- tation, 2026
Minh-Khoi Pham, Luca Cotugno, Alina Sirbu, Tai Tan Mai, Martin Crane, and Marija Bezbradica. Tabular foundation models for clinical survival analysis via survival-aware adap- tation, 2026. Accepted at the International Conference on AI in Healthcare 2026
2026
-
[16]
Patrick Royston and Mahesh K. B. Parmar. Restricted mean survival time: an alternative to the hazard ratio for the design and analysis of randomized trials with a time-to-event outcome. BMC Medical Research Methodology, 13:152, 2013
2013
-
[17]
Solomon, Susanna Jacobus, Michael Hughes, Milton Packer, and L
Hajime Uno, Brian Claggett, Lu Tian, Eisuke Inoue, Paul Gallo, Takahiro Miyata, Deborah Schrag, Masahiro Takeuchi, Yoshiaki Uyama, Lihui Zhao, Hicham Skali, Scott D. Solomon, Susanna Jacobus, Michael Hughes, Milton Packer, and L. J. Wei. Moving beyond the hazard ratio in quant...
2014
-
[18]
Per Kragh Andersen, Mette Gerster Hansen, and John P. Klein. Regression analysis of re- stricted mean survival time based on pseudo-observations.Lifetime Data Analysis, 10:335–350, 2004
2004
-
[19]
Andersen and Maja Pohar Perme
Per K. Andersen and Maja Pohar Perme. Pseudo-observations in survival analysis.Statistical Methods in Medical Research, 19(1):71–99, 2010. 32
2010
-
[20]
Parner and Per K
Erik T. Parner and Per K. Andersen. Regression analysis of censored data using pseudo- observations.The Stata Journal, 10(3):408–422, 2010
2010
-
[21]
Pseudo-observations and super learner for the estimation of the restricted mean survival time.Lifetime Data Analysis, 31:713–746, 2025
Ariane Cwiling, Vittorio Perduca, and Olivier Bouaziz. Pseudo-observations and super learner for the estimation of the restricted mean survival time.Lifetime Data Analysis, 31:713–746, 2025
2025
-
[22]
Kaplan and Paul Meier
Edward L. Kaplan and Paul Meier. Nonparametric estimation from incomplete observations. Journal of the American Statistical Association, 53(282):457–481, 1958
1958
-
[23]
TabICL: A tabular foundation model for in-context learning on large data, 2025
Jingang Qu, David Holzmüller, Gaël Varoquaux, and Marine Le Morvan. TabICL: A tabular foundation model for in-context learning on large data, 2025. Published at ICML 2025
2025
-
[24]
Cresswell, Keyvan Golestan, Guangwei Yu, Maksims Volkovs, and Anthony L
Junwei Ma, Valentin Thomas, Rasa Hosseinzadeh, Hamidreza Kamkari, Alex Labach, Jesse C. Cresswell, Keyvan Golestan, Guangwei Yu, Maksims Volkovs, and Anthony L. Caterini. Tab- DPT: Scaling tabular foundation models, 2024
2024
-
[25]
Conde, and Sri Satish Ambati
Pascal Pfeiffer, Dmitry Gordeev, Mathias Müller, Laura Fink, Joan Salvà Soler, Mark Landry, Branden Murray, Marcos V. Conde, and Sri Satish Ambati. TabH2O: A unified foundation model for tabular prediction, 2026
2026
-
[26]
Maddix, Junming Yin, Nick Erickson, Abdul Fatir Ansari, Boran Han, Shuai Zhang, Leman Akoglu, Christos Faloutsos, Michael W
Xiyuan Zhang, Danielle C. Maddix, Junming Yin, Nick Erickson, Abdul Fatir Ansari, Boran Han, Shuai Zhang, Leman Akoglu, Christos Faloutsos, Michael W. Mahoney, Cuixiong Hu, Huzefa Rangwala, George Karypis, and Bernie Wang. Mitra: Mixed synthetic priors for enhancing tabular fo...
2025
-
[27]
AutoGluon-Tabular: Robust and accurate AutoML for structured data, 2020
Nick Erickson, Jonas Mueller, Alexander Shirkov, Hang Zhang, Pedro Larroy, Mu Li, and Alexander Smola. AutoGluon-Tabular: Robust and accurate AutoML for structured data, 2020
2020
-
[28]
Kalbfleisch and Ross L
John D. Kalbfleisch and Ross L. Prentice.The Statistical Analysis of Failure Time Data. Wiley, 2 edition, 2002
2002
-
[29]
SurvSet: an open-source time-to-event dataset repository, 2022
Erik Drysdale. SurvSet: an open-source time-to-event dataset repository, 2022
2022
-
[30]
Pencina, Ralph B
Hajime Uno, Tianxi Cai, Michael J. Pencina, Ralph B. D’Agostino, and L. J. Wei. On the C-statistics for evaluating overall adequacy of risk prediction procedures with censored survival data.Statistics in Medicine, 30(10):1105–1117, 2011. 33
2011
Reviewed July 13, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.