REVIEW 4 major objections 5 minor 1 cited by
AdaSurvMamba: Dynamic Fusion and Semantic Scanning for Multimodal Survival Analysis
T0 review · 4 major / 5 minor · reviewed 2026-08-02 · deepseek-v4-flash
Pith's one-line read Adding patient-level importance gating and semantic token reordering to a state-space model improves cancer survival prediction across five cohorts.
desk verdict Worth engaging with: plausible architectural novelty and solid ablations, but the SOTA claim is undercut by missing Mamba baselines and thin margins. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing machinery is the Dual-Scale Importance-Aware Reconstruction (DSIR) combined with Semantic Aggregation Scanning (SAS). DSIR computes a sequence-level importance weight from pooled modality representations and a token-level gate logit from co-attended context, then multiplies the two to reconstruct each token before the state-space scan. SAS learns a shared prototype pool, uses Gumbel-Softmax routing to assign every token to a prototype, sorts tokens so same-prototype tokens are adjacent in the input sequence, and adds a prototype-weighted bias to the continuous step-size parameter of the Mamba state-space model. Together they make the sequence order and the information absorp
What would settle it
Perform repeated cross-validation with paired bootstrap significance tests, on all five cohorts, comparing AdaSurvMamba against the best competing baseline and the two closest Mamba-based models; if the improvement is not consistently outside the baseline's standard deviation, the central claim fails.
Extended reading notes
Core claim
AdaSurvMamba claims that replacing static multimodal fusion and rigid scanning with adaptive patient- and token-level gates plus semantically reordered state-space scanning yields consistent survival-prediction gains on five cancer cohorts. The paper's central evidence is a table of concordance indices showing the proposed model ahead of all compared unimodal and multimodal baselines on every cohort, with an average improvement of roughly 2.3% under both tested feature extractors. The authors attribute this to the DSIR module, which reconstructs each modality's input by combining global importance weights with local softmax gates, and the SAS module, which clusters tokens via a shared protot
Load-bearing premise
The central claim rests on assuming that the reported C-Index improvements are true algorithmic gains rather than artifacts of hyperparameter tuning, incomplete baseline comparison, or random variation in cross-validation.
Editorial extensions
If this is right
- If the reported gains are reproducible, adaptive per-patient fusion becomes a practical alternative to fixed late fusion for histology-genomics survival models.
- The semantic reordering before scanning suggests that token order itself, not just token content, is a tunable resource in state-space models.
- The 2.32% average C-Index improvement could translate into better risk stratification for the five studied cancer types if the result generalizes.
- The framework runs on a single GPU, so it is accessible to laboratories without large-scale computing resources.
- The shared prototype pool provides a lightweight way to align pathology and genomic tokens without heavy cross-attention.
Reading between the lines
- In our view, the DSIR gating mechanism could transfer to other multimodal medical tasks, such as radiology-image-plus-report or clinical-notes-plus-lab-values, where the dominant modality varies from patient to patient.
- The SAS semantic scanning may also improve Mamba-based models on other unordered or sparse input domains, such as point clouds or graph-structured data, where physical ordering is arbitrary.
- A testable extension would be to evaluate AdaSurvMamba on external cohorts with different staining protocols and scanners; if the semantic prototypes need retraining, that would indicate overfitting to the training distribution.
- One could also decouple the two modules and measure their individual contribution on new datasets, which the paper only does for two cohorts, to check whether the reported gains are dataset-specific.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. AdaSurvMamba proposes an adaptive framework for multimodal survival analysis combining WSI patches and genomic profiles. It introduces DSIR, a dual-scale gating mechanism that reconstructs features using sequence- and token-level importance weights, and SAS, which reorganizes tokens into semantics-based sequences via a shared prototype pool and modulates the Mamba state-transition step size. The method is evaluated on five TCGA cohorts against unimodal and multimodal baselines, reporting mean C-Index from 5-fold cross-validation and claiming consistent improvements (e.g., 2.32% average gain under UNI features). Code is provided.
Significance. The conceptual contribution is timely: moving from static fusion and fixed scanning paths to input-dependent gating and semantically reordered scanning is a plausible way to adapt Mamba to gigapixel pathology and heterogeneous genomic tokens. The paper ships a public implementation, includes ablations for the main modules, and evaluates on multiple public cohorts, which are strengths. However, the claimed empirical advantage rests on comparisons that omit the two closest Mamba-based baselines, on C-Index deltas that are partly within one standard deviation, and on hyperparameters selected on the same cohorts used for the final numbers. These issues must be resolved before the significance of the result can be assessed.
major comments (4)
- [§3.2, Table 1] The two most relevant comparators, SurvMamba [5] and ME-Mamba [23], are explicitly excluded because their official implementations were not available. Since the introduction motivates AdaSurvMamba by the limitations of these methods, they are the direct state of the art. The claim of 'consistent improvements over existing methods' is therefore not supported against the closest alternatives. Please add reimplementations, original reported numbers on compatible protocols, or at least a sensitivity comparison, and soften the claim if this is not possible.
- [§3.2, Table 1] No statistical significance testing is reported. Several improvements over the best baseline are within one standard deviation of the baseline or of the proposed method (e.g., BRCA UNI: 0.701±0.039 vs 0.690±0.019; GBMLGG UNI: 0.866±0.017 vs 0.852±0.032). Since only five folds are used, report fold-level paired comparisons or confidence intervals to show the gains are not noise.
- [§3.1 / §3.3] The hyperparameters T_g=4, T_p=16, r=32, d_p=64, λ=0.5 are selected through ablations performed on BLCA and BRCA with ResNet50 features, then used to produce the final Table 1 results on all five cohorts, including BLCA and BRCA, and also under UNI features. This is selection on the evaluation cohorts and can inflate the reported gains. Use a nested/held-out protocol, report selection and test cohorts separately, or validate externally before claiming consistent gains.
- [§3.2] The headline average improvement of 2.32% (and 2.43% for ResNet50) is not reproducible from Table 1. Using the natural per-cohort relative improvement (ours−best)/best yields 2.51% (UNI) and 2.49% (ResNet50); using absolute C-index points yields 1.78 and 1.74 percentage points. Please state the exact formula and correct the numbers if needed.
minor comments (5)
- [§2.3] L_m is used in R_m ∈ R^{L_m×T_m} but never defined; please define it as the token count for modality m.
- [§2.3] Gumbel-Softmax outputs continuous approximations, not discrete weights. Clarify whether hard straight-through assignments are used for the argsort and how gradients flow through the reordering.
- [§2.2, Eqs. (3)–(4)] The shapes of G_raw and G_ctx after the per-modality softmax are not stated; make the tensor dimensions explicit.
- [Table 5] The ablation only varies sizes up to 8 for T_p and does not explore larger T_g; if T_g=4,T_p=16 is claimed optimal, include neighboring configurations (e.g., (8,16)) or justify the grid.
- [Figure 1] The figure is very dense; a notation table for X, C, w, G, P, R, Δ would improve readability.
Circularity Check
BLCA/BRCA hyperparameter tuning is reused as evidence on the same cohorts; the other three cohorts keep the claim partially independent.
-
fitted input called prediction
[Section 3.1 (Implementation details), Section 3.3 (Ablation), Table 1]
"Based on our ablation studies, the optimal number of prototypes for genomics and pathology were configured as Tg = 4 and Tp = 16. ... The auxiliary loss weight λ was empirically set to 0.5 to balance fused survival prediction and modality-specific supervision. ... We report the mean Concordance Index (C-Index) and standard deviation from 5-fold cross-validation. ... We conduct extensive ablation studies on the BLCA and BRCA cohorts using ResNet50 features to systematically validate our proposed designs."
The hyperparameters Tg, Tp, and λ are selected by maximizing C-Index on BLCA and BRCA in the ablations (Tables 4-5), and the same two cohorts then appear in Table 1 as evidence: 'Ours' is reported as 0.707±0.029 on BLCA and 0.698±0.049 on BRCA. These entries feed the headline average improvement of 2.32%. The BLCA/BRCA portion of the reported gain is the value the hyperparameter search was optimizing, not an independent prediction; on those cohorts the result reduces to a selection outcome. The remaining three cohorts were not used for ablation, so the circularity is partial.
full rationale
The derivation of the DSIR and SAS modules is self-contained: Eqs. 1-9 define the architecture and loss, and no module is defined in terms of the reported C-Index. The central empirical claim is benchmarked against external methods rather than derived from the paper's own equations, so there is no self-definitional circularity. References [16] and [28] are self-citations but are used only as background about scan-order sensitivity and prior WSI work; no load-bearing uniqueness theorem or ansatz is imported from them. The exclusion of SurvMamba and ME-Mamba weakens the SOTA comparison but is a completeness issue, not circularity. The one genuine fitted-input problem is that key hyperparameters (Tg=4, Tp=16, λ=0.5) were selected by ablations on BLCA/BRCA, and those same two cohorts then appear in Table 1 as evidence of the average 2.32% improvement. Thus two of the five headline entries are post-selection estimates rather than independent predictions; the other three cohorts are not used for ablation, so the central claim is only partially affected. External validation is acknowledged as future work (Section 4), consistent with this assessment.
Assumptions & free parameters
free parameters (4)
- Prototype counts (Tg=4, Tp=16) =
4, 16
- Semantic decoupling rank r =
32
- Prototype dimension dp =
64
- Auxiliary loss weight lambda =
0.5
assumptions (6)
- domain assumption TCGA cohorts with paired WSI and genomic profiles contain learnable prognostic signal
- domain assumption Six functional groups from RNA-seq, CNV, and mutation data capture molecular alterations
- domain assumption Frozen foundation model (ResNet-50/UNI) embeddings retain morphological information needed for prognosis
- domain assumption Mamba suffers from long-range decay that degrades WSI/omics sequence modeling
- standard math Gumbel-Softmax with an argsort reordering provides a viable gradient path for discrete semantic grouping
- standard math Discrete-time negative log-likelihood is an appropriate survival objective
invented entities (2)
-
Shared prototype pool E_shared
-
Semantic routing weights R_m (Gumbel-Softmax router)
Cite this review
Pith. "Pith review of AdaSurvMamba: Dynamic Fusion and Semantic Scanning for Multimodal Survival Analysis." pith.science (2026). https://pith.science/paper/M5CZ52IP
@misc{pith2026260716260,
author = {Pith},
title = {Pith review of: AdaSurvMamba: Dynamic Fusion and Semantic Scanning for Multimodal Survival Analysis},
year = {2026},
howpublished = {\url{https://pith.science/paper/M5CZ52IP}},
note = {Machine review of arXiv:2607.16260}
}
read the original abstract
Multimodal survival analysis utilizing whole slide images (WSIs) and genomic profiles is fundamental for cancer prognosis. Recently, state-space models like Mamba have emerged as powerful tools for sequence modeling. However, translating this success to complex multimodal tasks is hindered by two critical limitations. First, conventional fusion strategies assume a static multimodal interaction strength, ignoring the fluctuating diagnostic importance of each modality across different patients and local regions. Second, the standard Mamba architecture processes tokens along predefined physical paths. This rigid scanning disrupts the semantic continuity of spatially scattered medical features and exacerbates long-range decay. To address these challenges, we introduce AdaSurvMamba as a novel adaptive framework for multimodal survival analysis. The framework features a Dual-Scale Importance-Aware Reconstruction (DSIR) module to dynamically modulate cross-modal interaction strength. It evaluates diagnostic importance at both the sequence and token levels to reconstruct the input representations. Furthermore, we propose a Semantic Aggregation Scanning (SAS) module to overcome contextual fragmentation. The SAS module dynamically reorganizes discrete tokens into semantically continuous sequences via a shared prototype pool. It explicitly modulates the state transition step size using global modality context and semantic priors to adaptively control the information absorption rate. Experiments across five TCGA cohorts demonstrate consistent gains over existing methods. Code is available at https://github.com/zjlGO/AdaSurvMamba.
Figures
Forward citations
Cited by 1 Pith paper
-
Hear to See: Discerning Stateful Listening for Audio-Visual Instance Segmentation
A new audio-visual instance segmentation architecture, using audio separation and an audio-modulated Mamba, reaches 48.54 mAP on AVISeg with a COCO-pretrained ResNet50.
Reference graph
Works this paper leans on
-
[5]
arXiv preprint arXiv:2404.08027 (2024)
Chen, Y., Xie, J., Lin, Y., Song, Y., Yang, W., Yu, R.: Survmamba: state space model with multi-grained multi-modal interaction for survival prediction. arXiv preprint arXiv:2404.08027 (2024)
arXiv 2024
-
[23]
Computerized Medical Imaging and Graphics129, 102733 (2026)
Zhang, C., Qu, L., Liu, X., Song, Z.: Me-mamba: Multi-expert mamba with effi- cient knowledge capture and fusion for multimodal survival analysis. Computerized Medical Imaging and Graphics129, 102733 (2026)
2026
-
[1]
Nature medicine30(3), 850–862 (2024)
Chen, R.J., Ding, T., Lu, M.Y., Williamson, D.F., Jaume, G., Song, A.H., Chen, B., Zhang, A., Shao, D., Shaban, M., et al.: Towards a general-purpose foundation model for computational pathology. Nature medicine30(3), 850–862 (2024)
2024
-
[2]
IEEE transactions on medical imaging41(4), 757–770 (2020)
Chen, R.J., Lu, M.Y., Wang, J., Williamson, D.F., Rodig, S.J., Lindeman, N.I., Mahmood, F.: Pathomic fusion: an integrated framework for fusing histopathology and genomic features for cancer diagnosis and prognosis. IEEE transactions on medical imaging41(4), 757–770 (2020)
2020
-
[3]
In: Proceedings of the IEEE/CVF interna- tional conference on computer vision
Chen, R.J., Lu, M.Y., Weng, W.H., Chen, T.Y., Williamson, D.F., Manz, T., Shady, M., Mahmood, F.: Multimodal co-attention transformer for survival pre- diction in gigapixel whole slide images. In: Proceedings of the IEEE/CVF interna- tional conference on computer vision. pp. 4015–4025 (2021)
2021
-
[4]
Cancer cell40(8), 865–878 (2022)
Chen, R.J., Lu, M.Y., Williamson, D.F., Chen, T.Y., Lipkova, J., Noor, Z., Shaban, M., Shady, M., Williams, M., Joo, B., et al.: Pan-cancer integrative histology- genomic analysis via multimodal deep learning. Cancer cell40(8), 865–878 (2022)
2022
-
[6]
Pattern Recognition169, 111991 (2026)
Cui, J., Li, Y., Shen, D., Wang, Y.: Mgcm: Multi-modal graph convolutional mamba for cancer survival prediction. Pattern Recognition169, 111991 (2026)
2026
-
[7]
Ding, S., Li, J., Wang, J., Ying, S., Shi, J.: Multimodal co-attention fusion network withonlinedataaugmentationforcancersubtypeclassification.IEEETransactions on Medical Imaging43(11), 3977–3989 (2024)
2024
Show all 30 references
-
[8]
Medical Image Analysis p
Fu, B., He, J., Zhang, X., Peng, Y., Zhang, Z., Tang, Q., Liu, X., Cao, Y., Wang, R.: Hsfsurv: A hybrid supervision framework at individual and feature levels for multimodal cancer survival analysis. Medical Image Analysis p. 103810 (2025)
2025
-
[9]
In: First conference on language modeling (2024)
Gu, A., Dao, T.: Mamba: Linear-time sequence modeling with selective state spaces. In: First conference on language modeling (2024)
2024
-
[10]
He,K.,Zhang,X.,Ren,S.,Sun,J.:Deepresiduallearningforimagerecognition.In: Proceedings of the IEEE conference on computer vision and pattern recognition. pp. 770–778 (2016)
2016
-
[11]
In: European conference on computer vision
Huang, T., Pei, X., You, S., Wang, F., Qian, C., Xu, C.: Localmamba: Visual state space model with windowed selective scan. In: European conference on computer vision. pp. 12–22. Springer (2024) 10 J. Zhong et al
2024
-
[12]
IEEE Transactions on Medical Imaging44(2), 1032–1042 (2024)
Huang, Y., Zhao, W., Fu, Y., Zhu, L., Yu, L.: Unleash the power of state space model for whole slide image with local aware scanning and importance resampling. IEEE Transactions on Medical Imaging44(2), 1032–1042 (2024)
2024
-
[13]
In: International conference on machine learning
Ilse,M.,Tomczak,J.,Welling,M.:Attention-baseddeepmultipleinstancelearning. In: International conference on machine learning. pp. 2127–2136. PMLR (2018)
2018
-
[14]
Nature502(7471), 333–339 (2013)
Kandoth, C., McLellan, M.D., Vandin, F., Ye, K., Niu, B., Lu, C., Xie, M., Zhang, Q., McMichael, J.F., Wyczalkowski, M.A., et al.: Mutational landscape and signif- icance across 12 major cancer types. Nature502(7471), 333–339 (2013)
2013
-
[15]
Advances in neural information processing systems30(2017)
Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-normalizing neural networks. Advances in neural information processing systems30(2017)
2017
-
[16]
In: Proceedings of the Computer Vision and Pattern Recognition Conference
Liu,L.,Zhang,M.,Yin,J.,Liu,T.,Ji,W.,Piao,Y.,Lu,H.:Defmamba:Deformable visual state space model. In: Proceedings of the Computer Vision and Pattern Recognition Conference. pp. 8838–8847 (2025)
2025
-
[17]
In: International Conference on Medical Image Computing and Computer-Assisted Intervention
Liu, M., Cai, C., Li, J., Xu, P., Li, J., Ma, J., Xu, J.: Murrenet: Modeling holis- tic multimodal interactions between histopathology and genomic profiles for sur- vival prediction. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. pp...
2025
-
[18]
Advances in neural information processing systems34, 2136–2147 (2021)
Shao, Z., Bian, H., Chen, Y., Wang, Y., Zhang, J., Ji, X., et al.: Transmil: Trans- former based correlated multiple instance learning for whole slide image classifica- tion. Advances in neural information processing systems34, 2136–2147 (2021)
2021
-
[19]
arXiv preprint arXiv:2407.00224 (2024)
Song, A.H., Chen, R.J., Jaume, G., Vaidya, A.J., Baras, A.S., Mahmood, F.: Multi- modal prototyping for cancer survival prediction. arXiv preprint arXiv:2407.00224 (2024)
2024 arXiv
-
[20]
Nature Reviews Bioengineering1(12), 930–949 (2023)
Song, A.H., Jaume, G., Williamson, D.F., Lu, M.Y., Vaidya, A., Miller, T.R., Mah- mood, F.: Artificial intelligence for digital and computational pathology. Nature Reviews Bioengineering1(12), 930–949 (2023)
2023
-
[21]
IEEE Transactions on Medical Imaging44(5), 2170–2181 (2025)
Wang, Z., Zhang, Y., Xu, Y., Imoto, S., Chen, H., Song, J.: Histo-genomic knowl- edge association for cancer prognosis from histopathology whole slide images. IEEE Transactions on Medical Imaging44(5), 2170–2181 (2025)
2025
-
[22]
In: Proceedings of the IEEE/CVF international conference on computer vision
Xu, Y., Chen, H.: Multimodal optimal transport-based co-attention transformer with global structure consistency for survival prediction. In: Proceedings of the IEEE/CVF international conference on computer vision. pp. 21241–21251 (2023)
2023
-
[24]
Zhang, J., Nguyen, A.T., Han, X., Trinh, V.Q.H., Qin, H., Samaras, D., Hosseini, M.S.: 2dmamba: Efficient state space model for image representation with applica- tionsongiga-pixelwholeslideimageclassification.In:ProceedingsoftheComputer Vision and Pattern Recognition Conferen...
2025
-
[25]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Zheng, T., Jiang, K., Xiao, Y., Zhao, S., Yao, H.: M3amba: Memory mamba is all you need for whole slide image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 15601–15610 (2025)
2025
-
[26]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Zheng, T., Yao, H., Jiang, K., Xiao, Y., Zhao, S.: Gmmamba: Group masking mamba for whole slide image classification. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 9935–9944 (2025)
2025
-
[27]
Pattern Recognition 167, 111768 (2025)
Zheng, T., Yao, H., Zhao, S., Jiang, K., Xiao, Y.: Graphmamba: Whole slide image classification meets graph-driven selective state space model. Pattern Recognition 167, 111768 (2025)
2025
-
[28]
Medical Image Analysis p
Zhong, J., Zhang, M., Liu, L., Liu, T., Jiang, J., Piao, Y., Xu, R., Tian, F., Sun, W., Bi, H., et al.: Diffusion-based cross-staining feature transformation for whole slide AdaSurvMamba 11 image analysis: From h&e to ihc representation learning. Medical Image Analysis p. 1041...
2026
-
[29]
IEEE Transactions on Medical Imaging44(2), 656–667 (2024)
Zhou, H., Zhou, F., Chen, H.: Cohort-individual cooperative learning for mul- timodal cancer survival analysis. IEEE Transactions on Medical Imaging44(2), 656–667 (2024)
2024
-
[30]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Zhou, J., Tang, J., Zuo, Y., Wan, P., Zhang, D., Shao, W.: Robust multimodal survival prediction with conditional latent differentiation variational autoencoder. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 10384–10393 (2025)
2025
Reviewed August 2, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.