REVIEW 3 major objections 5 minor 28 references
Topo-VM-UNetV2: Encoding Topology into Vision Mamba UNet for Polyp Segmentation
T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read Persistence-based attention maps improve Mamba U-Net polyp segmentation on five public datasets.
desk verdict Consistent empirical gains, but the topology story is likely wrong; needs revision before it should be trusted. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central mechanism is the Topo-SDI module: a per-scale Hadamard product between the encoder's features (after CBAM attention and a 1x1 convolution) and a resized topology attention map, followed by the same resolution-aligned multi-scale fusion as the original SDI. The attention map itself is built from a persistence diagram: significant 0- and 1-dimensional features of a probability map are selected by a 50th-percentile filter, each feature's persistence value is placed at the pixel(s) whose filtration value is 'very close' to the feature's birth value, and the resulting score map is sigmoid-activated into [0,1].
What would settle it
Recompute the topology attention maps while sweeping the 'very close' tolerance and the 50th-percentile significance filter across a coarse grid; if the reported Dice gains vanish or the maps reduce to generic edge detectors on synthetic images with known component counts, the improvement does not stem from persistent homology.
Extended reading notes
Core claim
Topo-VM-UNetV2 claims that replacing the plain SDI module in VM-UNetV2 with a topology-guided version that multiplies each multi-scale feature map by a persistence-derived attention map consistently improves polyp segmentation. The attention maps are generated by computing persistence diagrams of the model's probability maps under a sublevel filtration, filtering to the top 50% by persistence, assigning each surviving feature's persistence value to its birth location, and passing those scores through a sigmoid. The paper reports that this addition outperforms VM-UNetV2 on all five datasets and also beats a control in which raw probability maps, rather than topology-derived maps, are used for the same attention mechanism.
Load-bearing premise
The method assumes that the pixels whose probability values are very close to a topological feature's birth value are exactly where that feature is born, yet that tolerance is never defined and a sublevel filtration actually births a 0-dimensional component at a single local minimum pixel, not across a plateau.
Editorial extensions
If this is right
- The reported gains suggest that a lightweight topological prior computed once per image can sharpen boundaries and reduce false positives without changing the backbone or the inference-time architecture.
- The same Topo-SDI idea could be grafted onto other U-Net-style segmenters, since the attention maps are model-agnostic once probability maps exist.
- Because the topology maps are computed offline in Stage 1, adding them does not increase the model's parameter count or inference cost during deployment.
- The method's behavior on hard datasets such as ETIS and ColonDB indicates the largest payoff appears exactly where the base model struggles most with under- and over-segmentation.
- The ablation against PM-SDI, where raw probability maps replace the topology maps, indicates that the improvement comes from persistence information rather than from simply adding any auxiliary spatial signal.
Reading between the lines
- The same persistence-to-attention recipe might transfer to other medical imaging tasks like tumor or organ segmentation, where boundary accuracy and the number of connected components are clinically meaningful.
- A natural testable extension is to sweep the 'very close' tolerance and the 50th-percentile filter per dataset; if the improvements are stable across a wide range, the method is robust, and if they collapse, the reported gains may be implementation-specific.
- The attention mechanism effectively acts as a boundary-and-structure prior, so it could be combined with other priors such as shape constraints or anatomical atlases to push further.
- One implicit consequence is that the quality of the Stage-1 probability maps bounds the quality of the topology; retraining Stage 1 with better segmenters might yield even larger gains.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Topo-VM-UNetV2, a two-stage method for polyp segmentation that injects topology-aware attention into VM-UNetV2, a Mamba-based U-Net. In Stage 1, a trained VM-UNetV2 produces probability maps (PMs) for training and test images; these PMs are then processed via persistent homology to generate topology attention maps. The pipeline constructs a sublevel filtration of each PM, computes persistence diagrams for 0- and 1-dimensional features, filters features by persistence at the 50th percentile, assigns each surviving feature's persistence to its birth-location pixels, and applies a sigmoid to obtain attention weights in [0,1]. In Stage 2, these maps are multiplied with the multi-scale features inside the SDI module of VM-UNetV2, forming a Topo-SDI module. Experiments on Kvasir-SEG, ClinicDB, ColonDB, ETIS, and CVC-300 report consistent DSC, IoU, and MAE improvements over VM-UNetV2, with the largest gain on ETIS (3.29% DSC). An ablation compares Topo-SDI against a PM-SDI variant that uses sigmoid-transformed raw PMs as attention maps, showing larger gains for Topo-SDI. The authors state that each experiment is run five times with different seeds, but only averaged results are reported.
Significance. If the mechanism is correct, the work is a useful and inexpensive way to incorporate global topological structure into Mamba-based segmentation networks, and it addresses a recognized limitation of SSM architectures in capturing connected components and loops. The main strengths are the clear two-stage design, the evaluation across five public datasets with consistent gains, the inclusion of a PM-SDI ablation as a first-step control for the extra probability-map input, and the reporting of topology-attention computation cost. These elements make the empirical claim concrete and reproducible if code is released. The principal risk is that the topology attention maps may not actually encode the polyp's topology, because the birth-location heuristic in the sublevel filtration is conceptually questionable and empirically unvalidated; this concern must be resolved before the contribution can be fully credited.
major comments (3)
- [II-A2, Steps 1-3] The sublevel filtration defined in Step 1 activates pixels when p_ij <= t_n, so 0-dimensional homology classes are born at local minima of the probability map. In polyp segmentation, these minima are located in the background, not on the polyp. The birth-location mapping in Step 3 then assigns persistence values to 'cells whose filtration values closely match the feature's birth value,' but for a 0D class the birth cell is a single local-minimum pixel or a tied plateau, not a band of close-valued pixels, and the matching tolerance is never defined. Consequently, the topology attention maps may highlight background minima rather than polyp structures, which would mean the reported gains do not come from encoding polyp topology. Please validate this step by (i) overlaying birth locations on the PMs, (ii) re-running the pipeline with a superlevel filtration (activating p_ij >= t_n, where 0D classes are born at local maxima), or (iii) otherwise demonstrating that the birth-localization heuristic is correct for the claimed purpose.
- [II-A2, Step 3 and Table II] The persistence significance filter is fixed at the 50th percentile with no sensitivity analysis, and the PM-SDI ablation does not isolate the persistence geometry. PM-SDI uses a smooth sigmoid of the raw PM, whereas the topology maps, as the paper's own Fig. 5 states, emphasize boundaries and transitions; the observed Topo-SDI gains could therefore arise from a boundary-emphasis or high-frequency signal rather than from persistent homology. Please add at least one additional control whose spatial distribution matches the topology maps but whose values are not persistence-derived (e.g., an edge-filtered or randomly shuffled version of the same attention maps), and report results across a small grid of persistence thresholds (e.g., 40th, 50th, 60th percentiles) to show the 50th percentile choice is not load-bearing.
- [III-B and Table I] The manuscript reports that each experiment is run five times with different seeds, but Table I and Table II list only point estimates with no standard deviations, confidence intervals, or significance tests. Given that the gains on Kvasir-SEG (1.20% DSC) and ClinicDB (1.76% DSC) are small relative to typical seed-to-seed variability in medical segmentation models, the claim of consistent improvement is not statistically supported as presented. Please report per-seed results or standard deviations, and, if possible, paired statistical tests between Topo-SDI and VM-UNetV2 on the same data splits.
minor comments (5)
- [III-C / Table I] The comparison table omits PraNet, SANet, and Polyp-PVT with only a sentence explaining that U-Net v2 already outperforms them; please state this explicitly in the table caption or in the main text so readers do not interpret the table as a complete SOTA comparison.
- [Fig. 3 caption] The caption says 'As the threshold value increases or decreases,' but the sublevel filtration only uses an increasing threshold; please adjust the wording to avoid ambiguity.
- [III-E] The computational complexity section reports wall-clock time for 1450 images but not the per-image breakdown or the memory footprint; adding those details would make the cost claim easier to assess.
- [II-A2] The terms 'sub-level' and 'sublevel' are used inconsistently; please use one spelling throughout.
- [References] Reference [22] is formatted inconsistently with the other entries (missing conference/journal and year formatting); please check the bibliographic style.
Circularity Check
No significant circularity: the central claim is an empirical benchmark comparison, and the topology-attention input is not by construction equal to the predicted segmentation.
full rationale
The paper's derivation chain is empirical rather than analytic. Stage 1 trains VM-UNetV2 to produce probability maps, then computes persistence diagrams of those probability maps via a sublevel filtration, assigns persistence values to birth locations, and applies a sigmoid to obtain attention maps. Stage 2 inserts those maps into the SDI module of the same architecture and retrains. The reported gains are benchmark results, not consequences of an equation that reuses its own output. The ablation PM-SDI is a direct control for the extra probability-map input: feeding sigmoid(PM) as attention yields only small gains, whereas Topo-SDI yields larger gains, so the improvement is not forced by construction. Although the attention maps are computed from the model's own probability maps, this is a standard self-conditioning input rather than a fitted parameter renamed as a prediction; the final segmentation is not equal to the probability map or to a persistence transform of it. The undefined 'very close' tolerance in Birth Location Mapping and the untested 50th-percentile filter are potential correctness risks, but they are heuristic implementation choices, not circular steps. Cited prior work supplies the baseline architecture, the SDI module, and the persistent-homology background, and the authors' earlier self-citations are not load-bearing for the central claim. No specific reduction of a prediction to its own input by construction is present, so the circularity score is 0.
Assumptions & free parameters
free parameters (3)
- Persistence significance threshold (percentile) =
50th percentile
- Birth-location matching tolerance =
Not specified
- Sigmoid scaling for persistence scores =
Not specified
assumptions (6)
- domain assumption Persistent homology on sublevel filtrations of probability maps captures topologically meaningful polyp structures.
- ad hoc to paper Birth locations of topological features can be recovered as pixels with probability values close to the feature's birth value.
- ad hoc to paper The 50th percentile persistence filter separates significant topology from noise.
- domain assumption The sigmoid of persistence scores maps to useful attention weights in [0,1].
- standard math The Gudhi library computes correct persistence diagrams for cubical complexes.
- domain assumption Stage 1 probability maps generated by VM-UNetV2 are reliable enough for computing topology attention maps.
Cite this review
Pith. "Pith review of Topo-VM-UNetV2: Encoding Topology into Vision Mamba UNet for Polyp Segmentation." pith.science (2026). https://pith.science/paper/7XVOVBCF
@misc{pith2026250506210,
author = {Pith},
title = {Pith review of: Topo-VM-UNetV2: Encoding Topology into Vision Mamba UNet for Polyp Segmentation},
year = {2026},
howpublished = {\url{https://pith.science/paper/7XVOVBCF}},
note = {Machine review of arXiv:2505.06210}
}
read the original abstract
Convolutional neural network (CNN) and Transformer-based architectures are two dominant deep learning models for polyp segmentation. However, CNNs have limited capability for modeling long-range dependencies, while Transformers incur quadratic computational complexity. Recently, State Space Models such as Mamba have been recognized as a promising approach for polyp segmentation because they not only model long-range interactions effectively but also maintain linear computational complexity. However, Mamba-based architectures still struggle to capture topological features (e.g., connected components, loops, voids), leading to inaccurate boundary delineation and polyp segmentation. To address these limitations, we propose a new approach called Topo-VM-UNetV2, which encodes topological features into the Mamba-based state-of-the-art polyp segmentation model, VM-UNetV2. Our method consists of two stages: Stage 1: VM-UNetV2 is used to generate probability maps (PMs) for the training and test images, which are then used to compute topology attention maps. Specifically, we first compute persistence diagrams of the PMs, then we generate persistence score maps by assigning persistence values (i.e., the difference between death and birth times) of each topological feature to its birth location, finally we transform persistence scores into attention weights using the sigmoid function. Stage 2: These topology attention maps are integrated into the semantics and detail infusion (SDI) module of VM-UNetV2 to form a topology-guided semantics and detail infusion (Topo-SDI) module for enhancing the segmentation results. Extensive experiments on five public polyp segmentation datasets demonstrate the effectiveness of our proposed method. The code will be made publicly available.
Figures
Reference graph
Works this paper leans on
-
[1]
H. Sung, J. Ferlay, R. L. Siegel, M. Laversanne, I. Soerjomataram, A. Je- mal, and F. Bray, “Global cancer statistics 2020: Globocan estimates of incidence and mortality worldwide for 36 cancers in 185 countries,” CA: A Cancer Journal for Clinicians , vol. 71, no. 3, pp. 209–249, 2021
work page 2020
-
[2]
Current and future directions in network biology,
M. Zitnik, M. M. Li, A. Wells, K. Glass, D. Morselli Gysi, A. Krishnan, T. Murali, P. Radivojac, S. Roy, A. Baudot et al. , “Current and future directions in network biology,” Bioinformatics Advances , 2024
work page 2024
-
[3]
Exploring Transfer Learning for Deep Learning Polyp Detection in Colonoscopy Images Using YOLOv8
F. Vazquez, J. A. Nu ˜nez, X. Fu, P. Gu, and B. Fu, “Exploring transfer learning for deep learning polyp detection in colonoscopy images using YOLOv8,” arXiv preprint arXiv:2502.00133 , 2025
work page Pith review arXiv 2025
-
[4]
Boosting medical image classification with segmentation foundation model,
P. Gu, Z. Zhao, H. Wang, Y . Peng, Y . Zhang, N. Sapkota, C. Wang, and D. Z. Chen, “Boosting medical image classification with segmentation foundation model,” in ISBI, 2024, pp. 1–5
work page 2024
-
[5]
PraNet: Parallel reverse attention network for polyp segmentation,
D.-P. Fan, G.-P. Ji, T. Zhou, G. Chen, H. Fu, J. Shen, and L. Shao, “PraNet: Parallel reverse attention network for polyp segmentation,” in MICCAI, 2020, pp. 263–273
work page 2020
-
[6]
TestFit: A plug-and-play one-pass test time method for medical image segmentation,
Y . Zhang, T. Zhou, Y . Tao, S. Wang, Y . Wu, B. Liu, P. Gu, Q. Chen, and D. Z. Chen, “TestFit: A plug-and-play one-pass test time method for medical image segmentation,” Medical Image Analysis , vol. 92, p. 103069, 2024
work page 2024
-
[7]
P. Brand ˜ao, R. Mazzeo, G. Ciuti, R. Cali `o, G. Bianchi, A. Menciassi, P. Dario, and A. Cuschieri, “Towards a computed-aided diagnosis system in colonoscopy: Automatic polyp segmentation using convolution neural networks,” Journal of Biomedical Informatics , vol. 75, pp. 56–64, 2017
work page 2017
-
[8]
SwIPE: Efficient and robust medical image segmentation with implicit patch embeddings,
Y . Zhang, P. Gu, N. Sapkota, and D. Z. Chen, “SwIPE: Efficient and robust medical image segmentation with implicit patch embeddings,” in MICCAI, 2023, pp. 315–326
work page 2023
Show all 28 references
-
[9]
SAMDSK: Combining segment anything model with domain-specific knowledge for semi-supervised learning in medical image segmentation,
Y . Zhang, T. Zhou, S. Wang, Y . Wu, P. Gu, and D. Z. Chen, “SAMDSK: Combining segment anything model with domain-specific knowledge for semi-supervised learning in medical image segmentation,”arXiv preprint arXiv:2308.13759, 2023
2023 arXiv
-
[10]
VM-UNetV2: Rethinking vision Mamba U-Net for medical image segmentation,
M. Zhang, Y . Yu, S. Jin, L. Gu, T. Ling, and X. Tao, “VM-UNetV2: Rethinking vision Mamba U-Net for medical image segmentation,” in ISBRA, 2024, pp. 335–346
2024
-
[11]
kCBAC- Net: Deeply supervised complete bipartite networks with asymmetric convolutions for medical image segmentation,
P. Gu, H. Zheng, Y . Zhang, C. Wang, and D. Z. Chen, “kCBAC- Net: Deeply supervised complete bipartite networks with asymmetric convolutions for medical image segmentation,” in MICCAI, 2021, pp. 337–347
2021
-
[12]
U-Net: Convolutional net- works for biomedical image segmentation,
O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional net- works for biomedical image segmentation,” in MICCAI, 2015, pp. 234– 241
2015
-
[13]
Shallow attention network for polyp segmentation,
J. Wei, Y . Hu, R. Zhang, Z. Li, S. K. Zhou, and S. Cui, “Shallow attention network for polyp segmentation,” in MICCAI, 2021, pp. 699– 708
2021
-
[14]
An image is worth 16x16 words: Transformers for image recognition at scale,
A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly, J. Uszkoreit, and N. Houlsby, “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020
2010 arXiv
-
[15]
ConvFormer: Combining CNN and Transformer for medical image segmentation,
P. Gu, Y . Zhang, C. Wang, and D. Z. Chen, “ConvFormer: Combining CNN and Transformer for medical image segmentation,” in ISBI, 2023, pp. 1–5
2023
-
[16]
Polyp-PVT: Polyp segmentation with pyramid vision Transformers,
B. Dong, W. Wang, D.-P. Fan, J. Li, H. Fu, and L. Shao, “Polyp-PVT: Polyp segmentation with pyramid vision Transformers,” arXiv preprint arXiv:2108.06932, 2021
2021 arXiv
-
[17]
U-Net v2: Rethinking the skip connections of U-Net for medical image segmentation,
Y . Peng, M. Sonka, and D. Z. Chen, “U-Net v2: Rethinking the skip connections of U-Net for medical image segmentation,” arXiv preprint arXiv:2311.17791, 2023
2023 arXiv
-
[18]
Mamba: Linear-time sequence modeling with selective state spaces,
A. Gu and T. Dao, “Mamba: Linear-time sequence modeling with selective state spaces,” arXiv preprint arXiv:2312.00752 , 2023
2023 arXiv
-
[19]
VMamba: Visual state space model,
Y . Liu, Y . Tian, Y . Zhao, H. Yu, L. Xie, Y . Wang, Q. Ye, J. Jiao, and Y . Liu, “VMamba: Visual state space model,” Advances in Neural Information Processing Systems , vol. 37, pp. 103 031–103 063, 2024
2024
-
[20]
VM-UNet: Vision Mamba U-Net for medical image segmentation,
J. Ruan, J. Li, and S. Xiang, “VM-UNet: Vision Mamba U-Net for medical image segmentation,” arXiv preprint arXiv:2402.02491 , 2024
2024 arXiv
-
[21]
Edelsbrunner and J
H. Edelsbrunner and J. Harer, Computational topology: An introduction , 2010
2010
-
[22]
T. K. Dey and Y . Wang,Computational topology for data analysis , 2022
2022
-
[23]
CBAM: Convolutional block attention module,
S. Woo, J. Park, J.-Y . Lee, and I. S. Kweon, “CBAM: Convolutional block attention module,” in ECCV, 2018, pp. 3–19
2018
-
[24]
Kvasir-SEG: A segmented polyp dataset,
D. Jha, P. H. Smedsrud, M. A. Riegler, P. Halvorsen, T. de Lange, D. Johansen, and H. D. Johansen, “Kvasir-SEG: A segmented polyp dataset,” in MMM, 2020, pp. 451–462
2020
-
[25]
WM-DOV A maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians,
J. Bernal, F. J. S ´anchez, G. Fern ´andez-Esparrach, D. Gil, C. Rodr ´ıguez, and F. Vilari ˜no, “WM-DOV A maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physicians,” Computer- ized Medical Imaging and Graphics , vol. 43, pp. 99–111, 2015
2015
-
[26]
Automated polyp detection in colonoscopy videos using shape and context information,
N. Tajbakhsh, S. R. Gurudu, and J. Liang, “Automated polyp detection in colonoscopy videos using shape and context information,” IEEE Transactions on Medical Imaging , vol. 35, no. 2, pp. 630–644, 2015
2015
-
[27]
Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer,
J. Silva, A. Histace, O. Romain, X. Dray, and B. Granado, “Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancer,” Journal of CARS , vol. 9, pp. 283–293, 2014
2014
-
[28]
A benchmark for endoluminal scene segmentation of colonoscopy images,
D. V ´azquez, J. Bernal, F. J. S ´anchez, G. Fern ´andez-Esparrach, A. M. L´opez, A. Romero, M. Drozdzal, A. Courville et al. , “A benchmark for endoluminal scene segmentation of colonoscopy images,” Journal of Healthcare Engineering , vol. 2017, 2017
2017
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.