REVIEW 3 major objections 5 minor 34 references
FocusNet: Transformer-enhanced Polyp Segmentation with Local and Pooling Attention
T0 review · 3 major / 5 minor · reviewed 2026-08-16 · deepseek-v4-flash
Pith's one-line read FocusNet, a Transformer-attention network, segments colon polyps across five imaging modalities and outperforms prior methods on four of them.
desk verdict Useful multi-modality benchmark and a decent architecture, but the 'consistently outperforms' claim is contradicted by the paper's own Table I, and the single-run statistics can't support the marginal gains. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the Focus Attention Module (FAM), a dual-path attention block that balances local detail with global context: it builds a shared query from the detail-enhanced shallow features, derives separate key/value pairs from local windows and from adaptive average pooling, concatenates the two similarity scores before a single softmax, and adds the local and pooled attention outputs before multiplying with a channel-attention-refined feature. Two Cross-semantic Interaction Decoder Modules (CIDM-M and CIDM-A) supply the coarse segmentation maps and fused features by combining deep encoder levels with element-wise multiplication or addition plus channel/spatial attention. The Detail Enhancement Module (DEM) processes shallow features through four parallel branches of 1×3 and 3×1 deformable convolutions followed by efficient channel attention. The network's final prediction is the element-wise sum of four segmentation maps, two from the decoders and two from the shared FAM.
What would settle it
Retrain FocusNet and the strongest baselines several times with different random seeds on the same PolypDB splits; if the seed-to-seed spread in dice exceeds 0.59 percentage points, the smallest reported winning margin, the claim that FocusNet consistently outperforms is not established.
Extended reading notes
Core claim
FocusNet's central claim is that combining coarse semantic maps with boundary-focused shallow features, then reweighting them through a focus attention module, yields a polyp segmenter that generalizes across modalities and centers better than existing CNN-, transformer-, and mamba-based models. The architecture uses a pyramid vision transformer backbone; two cross-semantic interaction decoder variants (multiplicative CIDM-M and additive CIDM-A) assemble deep feature maps into coarse predictions, while the detail enhancement module passes the first-stage features through four branches of deformable convolutions and channel attention. The focus attention module then computes a shared query and separate local and pooling keys/values, concatenates the two similarity scores before softmax, and combines the attended values with channel-attended input. The paper reports this design produces the highest dice coefficient on BLI, FICE, LCI, and NBI in the modality-wise protocol, and on WLI it is competitive but slightly below PVT-CASCADE; the same pattern appears in center-wise tests, which the paper attributes to pooling attention sacrificing some fine detail.
Load-bearing premise
The load-bearing premise is that the reported dice differences come from the models' architectures rather than from luck in a single training run, because the paper reports one run per model with early stopping and no confidence intervals.
Editorial extensions
If this is right
- A single FocusNet model trained on WLI can be applied to BLI, FICE, LCI, and NBI images without modality-specific fine-tuning, the precondition for realistic multi-modality colonoscopy deployment.
- On the modality-wise benchmark, FocusNet's largest gains come on the hardest, smallest test sets (BLI and NBI), where it beats the prior best by 4.2 and 5.6 percentage points of dice.
- The WLI and center-wise results show FocusNet does not dominate every setting: PVT-CASCADE retains the top WLI dice by 0.41 points and leads on all three center-wise tests, so the paper's 'consistently outperforms' phrasing holds only for four of five modality tests.
- Ablations on BLI show the three modules are additive: the full model reaches 0.8247 dice versus 0.8170 for the backbone plus CIDM-M alone, so each component earns its place.
Reading between the lines
- A further step, not in the paper: if the multi-modality result replicates, PolypDB-style multi-modality benchmarks should become the default for polyp segmentation, because single-modality WLI leaderboards cannot detect whether a model will survive a modality shift in the clinic.
- The FAM's local and pooling window sizes are set to 3 and the paper says they are adjustable; a natural next experiment is to sweep window sizes and pooling strides to see whether the small WLI and center-wise gap to PVT-CASCADE closes or widens.
- A fair reading of the reported p-values against PVT-CASCADE on WLI and the Simula center (0.34 and 0.21) is that those differences may be within noise; a multi-seed evaluation with confidence intervals would settle whether FocusNet truly matches or trails on those splits.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes FocusNet, a Transformer-enhanced polyp segmentation network built on a PVTv2 backbone, with three new modules: a Cross-semantic Interaction Decoder Module (CIDM) in multiplicative and additive variants, a Detail Enhancement Module (DEM) using multi-branch deformable convolutions on shallow features, and a Focus Attention Module (FAM) combining local and pooling attention. The method is evaluated on PolypDB, a multi-center, multi-modality colonoscopy dataset (BLI, FICE, LCI, NBI, WLI), in both modality-wise and center-wise settings, and is compared against seven CNN-, Transformer-, and Mamba-based baselines. The paper reports top mDSC values on four modality-wise test splits (BLI 82.47%, FICE 88.46%, LCI 92.04%, NBI 82.09%) and competitive results on WLI (93.42%), along with an ablation study, computational complexity comparison, qualitative examples, and failure-case analysis. The central claim is that FocusNet consistently outperforms prior state-of-the-art methods across all five modalities and demonstrates strong generalization across centers.
Significance. If the reported results are robust, FocusNet would be a useful contribution to multi-modality polyp segmentation, a clinically relevant direction given the limited modality coverage of most existing datasets and models. The paper's strengths include the use of a newly assembled multi-center, multi-modality dataset, evaluation under both modality-wise and center-wise protocols, inclusion of efficiency metrics, qualitative results, failure-case discussion, and a public code link. However, the significance of the paper's central claim is weakened by the absence of repeated-run statistics and by the fact that the reported numbers themselves contradict the claimed 'consistent' superiority on several settings. The architectural ideas, especially the combination of local and pooling attention in FAM, are reasonable and potentially impactful, but the current evidence does not fully support the strength of the stated conclusions.
major comments (3)
- [Abstract, Section III.C, Tables I and II] The claim that FocusNet 'consistently outperforms existing state-of-the-art approaches' is not supported by the reported numbers. On WLI, FocusNet has mDSC 0.9342 versus PVT-CASCADE 0.9383 and mIoU 0.8862 versus 0.8927; on BKAI, mDSC is 0.9127 versus PVT-CASCADE 0.9138; on Simula, mDSC is 0.9230 versus PVT-CASCADE 0.9306. Section III.C itself acknowledges that FocusNet is 'slightly inferior' on WLI and on BKAI/Simula. The abstract, contributions list, and conclusion should be revised to state that FocusNet outperforms the compared methods on BLI, FICE, LCI, and NBI, and is competitive on WLI and across centers.
- [Section III.A and Tables I, II, IV] The manuscript lists P-values in Tables I and II but never specifies the statistical test, the number of runs, or the variance structure; all metrics appear to come from a single training run with early stopping. Test sets are small (BLI 70, FICE 70, LCI 60, NBI 146, Karolinska 30), and the smallest reported gaps are 0.41% mDSC on WLI and 0.11% mDSC on BKAI. To support the claim of statistical significance made in Section IV, the authors should report mean and standard deviation over multiple seeds, provide confidence intervals or bootstrap estimates, and name the test used.
- [Section III.D, Table IV] The ablation study is performed on a single modality (BLI) with single-run metrics. The DEM contribution is +1.06% mDSC over Setting #5, while Setting #5 itself is 0.33% mDSC below Setting #3, so the incremental benefit of adding DEM and the second CIDM variant is not clearly established. Without repeated runs or an additional validation modality, the claim that each module contributes to the final result is not supported by the present evidence.
minor comments (5)
- [II.D, Eq. (10)] Equation (10) has an unbalanced parenthesis: the right-hand side should be P + Conv_{1x1}(Conv_{3x3}(Conv_{3x3}(O_f))) or the intended structure should be made explicit.
- [Table II caption] The caption cites reference [34] (Tajbakhsh et al.) for the PolypDB dataset, but the dataset is introduced in reference [27]; the citation should be corrected.
- [III.C.1] In the paragraph describing NBI results, the text says 'FocusNet outperforms G-CASCADE by approximately 5.62%, 5.58%, and 4.64%' but no method named G-CASCADE appears elsewhere; this appears to be a typo for PVT-CASCADE.
- [II.C, after Eq. (5)] The phrase 'Eficient Channel Attention' should be 'Efficient Channel Attention'.
- [III.A] In the center-wise description, 'for it’s common in all three centers' should be revised to 'since it is common to all three centers'.
Circularity Check
No circularity: FocusNet's reported metrics are measured on held-out PolypDB test splits, not derived from fitted parameters or self-citations.
full rationale
The paper's central claim is an empirical architecture comparison. Section II defines the CIDM, DEM, and FAM modules via convolutional and attention operations, but none of these equations outputs a dice or mIoU number from a fitted parameter. Tables I, II, and IV report measured metrics on PolypDB test splits (BLI 70, FICE 70, LCI 60, NBI 146, WLI 360, BKAI 1000, Karolinska 30, Simula 257), computed from predictions against expert masks. These metrics are not derived from the model definition, so no fitted input is renamed as a prediction. Self-citations to PolypDB [27] and RMAMamba-T [33] exist, but they are not load-bearing in a logical sense: PolypDB is a fixed dataset with expert annotations, and RMAMamba-T is one of several baselines re-run under the same protocol. The paper's own admission in Section III.C that FocusNet is 'slightly inferior' to PVT-CASCADE on WLI (mDSC 0.9342 vs 0.9383) and on BKAI/Simula contradicts the abstract's 'consistently outperforms' wording, but inconsistency is not circularity. Similarly, the lack of confidence intervals or multiple seeds is a statistical robustness concern, not a definitional reduction. No uniqueness theorem is imported from the authors' prior work, no ansatz is smuggled in via citation, and no known empirical result is renamed as a new derivation. The derivation chain is self-contained; the only concerns are experimental rigor and overclaiming, which are outside the circularity definition.
Assumptions & free parameters
free parameters (4)
- FAM window size =
3
- DEM branch count =
4
- FAM input channels =
32
- Training hyperparameters =
lr=1e-4, batch=16, epochs=500, patience=50
assumptions (3)
- domain assumption The PolypDB dataset masks are accurate, expert-verified ground truth.
- domain assumption Training only on WLI and testing on other modalities measures cross-modality generalization.
- domain assumption Dice and IoU are valid measures of clinical polyp segmentation quality.
Cite this review
Pith. "Pith review of FocusNet: Transformer-enhanced Polyp Segmentation with Local and Pooling Attention." pith.science (2026). https://pith.science/paper/R3FW3SLF
@misc{pith2026250413597,
author = {Pith},
title = {Pith review of: FocusNet: Transformer-enhanced Polyp Segmentation with Local and Pooling Attention},
year = {2026},
howpublished = {\url{https://pith.science/paper/R3FW3SLF}},
note = {Machine review of arXiv:2504.13597}
}
read the original abstract
Colonoscopy is vital in the early diagnosis of colorectal polyps. Regular screenings can effectively prevent benign polyps from progressing to CRC. While deep learning has made impressive strides in polyp segmentation, most existing models are trained on single-modality and single-center data, making them less effective in real-world clinical environments. To overcome these limitations, we propose FocusNet, a Transformer-enhanced focus attention network designed to improve polyp segmentation. FocusNet incorporates three essential modules: the Cross-semantic Interaction Decoder Module (CIDM) for generating coarse segmentation maps, the Detail Enhancement Module (DEM) for refining shallow features, and the Focus Attention Module (FAM), to balance local detail and global context through local and pooling attention mechanisms. We evaluate our model on PolypDB, a newly introduced dataset with multi-modality and multi-center data for building more reliable segmentation methods. Extensive experiments showed that FocusNet consistently outperforms existing state-of-the-art approaches with a high dice coefficients of 82.47% on the BLI modality, 88.46% on FICE, 92.04% on LCI, 82.09% on the NBI and 93.42% on WLI modality, demonstrating its accuracy and robustness across five different modalities. The source code for FocusNet is available at https://github.com/JunZengz/FocusNet.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
-
[1]
Colorectal cancer statistics, 2023,
R. L. Siegel, N. S. Wagle, A. Cercek, R. A. Smith, and A. Jemal, “Colorectal cancer statistics, 2023,” CA: a cancer journal for clini- cians, vol. 73, no. 3, pp. 233–254, 2023
work page 2023
-
[2]
R. L. Siegel, A. N. Giaquinto, and A. Jemal, “Cancer statistics, 2024,” CA: a cancer journal for clinicians , vol. 74, no. 1, pp. 12–49, 2024
work page 2024
-
[3]
Prospective study of the frequency and size distribution of polyps missed by colonoscopy,
L. Hixson, M. Fennerty, R. Sampliner, D. McGee, and H. Garewal, “Prospective study of the frequency and size distribution of polyps missed by colonoscopy,”JNCI: Journal of the National Cancer Institute, vol. 82, no. 22, pp. 1769–1772, 1990
work page 1990
-
[4]
U-Net: Convolutional networks for biomedical image segmentation,
O. Ronneberger, P. Fischer, and T. Brox, “U-Net: Convolutional networks for biomedical image segmentation,” in Proceedings of International Conference on Medical Image Computing and Computer- Assisted Intervention, 2015, pp. 234–241
work page 2015
-
[5]
Road extraction by deep residual u-net,
Z. Zhang, Q. Liu, and Y. Wang, “Road extraction by deep residual u-net,” IEEE Geoscience and Remote Sensing Letters , vol. 15, no. 5, pp. 749–753, 2018
work page 2018
-
[6]
ResUNet++: An Advanced Architecture for Medical Image Segmentation,
D. Jha, P. H. Smedsrud, M. A. Riegler, D. Johansen, T. De Lange, P. Halvorsen, and H. D. Johansen, “ResUNet++: An Advanced Architecture for Medical Image Segmentation,” in Proceedings of the 2019 IEEE International Symposium on Multimedia (ISM) , 2019, pp. 225–2255
work page 2019
-
[7]
Doubleu-net: A deep convolutional neural network for medical image segmentation,
D. Jha, M. A. Riegler, D. Johansen, P. Halvorsen, and H. D. Johansen, “Doubleu-net: A deep convolutional neural network for medical image segmentation,” in Proceedings of the International Symposium on computer-based medical Systems (CBMS) , 2020, pp. 558–564
work page 2020
-
[8]
Transunet: Transformers make strong encoders for medical image segmentation,
J. Chen, Y. Lu, Q. Yu, X. Luo, E. Adeli, Y. Wang, L. Lu, A. L. Yuille, and Y. Zhou, “Transunet: Transformers make strong encoders for medical image segmentation,” arXiv preprint arXiv:2102.04306, 2021
arXiv 2021
Show all 34 references
-
[9]
Transresu-net: Transformer based resu-net for real-time colonoscopy polyp segmentation,
N. K. Tomar, A. Shergill, B. Rieders, U. Bagci, and D. Jha, “Transresu-net: Transformer based resu-net for real-time colonoscopy polyp segmentation,” arXiv preprint arXiv:2206.08985, 2022
2022 arXiv
-
[10]
Tganet: Text-guided attention for improved polyp segmentation,
N. K. Tomar, D. Jha, U. Bagci, and S. Ali, “Tganet: Text-guided attention for improved polyp segmentation,” in International Con- ference on Medical Image Computing and Computer-Assisted Interven- tion, 2022, pp. 151–160
2022
-
[11]
CCBANet: cascading context and balancing attention for polyp segmentation,
T.-C. Nguyen, T.-P. Nguyen, G.-H. Diep, A.-H. Tran-Dinh, T. V. Nguyen, and M.-T. Tran, “CCBANet: cascading context and balancing attention for polyp segmentation,” in Proceedings of the Medical Image Computing and Computer Assisted Intervention– MICCAI, 2021, pp. 633–643
2021
-
[12]
Uacanet: Uncertainty augmented context attention for polyp segmentation,
T. Kim, H. Lee, and D. Kim, “Uacanet: Uncertainty augmented context attention for polyp segmentation,” in Proceedings of the 29th ACM International Conference on Multimedia , 2021, pp. 2167– 2175
2021
-
[13]
Colonformer: An efficient transformer based method for colon polyp segmentation,
N. T. Duc, N. T. Oanh, N. T. Thuy, T. M. Triet, and V. S. Dinh, “Colonformer: An efficient transformer based method for colon polyp segmentation,” IEEE Access, vol. 10, pp. 80 575–80 586, 2022
2022
-
[14]
RSAFormer: A method of polyp segmentation with region self- attention transformer,
X. Yin, J. Zeng, T. Hou, C. Tang, C. Gan, D. K. Jain, and S. Garc´ıa, “RSAFormer: A method of polyp segmentation with region self- attention transformer,” Computers in Biology and Medicine , vol. 172, p. 108268, 2024
2024
-
[15]
Msrf-net: a multi- scale residual fusion network for biomedical image segmenta- tion,
A. Srivastava, D. Jha, S. Chanda, U. Pal, H. D. Johansen, D. Jo- hansen, M. A. Riegler, S. Ali, and P. Halvorsen, “Msrf-net: a multi- scale residual fusion network for biomedical image segmenta- tion,” IEEE Journal of Biomedical and Health Informatics , vol. 26, no. 5, pp. 225...
2021
-
[16]
Gmsrf- net: An improved generalizability with global multi-scale residual fusion network for polyp segmentation,
A. Srivastava, S. Chanda, D. Jha, U. Pal, and S. Ali, “Gmsrf- net: An improved generalizability with global multi-scale residual fusion network for polyp segmentation,” in Proceedings of the 26th International Conference on Pattern Recognition (ICPR) , 2022, pp. 4321–4327
2022
-
[17]
Automatic polyp segmentation with multiple kernel dilated convolution network,
N. K. Tomar, A. Srivastava, U. Bagci, and D. Jha, “Automatic polyp segmentation with multiple kernel dilated convolution network,” in Proceedings of the IEEE 35th International Symposium on Computer-Based Medical Systems (CBMS) , 2022, pp. 317–322
2022
-
[18]
Multi- level feature fusion network combining attention mechanisms for polyp segmentation,
J. Liu, Q. Chen, Y. Zhang, Z. Wang, X. Deng, and J. Wang, “Multi- level feature fusion network combining attention mechanisms for polyp segmentation,” Information Fusion, vol. 104, p. 102195, 2024
2024
-
[19]
Swin transformer: Hierarchical vision transformer using shifted windows,
Z. Liu, Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo, “Swin transformer: Hierarchical vision transformer using shifted windows,” in Proceedings of IEEE/CVF International Conference on Computer Vision, 2021, pp. 9992–10 002
2021
-
[20]
Pvtv2: Improved baselines with pyramid vision transformer,
W. Wang, E. Xie, X. Li, D.-P. Fan, K. Song, D. Liang, T. Lu, P. Luo, and L. Shao, “Pvtv2: Improved baselines with pyramid vision transformer,” Computational Visual Media , vol. 8, no. 3, pp. 1–10, 2022
2022
-
[21]
Polyp-pvt: Polyp segmentation with pyramid vision transformers,
B. Dong, W. Wang, D.-P. Fan, J. Li, H. Fu, and L. Shao, “Polyp-pvt: Polyp segmentation with pyramid vision transformers,” arXiv preprint arXiv:2108.06932, 2021
2021 arXiv
-
[22]
Pvt v2: Improved baselines with pyramid vision transformer,
W. Wang, E. Xie, X. Li, D.-P. Fan, K. Song, D. Liang, T. Lu, P. Luo, and L. Shao, “Pvt v2: Improved baselines with pyramid vision transformer,” Computational visual media , vol. 8, no. 3, pp. 415– 424, 2022
2022
-
[23]
Cbam: Convolutional block attention module,
S. Woo, J. Park, J.-Y. Lee, and I. S. Kweon, “Cbam: Convolutional block attention module,” in Proceedings of the European Conference on Computer Vision (ECCV) , 2018, pp. 3–19
2018
-
[24]
Squeeze-and-excitation networks,
J. Hu, L. Shen, and G. Sun, “Squeeze-and-excitation networks,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132–7141
2018
-
[25]
Eca- net: Efficient channel attention for deep convolutional neural networks,
Q. Wang, B. Wu, P. Zhu, P. Li, W. Zuo, and Q. Hu, “Eca- net: Efficient channel attention for deep convolutional neural networks,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2020, pp. 11 534–11 542
2020
-
[26]
Transnext: Robust foveal visual perception for vision transformers,
D. Shi, “Transnext: Robust foveal visual perception for vision transformers,” in Proceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition , 2024, pp. 17 773–17 783
2024
-
[27]
Polypdb: A curated multi-center dataset for development of ai algorithms in colonoscopy,
D. Jha, N. K. Tomar, V. Sharma, Q.-H. Trinh, K. Biswas, H. Pan, R. K. Jha, G. Durak, A. Hann, J. Varkey et al. , “Polypdb: A curated multi-center dataset for development of ai algorithms in colonoscopy,” arXiv preprint arXiv:2409.00045 , 2024
2024 arXiv
-
[28]
Unet++: Redesigning skip connections to exploit multiscale features in image segmentation,
Z. Zhou, M. M. Rahman Siddiquee, N. Tajbakhsh, and J. Liang, “Unet++: Redesigning skip connections to exploit multiscale features in image segmentation,” IEEE T ransactions on Medical Imaging, vol. 39, no. 6, pp. 1856–1867, 2020
2020
-
[29]
Pranet: Parallel reverse attention network for polyp segmenta- tion,
D.-P. Fan, G.-P. Ji, T. Zhou, G. Chen, H. Fu, J. Shen, and L. Shao, “Pranet: Parallel reverse attention network for polyp segmenta- tion,” in Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention , Lima, Peru, 2020, pp. 263–273
2020
-
[30]
Caranet: context axial reverse attention network for segmentation of small medical ob- jects,
A. Lou, S. Guan, H. Ko, and M. H. Loew, “Caranet: context axial reverse attention network for segmentation of small medical ob- jects,” in Proceedings of the Medical Imaging 2022: Image Processing , vol. 12032, 2022, pp. 81–92
2022
-
[31]
Medical image segmentation via cascaded attention decoding,
M. M. Rahman and R. Marculescu, “Medical image segmentation via cascaded attention decoding,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , 2023, pp. 6222–6231
2023
-
[32]
Mamba-unet: Unet-like pure visual mamba for medical image segmentation,
Z. Wang, J.-Q. Zheng, Y. Zhang, G. Cui, and L. Li, “Mamba-unet: Unet-like pure visual mamba for medical image segmentation,” arXiv preprint arXiv:2402.05079 , 2024
2024 arXiv
-
[33]
A reverse mamba attention network for pathological liver segmentation,
J. Zeng, D. Jha, E. Aktas, E. Keles, A. Medetalibeyoglu, M. An- talek, R. Lewandowski, D. Ladner, A. A. Borhani, G. Durak, and U. Bagci, “A reverse mamba attention network for pathological liver segmentation,” arXiv preprint arXiv:2502.18232 , 2025
2025 arXiv
-
[34]
Automated polyp detection in colonoscopy videos using shape and context infor- mation,
N. Tajbakhsh, S. R. Gurudu, and J. Liang, “Automated polyp detection in colonoscopy videos using shape and context infor- mation,” IEEE T ransactions on Medical Imaging , vol. 35, no. 2, pp. 630–644, 2016
2016
Reviewed August 16, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.