pith. sign in

arxiv: 2606.20282 · v1 · pith:DOYLKK2Knew · submitted 2026-06-18 · 💻 cs.CV

U²Mamba: A Two-level Nested U-structure Mamba for Salient Object Detection

Junhui Li , Jialu Li , Youshan Zhang This is my paper

Pith reviewed 2026-06-26 17:44 UTC · model grok-4.3

classification 💻 cs.CV
keywords salient object detectionMambanested U-structuremultiscale blockshierarchical supervisioncontextual featuresU-Net architecture
0
0 comments X

The pith

U²Mamba uses a nested U-structure with multiscale Mamba blocks and level-wise supervision to match top salient object detection performance.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents U²Mamba, a U-structured network for salient object detection that places multiscale Mamba U-blocks inside a two-level nested U-architecture. This design increases network depth for stronger local feature extraction while letting shallow and deep layers contribute different receptive fields to gather more context and long-range information without resolution limits. It replaces conventional deep supervision with a hierarchical scheme that applies loss at every level during training. The resulting model reaches highly competitive accuracy on standard benchmarks against existing methods.

Core claim

U²Mamba builds a two-level nested U-structure that embeds multiscale Mamba U-blocks to deepen the network and integrate multi-scale receptive fields, combined with hierarchical supervision that computes loss at each level, producing richer contextual and longer-range features for salient object detection.

What carries the argument

The two-level nested U-structure with multiscale Mamba U-blocks (MMUBs), which increases depth and fuses receptive fields across layers to collect contextual information without resolution constraints.

If this is right

  • The network integrates receptive fields from both shallow and deep layers to collect richer contextual and longer-range data.
  • Increased model depth from the multiscale Mamba U-blocks improves local feature extraction.
  • Hierarchical supervision during training replaces single top-level loss and applies loss at each level.
  • The full architecture achieves highly competitive results against state-of-the-art methods without dataset-specific adjustments.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The nested design could transfer to other dense prediction tasks such as semantic segmentation or edge detection where multi-scale context matters.
  • Replacing attention mechanisms with Mamba blocks inside the nested U may lower memory use for high-resolution inputs compared with transformer alternatives.
  • Adding a third nesting level or varying the block scale schedule offers a direct route to test further gains in feature hierarchy.

Load-bearing premise

The assumption that the nested U-structure, multiscale Mamba blocks, and hierarchical supervision together deliver measurable performance gains over prior Mamba and U-Net baselines on salient object detection tasks.

What would settle it

Evaluating U²Mamba on standard SOD benchmarks such as DUTS or ECSSD and finding that its F-measure, MAE, or S-measure fall below those of current leading methods by a clear margin.

read the original abstract

Mamba-based models have emerged as a promising alternative for salient object detection (SOD), offering significant advantages in modeling long sequences. However, existing models often fail to explore contextual information and the depth of the entire architecture. This paper introduces U$^2$Mamba, a powerful and innovative U-structured network for salient object detection. We propose multiscale Mamba U-blocks (MMUBs) that enhance the model depth to improve local feature extraction capabilities. Our newly developed nested U-structure, incorporating MMUBs, enables the network to integrate various receptive fields from shallow and deep layers, thereby collecting richer contextual information and longer-range data without being constrained by resolution. Instead of using the traditional deep supervision scheme and top-level supervised training, we propose a hierarchical training supervision method where the loss is computed at each level during the training process. Extensive experiments demonstrate that U$^2$Mamba achieves highly competitive performance against state-of-the-art methods. The source code is available at \url{https://github.com/JL021/U2Mamba}.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Referee Report

0 major / 3 minor

Summary. The paper proposes U²Mamba, a two-level nested U-structured Mamba network for salient object detection. It introduces multiscale Mamba U-blocks (MMUBs) to increase architectural depth and improve local feature extraction, embeds these within a nested U-structure to aggregate multi-scale receptive fields and long-range context without resolution constraints, and replaces standard deep supervision with hierarchical supervision that applies loss at each level. Extensive experiments on standard SOD benchmarks are reported to demonstrate highly competitive performance against state-of-the-art methods, with source code released at the provided GitHub link.

Significance. If the empirical performance claims hold under independent verification, the architecture offers a concrete way to combine Mamba's linear-complexity long-sequence modeling with nested U-Net-style multi-scale fusion and level-wise supervision. The public implementation is a clear strength that enables direct reproducibility and further ablation studies. The work sits at the intersection of state-space models and dense prediction, potentially informing efficient alternatives to transformer-based SOD pipelines.

minor comments (3)
  1. Abstract: the phrase 'highly competitive performance' is used without any quantitative indicators (e.g., mean F-measure or MAE ranges); adding one or two headline numbers would strengthen the claim for readers who only see the abstract.
  2. The description of hierarchical supervision versus 'traditional deep supervision' would benefit from an explicit equation or pseudocode showing how the per-level losses are weighted and aggregated, especially since this is presented as a methodological contribution.
  3. Figure captions and architecture diagrams should explicitly label the two-level nesting and the placement of MMUBs so that the 'nested U-structure' can be traced without ambiguity.

Simulated Author's Rebuttal

0 responses · 0 unresolved

We thank the referee for the positive summary of our manuscript and the recommendation of minor revision. No major comments were provided in the report, so we have no specific points to address at this stage. We will carefully consider any minor suggestions during the revision process and ensure the final version maintains the claimed contributions regarding the nested U-structure, MMUBs, and hierarchical supervision for salient object detection.

Circularity Check

0 steps flagged

No significant circularity

full rationale

The paper presents an empirical architecture proposal (U²Mamba with MMUBs and hierarchical supervision) whose central claim is competitive SOD performance on standard benchmarks. No derivation chain, first-principles result, or fitted parameter is presented as a prediction; the manuscript supplies public code and frames results as measured outcomes rather than reductions to inputs by construction. No self-citation load-bearing steps, uniqueness theorems, or ansatzes appear in the abstract or described structure.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

Only abstract available; no explicit free parameters, axioms, or invented entities can be extracted beyond standard deep-learning assumptions such as gradient-based optimization and the existence of salient-object ground truth labels.

axioms (1)
  • domain assumption Gradient descent on a neural network with the proposed architecture will converge to a useful local minimum for salient object detection.
    Implicit in all empirical DL claims; location: abstract description of training process.

pith-pipeline@v0.9.1-grok · 5716 in / 1206 out tokens · 15036 ms · 2026-06-26T17:44:10.793650+00:00 · methodology

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

34 extracted references · 4 canonical work pages · 3 internal anchors

  1. [1]

    U$^2$Mamba: A Two-level Nested U-structure Mamba for Salient Object Detection

    INTRODUCTION Salient Object Detection (SOD) is a fundamental problem in visual understanding, playing a critical role in applications such as medical imaging, autonomous driving, scene recog- nition, and video analysis [1]. The objective of SOD is to accurately identify visually prominent objects with precise boundaries. Although recent deep learning appr...

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  2. [2]

    We introduceU 2Mamba, a novel nested U-structured SOD framework that, for the first time, systematically inte- grates the Mamba state space mechanism into salient object detection

  3. [3]

    We design a newMultiscale Mamba U-Block (MMUB), enabling efficient intra-stage multiscale feature extraction with reduced spatial redundancy and memory cost, while preserving fine-grained saliency boundaries

  4. [4]

    Extensive experiments demonstrate that U2Mamba ob- tains favorable results across multiple benchmarks, validat- ing the effectiveness and scalability of Mamba-based archi- tectures for salient object detection

  5. [5]

    The entire architecture of U2Mamba is then presented, which includes a multiscale Mamba mechanism and a stacked U-Net-like structure

    METHOD The goal of U 2Mamba is to introduce a nested U-structure model with an advanced state space model (SSM) for the Salient Object Detection task. The entire architecture of U2Mamba is then presented, which includes a multiscale Mamba mechanism and a stacked U-Net-like structure. The detailed structure of U 2Mamba will be introduced in the following s...

  6. [6]

    Datasets and Metrics We train our network on DUTS-TR, which has 10553 images in total

    EXPERIMENTS 3.1. Datasets and Metrics We train our network on DUTS-TR, which has 10553 images in total. Currently, it is the largest and most popular train- ing dataset for salient object detection. We supplemented this dataset with 21106 training photos obtained offline us- ing horizontal flipping. We evaluate our method on several frequently used benchm...

  7. [7]

    Our developed multi- scale Mamba U structure block (MMUB) is integrated into each stage of U2-Mamba

    CONCLUSION In this research, we present a multi-scale Mamba mecha- nism for salient object detection utilizing a novel nested U structure, referred to as U 2-Mamba. Our developed multi- scale Mamba U structure block (MMUB) is integrated into each stage of U2-Mamba. This design enables U 2-Mamba to capture rich local and global information at high resoluti...

  8. [8]

    Review the state-of-the-art technologies of semantic segmentation based on deep learning,

    Yujian Mo, Yan Wu, Xinneng Yang, Feilin Liu, and Yujun Liao, “Review the state-of-the-art technologies of semantic segmentation based on deep learning,”Neurocomputing, vol. 493, pp. 626–646, 2022

    2022

  9. [9]

    Fcn-based approach for the automatic segmentation of bone surfaces in ultrasound images,

    Mateo Villa, Guillaume Dardenne, Maged Nasan, Hoel Letissier, Chafiaa Hamitouche, and Eric Stindel, “Fcn-based approach for the automatic segmentation of bone surfaces in ultrasound images,”International journal of computer assisted radiology and surgery, vol. 13, pp. 1707–1716, 2018

    2018

  10. [10]

    Neighborhood attention transformer,

    Ali Hassani, Steven Walton, Jiachen Li, Shen Li, and Humphrey Shi, “Neighborhood attention transformer,” inPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 6185–6194

    2023

  11. [11]

    Swin transformer: Hi- erarchical vision transformer using shifted windows,

    Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo, “Swin transformer: Hi- erarchical vision transformer using shifted windows,” inPro- ceedings of the IEEE/CVF international conference on com- puter vision, 2021, pp. 10012–10022

    2021

  12. [12]

    Ssnet: A novel transformer and cnn hybrid network for re- mote sensing semantic segmentation,

    Min Yao, Yaozu Zhang, Guofeng Liu, and Dongdong Pang, “Ssnet: A novel transformer and cnn hybrid network for re- mote sensing semantic segmentation,”IEEE Journal of Se- lected Topics in Applied Earth Observations and Remote Sens- ing, 2024

    2024

  13. [13]

    A survey on visual mamba,

    Hanwei Zhang, Ying Zhu, Dan Wang, Lijun Zhang, Tianxiang Chen, Ziyang Wang, and Zi Ye, “A survey on visual mamba,” Applied Sciences, vol. 14, no. 13, pp. 5683, 2024

    2024

  14. [14]

    VMamba: Visual State Space Model

    Yue Liu, Yunjie Tian, Yuzhong Zhao, Hongtian Yu, Lingxi Xie, Yaowei Wang, Qixiang Ye, and Yunfan Liu, “Vmamba: Visual state space model,”arXiv preprint arXiv:2401.10166, 2024

    work page internal anchor Pith review Pith/arXiv arXiv 2024

  15. [15]

    U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentation

    Jun Ma, Feifei Li, and Bo Wang, “U-mamba: Enhancing long- range dependency for biomedical image segmentation,”arXiv preprint arXiv:2401.04722, 2024

    work page internal anchor Pith review Pith/arXiv arXiv 2024

  16. [16]

    Mambasod: Dual mamba-driven cross-modal fusion network for rgb-d salient object detection,

    Yue Zhan, Zhihong Zeng, Haijun Liu, Xiaoheng Tan, and Yinli Tian, “Mambasod: Dual mamba-driven cross-modal fusion network for rgb-d salient object detection,”Neurocomputing, vol. 631, pp. 129718, 2025

    2025

  17. [17]

    U-shaped vision mamba for single image dehazing,

    Zhuoran Zheng and Chen Wu, “U-shaped vision mamba for single image dehazing,”arXiv preprint arXiv:2402.04139, 2024

    work page arXiv 2024

  18. [18]

    Uiu-net: U- net in u-net for infrared small object detection,

    Xin Wu, Danfeng Hong, and Jocelyn Chanussot, “Uiu-net: U- net in u-net for infrared small object detection,”IEEE Trans- actions on Image Processing, vol. 32, pp. 364–376, 2022

    2022

  19. [19]

    U2-net: Going deeper with nested u-structure for salient object detection,

    Xuebin Qin, Zichen Zhang, Chenyang Huang, Masood De- hghan, and Martin Jagersand, “U2-net: Going deeper with nested u-structure for salient object detection,”Pattern Recog- nition, vol. 106, pp. 107404, 2020

    2020

  20. [20]

    U2-onet: A two-level nested octave u- structure network with a multi-scale attention mechanism for moving object segmentation,

    Chenjie Wang, Chengyuan Li, Jun Liu, Bin Luo, Xin Su, Yajun Wang, and Yan Gao, “U2-onet: A two-level nested octave u- structure network with a multi-scale attention mechanism for moving object segmentation,”Remote sensing, vol. 13, no. 1, pp. 60, 2020

    2020

  21. [21]

    Hierarchical saliency detection,

    Qiong Yan, Li Xu, Jianping Shi, and Jiaya Jia, “Hierarchical saliency detection,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2013, pp. 1155– 1162

    2013

  22. [22]

    The secrets of salient object segmentation,

    Yuhong Li, Xiaodi Hou, Christof Koch, James M Rehg, and Alan L Yuille, “The secrets of salient object segmentation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 4334–4341

    2014

  23. [23]

    Saliency detection via graph-based mani- fold ranking,

    Chuan Yang, Lihe Zhang, Huchuan Lu, Xiang Ruan, and Ming-Hsuan Yang, “Saliency detection via graph-based mani- fold ranking,” inProceedings of the IEEE conference on com- puter vision and pattern recognition, 2013, pp. 3166–3173

    2013

  24. [24]

    Visual saliency based on multi- scale deep features,

    Guanbin Li and Yizhou Yu, “Visual saliency based on multi- scale deep features,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 5455– 5463

    2015

  25. [25]

    Learning to detect salient objects with image-level supervision,

    Lijun Wang, Huchuan Lu, Yifan Wang, Mengyang Feng, Dong Wang, Baocai Yin, and Xiang Ruan, “Learning to detect salient objects with image-level supervision,” inProceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 136–145

    2017

  26. [26]

    Boosting broader receptive fields for salient object detection,

    Mingcan Ma, Changqun Xia, Chenxi Xie, Xiaowu Chen, and Jia Li, “Boosting broader receptive fields for salient object detection,”IEEE Transactions on Image Processing, vol. 32, pp. 1026–1038, 2023

    2023

  27. [27]

    F 3net: fusion, feedback and focus for salient object detection,

    Jun Wei, Shuhui Wang, and Qingming Huang, “F 3net: fusion, feedback and focus for salient object detection,” inProceed- ings of the AAAI conference on artificial intelligence, 2020, vol. 34, pp. 12321–12328

    2020

  28. [28]

    Recursive contour-saliency blending network for accurate salient object detection,

    Yun Yi Ke and Takahiro Tsubono, “Recursive contour-saliency blending network for accurate salient object detection,” inPro- ceedings of the IEEE/CVF winter conference on applications of computer vision, 2022, pp. 2940–2950

    2022

  29. [29]

    Msenet: Marbling score estimation network for automated assessment of korean beef,

    Hyo-Jun Lee, Yeong Jun Koh, Young-Kuk Kim, Seung Hwan Lee, Jun Heon Lee, and Dong Won Seo, “Msenet: Marbling score estimation network for automated assessment of korean beef,”Meat Science, vol. 188, pp. 108784, 2022

    2022

  30. [30]

    Label decoupling framework for salient object detec- tion,

    Jun Wei, Shuhui Wang, Zhe Wu, Chi Su, Qingming Huang, and Qi Tian, “Label decoupling framework for salient object detec- tion,” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 13025–13034

    2020

  31. [31]

    Poolnet deep feature based person re-identification,

    J Stella Janci Rani and M Gethsiyal Augasta, “Poolnet deep feature based person re-identification,”Multimedia Tools and Applications, vol. 82, no. 16, pp. 24967–24989, 2023

    2023

  32. [32]

    Pixels, regions, and objects: Multiple enhancement for salient object detection,

    Yi Wang, Ruili Wang, Xin Fan, Tianzhu Wang, and Xiangjian He, “Pixels, regions, and objects: Multiple enhancement for salient object detection,” inProceedings of the IEEE/CVF con- ference on computer vision and pattern recognition, 2023, pp. 10031–10040

    2023

  33. [33]

    Visual saliency transformer,

    Nian Liu, Ni Zhang, Kaiyuan Wan, Ling Shao, and Junwei Han, “Visual saliency transformer,” inProceedings of the IEEE/CVF international conference on computer vision, 2021, pp. 4722–4732

    2021

  34. [34]

    Vst++: Ef- ficient and stronger visual saliency transformer,

    Nian Liu, Ziyang Luo, Ni Zhang, and Junwei Han, “Vst++: Ef- ficient and stronger visual saliency transformer,”IEEE Trans- actions on Pattern Analysis and Machine Intelligence, vol. 46, no. 11, pp. 7300–7316, 2024

    2024