Hi-Mamba: Hierarchical Mamba for Efficient Image Super-Resolution
Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:OSMOZ2YSrecord.jsonopen to challenge →
read the original abstract
State Space Models (SSM), such as Mamba, have shown strong representation ability in modeling long-range dependency with linear complexity, achieving successful applications from high-level to low-level vision tasks. However, SSM's sequential nature necessitates multiple scans in different directions to compensate for the loss of spatial dependency when unfolding the image into a 1D sequence. This multi-direction scanning strategy significantly increases the computation overhead and is unbearable for high-resolution image processing. To address this problem, we propose a novel Hierarchical Mamba network, namely, Hi-Mamba, for image super-resolution (SR). Hi-Mamba consists of two key designs: (1) The Hierarchical Mamba Block (HMB) assembled by a Local SSM (L-SSM) and a Region SSM (R-SSM) both with the single-direction scanning, aggregates multi-scale representations to enhance the context modeling ability. (2) The Direction Alternation Hierarchical Mamba Group (DA-HMG) allocates the isomeric single-direction scanning into cascading HMBs to enrich the spatial relationship modeling. Extensive experiments demonstrate the superiority of Hi-Mamba across five benchmark datasets for efficient SR. For example, Hi-Mamba achieves a significant PSNR improvement of 0.29 dB on Manga109 for $\times3$ SR, compared to the strong lightweight MambaIR.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
SP-MoMamba: Superpixel-driven Mixture of State Space Experts for Efficient Image Super-Resolution
SP-MoMamba uses superpixels to drive content-aware state space modeling and multi-scale mixture-of-experts for efficient single-image super-resolution.
-
RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thought
RealSR-R1 introduces VLCoT-GRPO with four rewards to add understanding and reasoning to real-world image super-resolution models.
-
State Space Models Meet Remote Sensing: A Survey
A literature survey of State Space Model methods applied to remote sensing tasks, architectures, and challenges since their introduction to the field.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.