Pith. sign in

REVIEW 4 major objections 3 minor 35 references

Cross-modal State Space Modeling for Real-time RGB-thermal Wild Scene Semantic Segmentation

T0 review · 4 major / 3 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A cross-modal state space model fuses RGB and thermal images in linear time, reaching state-of-the-art segmentation accuracy on wild-scene benchmarks.

desk verdict The PST900 SOTA claim is contradicted by the paper's own table; the architecture has merit but needs a corrected revision. read the letter →

arxiv 2506.17869 v1 pith:LJNL2BRW submitted 2025-06-22 cs.CV cs.RO

Xiaodong Guo , Zi'ang Lin , Luwen Hu , Zhihong Deng , Tong Liu , Wujie Zhou This is my paper
classification cs.CVcs.RO
keywords RGB-thermalsemanticsegmentationstatespacemodelcross-modalfusionlinearcomplexityreal-timeselectivescanwildsceneunderstandingEfficientViT
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to show that global cross-modal fusion for RGB-thermal semantic segmentation can be done in linear time, not quadratic, by building a state space model whose hidden state for each modality is computed from the other modality's previous state. It introduces CM-SS2D, which interleaves the two modalities into one scan sequence, and CM-SSA, which combines the resulting global associations with local convolutional features. On the CART and PST900 benchmarks the resulting model, CM-SSM, reports state-of-the-art mean intersection-over-union of 74.6% and 85.9% while using 12.59M parameters and running at 114 frames per second on an RTX 4090 GPU. A sympathetic reader would take the central claim to be that constructing the hidden state across modalities is the right way to adapt state space models to multi-modal fusion.

What carries the argument

The central object is the cross-modal hidden state recurrence, implemented in the CM-SS2D module. First, RGB and thermal features are interleaved into a 'RGB-thermal-RGB' visual sequence across four scanning directions. Then the hidden state of each modality is derived from the other modality's previous hidden state through the discretized state space equations, giving each hidden state a blend of cross-modal and global context. The CM-SSA module then merges the global association from CM-SS2D with a convolutional local association using gated residual connections and a 1x1 convolution.

What would settle it

Rerun CM-SSM and the leading baselines on the official CART and PST900 split definitions; if CM-SSM's mIoU falls below CMX's 74.0% on the same split, the state-of-the-art claim fails.

Watch

Extended reading notes

Core claim

CM-SSM establishes that the pivotal design for cross-modal state space fusion is to construct the hidden state across modalities, rather than merely using multi-modal information to generate SSM parameters. At each scan position k, the RGB hidden state $\bar{r}_k$ is computed from the thermal hidden state $\bar{t}_{k-1}$ and the current RGB input, and symmetrically $\bar{t}_k = \bar{A}\bar{r}_{k-1} + \bar{B}t_k$. This couples the two modalities' recurrent memories so that each hidden state carries both the other modality's information at the same spatial position and global context accumulated along the scan. Because the recurrence processes a sequence of length $2HW$ with a fixed per-step cost, the entire fusion module has linear computational complexity with respect to image resolution.

Load-bearing premise

The reported state-of-the-art comparisons assume that the train/val/test splits used here match the official splits used by every baseline paper, because CART is described only as randomly partitioned 6:1:1.

Editorial extensions

If this is right

  • If the central claim is correct, quadratic-complexity transformer-based fusion can be replaced by linear-complexity state space fusion for high-resolution multi-modal inputs without sacrificing accuracy.
  • The cross-modal hidden-state exchange gives a template for fusing more than two modalities by chaining state updates.
  • Real-time deployment on resource-constrained robots becomes more feasible: 114 FPS on an RTX 4090 with 12.59M parameters.
  • Existing SSM fusion baselines that use multi-modal information only to generate parameters are subsumed by a design that also carries information through the hidden state.
  • The reported gains on small object classes such as vehicles and persons on CART suggest the mechanism especially helps spatially compact targets.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same cross-modal state construction could plausibly extend to RGB-depth or RGB-event fusion, where the complementary cues have different spatial statistics and noise profiles.
  • The linear-complexity claim should be stress-tested at higher input resolutions, since actual wall-clock speed depends on the scan implementation and memory access patterns.
  • The paper does not analyze behavior when one modality is degraded or missing; a testable extension would corrupt thermal input and measure how much the cross-modal recurrence degrades relative to convolutional fusion.
  • A deeper investigation might isolate whether the improvement over FusionMamba-style parameter-sharing comes from the hidden-state coupling itself or from the residual gating in CM-SSA.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 3 minor

Summary. The paper proposes CM-SSM, a real-time RGB-thermal semantic segmentation architecture based on cross-modal state space modeling. The method consists of two modules: CM-SS2D, which builds a cross-modal visual sequence by interleaving RGB and thermal features and computes each modality's hidden state from the other modality's previous state, and CM-SSA, which combines the resulting global associations with local convolutional features. The authors report state-of-the-art results on CART (74.6% mIoU) and PST900 (85.9% mIoU) with 12.59M parameters and 114 FPS on an RTX 4090, and include ablation studies supporting the contribution of CM-SS2D and CM-SSA. The paper also provides code publicly.

Significance. If the reported results are correct, the paper offers a useful practical contribution: an efficient, linear-complexity alternative to Transformer-based cross-modal fusion for resource-constrained field robots. The architecture is plausible, and the ablation study compares against several fusion strategies, which is a strength. The public code and reproducible experimental setup are also positive. However, the central empirical claims are currently undermined by arithmetic inconsistencies in the PST900 table, an apparent mismatch between the text and Eq. (10), and ambiguity about whether reported CART splits match those of the cited baselines. These issues must be resolved before the state-of-the-art claims can be accepted.

major comments (4)
  1. [§III-C, Eq. (10)] Eq. (10) states that F_i = CBR_1x1(Cat(R_i, T_i, L)), but the surrounding text says that the module combines G_R, G_T, and L. As written, the equation drops the global association outputs G_R and G_T entirely, meaning the CM-SS2D branch would not contribute to the final fused feature. This contradicts the ablation study in Table IV, where removing CM-SS2D decreases mIoU by 1.3%. Please correct the equation or the text, and specify which formulation is actually implemented.
  2. [§IV-C2, Table II] The reported PST900 mIoU of 85.9% is inconsistent with the four per-class IoUs listed for CM-SSM in Table II (80.5, 85.4, 85.7, 78.1). The unweighted mean of these four values is 82.4%. Since Sec. IV-A defines mIoU as the mean intersection over union and does not mention frequency weighting or an additional background class, the 85.9% figure is arithmetically unsupported. If a different averaging scheme is used, the table and metric definition must be clarified, and all baseline comparisons must use the same scheme. Under the standard four-class mean, CM-SSM would rank below MDNet (83.0%) in Table II, which would directly affect the generalizability claim.
  3. [§III-B, Eqs. (4)-(5)] The cross-modal sequence is defined as f_1_c = {r_1, t_1, r_2, t_2, ..., r_k, t_k, ...}. In this ordering, the state immediately preceding t_k is rbar_k, not rbar_{k-1}. Eq. (5) nevertheless uses rbar_{k-1} to compute tbar_k. This means the thermal hidden state does not incorporate the RGB hidden state at the same position, which is inconsistent with the described scanning order and with the stated idea of deriving one modality's state from the other at each step. Please correct the indexing or explicitly define a different intended ordering.
  4. [§IV-A] The paper states that CART "was randomly partitioned into train/val/test set at a 6:1:1 ratio," but it does not specify whether this random partition is identical to the official CART split or to the splits used by the baseline methods in Table I. If the split differs, the comparison may not be meaningful. Please state whether the official splits were used, and if a custom random split was used, provide the split indices or explain how the comparison remains fair.
minor comments (3)
  1. [§III-C, Eq. (8)] The text says that ⊗ denotes addition, but in context Eq. (8) uses ⊗ to combine a gated feature with the input, which should be element-wise multiplication. Please clarify the notation.
  2. [Throughout] There are several typos, including "dateset" (Sec. IV-A), "filed robots" (Sec. V), and "corss-modal" (Sec. V). A careful proofread would improve presentation.
  3. [§I, Contributions] The contribution list includes specific parameter counts and FPS values; please ensure these are consistent with Table III and with the corresponding numbers stated in the abstract and conclusion, which they currently are.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity found: the paper is an empirical architecture study whose results come from training and evaluation, not from a derivation that reduces to its inputs.

full rationale

CM-SSM is an empirical architecture paper. The central claims are the proposed CM-SS2D and CM-SSA module designs plus measured mIoU, parameter count, FLOPs, and FPS on CART and PST900. No inferred quantity is defined in terms of a target it is then said to predict, and no fitted parameter is renamed as a prediction. Equations (4) and (5) define the cross-modal hidden-state updates as a model architecture choice, not as a derivation of the reported accuracies. Self-citations appear only as related work and comparison baselines (e.g., CLNet-T [2], MDNet [16], MCNet-T [6]) and are not used to justify the central premise; the ablation study in Table IV provides internal, independent evidence for the module contributions. The PST900 mIoU inconsistency noted by the skeptic (85.9% reported vs. roughly 82.4% from the four per-class IoUs in Table II) is a potential internal-consistency or arithmetic problem, not a circularity of the kind this pass evaluates. It does not make the reported result equivalent to its inputs by construction. Therefore the appropriate circularity score is 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

This is a supervised learning paper; no physical or mathematical constants are fitted to derive the central claim. The trained network weights and standard training hyperparameters are learned or chosen in the usual way. The key domain assumptions concern benchmark comparability and metric definition, and these are listed as axioms.

assumptions (3)
  • standard math The discretized SSM update in Eq. (3) is a faithful numerical approximation of the continuous SSM for the learned A, B, and Delta.
    The paper adopts the exponential and linear discretization from VMamba/Mamba without derivation; it requires Delta small enough for the approximation to be stable.
  • domain assumption The baseline numbers in Tables I and II come from training and testing under the identical data split and evaluation protocol as CM-SSM.
    The paper randomly partitions CART at 6:1:1 but does not state whether this matches the official benchmark splits used by the cited methods.
  • domain assumption The reported PST900 mIoU includes an unlisted background class in its averaging.
    Without this assumption the reported 85.9% mIoU cannot be reconciled with the mean of the four listed class IoUs, which is 82.4%.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Cross-modal State Space Modeling for Real-time RGB-thermal Wild Scene Semantic Segmentation." pith.science (2026). https://pith.science/paper/LJNL2BRW

@misc{pith2026250617869,
  author       = {Pith},
  title        = {Pith review of: Cross-modal State Space Modeling for Real-time RGB-thermal Wild Scene Semantic Segmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LJNL2BRW}},
  note         = {Machine review of arXiv:2506.17869}
}
read the original abstract

The integration of RGB and thermal data can significantly improve semantic segmentation performance in wild environments for field robots. Nevertheless, multi-source data processing (e.g. Transformer-based approaches) imposes significant computational overhead, presenting challenges for resource-constrained systems. To resolve this critical limitation, we introduced CM-SSM, an efficient RGB-thermal semantic segmentation architecture leveraging a cross-modal state space modeling (SSM) approach. Our framework comprises two key components. First, we introduced a cross-modal 2D-selective-scan (CM-SS2D) module to establish SSM between RGB and thermal modalities, which constructs cross-modal visual sequences and derives hidden state representations of one modality from the other. Second, we developed a cross-modal state space association (CM-SSA) module that effectively integrates global associations from CM-SS2D with local spatial features extracted through convolutional operations. In contrast with Transformer-based approaches, CM-SSM achieves linear computational complexity with respect to image resolution. Experimental results show that CM-SSM achieves state-of-the-art performance on the CART dataset with fewer parameters and lower computational cost. Further experiments on the PST900 dataset demonstrate its generalizability. Codes are available at https://github.com/xiaodonguo/CMSSM.

Figures

Figures reproduced from arXiv: 2506.17869 by the authors.

Figure 1
Figure 1. Three cross-modal feature fusion strategies: (a) convolution [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Illustration of CM-SSM. CM-SSM consists of two image encoders to extract the feature of RGB and thermal images, four CM-SSA modules to [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Illustration of CM-SS2D. CM-SS2D consists of three steps: 1) cross-modal selective scanning, 2) cross-modal state space modeling, and 3) scan [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (3 more)
Figure 2
Figure 2. Figure 2: It features a typical encoder-decoder architecture, [PITH_FULL_IMAGE:figures/full_fig_p003_2.png]
Figure 2
Figure 2. Figure 2: Firstly, the global association is achieved through CM [PITH_FULL_IMAGE:figures/full_fig_p004_2.png]
Figure 4
Figure 4. Figure 4: Visual diagram of the segmentation maps of CM-SSM and some SOTA models on the CART dataset. [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

35 extracted references · 24 canonical work pages

  1. [1]

    Caltech aerial rgb-thermal dataset in the wild,

    C. Lee, M. Anderson, N. Ranganathan, X. Zuo, K. Do, G. Gkioxari, and S.-J. Chung, “Caltech aerial rgb-thermal dataset in the wild,” in European Conference on Computer Vision. Springer, 2024, pp. 236– 256

    work page 2024

  2. [2]

    Contrastive learning-based knowledge distillation for RGB-thermal urban scene semantic segmentation,

    X. Guo, W. Zhou, and T. Liu, “Contrastive learning-based knowledge distillation for RGB-thermal urban scene semantic segmentation,” Knowledge-Based Systems, vol. 292, p. 111588, 2024

    work page 2024

  3. [3]

    GMNet: Graded- feature multilabel-learning network for RGB-thermal urban scene semantic segmentation,

    W. Zhou, J. Liu, J. Lei, L. Yu, and J.-N. Hwang, “GMNet: Graded- feature multilabel-learning network for RGB-thermal urban scene semantic segmentation,”IEEE Transactions on Image Processing, vol. 30, pp. 7790–7802, 2021

    work page 2021

  4. [4]

    Multilevel attention imitation knowl- edge distillation for rgb-thermal transmission line detection,

    X. Guo, W. Zhou, and T. Liu, “Multilevel attention imitation knowl- edge distillation for rgb-thermal transmission line detection,”Expert Systems with Applications, vol. 260, p. 125406, 2025

    work page 2025

  5. [5]

    Attention is all you need,

    A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. u. Kaiser, and I. Polosukhin, “Attention is all you need,” inAdvances in Neural Information Processing Systems, vol. 30, 2017

    work page 2017

  6. [6]

    Transferring prior thermal knowledge for snowy urban scene semantic segmentation,

    X. Guo, T. Liu, Y . Mou, S. Chai, B. Ren, Y . Wang, W. Shi, S. Liu, and W. Zhou, “Transferring prior thermal knowledge for snowy urban scene semantic segmentation,”IEEE Transactions on Intelligent Transportation Systems, 2025

    work page 2025

  7. [7]

    MMSMCNet: Modal mem- ory sharing and morphological complementary networks for RGB-T urban scene semantic segmentation,

    W. Zhou, H. Zhang, W. Yan, and W. Lin, “MMSMCNet: Modal mem- ory sharing and morphological complementary networks for RGB-T urban scene semantic segmentation,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 33, no. 12, pp. 7096–7108, 2023

    work page 2023

  8. [8]

    CMX: Cross-modal fusion for RGB-X semantic segmentation with transform- ers,

    J. Zhang, H. Liu, K. Yang, X. Hu, R. Liu, and R. Stiefelhagen, “CMX: Cross-modal fusion for RGB-X semantic segmentation with transform- ers,”IEEE Transactions on intelligent transportation systems, vol. 24, no. 12, pp. 14 679–14 694, 2023

    work page 2023

Show all 35 references
  1. [9]

    Delivering arbitrary-modal semantic segmenta- tion,

    J. Zhang, R. Liu, H. Shi, K. Yang, S. Reiß, K. Peng, H. Fu, K. Wang, and R. Stiefelhagen, “Delivering arbitrary-modal semantic segmenta- tion,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 1136–1147

    2023

  2. [10]

    Combining recurrent, convolutional, and continuous-time models with linear state space layers,

    A. Gu, I. Johnson, K. Goel, K. Saab, T. Dao, A. Rudra, and C. R ´e, “Combining recurrent, convolutional, and continuous-time models with linear state space layers,”Advances in neural information processing systems, vol. 34, pp. 572–585, 2021

    2021

  3. [11]

    Efficiently modeling long sequences with structured state spaces,

    A. Gu, K. Goel, and C. R ´e, “Efficiently modeling long sequences with structured state spaces,”arXiv preprint arXiv:2111.00396, 2021

    2021 arXiv

  4. [12]

    Hungry hungry hippos: Towards language modeling with state space models,

    D. Y . Fu, T. Dao, K. K. Saab, A. W. Thomas, A. Rudra, and C. R ´e, “Hungry hungry hippos: Towards language modeling with state space models,”arXiv preprint arXiv:2212.14052, 2022

    2022 arXiv

  5. [13]

    Simpli- fied state space layers for sequence modeling,

    J. T. Smith, A. Warrington, and S. W. Linderman, “Simpli- fied state space layers for sequence modeling,”arXiv preprint arXiv:2208.04933, 2022

    2022 arXiv

  6. [14]

    Vision mamba: Efficient visual representation learning with bidirectional state space model,

    L. Zhu, B. Liao, Q. Zhang, X. Wang, W. Liu, and X. Wang, “Vision mamba: Efficient visual representation learning with bidirectional state space model,”arXiv preprint arXiv:2401.09417, 2024

    2024 arXiv

  7. [15]

    Vmamba: Visual State Space Model,

    Y . Liu, Y . Tian, Y . Zhao, H. Yu, L. Xie, Y . Wang, Q. Ye, and Y . Liu, “Vmamba: Visual State Space Model,” inAdvances in Neural Information Processing Systems, vol. 37, 2024, pp. 103 031–103 063

    2024

  8. [16]

    MDNet: Mamba-effective diffusion- distillation network for RGB-thermal urban dense prediction,

    W. Zhou, H. Wu, and Q. Jiang, “MDNet: Mamba-effective diffusion- distillation network for RGB-thermal urban dense prediction,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 35, no. 4, pp. 3222–3233, 2025

    2025

  9. [17]

    Fusionmamba: Dynamic feature enhancement for multimodal image fusion with mamba,

    X. Xie, Y . Cui, T. Tan, X. Zheng, and Z. Yu, “Fusionmamba: Dynamic feature enhancement for multimodal image fusion with mamba,” Visual Intelligence, vol. 2, no. 1, p. 37, 2024

    2024

  10. [18]

    Fusionmamba: Efficient remote sensing image fusion with state space model,

    S. Peng, X. Zhu, H. Deng, L.-J. Deng, and Z. Lei, “Fusionmamba: Efficient remote sensing image fusion with state space model,”IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1–16, 2024

    2024

  11. [19]

    Sigma: Siamese mamba network for multi-modal semantic segmentation,

    Z. Wan, P. Zhang, Y . Wang, S. Yong, S. Stepputtis, K. Sycara, and Y . Xie, “Sigma: Siamese mamba network for multi-modal semantic segmentation,”arXiv preprint arXiv:2404.04256, 2024

    2024 arXiv

  12. [20]

    MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes,

    Q. Ha, K. Watanabe, T. Karasawa, Y . Ushiku, and T. Harada, “MFNet: Towards real-time semantic segmentation for autonomous vehicles with multi-spectral scenes,” in2017 IEEE/RSJ International Confer- ence on Intelligent Robots and Systems (IROS), 2017, pp. 5108–5115

    2017

  13. [21]

    Pst900: Rgb-thermal calibration, dataset and segmenta- tion network,

    S. S. Shivakumar, N. Rodrigues, A. Zhou, I. D. Miller, V . Kumar, and C. J. Taylor, “Pst900: Rgb-thermal calibration, dataset and segmenta- tion network,” in2020 IEEE international conference on robotics and automation (ICRA), 2020, pp. 9441–9447

    2020

  14. [22]

    Multispectral fusion transformer network for RGB-thermal urban scene semantic segmentation,

    H. Zhou, C. Tian, Z. Zhang, Q. Huo, Y . Xie, and Z. Li, “Multispectral fusion transformer network for RGB-thermal urban scene semantic segmentation,”IEEE Geoscience and Remote Sensing Letters, vol. 19, pp. 1–5, 2022

    2022

  15. [23]

    Mamba: Linear-time sequence modeling with selective state spaces,

    A. Gu and T. Dao, “Mamba: Linear-time sequence modeling with selective state spaces,”arXiv preprint arXiv:2312.00752, 2023

    2023 arXiv

  16. [24]

    Coupled mamba: Enhanced multi-modal fusion with coupled state space model,

    W. Li, H. Zhou, J. Yu, Z. Song, and W. Yang, “Coupled mamba: Enhanced multi-modal fusion with coupled state space model,”arXiv preprint arXiv:2405.18014, 2024

    2024 arXiv

  17. [25]

    Efficientvit: Lightweight multi-scale attention for high-resolution dense prediction,

    H. Cai, J. Li, M. Hu, C. Gan, and S. Han, “Efficientvit: Lightweight multi-scale attention for high-resolution dense prediction,” inProceed- ings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 17 256–17 267

    2023

  18. [26]

    Segformer: Simple and efficient design for semantic segmentation with transformers,

    E. Xie, W. Wang, Z. Yu, A. Anandkumar, J. M. Alvarez, and P. Luo, “Segformer: Simple and efficient design for semantic segmentation with transformers,”Advances in neural information processing sys- tems, vol. 34, pp. 12 077–12 090, 2021

    2021

  19. [27]

    Explicit attention-enhanced fusion for RGB-thermal perception tasks,

    M. Liang, J. Hu, C. Bao, H. Feng, F. Deng, and T. L. Lam, “Explicit attention-enhanced fusion for RGB-thermal perception tasks,”IEEE Robotics and Automation Letters, vol. 8, no. 7, pp. 4060–4067, 2023

    2023

  20. [28]

    Sgfnet: semantic-guided fusion net- work for rgb-thermal semantic segmentation,

    Y . Wang, G. Li, and Z. Liu, “Sgfnet: semantic-guided fusion net- work for rgb-thermal semantic segmentation,”IEEE Transactions on Circuits and Systems for Video Technology, vol. 33, no. 12, pp. 7737– 7748, 2023

    2023

  21. [29]

    EGFNet: Edge-aware guidance fusion network for RGB–thermal urban scene parsing,

    S. Dong, W. Zhou, C. Xu, and W. Yan, “EGFNet: Edge-aware guidance fusion network for RGB–thermal urban scene parsing,”IEEE Transactions on Intelligent Transportation Systems, vol. 25, no. 1, pp. 657–669, 2025

    2025

  22. [30]

    SFAF-MA: Spatial fea- ture aggregation and fusion with modality adaptation for RGB-thermal semantic segmentation,

    X. He, M. Wang, T. Liu, L. Zhao, and Y . Yue, “SFAF-MA: Spatial fea- ture aggregation and fusion with modality adaptation for RGB-thermal semantic segmentation,”IEEE Transactions on Instrumentation and Measurement, vol. 72, pp. 1–10, 2023

    2023

  23. [31]

    Semanticrt: A large-scale dataset and method for robust semantic segmentation in multispectral images,

    W. Ji, J. Li, C. Bian, Z. Zhang, and L. Cheng, “Semanticrt: A large-scale dataset and method for robust semantic segmentation in multispectral images,” inProceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 3307–3316

    2023

  24. [32]

    Complementary random masking for RGB-thermal semantic segmentation,

    U. Shin, K. Lee, I. S. Kweon, and J. Oh, “Complementary random masking for RGB-thermal semantic segmentation,” in2024 IEEE International Conference on Robotics and Automation (ICRA), 2024, pp. 11 110–11 117

    2024

  25. [33]

    Context-aware interaction network for rgb-t semantic segmentation,

    Y . Lv, Z. Liu, and G. Li, “Context-aware interaction network for rgb-t semantic segmentation,”IEEE Transactions on Multimedia, vol. 26, pp. 6348–6360, 2024

    2024

  26. [34]

    DBCNet: Dynamic bilateral cross-fusion network for RGB-T urban scene understanding in intelli- gent vehicles,

    W. Zhou, T. Gong, J. Lei, and L. Yu, “DBCNet: Dynamic bilateral cross-fusion network for RGB-T urban scene understanding in intelli- gent vehicles,”IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 53, no. 12, pp. 7631–7641, 2023

    2023

  27. [35]

    C 4Net: Excavating Cross-modal Context-and Content-Complementarity for RGB-T Semantic Segmen- tation,

    S. Zhao, J. Li, and Q. Zhang, “C 4Net: Excavating Cross-modal Context-and Content-Complementarity for RGB-T Semantic Segmen- tation,”IEEE Transactions on Circuits and Systems for Video Tech- nology, vol. 35, no. 2, pp. 1347–1361, 2025

    2025

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.