Pith. sign in

REVIEW 1 cited by

Vision Backbone Enhancement via Multi-Stage Cross-Scale Attention

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2308.05872 v2 pith:LAD3KW4L submitted 2023-08-10 cs.CV

classification cs.CV
keywords multi-stagecross-scaleinteractionsattentiondifferentfeaturemapsvision
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Convolutional neural networks (CNNs) and vision transformers (ViTs) have achieved remarkable success in various vision tasks. However, many architectures do not consider interactions between feature maps from different stages and scales, which may limit their performance. In this work, we propose a simple add-on attention module to overcome these limitations via multi-stage and cross-scale interactions. Specifically, the proposed Multi-Stage Cross-Scale Attention (MSCSA) module takes feature maps from different stages to enable multi-stage interactions and achieves cross-scale interactions by computing self-attention at different scales based on the multi-stage feature maps. Our experiments on several downstream tasks show that MSCSA provides a significant performance boost with modest additional FLOPs and runtime.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Stroke Lesion Segmentation using Multi-Stage Cross-Scale Attention

    eess.IV 2025-01 conditional novelty 4.0 of 10

    Adding a multi-stage cross-scale attention module to U-Net improves small stroke lesion segmentation on ATLAS v2.0, with the best ensemble achieving the highest Dice and F1 scores.

Pith tools