Pith. sign in

REVIEW 3 major objections 5 minor 71 references

SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation

T0 review · 3 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read SCORE introduces open-vocabulary remote sensing instance segmentation and claims state-of-the-art cross-dataset results by injecting regional and global scene context into CLIP-based class and text embeddings.

desk verdict Solid cross-dataset RS instance segmentation system, but the 'open-vocabulary' SOTA claim is not demonstrated because the benchmarks mostly share classes with training; no base/novel split. read the letter →

arxiv 2507.12857 v2 pith:YIBTXCNE submitted 2025-07-17 cs.CV

Shiqi Huang , Shuting He , Huaiyuan Qin , Bihan Wen This is my paper · ORCID
classification cs.CV
keywords open-vocabularysegmentationremotesensinginstancescenecontextregion-awareintegrationglobaladaptationCLIPcross-datasetgeneralization
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Open-vocabulary instance segmentation in remote sensing is nearly unexplored: models trained on natural images fail on aerial data, where objects are small, visually ambiguous, and strongly tied to their surroundings. The paper claims that this scene context is the missing signal, and that injecting it into both visual and textual representations closes the gap. Its SCORE framework extracts regional context from a remote-sensing CLIP model's patch embeddings, pools it inside adaptively dilated mask proposals, and refines class embeddings with it; a second module injects global context into frozen CLIP text embeddings. On new cross-dataset benchmarks, the model trained on iSAID reaches 38.68 average mAP versus 33.24 for the best prior method, and trained on SIOR it reaches 32.59 versus 28.27. If true, one model trained on a single annotated dataset can segment unseen object classes in other aerial datasets using only their names.

What carries the argument

The load-bearing mechanism is the pair of context-injection modules, with Region-Aware Integration carrying the main argument. In RAI, adaptive region formation dilates each predicted mask by max-pooling with kernel size $k = 3 + \mathrm{clamp}(\delta, 0, 10)$, then pools RemoteCLIP patch embeddings inside the expanded mask into a regional context $F_{\mathrm{region}}$, which is injected into class embeddings $V$ through $l$ sequential transformer layers with a temperature coefficient $\lambda$. Global Context Adaptation forms the complementary mechanism: it takes the RemoteCLIP [CLS] token as the query in multi-head cross-attention over text embeddings $T$, producing adapted embeddings $\hat{T}$. The region-aware class embeddings $\hat{V}$ and adapted text embeddings $\hat{T}$ are scored together, combining in-vocabulary and out-of-vocabulary predictions at inference.

What would settle it

Build or select a remote sensing test set where objects appear in atypical environments, such as ships on land or vehicles in water, and compare SCORE against its no-context baseline on that set; if the mAP advantage does not shrink, the reported gains are not actually caused by the environmental priors the paper claims.

Watch

Extended reading notes

Core claim

The central discovery is that multi-granularity scene context, taken from a remote-sensing-aware CLIP model, resolves the ambiguity that blocks open-vocabulary instance segmentation in aerial imagery. Region-Aware Integration (RAI) uses each predicted mask as a spatial reference, expands it with a learnable dilation, and mask-pools the RemoteCLIP patch embeddings inside that region to form a regional context vector; the vector is then fused into the class embeddings through stacked transformer layers. Global Context Adaptation (GCA) projects the RemoteCLIP [CLS] token as a query and cross-attends over the frozen text embeddings, producing a classifier adapted to remote sensing while keeping its open-vocabulary generality. With both modules, the paper reports 38.68 average mAP when trained on iSAID and 32.59 when trained on SIOR across the four test datasets, and the same modules also improve open-vocabulary semantic segmentation in the supplementary experiments.

Load-bearing premise

The method assumes the predicted mask proposals from the instance branch are spatially accurate enough to define an object's surrounding region; if a proposal for a novel class is wrong, the regional context pooled from the wrong area can inject misleading information into the class embedding.

Editorial extensions

If this is right

  • A single model trained on one annotated remote sensing dataset can segment object classes it has never seen in other aerial datasets, provided the class names are supplied at test time.
  • Objects that are visually similar but live in different environments, such as vehicles and ships, can be separated using the surrounding scene rather than the object alone.
  • The same context-injection modules transfer beyond instance segmentation, improving open-vocabulary semantic segmentation results reported in the supplement.
  • The new cross-dataset benchmarks give later work a fixed protocol for measuring open-vocabulary remote sensing instance segmentation.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper does not separate the contribution of the context modules from the contribution of running two frozen CLIP encoders and ensembling their outputs; an ablation that keeps the two encoders but disables only the context fusion would isolate that effect.
  • The regional-context idea should transfer to other dense geospatial tasks where mask proposals exist, such as open-vocabulary object detection or panoptic segmentation, but the paper does not test those settings.
  • Because the context branch is a frozen remote-sensing CLIP, replacing it with a larger or better remote-sensing vision-language model would likely improve SCORE without retraining the rest of the system.
  • If object-environment correlations were deliberately broken, for example by placing ships on land and cars in water, the reported advantage over the no-context baseline should shrink; the paper does not run that stress test.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes SCORE, a framework for open-vocabulary remote sensing instance segmentation. It uses a frozen remote-sensing CLIP (RemoteCLIP) to extract two types of scene context: regional context, obtained by pooling patch features inside an adaptively expanded predicted mask, and global context, taken from the image-level [CLS] token. Region-Aware Integration (RAI) refines class embeddings with regional context, while Global Context Adaptation (GCA) injects the global context into frozen CLIP text embeddings via multi-head cross-attention. The method is evaluated on cross-dataset benchmarks—training on iSAID or SIOR and testing on NWPU-VHR-10, SOTA, FAST, and SIOR—where it reports higher average mAP than ODISE, FC-CLIP, MAFT+, and ZoRI. A supplementary experiment extends the framework to remote sensing semantic segmentation.

Significance. If the empirical claims hold, the paper would provide a practical, modular way to exploit scene context for open-vocabulary instance segmentation in remote sensing, an under-explored task with clear application value. The work has several strengths: the design of RAI and GCA is clean and well motivated, the ablation studies cover important design axes (context VLM, context type, injection method), and the code is released. The qualitative results in Figure 4 provide intuitive evidence that regional context can disambiguate visually similar objects such as ships and vehicles. However, the central claim of 'SOTA performance' is currently not isolated from closed-vocabulary recognition: the cross-dataset benchmarks overlap heavily in class labels, and all design choices are selected using the test sets. These issues need to be addressed before the significance can be fully established.

major comments (3)
  1. [§3.1, §4.1, Table 1] The paper defines open-vocabulary learning as Ctrain != Ctest, but the cross-dataset benchmarks in Table 1 do not enforce class-disjoint splits. For example, when training on iSAID and testing on NWPU-VHR-10, most of the ten NWPU classes (including airplane, ship, storage tank, baseball diamond, tennis court, basketball court, ground track field, harbor, bridge, and vehicle) correspond to iSAID categories; the same issue holds for SOTA, where roughly 14 of 18 classes overlap iSAID, and for the SIOR-to-iSAID direction. As a result, the aggregate mAP values in Table 1 (38.68 and 32.59) are dominated by seen classes and do not isolate open-vocabulary performance. No base/novel class split is reported, so the reported gains of +5.53 and +4.32 over the best baselines could be driven entirely by improvements on seen classes. The qualitative examples in Figure 4 are suggestive but not quantitative. To support the central claim, the authors should report per-class mAP separately for base classes (present in training) and novel classes (absent from training), or restrict evaluation to a held-out subset of unseen classes. This is a load-bearing issue for the paper's main claim.
  2. [§4.4, Tables 3 and 5] The selection of the context VLM (RemoteCLIP vs. CLIP, SkyCLIP, GeoRSCLIP in Table 3) and of the global-context injection method (MHA vs. addition and concatenation in Table 5) is performed by comparing performance on the same test datasets used for the main results. No validation split or cross-validation is reported, and Tables 1, 3, and 5 present single runs without error bars or significance measures. This makes the reported numbers an optimistic estimate of true generalization and weakens the claim that the improvements are systematic. At minimum, the authors should evaluate ablations on a held-out split, report repeated-run statistics, or disclose that the design choices were tuned on the test sets. This is a correctness risk in the empirical argument, not a mathematical inconsistency.
  3. [§3.4, Eq. (5)] RAI pools RemoteCLIP patch features from the adaptively expanded predicted mask M'. For novel classes never seen in training, the proposal generator may produce inaccurate masks; in that case, the regional context is pooled from the wrong area and can reinforce an incorrect classification rather than resolve ambiguity. The paper does not analyze this sensitivity, for example by comparing regional context extracted from predicted masks against that extracted from ground-truth masks, or by quantifying proposal quality on novel classes. Since the claimed improvement on novel classes is attributed to RAI, this omission leaves the mechanism insufficiently validated.
minor comments (5)
  1. [§4.4] In the component analysis, the text refers to 'VCA' and 'VPA' when describing the global context module; the consistent name introduced in §3.5 is GCA. Please correct these inconsistencies.
  2. [Supplementary, Table A] The semantic segmentation extension reports a large drop on Potsdam (26.51 for SCORE vs. 43.29 for GSNet), and the text says the method outperforms 'across three of four benchmarks'. The abstract and main text claim 'achieves SOTA performance' without this caveat; please qualify the claim to match the actual results.
  3. [§3.4, Eq. (4)] Equation (4) computes an integer kernel size k from a continuous learnable parameter δ with clamping. Please state how gradients are handled for the discrete max-pooling kernel size (e.g., straight-through estimator or rounding).
  4. [§4.1] The evaluation metric is reported as 'mAP' without specifying the exact protocol (e.g., COCO-style AP with IoU thresholds or PASCAL VOC AP). Please clarify the definition so the numbers are reproducible.
  5. [Figure 4] The caption of Figure 4 mentions 'jittering=False' without explaining the setting. Please either provide a brief explanation or remove the phrase.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the method is trained on one dataset and evaluated on held-out datasets, and the claimed SOTA is an empirical result rather than a construction.

full rationale

The paper's derivation chain is empirical rather than deductive. RAI and GCA are trainable modules whose parameters are optimized on training datasets (iSAID, SIOR), and the SOTA claim is assessed on held-out test datasets not used for gradient updates. No equation in Sections 3.4-3.6 defines a predicted quantity as equal, by construction, to a fitted input: regional context is mask-pooled from frozen RemoteCLIP features and injected via learned transformer layers, and global context is injected via cross-attention into frozen-CLIP text embeddings; neither operation is equivalent to the final mAP. The choice of RemoteCLIP and general CLIP for OV classification is an ablation-driven design selection, and while it is made on the same test suites, that is a model-selection risk, not a mathematical circularity. The cited prior works (ZoRI, GSNet) are external baselines or related work, not load-bearing uniqueness arguments. A separate empirical caveat is the class overlap between training and test sets, which may make the reported overall mAP dominated by seen categories, but this concerns the validity of the open-vocabulary evaluation, not circularity of the derivation.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The core claim rests on standard deep-learning training (no new mathematical axioms) plus three domain assumptions about CLIP/RemoteCLIP transfer and proposal quality. The only fitted quantities are ordinary network parameters and two design hyperparameters (dilation factor and temperature). No invented entities are introduced.

free parameters (5)
  • dilation factor δ = initialized to 1; learned
    Controls the expansion of predicted masks in Adaptive Region Formation (Eq. 4); determines the region pooled for context.
  • temperature coefficient λ = not stated numerically; learned
    Scales regional context contribution inside RAI transformer layers (Eq. 6).
  • number of RAI transformer layers l = not specified in paper
    Depth of the context-integration transformer; a hand-chosen architecture hyperparameter.
  • GCA projection matrices w_Q, w_K, w_V = learned
    Project global context and text embeddings into shared dimension for cross-attention (Eq. 7).
  • Mask2Former object queries = 300 queries
    Instance proposal generator capacity; a fixed standard hyperparameter.
assumptions (4)
  • domain assumption RemoteCLIP patch embeddings encode scene-level semantics that transfer across remote sensing datasets
    Used in Eq. 5 as the source of regional context; if this transfer fails for novel scenes, RAI can add noise.
  • domain assumption Mask2Former proposals are accurate enough to serve as spatial references for novel classes
    RAI pools features inside expanded predicted masks (Eq. 5); inaccurate proposals corrupt the regional context.
  • domain assumption Cross-attention injection of global context preserves CLIP text embeddings' open-vocabulary generalization
    GCA modifies the classifier T; if the projection breaks cross-modal alignment, novel-class recognition degrades. Ablations in Table 5 support MHA over add/concat.
  • domain assumption Frozen general CLIP features generalize better than RS-CLIP for OV classification
    Section 3.6 and Table 6 show RS CLIPs underperform general CLIP for out-vocabulary classification; the method depends on this.

how reviews work

0 comments
Cite this review

Pith. "Pith review of SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation." pith.science (2026). https://pith.science/paper/YIBTXCNE

@misc{pith2026250712857,
  author       = {Pith},
  title        = {Pith review of: SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/YIBTXCNE}},
  note         = {Machine review of arXiv:2507.12857}
}
abstract

Most existing remote sensing instance segmentation approaches are designed for close-vocabulary prediction, limiting their ability to recognize novel categories or generalize across datasets. This restricts their applicability in diverse Earth observation scenarios. To address this, we introduce open-vocabulary (OV) learning for remote sensing instance segmentation. While current OV segmentation models perform well on natural image datasets, their direct application to remote sensing faces challenges such as diverse landscapes, seasonal variations, and the presence of small or ambiguous objects in aerial imagery. To overcome these challenges, we propose $\textbf{SCORE}$ ($\textbf{S}$cene $\textbf{C}$ontext matters in $\textbf{O}$pen-vocabulary $\textbf{RE}$mote sensing instance segmentation), a framework that integrates multi-granularity scene context, i.e., regional context and global context, to enhance both visual and textual representations. Specifically, we introduce Region-Aware Integration, which refines class embeddings with regional context to improve object distinguishability. Additionally, we propose Global Context Adaptation, which enriches naive text embeddings with remote sensing global context, creating a more adaptable and expressive linguistic latent space for the classifier. We establish new benchmarks for OV remote sensing instance segmentation across diverse datasets. Experimental results demonstrate that, our proposed method achieves SOTA performance, which provides a robust solution for large-scale, real-world geospatial analysis. Our code is available at https://github.com/HuangShiqi128/SCORE.

Figures

Figures reproduced from arXiv: 2507.12857 by the authors.

Figure 1
Figure 1. The example illustrates how human perception & [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Overview of SCORE training framework. It consists of three main branches: context branch (blue) extracts multi-granularity scene context from RS CLIP, semantic branch (yellow) encodes text embeddings with a frozen CLIP text encoder, and instance branch (orange) generates class embeddings and instance proposals. These branches interact through Region-Aware Integration (RAI) and Global Context Adaptation (GCA) to deri… view at source ↗
Figure 3
Figure 3. Illustration of Adaptive Region Formation and Regional [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: Qualitative comparisons between the baseline and our model. “iSAID → FAST” denotes training on iSAID and testing on FAST. We set jittering=False for better readability. Novel and Base indicate whether a class is absent or present in the training dataset, respectively. …

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

71 extracted references · 66 canonical work pages

  1. [1]

    Open-vocabulary remote sensing image semantic segmentation

    Qinglong Cao, Yuntian Chen, Chao Ma, and Xiaokang Yang. Open-vocabulary remote sensing image semantic segmentation. arXiv preprint arXiv:2409.07683, 2024. 2, 3

    arXiv 2024

  2. [2]

    Obbinst: Remote sensing instance segmentation with oriented bounding box supervision

    Xu Cao, Huanxin Zou, Jun Li, Xinyi Ying, and Shitian He. Obbinst: Remote sensing instance segmentation with oriented bounding box supervision. International Journal of Applied Earth Observation and Geoinformation, 128:103717, 2024. 1

    work page 2024

  3. [3]

    Instance segmentation for large, multi-channel remote sensing imagery using mask-rcnn and a mosaicking approach

    Osmar Luiz Ferreira de Carvalho, Osmar Abilio de Carvalho Junior, Anesmar Olino de Albuquerque, Pablo Pozzobon de Bem, Cristiano Rosa Silva, Pedro Hen- rique Guimaraes Ferreira, Rebeca dos Santos de Moura, Roberto Arnaldo Trancoso Gomes, Renato Fontes Guimaraes, and Dibio Leandro Borges. Instance segmentation for large, multi-channel remote sensing imager...

    work page 2020

  4. [4]

    Rsprompter: Learning to prompt for remote sensing instance segmentation based on visual foundation model

    Keyan Chen, Chenyang Liu, Hao Chen, Haotian Zhang, Wenyuan Li, Zhengxia Zou, and Zhenwei Shi. Rsprompter: Learning to prompt for remote sensing instance segmentation based on visual foundation model. IEEE Transactions on Geoscience and Remote Sensing, 62:1–17, 2024. 2

    work page 2024

  5. [5]

    Open-vocabulary panoptic segmentation with embedding modulation

    Xi Chen, Shuang Li, Ser-Nam Lim, Antonio Torralba, and Hengshuang Zhao. Open-vocabulary panoptic segmentation with embedding modulation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1141– 1150, 2023. 2

    work page 2023

  6. [6]

    Masked-attention mask transformer for universal image segmentation

    Bowen Cheng, Ishan Misra, Alexander G Schwing, Alexander Kirillov, and Rohit Girdhar. Masked-attention mask transformer for universal image segmentation. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1290–1299, 2022. 6

    work page 2022

  7. [7]

    Multi-class geospatial object detection and geographic image classification based on collection of part detectors

    Gong Cheng, Junwei Han, Peicheng Zhou, and Lei Guo. Multi-class geospatial object detection and geographic image classification based on collection of part detectors. ISPRS Journal of Photogrammetry and Remote Sensing, 2014. 5, 1, 2

    work page 2014

  8. [8]

    Remote sensing image scene classification: Benchmark and state of the art

    Gong Cheng, Junwei Han, and Xiaoqiang Lu. Remote sensing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 2017. 6

    work page 2017

Show all 71 references
  1. [9]

    Remote sensing image scene classification meets deep learning: Challenges, methods, benchmarks, and opportunities

    Gong Cheng, Xingxing Xie, Junwei Han, Lei Guo, and Gui-Song Xia. Remote sensing image scene classification meets deep learning: Challenges, methods, benchmarks, and opportunities. J-STARS, 2020. 2

    2020

  2. [10]

    Cat-seg: Cost aggregation for open-vocabulary semantic segmentation

    Seokju Cho, Heeseong Shin, Sunghwan Hong, Anurag Arnab, Paul Hongsuck Seo, and Seungryong Kim. Cat-seg: Cost aggregation for open-vocabulary semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4113–4123, 2024. 2, 1

    2024

  3. [11]

    Object detection in aerial images: A large-scale benchmark and challenges

    Jian Ding, Nan Xue, Gui-Song Xia, Xiang Bai, Wen Yang, Michael Ying Yang, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, et al. Object detection in aerial images: A large-scale benchmark and challenges. IEEE transactions on pattern analysis and machine intelligence,...

  4. [12]

    Open-vocabulary universal image segmentation with maskclip

    Zheng Ding, Jieke Wang, and Zhuowen Tu. Open-vocabulary universal image segmentation with maskclip. In Proceedings of the 40th International Conference on Machine Learning, pages 8090–8102, 2023. 2

    2023

  5. [13]

    Flair: a country-scale land cover semantic segmentation dataset from multi-source optical imagery

    Anatol Garioud, Nicolas Gonthier, Loic Landrieu, Apolline De Wit, Marion Valette, Marc Poup´ee, S´ebastien Giordano, et al. Flair: a country-scale land cover semantic segmentation dataset from multi-source optical imagery. Advances in Neural Information Processing Systems , 36...

  6. [14]

    Scaling open-vocabulary image segmentation with image-level labels

    Golnaz Ghiasi, Xiuye Gu, Yin Cui, and Tsung-Yi Lin. Scaling open-vocabulary image segmentation with image-level labels. In European conference on computer vision, pages 540–557. Springer, 2022. 2

    2022

  7. [15]

    Open-vocabulary object detection via vision and language knowledge distillation

    Xiuye Gu, Tsung-Yi Lin, Weicheng Kuo, and Yin Cui. Open-vocabulary object detection via vision and language knowledge distillation. arXiv preprint arXiv:2104.13921 ,

    arXiv

  8. [16]

    Forest fire segmentation from aerial imagery data using an improved instance segmentation model

    Zhihao Guan, Xinyu Miao, Yunjie Mu, Quan Sun, Qiaolin Ye, and Demin Gao. Forest fire segmentation from aerial imagery data using an improved instance segmentation model. Remote Sensing, 14(13):3159, 2022. 1

    2022

  9. [17]

    Aerialformer: Multi-resolution transformer for aerial image segmentation

    Taisei Hanyu, Kashu Yamazaki, Minh Tran, Roy A McCann, Haitao Liao, Chase Rainwater, Meredith Adkins, Jackson Cothren, and Ngan Le. Aerialformer: Multi-resolution transformer for aerial image segmentation. Remote Sensing, 16(16):2930, 2024. 1, 2

    2024

  10. [18]

    Zori: Towards discriminative zero-shot remote sensing instance segmentation

    Shiqi Huang, Shuting He, and Bihan Wen. Zori: Towards discriminative zero-shot remote sensing instance segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 3724–3732, 2025. 2, 6

    2025

  11. [19]

    Openclip, 2021

    Gabriel Ilharco, Mitchell Wortsman, Ross Wightman, Cade Gordon, Nicholas Carlini, Rohan Taori, Achal Dave, Vaishaal Shankar, Hongseok Namkoong, John Miller, Hannaneh Hajishirzi, Ali Farhadi, and Ludwig Schmidt. Openclip, 2021. 6

    2021

  12. [20]

    2d semantic labeling potsdam dataset

    ISPRS. 2d semantic labeling potsdam dataset. https: / / www . isprs . org / education / benchmarks / UrbanSemLab / 2d - sem - label - potsdam . aspx,

  13. [21]

    Scaling up visual and vision-language representation learning with noisy text supervision

    Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc Le, Yun-Hsuan Sung, Zhen Li, and Tom Duerig. Scaling up visual and vision-language representation learning with noisy text supervision. In International conference on machine learning, pages 4904–

  14. [22]

    Collaborative vision-text representation optimizing for open-vocabulary segmentation

    Siyu Jiao, Hongguang Zhu, Jiannan Huang, Yao Zhao, Yunchao Wei, and Humphrey Shi. Collaborative vision-text representation optimizing for open-vocabulary segmentation. 9 In European Conference on Computer Vision, pages 399–416. Springer, 2024. 2, 3, 6

    2024

  15. [23]

    Segment anything

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. Segment anything. In Proceedings of the IEEE/CVF international conference on computer vision, pages 4015–4026, 2023. 2

    2023

  16. [24]

    Language-driven semantic segmentation

    Boyi Li, Kilian Q Weinberger, Serge Belongie, Vladlen Koltun, and Ren ´e Ranftl. Language-driven semantic segmentation. arXiv preprint arXiv:2201.03546, 2022. 2

    2022 arXiv

  17. [25]

    Object detection in optical remote sensing images: A survey and a new benchmark

    Ke Li, Gang Wan, Gong Cheng, Liqiu Meng, and Junwei Han. Object detection in optical remote sensing images: A survey and a new benchmark. ISPRS journal of photogrammetry and remote sensing, 159:296–307, 2020. 5, 6, 1

    2020

  18. [26]

    Segearth-ov: Towards training-free open-vocabulary segmentation for remote sensing images

    Kaiyu Li, Ruixun Liu, Xiangyong Cao, Xueru Bai, Feng Zhou, Deyu Meng, and Zhi Wang. Segearth-ov: Towards training-free open-vocabulary segmentation for remote sensing images. arXiv preprint arXiv:2410.01768, 2024. 7

    2024 arXiv

  19. [27]

    Robust deep alignment network with remote sensing knowledge graph for zero-shot and generalized zero- shot remote sensing image scene classification

    Yansheng Li, Deyu Kong, Yongjun Zhang, Yihua Tan, and Ling Chen. Robust deep alignment network with remote sensing knowledge graph for zero-shot and generalized zero- shot remote sensing image scene classification. ISPRS Journal of Photogrammetry and Remote Sensing, 179:145– 1...

    2021

  20. [28]

    Large selective kernel network for remote sensing object detection

    Yuxuan Li, Qibin Hou, Zhaohui Zheng, Ming-Ming Cheng, Jian Yang, and Xiang Li. Large selective kernel network for remote sensing object detection. In Proceedings of the IEEE/CVF international conference on computer vision, pages 16794–16805, 2023. 2

    2023

  21. [29]

    Open-vocabulary semantic segmentation with mask-adapted clip

    Feng Liang, Bichen Wu, Xiaoliang Dai, Kunpeng Li, Yinan Zhao, Hang Zhang, Peizhao Zhang, Peter Vajda, and Diana Marculescu. Open-vocabulary semantic segmentation with mask-adapted clip. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages...

    2023

  22. [30]

    Remoteclip: A vision language foundation model for remote sensing.IEEE Transactions on Geoscience and Remote Sensing, 2024

    Fan Liu, Delong Chen, Zhangqingyun Guan, Xiaocong Zhou, Jiale Zhu, Qiaolin Ye, Liyong Fu, and Jun Zhou. Remoteclip: A vision language foundation model for remote sensing.IEEE Transactions on Geoscience and Remote Sensing, 2024. 2, 3, 4, 6, 7

    2024

  23. [31]

    Global context parallel attention for anchor-free instance segmentation in remote sensing images

    Xinyu Liu and Xiaoguang Di. Global context parallel attention for anchor-free instance segmentation in remote sensing images. IEEE Geoscience and Remote Sensing Letters, 19:1–5, 2020. 2

    2020

  24. [32]

    Yuanyuan Liu, Dingyuan Chen, Ailong Ma, Yanfei Zhong, Fang Fang, and Kai Xu. Multiscale u-shaped cnn building instance extraction framework with edge constraint for high- spatial-resolution remote sensing imagery.IEEE Transactions on Geoscience and Remote Sensing, 59(7):6106–6...

    2020

  25. [33]

    Learning to aggregate multi-scale context for instance segmentation in remote sensing images

    Ye Liu, Huifang Li, Chao Hu, Shuang Luo, Yan Luo, and Chang Wen Chen. Learning to aggregate multi-scale context for instance segmentation in remote sensing images. IEEE Transactions on Neural Networks and Learning Systems ,

  26. [34]

    Image retrieval on real-life images with pre- trained vision-and-language models

    Zheyuan Liu, Cristian Rodriguez-Opazo, Damien Teney, and Stephen Gould. Image retrieval on real-life images with pre- trained vision-and-language models. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 2125–2134, 2021. 3

    2021

  27. [35]

    A convnet for the 2020s, 2022

    Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and Saining Xie. A convnet for the 2020s, 2022. 6

    2022

  28. [36]

    Dual local-global contextual pathways for recognition in aerial imagery

    Alina Marcu and Marius Leordeanu. Dual local-global contextual pathways for recognition in aerial imagery. arXiv preprint arXiv:1605.05462, 2016. 2

    2016 arXiv

  29. [37]

    Scaling open-vocabulary object detection.Advances in Neural Information Processing Systems, 36:72983–73007, 2023

    Matthias Minderer, Alexey Gritsenko, and Neil Houlsby. Scaling open-vocabulary object detection.Advances in Neural Information Processing Systems, 36:72983–73007, 2023. 3

    2023

  30. [38]

    H2rsvlm: Towards helpful and honest remote sensing large vision language model

    Chao Pang, Jiang Wu, Jiayu Li, Yi Liu, Jiaxing Sun, Weijia Li, Xingxing Weng, Shuai Wang, Litong Feng, Gui-Song Xia, et al. H2rsvlm: Towards helpful and honest remote sensing large vision language model. arXiv e-prints, pages arXiv–2403, 2024. 2, 3

    2024

  31. [39]

    Freeseg: Unified, universal and open-vocabulary image segmentation

    Jie Qin, Jie Wu, Pengxiang Yan, Ming Li, Ren Yuxi, Xuefeng Xiao, Yitong Wang, Rui Wang, Shilei Wen, Xin Pan, et al. Freeseg: Unified, universal and open-vocabulary image segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1...

    2023

  32. [40]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International conference on machine learning, pa...

  33. [41]

    Floodnet: A high resolution aerial imagery dataset for post flood scene understanding

    Maryam Rahnemoonfar, Tashnim Chowdhury, Argho Sarkar, Debvrat Varshney, Masoud Yari, and Robin Roberson Murphy. Floodnet: A high resolution aerial imagery dataset for post flood scene understanding. IEEE Access, 9:89644–89654,

  34. [42]

    Denseclip: Language-guided dense prediction with context-aware prompting

    Yongming Rao, Wenliang Zhao, Guangyi Chen, Yansong Tang, Zheng Zhu, Guan Huang, Jie Zhou, and Jiwen Lu. Denseclip: Language-guided dense prediction with context-aware prompting. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 18082–1...

    2022

  35. [43]

    Instance segmentation of standing dead trees in dense forest from aerial imagery using deep learning.ISPRS Open Journal of Photogrammetry and Remote Sensing, 6:100024, 2022

    Abubakar Sani-Mohammed, Wei Yao, and Marco Heurich. Instance segmentation of standing dead trees in dense forest from aerial imagery using deep learning.ISPRS Open Journal of Photogrammetry and Remote Sensing, 6:100024, 2022. 1

    2022

  36. [44]

    Object detection and instance segmentation in remote sensing imagery based on precise mask r-cnn

    Hao Su, Shunjun Wei, Min Yan, Chen Wang, Jun Shi, and Xiaoling Zhang. Object detection and instance segmentation in remote sensing imagery based on precise mask r-cnn. In IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, pages 1454–1457. IEEE, 2019. ...

    2019

  37. [45]

    Hq-isnet: High-quality instance segmentation for remote sensing imagery

    Hao Su, Shunjun Wei, Shan Liu, Jiadian Liang, Chen Wang, Jun Shi, and Xiaoling Zhang. Hq-isnet: High-quality instance segmentation for remote sensing imagery. Remote Sensing,

  38. [46]

    Faster and better instance segmentation for large scene remote sensing imagery

    Hao Su, Peng Huang, Jun Yin, and Xiaofeng Zhang. Faster and better instance segmentation for large scene remote sensing imagery. In IGARSS 2022-2022 IEEE international geoscience and remote sensing symposium, pages 2187–2190. IEEE, 2022. 2 10

    2022

  39. [47]

    Fair1m: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery

    Xian Sun, Peijin Wang, Zhiyuan Yan, Feng Xu, Ruiping Wang, Wenhui Diao, Jin Chen, Jihao Li, Yingchao Feng, Tao Xu, et al. Fair1m: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery. ISPRS Journal of Photogrammetry and Remote Sensi...

    2022

  40. [48]

    Samrs: Scaling-up remote sensing segmentation dataset with segment anything model.Advances in Neural Information Processing Systems , 36:8815–8827,

    Di Wang, Jing Zhang, Bo Du, Minqiang Xu, Lin Liu, Dacheng Tao, and Liangpei Zhang. Samrs: Scaling-up remote sensing segmentation dataset with segment anything model.Advances in Neural Information Processing Systems , 36:8815–8827,

  41. [49]

    Cris: Clip- driven referring image segmentation

    Zhaoqing Wang, Yu Lu, Qiang Li, Xunqiang Tao, Yandong Guo, Mingming Gong, and Tongliang Liu. Cris: Clip- driven referring image segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11686–11695, 2022. 3

    2022

  42. [50]

    Skyscript: A large and semantically diverse vision-language dataset for remote sensing

    Zhecheng Wang, Rajanie Prabha, Tianyuan Huang, Jiajun Wu, and Ram Rajagopal. Skyscript: A large and semantically diverse vision-language dataset for remote sensing. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 5805–5813, 2024. 2, 3, 7

    2024

  43. [51]

    Lfg-net: Low-level feature guided network for precise ship instance segmentation in sar images

    Shunjun Wei, Xiangfeng Zeng, Hao Zhang, Zichen Zhou, Jun Shi, and Xiaoling Zhang. Lfg-net: Low-level feature guided network for precise ship instance segmentation in sar images. IEEE Transactions on Geoscience and Remote Sensing, 60: 1–17, 2022. 1

    2022

  44. [52]

    Towards open vocabulary learning: A survey

    Jianzong Wu, Xiangtai Li, Shilin Xu, Haobo Yuan, Henghui Ding, Yibo Yang, Xia Li, Jiangning Zhang, Yunhai Tong, Xudong Jiang, et al. Towards open vocabulary learning: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(7):5092–5113, 2024. 1

    2024

  45. [53]

    Improved anchor-free instance segmentation for building extraction from high-resolution remote sensing images

    Tong Wu, Yuan Hu, Ling Peng, and Ruonan Chen. Improved anchor-free instance segmentation for building extraction from high-resolution remote sensing images. Remote Sensing, 12(18):2910, 2020. 1

    2020

  46. [54]

    Open-vocabulary panoptic segmentation with text-to-image diffusion models

    Jiarui Xu, Sifei Liu, Arash Vahdat, Wonmin Byeon, Xiaolong Wang, and Shalini De Mello. Open-vocabulary panoptic segmentation with text-to-image diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2955–2966, 2023. 2, 5, 6

    2023

  47. [55]

    A simple baseline for open- vocabulary semantic segmentation with pre-trained vision- language model

    Mengde Xu, Zheng Zhang, Fangyun Wei, Yutong Lin, Yue Cao, Han Hu, and Xiang Bai. A simple baseline for open- vocabulary semantic segmentation with pre-trained vision- language model. In European Conference on Computer Vision, pages 736–753. Springer, 2022. 1, 5

    2022

  48. [56]

    Side adapter network for open-vocabulary semantic segmentation

    Mengde Xu, Zheng Zhang, Fangyun Wei, Han Hu, and Xiang Bai. Side adapter network for open-vocabulary semantic segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2945–2954,

  49. [57]

    An improved swin transformer-based model for remote sensing object detection and instance segmentation

    Xiangkai Xu, Zhejun Feng, Changqing Cao, Mengyuan Li, Jin Wu, Zengyan Wu, Yajie Shang, and Shubing Ye. An improved swin transformer-based model for remote sensing object detection and instance segmentation. Remote Sensing,

  50. [58]

    Semantic annotation of high-resolution satellite images via weakly supervised learning

    Xiwen Yao, Junwei Han, Gong Cheng, Xueming Qian, and Lei Guo. Semantic annotation of high-resolution satellite images via weakly supervised learning. IEEE Transactions on Geoscience and Remote Sensing, 54(6):3660–3671, 2016. 1, 2

    2016

  51. [59]

    Instance segmentation ship detection based on improved yolov7 using complex background sar images

    Muhammad Yasir, Lili Zhan, Shanwei Liu, Jianhua Wan, Md Sakaouth Hossain, Arife Tugsan Isiacik Colak, Mengge Liu, Qamar Ul Islam, Syed Raza Mehdi, and Qian Yang. Instance segmentation ship detection based on improved yolov7 using complex background sar images. Frontiers in Mar...

    2023

  52. [60]

    Towards open-vocabulary remote sensing image semantic segmentation

    Chengyang Ye, Yunzhi Zhuge, and Pingping Zhang. Towards open-vocabulary remote sensing image semantic segmentation. arXiv preprint arXiv:2412.19492, 2024. 1

    2024 arXiv

  53. [61]

    Towards open-vocabulary remote sensing image semantic segmentation

    Chengyang Ye, Yunzhi Zhuge, and Pingping Zhang. Towards open-vocabulary remote sensing image semantic segmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, 2025. 2, 3, 5, 8, 1

    2025

  54. [62]

    Remote sensing image instance segmentation network with transformer and multi- scale feature representation

    Wenhui Ye, Wei Zhang, Weimin Lei, Wenchao Zhang, Xinyi Chen, and Yanwen Wang. Remote sensing image instance segmentation network with transformer and multi- scale feature representation. Expert Systems with applications, 234:121007, 2023. 1, 2

    2023

  55. [63]

    Convolutions die hard: Open-vocabulary segmentation with single frozen convolutional clip

    Qihang Yu, Ju He, Xueqing Deng, Xiaohui Shen, and Liang- Chieh Chen. Convolutions die hard: Open-vocabulary segmentation with single frozen convolutional clip. Advances in Neural Information Processing Systems, 36:32215–32234,

  56. [64]

    isaid: A large-scale dataset for instance segmentation in aerial images, 2019

    Syed Waqas Zamir, Aditya Arora, Akshita Gupta, Salman Khan, Guolei Sun, Fahad Shahbaz Khan, Fan Zhu, Ling Shao, Gui-Song Xia, and Xiang Bai. isaid: A large-scale dataset for instance segmentation in aerial images, 2019. 1, 5, 2

    2019

  57. [65]

    A simple framework for open- vocabulary segmentation and detection

    Hao Zhang, Feng Li, Xueyan Zou, Shilong Liu, Chunyuan Li, Jianwei Yang, and Lei Zhang. A simple framework for open- vocabulary segmentation and detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 1020–1031, 2023. 2

    2023

  58. [66]

    Semantic attention and scale complementary network for instance segmentation in remote sensing images

    Tianyang Zhang, Xiangrong Zhang, Peng Zhu, Xu Tang, Chen Li, Licheng Jiao, and Huiyu Zhou. Semantic attention and scale complementary network for instance segmentation in remote sensing images. IEEE Transactions on Cybernetics,

  59. [67]

    How well do deep learning-based methods for land cover classification and object detection perform on high resolution remote sensing imagery? Remote Sensing, 2020

    Xin Zhang, Liangxiu Han, Lianghao Han, and Liang Zhu. How well do deep learning-based methods for land cover classification and object detection perform on high resolution remote sensing imagery? Remote Sensing, 2020. 2

    2020

  60. [68]

    Rs5m: A large scale vision-language dataset for remote sensing vision-language foundation model

    Zilun Zhang, Tiancheng Zhao, Yulong Guo, and Jianwei Yin. Rs5m: A large scale vision-language dataset for remote sensing vision-language foundation model. arXiv preprint arXiv:2306.11300, 2(3):6, 2023. 2, 3, 7

    2023 arXiv

  61. [69]

    Multi-swin mask transformer for instance segmentation of agricultural field extraction

    Bo Zhong, Tengfei Wei, Xiaobo Luo, Bailin Du, Longfei Hu, Kai Ao, Aixia Yang, and Junjun Wu. Multi-swin mask transformer for instance segmentation of agricultural field extraction. Remote sensing, 15(3):549, 2023. 1

    2023

  62. [70]

    Cug misdataset: A remote sensing instance segmentation dataset for improved wide-area high- precision mining land occupation recognition

    Yuqian Zhu, Weitao Chen, Wenxi He, Ruizhen Wang, Xianju Li, and Lizhe Wang. Cug misdataset: A remote sensing instance segmentation dataset for improved wide-area high- precision mining land occupation recognition. IEEE Journal of Selected Topics in Applied Earth Observations a...

    2024

  63. [2013]

    Accessed: 2024-08-11. 1, 2

    2024

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.