Pith. sign in

REVIEW 4 major objections 5 minor 2 cited by

SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensing

T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A single shared transformer backbone learns optical, multispectral, and SAR imagery together, beating SkySense by 1.8 points on average across 16 datasets.

desk verdict The 665M-parameter efficiency claim is misleading because all benchmark results come from the 1.99B MoE model, yet the paper is still a solid incremental RSFM contribution worth reviewing. read the letter →

arxiv 2507.13812 v1 pith:XGCCRVIR submitted 2025-07-18 cs.CV

Yingying Zhang , Lixiang Ru , Kang Wu , Lei Yu , Lei Liang , Yansheng Li , Jingdong Chen This is my paper · ORCID
classification cs.CV MSC 68T4568T07
keywords remotesensingfoundationmodelmulti-modallearningself-supervisedcontrastivemixtureofexpertsunifiedbackboneadaptivepatchmergingmodalityprompttokens
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

SkySense V2 claims that a single unified transformer backbone, with all parameters shared across high-resolution optical, Sentinel-2 multispectral, and Sentinel-1 SAR imagery, can outperform SkySense's three separate backbones on 16 datasets across 7 Earth-observation tasks. The paper argues that this unified design eliminates parameter redundancy, speeds up representation learning by aggregating gradients from multiple modalities, and leaves room to scale capacity with a mixture-of-experts module. To adapt self-supervised learning to remote sensing, it introduces Query-based Semantic Aggregation Contrastive Learning (QSACL), where learnable queries aggregate features of the same semantic content across different augmented views before contrastive loss is applied. If the claims hold, a single pre-trained encoder could replace modality-specific backbones, simplifying multi-modal Earth observation models and improving their generalization to unseen sensors.

What carries the argument

The central mechanism is the unified transformer encoder with four stages: Swin Transformer V2 blocks in the first two stages and vanilla transformer blocks in the last two, all parameters shared across modalities. Adaptive Patch Merging (APM) selectively downsamples feature resolution for high-resolution optical data while preserving resolution for medium-resolution multispectral and SAR data, maintaining spatial alignment. Learnable modality-specific prompt tokens are inserted in the last two stages to recover feature diversity lost by full parameter sharing. The mixture-of-experts (MoE) module replaces the feed-forward networks in the last six blocks, scaling capacity to 1,994M total (661M activated) parameters with sparse gating (8 experts, top-1 routing). QSACL uses 16 learnable queries in a transformer decoder layer to attend to features from global and local augmented views, producing semantically aggregated features per query that are contrasted across student and teacher branches.

What would settle it

Re-run the same pre-training and downstream fine-tuning protocol on a publicly released, independently validated subset of the 21-million-set corpus with manually checked geo-alignment, and compare SkySense V2 against SkySense; if the average 1.8-point advantage disappears or shrinks materially on that curated subset, the gains are attributable to data artifacts rather than the unified backbone, APM, prompts, MoE, or QSACL.

Watch

Extended reading notes

Core claim

SkySense V2 establishes that a unified backbone with fully shared parameters across modalities, supplemented by modality-specific prompt tokens and a mixture-of-experts module, yields stronger representations than SkySense's separate Swin-H and two ViT-L backbones. The paper reports that this 665M-parameter (activated) unified backbone outperforms SkySense's 1.26B-parameter three-backbone design by an average of 1.8 points across 16 datasets, including segmentation, detection, classification, change detection, and multi-modal fusion tasks. The key discovery is the combination of Adaptive Patch Merging (APM) to handle varying ground sample distances, learnable modality prompts to preserve feature diversity, and QSACL to make contrastive learning semantically accurate for remote sensing images, which contain multiple subjects per image rather than a single focus.

Load-bearing premise

The model is pre-trained on roughly 21 million geographically aligned multi-modal image sets inherited from SkySense, and the whole argument depends on those sets having correct pixel-level alignment across optical, Sentinel-2, and Sentinel-1 images and trustworthy OpenStreetMap labels; systematic misalignment or label noise could inflate the measured gains independently of the new architecture.

Editorial extensions

If this is right

  • If the gains hold, a single pre-trained backbone can serve all three modalities, cutting backbone parameters from 1.26B to 661M and simplifying deployment for downstream Earth-observation tasks.
  • The unified design aggregates gradients from all modalities, which the paper argues accelerates pre-training convergence compared to separate backbones.
  • Adding modality-specific prompt tokens recovers feature diversity lost by full parameter sharing, suggesting that small per-modality parameter sets can substitute for entire separate backbones.
  • QSACL's query-based aggregation of semantics across views could generalize to other multi-subject image domains where standard contrastive learning suffers from semantic mismatch between augmented views.
  • The MoE-scaling approach indicates that parameter-efficient unified backbones can be scaled up to significantly larger total capacities while keeping activated parameters moderate, yielding further performance gains as expert count grows.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The paper's design suggests that a single shared backbone may also absorb additional modalities beyond optical, multispectral, and SAR, such as thermal or LiDAR, by adding corresponding tokenizers and prompt tokens, without redesigning the core encoder.
  • The QSACL mechanism of learning semantic queries could be combined with dense image-text alignment more explicitly, where each query corresponds to a semantic class, potentially producing a fully interpretable, class-conditioned representation.
  • The reported improvement on unseen sensors (Gaofen-2, Landsat-8, Gaofen-3) implies that unified pre-training confers cross-sensor transfer, which could be tested further on more diverse sensor families with a systematic calibration of the alignment quality.
  • An implicit testable extension is whether the same unified backbone, pre-trained with QSACL, benefits from increased numbers of queries beyond 16 on datasets with more semantic classes, or whether query count should scale with class diversity.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. SkySense V2 presents a unified multi-modal remote sensing foundation model that replaces SkySense's three separate backbones (Swin-H for HR optical, ViT-L for MS, ViT-L for SAR) with a single shared transformer backbone. The architecture introduces Adaptive Patch Merging (APM) to handle varying ground resolutions across modalities, learnable modality-specific prompt tokens to preserve feature diversity, and a Mixture-of-Experts (MoE) module to scale capacity. Pre-training combines the inherited MGCL and GCPL losses from SkySense with a new Query-based Semantic Aggregation Contrastive Learning (QSACL) loss and dense image-text alignment using OSM labels. The model is evaluated on 16 datasets across 7 tasks, reporting an average improvement of 1.8 points over SkySense and state-of-the-art results on most benchmarks, with additional out-of-sensor generalization experiments in Appendix F.3.

Significance. If the reported results hold, SkySense V2 is a meaningful advance: it demonstrates that a single shared backbone with roughly half of SkySense's activated parameters (661M activated vs 1.26B total for SkySense) can match or exceed its predecessor across diverse single- and multi-modal tasks. The out-of-sensor generalization results (Appendix F.3) and the extensive ablations (MoE, prompts, APM, QSACL queries) are valuable evidence beyond simple benchmark improvements. The paper also provides k-NN convergence curves and t-SNE visualizations. However, the headline efficiency claim is confounded by MoE, the 'state-of-the-art' claim omits relevant unified-backbone baselines mentioned in the paper, and the lack of error bars or significance tests tempers confidence in the small margins. These issues are addressable but require additional experiments or careful reframing.

major comments (4)
  1. [Section 1, Section 3.1.3, Appendix E, Appendix F.6] The efficiency claim conflates the pre-MoE unified backbone with the model actually evaluated. Section 1 states that SkySense V2's unified backbone uses 'only 665 million parameters' versus SkySense's 1.26B three-backbone design, but Section 3.1.3 and Appendix E show that the evaluated model has 1,994.10M total backbone parameters (661.40M activated) because of MoE, and all results in Tables 1-3 are for this MoE model. Appendix F.6 (Table 17) shows that removing MoE decreases accuracy by 0.81 on RESISC-45 (TR=10%), 0.37 on BEN-S2, and 0.86 on BEN-MM, so MoE contributes materially to the reported gains. To support the 'unified backbone reduces parameters' narrative, the paper must either report the full 16-dataset results for the 665M no-MoE model (at least the key comparisons against SkySense), or clearly state that the 1.8-point average gain belongs to the MoE-scaled model with 1.99B total backbone parameters and adjust the efficiency framing accordingly.
  2. [Section 2.2, Section 4] The paper claims 'state-of-the-art results across various modalities' (Section 4) but does not compare against any of the unified-backbone multi-modal RSFMs it discusses in Section 2.2: AnySat, msGFM, and OFA-Net. These are the most relevant competitors for the central architectural claim. At minimum, the authors should include AnySat and msGFM results on the shared benchmarks (e.g., PASTIS, BEN-MM, fMoW-S2) where public numbers exist, or explicitly justify their exclusion. Without such comparisons, the 'state-of-the-art' claim is overstated and the reader cannot assess whether the unified backbone itself is competitive with existing unified designs.
  3. [Tables 1-3] All baseline numbers in the comparison tables are taken from prior publications, and the paper reports no error bars, multiple seeds, or significance tests. Several of the reported gains over SkySense are small (e.g., Table 3c: BEN-MM S1-only 86.2 to 86.5; Table 1: BEN-S2 TR=10% 88.67 to 89.13; Table 2a: Dyna.-S2 46.2 to 47.5 for the S2-only row). Since the central claim is an average +1.8-point improvement, the authors should provide variance estimates or at least run the SkySense baseline under identical fine-tuning protocols for a few key datasets to rule out that the gains are within noise or due to tuning differences.
  4. [Section 3.2, Figure 7, Appendix F.7] The primary novel pre-training loss, QSACL, is only validated with k-NN accuracy after 20,000 pre-training iterations (Figure 7 and Appendix F.7, Table 18), not with full pre-training followed by downstream fine-tuning. Since QSACL is one of the three loss terms and is central to the paper's claimed novelty, the authors should either report downstream fine-tuning results for QSACL on at least one or two representative tasks (e.g., RESISC-45 and BEN-S2) with the full 600k-iteration pre-training, or clearly acknowledge this as an ablation performed only at reduced scale. This is important because the k-NN proxy may not reflect final transfer performance.
minor comments (5)
  1. [Throughout] There are several typos and minor language issues: 'In additional' (Abstract), 'a board range of tasks' (Figure 1 caption), 'RadnomRotate' (Table 5), and 'varing' in the captions of Tables 14, 15, and 18.
  2. [Section 4.1, Appendix A.2] The paper states that the OSM labels are used for dense image-text alignment but does not describe any filtering or quality control for OSM label noise. Given that OSM is crowd-sourced, a brief statement on label cleaning or its known limitations would strengthen the reproducibility of the pre-training pipeline.
  3. [Section 3.1.1, Figure 3] The APM mechanism for MS and SAR tokens is described qualitatively as 'applying a linear projection with averaging the weights across the input dimensions.' A concrete formula or diagram would clarify how the shared linear layer is adapted to preserve resolution without training separate weights.
  4. [References] References [59] and [60] appear to be the same paper ('Mixture-of-experts meets instruction tuning') with conflicting venue and year information; please verify and consolidate.
  5. [Appendix E, Table 9] The parameter comparison table lists an 'Others' category (404.13M for SkySense, 490.49M for SkySense V2) but does not define what it contains. Please specify the components in this category.

Circularity Check

0 steps flagged · score 2.0 of 10

No circular derivation: the 1.8-point improvement is an external benchmark comparison, not a fitted or self-referential result. Minor self-citations and the pre-MoE parameter count create attribution caveats but do not make the core claim circular.

full rationale

The central claim is empirical: SkySense V2 is fine-tuned and evaluated on 16 external datasets with fixed task heads and standard splits, and the reported gains are measured against SkySense and other published RSFMs. None of these results is obtained by inverting a fitted parameter, by defining the metric to match the method, or by assuming the conclusion. The pre-training objective in Eq. 5 is a weighted sum of MGCL, ITA, and QSACL; QSACL's cross-attention aggregation and contrastive loss in Eqs. 3-4 define a concrete learning rule rather than renaming the evaluation target. The paper does reuse SkySense's training corpus, MGCL/GCPL losses, and evaluation protocol, with overlapping author lists; this is substantial reuse and makes the marginal contribution of QSACL hard to isolate, but the load-bearing evidence is still the external benchmark comparison, not the self-citation itself. One presentation issue is genuine but not circular: the headline 'only 665 million parameters' refers to the unified backbone before MoE, while the model evaluated in Section 4 has a 1,994.10M-parameter backbone (Table 9), and Appendix F.6 shows MoE contributes to the gain; this is an attribution and ablation-reporting weakness, not a derivation that reduces to its inputs. Score 2 reflects the minor, non-load-bearing self-citation and the absence of an isolated QSACL ablation, not a circular core.

Assumptions & free parameters 6 free parameters · 5 assumptions · 0 invented entities

The central result rests on a large inherited pre-training corpus, the validity of geographic alignment and OSM labels, and a set of hand-chosen hyperparameters (loss weights, query count, prompt count, MoE size, APM downsampling). Removing any of these could change the measured 1.8 point average gain.

free parameters (6)
  • loss weights lambda1, lambda2, lambda3 = 1.0, 1.0, 1.0
    Chosen equal in Appendix C; no sensitivity analysis is reported, so the contribution of each loss is not isolated.
  • MoE auxiliary loss weight = 0.01
    Set in Appendix C without ablation.
  • number of QSACL queries m = 16
    Selected from Table 18; 16 and 24 give similar k-NN accuracy.
  • number of modality prompt tokens per stage = 4
    Set in Section 4.1 without a dedicated ablation.
  • MoE block count L and expert count M = L=6, M=8, k=1
    Tables 14-16 justify these by k-NN accuracy on AID and RESISC-45; the same validation objective is used to select the final model.
  • APM downsampling activation = Stages 2, 3, and 4 (1/8 output)
    Section F.2 Table 11 shows the 1/8 configuration is not the best for segmentation (1/1 gives 72.88 on iSAID vs 71.87); the choice is an efficiency tradeoff, not an accuracy optimum.
assumptions (5)
  • standard math Backpropagation through transformer attention, MoE gating, and Sinkhorn-Knopp assignment is valid and stable at 600k iterations.
    Invoked throughout Section 3 and Appendix A without proof.
  • domain assumption The inherited SkySense pre-training corpus has correct geographic alignment between HR optical, Sentinel-2, and Sentinel-1 imagery.
    Section 4.1 states the same 21M-set is used; multi-modal contrastive learning in Eq. 6-11 depends on pixel-level correspondences.
  • domain assumption OSM pixel-level labels align with the imagery and their class names are semantically captured by the CLIP text encoder.
    Section A.2 builds L_ITA on this without validating label noise or text encoding quality.
  • ad hoc to paper For MS and SAR tokens, APM can maintain full feature resolution by applying a linear projection whose weights are averaged across input dimensions, and this preserves feature quality.
    Section 3.1.1 introduces the averaged-weight projection with no theoretical or per-modality empirical justification.
  • domain assumption Remote sensing images contain multiple subjects in one image, so query-based semantic aggregation across views improves contrastive learning.
    Figure 2 and Section 3.2 motivate QSACL; the assumption is plausible but not tested independently of the QSACL loss.

how reviews work

0 comments
Cite this review

Pith. "Pith review of SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensing." pith.science (2026). https://pith.science/paper/XGCCRVIR

@misc{pith2026250713812,
  author       = {Pith},
  title        = {Pith review of: SkySense V2: A Unified Foundation Model for Multi-modal Remote Sensing},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/XGCCRVIR}},
  note         = {Machine review of arXiv:2507.13812}
}
read the original abstract

The multi-modal remote sensing foundation model (MM-RSFM) has significantly advanced various Earth observation tasks, such as urban planning, environmental monitoring, and natural disaster management. However, most existing approaches generally require the training of separate backbone networks for each data modality, leading to redundancy and inefficient parameter utilization. Moreover, prevalent pre-training methods typically apply self-supervised learning (SSL) techniques from natural images without adequately accommodating the characteristics of remote sensing (RS) images, such as the complicated semantic distribution within a single RS image. In this work, we present SkySense V2, a unified MM-RSFM that employs a single transformer backbone to handle multiple modalities. This backbone is pre-trained with a novel SSL strategy tailored to the distinct traits of RS data. In particular, SkySense V2 incorporates an innovative adaptive patch merging module and learnable modality prompt tokens to address challenges related to varying resolutions and limited feature diversity across modalities. In additional, we incorporate the mixture of experts (MoE) module to further enhance the performance of the foundation model. SkySense V2 demonstrates impressive generalization abilities through an extensive evaluation involving 16 datasets over 7 tasks, outperforming SkySense by an average of 1.8 points.

Figures

Figures reproduced from arXiv: 2507.13812 by the authors.

Figure 1
Figure 1. SkySense V2 has achieved superior performance on 16 [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Comparison of different augmented views from natural [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Overview of the unified transformer backbone model in [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: The illustration of modality-specific prompt tokens [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]
Figure 5
Figure 5. Figure 5: Overview of the SkySense V2 pre-training pipeline. The SkySense V2 employs data augmentations on multi-modal inputs, which [PITH_FULL_IMAGE:figures/full_fig_p005_5.png]
Figure 6
Figure 6. Figure 6: Computation pipelines for QSACL with multi-crop aug [PITH_FULL_IMAGE:figures/full_fig_p005_6.png]
Figure 7
Figure 7. Figure 7: Ablation study using k-NN classification was conducted [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]
Figure 8
Figure 8. Figure 8: t-SNE visualization of the output feature representation [PITH_FULL_IMAGE:figures/full_fig_p008_8.png]
Figure 10
Figure 10. Figure 10: Overview of Downstream Usage of SkySense V2. Each [PITH_FULL_IMAGE:figures/full_fig_p011_10.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. TESSERA v2: Scaling Pixel-wise Earth Foundation Models

    cs.CV 2026-07 conditional novelty 7.0 of 10

    Downstream-driven scaling of pixel-wise Barlow Twins EO models favors large encoders and matched data over projectors, and distillation yields compact Matryoshka students that lead multi-task embedding benchmarks.

  2. Scalable and Trustworthy Earth Observation Foundation Models

    cs.LG 2026-07 conditional novelty 3.0 of 10

    Remote-sensing foundation models need domain-specific design and evaluation around measurement physics and decision constraints; benchmark accuracy alone is insufficient for trustworthy EO deployment.

Reference graph

Works this paper leans on

86 extracted references · 66 canonical work pages · cited by 2 Pith papers

  1. [1]

    Self- supervised material and texture representation learning for remote sensing tasks

    Peri Akiva, Matthew Purri, and Matthew Leotta. Self- supervised material and texture representation learning for remote sensing tasks. In Proceedings of the IEEE/CVF Con- 16 Model AID DIOR iSAID OA(TR=20/50%) mAP50 mIoU Randm Init 66.82/90.78 56.36 48.34 SkySense V2 98.34/99.05 79.50 71.87 Table 19. Comparison of SkySense V2 with random initialization and...

    2022

  2. [2]

    AnySat: An Earth observation model for any resolutions, scales, and modalities

    Guillaume Astruc, Nicolas Gonthier, Clement Mallet, and Loic Landrieu. AnySat: An Earth observation model for any resolutions, scales, and modalities. arXiv preprint arXiv:2412.14123, 2024. 3

    arXiv 2024

  3. [3]

    Geography-aware self-supervised learning

    Kumar Ayush, Burak Uzkent, Chenlin Meng, Kumar Tan- may, Marshall Burke, David Lobell, and Stefano Ermon. Geography-aware self-supervised learning. In Proceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 10181–10190, 2021. 6, 7

    2021

  4. [4]

    Satlaspretrain: A large- scale dataset for remote sensing image understanding

    Favyen Bastani, Piper Wolters, Ritwik Gupta, Joe Ferdi- nando, and Aniruddha Kembhavi. Satlaspretrain: A large- scale dataset for remote sensing image understanding. Pro- ceedings of the IEEE/CVF International Conference on Computer Vision, pages 16772–16782, 2023. 6, 7

    2023

  5. [5]

    A multi- scale weakly supervised learning method with adaptive on- line noise correction for high-resolution change detection of built-up areas

    Yinxia Cao, Xin Huang, and Qihao Weng. A multi- scale weakly supervised learning method with adaptive on- line noise correction for high-resolution change detection of built-up areas. Remote Sensing of Environment, 297:113779,

  6. [6]

    Unsupervised learning of visual features by contrasting cluster assignments

    Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Pi- otr Bojanowski, and Armand Joulin. Unsupervised learning of visual features by contrasting cluster assignments. Ad- vances in neural information processing systems , 33:9912– 9924, 2020. 9, 10

    2020

  7. [7]

    Emerg- ing properties in self-supervised vision transformers

    Mathilde Caron, Hugo Touvron, Ishan Misra, Herv ´e J´egou, Julien Mairal, Piotr Bojanowski, and Armand Joulin. Emerg- ing properties in self-supervised vision transformers. In Pro- ceedings of the IEEE/CVF international conference on com- puter vision, pages 9650–9660, 2021. 5, 9

    2021

  8. [8]

    A billion-scale foundation model for remote sensing images

    Keumgang Cha, Junghoon Seo, and Taekyung Lee. A billion-scale foundation model for remote sensing images. arXiv preprint arXiv:2304.05215, 2023. 7, 11

    arXiv 2023

Show all 86 references
  1. [9]

    A spatial-temporal attention- based method and a new dataset for remote sensing image change detection

    Hao Chen and Zhenwei Shi. A spatial-temporal attention- based method and a new dataset for remote sensing image change detection. Remote Sensing, 12(10):1662, 2020. 2, 6

    2020

  2. [10]

    Remote sensing im- age change detection with transformers

    Hao Chen, Zipeng Qi, and Zhenwei Shi. Remote sensing im- age change detection with transformers. IEEE Transactions on Geoscience and Remote Sensing, 60:1–14, 2021. 6, 11

    2021

  3. [11]

    Collaborative global-local networks for memory-efficient segmentation of ultra-high resolution images

    Wuyang Chen, Ziyu Jiang, Zhangyang Wang, Kexin Cui, and Xiaoning Qian. Collaborative global-local networks for memory-efficient segmentation of ultra-high resolution images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 8924–8933,

  4. [12]

    A survey on object detec- tion in optical remote sensing images

    Gong Cheng and Junwei Han. A survey on object detec- tion in optical remote sensing images. ISPRS journal of pho- togrammetry and remote sensing, 117:11–28, 2016. 1

    2016

  5. [13]

    Remote sens- ing image scene classification: Benchmark and state of the art

    Gong Cheng, Junwei Han, and Xiaoqiang Lu. Remote sens- ing image scene classification: Benchmark and state of the art. Proceedings of the IEEE, 105(10):1865–1883, 2017. 2, 6

    2017

  6. [14]

    Anchor-free oriented proposal generator for object detection

    Gong Cheng, Jiabao Wang, Ke Li, Xingxing Xie, Chunbo Lang, Yanqing Yao, and Junwei Han. Anchor-free oriented proposal generator for object detection. IEEE Transactions on Geoscience and Remote Sensing, 60:1–11, 2022. 6

    2022

  7. [15]

    Satmae: Pre-training transformers for tem- poral and multi-spectral satellite imagery

    Yezhen Cong, Samar Khanna, Chenlin Meng, Patrick Liu, Erik Rozi, Yutong He, Marshall Burke, David Lobell, and Stefano Ermon. Satmae: Pre-training transformers for tem- poral and multi-spectral satellite imagery. Advances in Neu- ral Information Processing Systems, 35:197–211, ...

    2022

  8. [16]

    Vision transformers need registers

    Timoth ´ee Darcet, Maxime Oquab, Julien Mairal, and Piotr Bojanowski. Vision transformers need registers. In The Twelfth International Conference on Learning Representa- tions, 2024. 2

    2024

  9. [17]

    Urban change detection for multispectral earth observation using convolutional neural networks

    Rodrigo Caye Daudt, Bertr Le Saux, Alexandre Boulch, and Yann Gousseau. Urban change detection for multispectral earth observation using convolutional neural networks. In IGARSS 2018-2018 IEEE International Geoscience and Re- mote Sensing Symposium, pages 2115–2118. Ieee, 2018. 2, 6

    2018

  10. [18]

    An image is worth 16x16 words: Trans- formers for image recognition at scale

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Syl- vain Gelly, et al. An image is worth 16x16 words: Trans- formers for image recognition at scale. arXiv preprint a...

    2010 arXiv

  11. [19]

    William Fedus, Barret Zoph, and Noam M. Shazeer. Switch transformers: Scaling to trillion parameter models with sim- ple and efficient sparsity. ArXiv, abs/2101.03961, 2021. 2

    2021 arXiv

  12. [20]

    Anthony Fuller, Koreen Millard, and James R. Green. Croma: Remote sensing representations with contrastive radar-optical masked autoencoders. Advances in Neural In- formation Processing Systems, 2023. 6, 13

    2023

  13. [21]

    Multi-modal temporal attention models for crop mapping from satellite time series

    Vivien Sainte Fare Garnot, Loic Landrieu, and Nesrine Chehata. Multi-modal temporal attention models for crop mapping from satellite time series. ISPRS Journal of Pho- togrammetry and Remote Sensing, 187:294–305, 2022. 2, 7, 13

    2022

  14. [22]

    Bootstrap your own latent-a new approach to self-supervised learning

    Jean-Bastien Grill, Florian Strub, Florent Altch ´e, Corentin Tallec, Pierre Richemond, Elena Buchatskaya, Carl Doersch, Bernardo Avila Pires, Zhaohan Guo, Mohammad Ghesh- laghi Azar, et al. Bootstrap your own latent-a new approach to self-supervised learning. Advances in neur...

    2020

  15. [23]

    Isdnet: Integrating shallow and deep networks for efficient ultra-high resolution segmentation

    Shaohua Guo, Liang Liu, Zhenye Gan, Yabiao Wang, Wuhao Zhang, Chengjie Wang, Guannan Jiang, Wei Zhang, Ran Yi, Lizhuang Ma, et al. Isdnet: Integrating shallow and deep networks for efficient ultra-high resolution segmentation. In Proceedings of the IEEE/CVF Conference on Compu...

    2022

  16. [24]

    Skysense: A multi- modal remote sensing foundation model towards universal interpretation for earth observation imagery

    Xin Guo, Jiangwei Lao, Bo Dang, Yingying Zhang, Lei Yu, Lixiang Ru, Liheng Zhong, Ziyuan Huang, Kang Wu, Dingxiang Hu, Huimei He, Jian Wang, Jingdong Chen, Ming Yang, Yongjun Zhang, and Yansheng Li. Skysense: A multi- modal remote sensing foundation model towards universal int...

    2024

  17. [25]

    Unitr: A uni- fied and efficient multi-modal transformer for bird’s-eye- view representation

    Wang Haiyang, Tang Hao, Shi Shaoshuai, Li Aoxue, Li Zhenguo, Schiele Bernt, and Liwei Wang. Unitr: A uni- fied and efficient multi-modal transformer for bird’s-eye- view representation. In ICCV, 2023. 3

    2023

  18. [26]

    Bridging remote sensors with multisensor geospatial foundation models

    Boran Han, Shuai Zhang, Xingjian Shi, and Markus Reich- stein. Bridging remote sensors with multisensor geospatial foundation models. 2024 IEEE/CVF Conference on Com- puter Vision and Pattern Recognition (CVPR), pages 27852– 27862, 2024. 3

    2024

  19. [27]

    Momentum contrast for unsupervised visual rep- resentation learning

    Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momentum contrast for unsupervised visual rep- resentation learning. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 9729–9738, 2020. 10

    2020

  20. [28]

    Spectralgpt: Spectral remote sensing foundation model

    Danfeng Hong, Bing Zhang, Xuyang Li, Yuxuan Li, Chenyu Li, Jing Yao, Pedram Ghamisi, Naoto Yokoya, Hao Li, Xiup- ing Jia, Antonio Plaza, Paolo Gamba, Jon Atli Benediktsson, and Jocelyn Chanussot. Spectralgpt: Spectral remote sensing foundation model. IEEE Transactions on Patte...

    2024

  21. [29]

    Unsuper- vised domain adaptation using a teacher-student network for cross-city classification of sentinel-2 images

    Jingliang Hu, Lichao Mou, and Xiao Xiang Zhu. Unsuper- vised domain adaptation using a teacher-student network for cross-city classification of sentinel-2 images. The Interna- tional Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 43:1569–1574,...

    2020

  22. [30]

    Toward accurate mapping of 30-m time-series global imper- vious surface area (gisa)

    Xin Huang, Yihong Song, Jie Yang, Wenrui Wang, Huiqun Ren, Mengjie Dong, Yujin Feng, Haidan Yin, and Jiayi Li. Toward accurate mapping of 30-m time-series global imper- vious surface area (gisa). International Journal of Applied Earth Observation and Geoinformation , 109:10278...

    2022

  23. [31]

    Joseph Hughes and Robert H

    M. Joseph Hughes and Robert H. Kennedy. High-quality cloud masking of landsat 8 imagery using convolutional neu- ral networks. Remote. Sens., 11:2591, 2019. 14

    2019

  24. [32]

    Tutel: Adaptive mixture-of-experts at scale, 2022

    Changho Hwang, Wei Cui, Yifan Xiong, Ziyue Yang, Ze Liu, Han Hu, Zilong Wang, Rafael Salas, Jithin Jose, Prab- hat Ram, Joe Chau, Peng Cheng, Fan Yang, Mao Yang, and Yongqiang Xiong. Tutel: Adaptive mixture-of-experts at scale, 2022. 16

    2022

  25. [33]

    Jacobs, Michael I

    Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan, and Geoffrey E. Hinton. Adaptive mixtures of local experts.Neu- ral Computation, 3:79–87, 1991. 2, 4, 14

    1991

  26. [34]

    Pallavi Jain, Bianca Schoen-Phelan, and Robert J. Ross. Self-supervised learning for invariant representations from multi-spectral and sar images. IEEE Journal of Selected Top- ics in Applied Earth Observations and Remote Sensing , 15: 7797–7808, 2022. 2

    2022

  27. [35]

    Vi- sual prompt tuning

    Menglin Jia, Luming Tang, Bor-Chun Chen, Claire Cardie, Serge Belongie, Bharath Hariharan, and Ser-Nam Lim. Vi- sual prompt tuning. In European Conference on Computer Vision (ECCV), 2022. 2

    2022

  28. [36]

    Object detection in optical remote sensing images: A survey and a new benchmark

    Ke Li, Gang Wan, Gong Cheng, Liqiu Meng, and Junwei Han. Object detection in optical remote sensing images: A survey and a new benchmark. ISPRS journal of photogram- metry and remote sensing, 159:296–307, 2020. 2, 6, 16

    2020

  29. [37]

    Ori- ented reppoints for aerial object detection

    Wentong Li, Yijie Chen, Kaixuan Hu, and Jianke Zhu. Ori- ented reppoints for aerial object detection. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1829–1838, 2022. 6, 11

    2022

  30. [38]

    S2mae: A spatial-spectral pretraining foundation model for spec- tral remote sensing data

    Xuyang Li, Danfeng Hong, and Jocelyn Chanussot. S2mae: A spatial-spectral pretraining foundation model for spec- tral remote sensing data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 24088–24097, 2024. 2

    2024

  31. [39]

    Masked angle-aware autoencoder for remote sensing images

    Zhihao Li, Biao Hou, Siteng Ma, Zitong Wu, Xianpeng Guo, Bo Ren, and Licheng Jiao. Masked angle-aware autoencoder for remote sensing images. InEuropean Conference on Com- puter Vision, pages 260–278. Springer, 2024. 2, 6, 7

    2024

  32. [40]

    See- ing beyond the patch: Scale-adaptive semantic segmentation of high-resolution remote sensing imagery based on rein- forcement learning

    Yinhe Liu, Sunan Shi, Junjue Wang, and Yanfei Zhong. See- ing beyond the patch: Scale-adaptive semantic segmentation of high-resolution remote sensing imagery based on rein- forcement learning. In Proceedings of the IEEE/CVF In- ternational Conference on Computer Vision , page...

    2023

  33. [41]

    Swin transformer: Hierarchical vision transformer using shifted windows

    Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision, pages 10012–10022, 2021. 1

    2021

  34. [42]

    Swin transformer v2: Scaling up capacity and resolution

    Ze Liu, Han Hu, Yutong Lin, Zhuliang Yao, Zhenda Xie, Yixuan Wei, Jia Ning, Yue Cao, Zheng Zhang, Li Dong, Furu Wei, and Baining Guo. Swin transformer v2: Scaling up capacity and resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (...

    2022

  35. [43]

    Task-customized masked autoencoder via mixture of cluster-conditional ex- perts

    Zhili Liu, Kai Chen, Jianhua Han, Lanqing Hong, Hang Xu, Zhenguo Li, and James Tin-Yau Kwok. Task-customized masked autoencoder via mixture of cluster-conditional ex- perts. ArXiv, abs/2402.05382, 2024. 4, 15

    2024 arXiv

  36. [44]

    Fully convolutional networks for semantic segmentation

    Jonathan Long, Evan Shelhamer, and Trevor Darrell. Fully convolutional networks for semantic segmentation. In Pro- ceedings of the IEEE conference on computer vision and pat- tern recognition, pages 3431–3440, 2015. 13

    2015

  37. [45]

    Sgdr: Stochastic gradient descent with warm restarts

    Ilya Loshchilov and Frank Hutter. Sgdr: Stochastic gradient descent with warm restarts. arXiv: Learning, 2016. 6, 10

    2016

  38. [46]

    Fixing weight decay reg- ularization in adam

    Ilya Loshchilov and Frank Hutter. Fixing weight decay reg- ularization in adam. CoRR, abs/1711.05101, 2017. 6, 10

    2017 arXiv

  39. [47]

    Land cover change detection with heterogeneous remote sensing images: Review, progress, and perspective

    ZhiYong Lv, HaiTao Huang, Xinghua Li, MingHua Zhao, Jon Atli Benediktsson, WeiWei Sun, and Nicola Falco. Land cover change detection with heterogeneous remote sensing images: Review, progress, and perspective. Proceedings of the IEEE, 2022. 1

    2022

  40. [48]

    Change- aware sampling and contrastive learning for satellite images

    Utkarsh Mall, Bharath Hariharan, and Kavita Bala. Change- aware sampling and contrastive learning for satellite images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5261–5270, 2023. 2, 6, 7, 11 18

    2023

  41. [49]

    Seasonal contrast: Un- supervised pre-training from uncurated remote sensing data

    Oscar Manas, Alexandre Lacoste, Xavier Gir ´o-i Nieto, David Vazquez, and Pau Rodriguez. Seasonal contrast: Un- supervised pre-training from uncurated remote sensing data. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9414–9423, 2021. 2, 6, 7, 11

    2021

  42. [50]

    Towards geospatial foundation models via continual pretraining

    Mat ´ıas Mendieta, Boran Han, Xingjian Shi, Yi Zhu, Chen Chen, and Mu Li. Towards geospatial foundation models via continual pretraining. Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision, pages 16806–16816,

  43. [51]

    Cmid: A unified self-supervised learning framework for remote sensing image understanding

    Dilxat Muhtar, Xueliang Zhang, Pengfeng Xiao, Zhenshi Li, and Feng Gu. Cmid: A unified self-supervised learning framework for remote sensing image understanding. IEEE Transactions on Geoscience and Remote Sensing , 2023. 2, 6, 7

    2023

  44. [52]

    Rethinking transformers pre-training for multi- spectral satellite imagery

    Mubashir Noman, Muzammal Naseer, Hisham Cholakkal, Rao Muhammad Anwer, Salman Khan, and Fahad Shah- baz Khan. Rethinking transformers pre-training for multi- spectral satellite imagery. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)...

    2024

  45. [53]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 1, 4

    2023 arXiv

  46. [54]

    Learning transferable visual models from natural language supervi- sion

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervi- sion. In International conference on machine learning, ...

    2021

  47. [55]

    Scale-mae: A scale-aware masked autoencoder for multiscale geospatial representation learning

    Colorado J Reed, Ritwik Gupta, Shufan Li, Sarah Brock- man, Christopher Funk, Brian Clipp, Kurt Keutzer, Salvatore Candido, Matt Uyttendaele, and Trevor Darrell. Scale-mae: A scale-aware masked autoencoder for multiscale geospatial representation learning. In Proceedings of th...

    2023

  48. [56]

    Faster r-cnn: Towards real-time object detection with region proposal networks

    Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks. Advances in neural information process- ing systems, 28, 2015. 6, 11

    2015

  49. [57]

    Scaling vision with sparse mix- ture of experts

    Carlos Riquelme, Joan Puigcerver, Basil Mustafa, Maxim Neumann, Rodolphe Jenatton, Andr ´e Susano Pinto, Daniel Keysers, and Neil Houlsby. Scaling vision with sparse mix- ture of experts. In Neural Information Processing Systems,

  50. [58]

    U- net: Convolutional networks for biomedical image segmen- tation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U- net: Convolutional networks for biomedical image segmen- tation. In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Pa...

    2015

  51. [59]

    Sheng Shen, Le Hou, Yan-Quan Zhou, Nan Du, S. Long- pre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Albert Webson, Yunxuan Li, Vincent Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, and Denny Zhou. Mixture- of-experts m...

    2023

  52. [60]

    Mixture-of- experts meets instruction tuning: A winning combination for large language models

    Sheng Shen, Le Hou, Yanqi Zhou, Nan Du, Shayne Long- pre, Jason Wei, Hyung Won Chung, Barret Zoph, William Fedus, Xinyun Chen, Tu Vu, Yuexin Wu, Wuyang Chen, Al- bert Webson, Yunxuan Li, Vincent Y Zhao, Hongkun Yu, Kurt Keutzer, Trevor Darrell, and Denny Zhou. Mixture-of- expe...

    2024

  53. [61]

    Fully convolutional networks for dense se- mantic labelling of high-resolution aerial imagery

    Jamie Sherrah. Fully convolutional networks for dense se- mantic labelling of high-resolution aerial imagery. arXiv preprint arXiv:1606.02585, 2016. 6, 11

    2016 arXiv

  54. [62]

    Bigearthnet: A large-scale benchmark archive for remote sensing image understanding

    Gencer Sumbul, Jian Kang, Tristan Kreuziger, Filipe Marcelino, Hugo Costa, Pedro Benevides, Mario Caetano, and Beg ¨um Demir. Bigearthnet: A large-scale benchmark archive for remote sensing image understanding. In IEEE International Geoscience and Remote Sensing Symposium , pa...

    2019

  55. [63]

    Gencer Sumbul, Arne de Wall, Tristan Kreuziger, Filipe Marcelino, Hugo Costa, Pedro Benevides, Mario Caetano, Beg¨um Demir, and V olkerl Mark. BigEarthNet-MM: A large-scale, multimodal, multilabel benchmark archive for remote sensing image classification and retrieval.IEEE Geo...

    2021

  56. [64]

    Ringmo: A remote sensing foundation model with masked image modeling

    Xian Sun, Peijin Wang, Wanxuan Lu, Zicong Zhu, Xiao- nan Lu, Qibin He, Junxi Li, Xuee Rong, Zhujun Yang, Hao Chang, et al. Ringmo: A remote sensing foundation model with masked image modeling. IEEE Transactions on Geo- science and Remote Sensing, 2022. 2, 6, 7, 11

    2022

  57. [65]

    Fair1m: A benchmark dataset for fine- grained object recognition in high-resolution remote sens- ing imagery

    Xian Sun, Peijin Wang, Zhiyuan Yan, Feng Xu, Ruiping Wang, Wenhui Diao, Jin Chen, Jihao Li, Yingchao Feng, Tao Xu, et al. Fair1m: A benchmark dataset for fine- grained object recognition in high-resolution remote sens- ing imagery. ISPRS Journal of Photogrammetry and Remote Se...

    2022

  58. [66]

    Tov: The original vision model for optical re- mote sensing image understanding via self-supervised learn- ing

    Chao Tao, Ji Qi, Guo Zhang, Qing Zhu, Weipeng Lu, and Haifeng Li. Tov: The original vision model for optical re- mote sensing image understanding via self-supervised learn- ing. IEEE Journal of Selected Topics in Applied Earth Ob- servations and Remote Sensing, 2023. 6, 7

    2023

  59. [67]

    Dynamicearthnet: Daily multi-spectral satellite dataset for semantic change segmentation

    Aysim Toker, Lukas Kondmann, Mark Weber, Marvin Eisenberger, Andr´es Camero, Jingliang Hu, Ariadna Pregel Hoderlein, C ¸ a˘glar S ¸enaras, Timothy Davis, Daniel Cre- mers, et al. Dynamicearthnet: Daily multi-spectral satellite dataset for semantic change segmentation. In Proce...

    2022

  60. [68]

    Enabling country-scale land cover mapping with meter-resolution satellite imagery

    Xin-Yi Tong, Guisong Xia, and Xiaoxiang Zhu. Enabling country-scale land cover mapping with meter-resolution satellite imagery. Isprs Journal of Photogrammetry and Re- mote Sensing, 196:178 – 196, 2022. 14

    2022

  61. [69]

    Laurens van der Maaten and Geoffrey E. Hinton. Visualizing 19 data using t-sne. Journal of Machine Learning Research, 9: 2579–2605, 2008. 8

    2008

  62. [70]

    Advancing plain vision transformer toward remote sensing foundation model

    Di Wang, Qiming Zhang, Yufei Xu, Jing Zhang, Bo Du, Dacheng Tao, and Liangpei Zhang. Advancing plain vision transformer toward remote sensing foundation model. IEEE Transactions on Geoscience and Remote Sensing , 61:1–15,

  63. [71]

    Scaling-up remote sensing segmentation dataset with segment anything model

    Di Wang, Jing Zhang, Bo Du, Dacheng Tao, and Liangpei Zhang. Scaling-up remote sensing segmentation dataset with segment anything model. Advances in Neural Information Processing Systems, 2023. 7

    2023

  64. [72]

    De- cur: decoupling common & unique representations for mul- timodal self-supervision

    Yi Wang, Conrad M Albrecht, Nassim Ait Ali Braham, Chenying Liu, Zhitong Xiong, and Xiao Xiang Zhu. De- cur: decoupling common & unique representations for mul- timodal self-supervision. arXiv preprint arXiv:2309.05300,

    arXiv

  65. [73]

    Ssl4eo-s12: A large-scale multi-modal, multi-temporal dataset for self- supervised learning in earth observation

    Yi Wang, Nassim Ait Ali Braham, Zhitong Xiong, Chenying Liu, Conrad M Albrecht, and Xiao Xiang Zhu. Ssl4eo-s12: A large-scale multi-modal, multi-temporal dataset for self- supervised learning in earth observation. IEEE Geoscience and Remote Sensing Magazine, 11(3):98–106, 2023...

    2023

  66. [74]

    Zeng, Zhiyuan Yan, Jian Kang, and Xian Sun

    Zhirui Wang, X.-M. Zeng, Zhiyuan Yan, Jian Kang, and Xian Sun. Air-polsar-seg: A large-scale data set for terrain segmentation in complex-scene polsar images. IEEE Jour- nal of Selected Topics in Applied Earth Observations and Remote Sensing, 15:3830–3841, 2022. 14

    2022

  67. [75]

    Dino-mc: Self-supervised contrastive learn- ing for remote sensing imagery with multi-sized local crops

    Xinye Wanyan, Sachith Seneviratne, Shuchang Shen, and Michael Kirley. Dino-mc: Self-supervised contrastive learn- ing for remote sensing imagery with multi-sized local crops. arXiv preprint arXiv:2303.06670, 2023. 2, 6, 7

    2023 arXiv

  68. [76]

    isaid: A large-scale dataset for instance segmentation in aerial images

    Syed Waqas Zamir, Aditya Arora, Akshita Gupta, Salman Khan, Guolei Sun, Fahad Shahbaz Khan, Fan Zhu, Ling Shao, Gui-Song Xia, and Xiang Bai. isaid: A large-scale dataset for instance segmentation in aerial images. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision ...

    2019

  69. [77]

    A compre- hensive survey of oriented object detection in remote sens- ing images

    Long Wen, Yu Cheng, Yi Fang, and Xinyu Li. A compre- hensive survey of oriented object detection in remote sens- ing images. Expert Systems with Applications, page 119960,

  70. [78]

    Residual mixture of ex- perts

    Lemeng Wu, Mengchen Liu, Yinpeng Chen, Dongdong Chen, Xiyang Dai, and Lu Yuan. Residual mixture of ex- perts. ArXiv, abs/2204.09636, 2022. 4, 15

    2022 arXiv

  71. [79]

    Aid: A benchmark data set for performance evaluation of aerial scene classification

    Gui-Song Xia, Jingwen Hu, Fan Hu, Baoguang Shi, Xiang Bai, Yanfei Zhong, Liangpei Zhang, and Xiaoqiang Lu. Aid: A benchmark data set for performance evaluation of aerial scene classification. IEEE Transactions on Geoscience and Remote Sensing, 55(7):3965–3981, 2017. 2, 6, 16

    2017

  72. [80]

    Unified perceptual parsing for scene understand- ing

    Tete Xiao, Yingcheng Liu, Bolei Zhou, Yuning Jiang, and Jian Sun. Unified perceptual parsing for scene understand- ing. In Proceedings of the European conference on computer vision (ECCV), pages 418–434, 2018. 6, 7, 11

    2018

  73. [81]

    One for all: Toward unified foundation models for earth vision

    Zhitong Xiong, Yi Wang, Fahong Zhang, and Xiao Xiang Zhu. One for all: Toward unified foundation models for earth vision. IGARSS 2024 - 2024 IEEE International Geoscience and Remote Sensing Symposium, pages 2734–2738, 2024. 3

    2024

  74. [82]

    Graph adversarial self-supervised learning

    Longqi Yang, Liangliang Zhang, and Wenjing Yang. Graph adversarial self-supervised learning. In Advances in Neural Information Processing Systems, 2021. 2

    2021

  75. [83]

    A review of deep learning methods for semantic segmentation of remote sensing imagery

    Xiaohui Yuan, Jianfang Shi, and Lichuan Gu. A review of deep learning methods for semantic segmentation of remote sensing imagery. Expert Systems with Applications , 169: 114417, 2021. 1

    2021

  76. [84]

    Meta- transformer: A unified framework for multimodal learning

    Yiyuan Zhang, Kaixiong Gong, Kaipeng Zhang, Hongsheng Li, Yu Qiao, Wanli Ouyang, and Xiangyu Yue. Meta- transformer: A unified framework for multimodal learning. arXiv preprint arXiv:2307.10802, 2023. 3

    2023 arXiv

  77. [85]

    Uni- perceiver: Pre-training unified architecture for generic per- ception for zero-shot and few-shot tasks

    Xizhou Zhu, Jinguo Zhu, Hao Li, Xiaoshi Wu, Xiaogang Wang, Hongsheng Li, Xiaohua Wang, and Jifeng Dai. Uni- perceiver: Pre-training unified architecture for generic per- ception for zero-shot and few-shot tasks. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recogniti...

    2022

  78. [86]

    Shazeer, and William Fedus

    Barret Zoph, Irwan Bello, Sameer Kumar, Nan Du, Yanping Huang, Jeff Dean, Noam M. Shazeer, and William Fedus. St- moe: Designing stable and transferable sparse expert mod- els. 2022. 2 20

    2022

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.