Pith. sign in

REVIEW 22 cited by

RSGPT: A Remote Sensing Vision Language Model and Benchmark

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2307.15266 v1 pith:NMVGROBD submitted 2023-07-28 cs.CV

Yuan Hu , Jianlong Yuan , Congcong Wen , Xiaonan Lu , Xiang Li This is my paper · ORCID
classification cs.CV
keywords vlmslanguagelargedatasetmodelsvisioncaptionsdatasets
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

The emergence of large-scale large language models, with GPT-4 as a prominent example, has significantly propelled the rapid advancement of artificial general intelligence and sparked the revolution of Artificial Intelligence 2.0. In the realm of remote sensing (RS), there is a growing interest in developing large vision language models (VLMs) specifically tailored for data analysis in this domain. However, current research predominantly revolves around visual recognition tasks, lacking comprehensive, large-scale image-text datasets that are aligned and suitable for training large VLMs, which poses significant challenges to effectively training such models for RS applications. In computer vision, recent research has demonstrated that fine-tuning large vision language models on small-scale, high-quality datasets can yield impressive performance in visual and language understanding. These results are comparable to state-of-the-art VLMs trained from scratch on massive amounts of data, such as GPT-4. Inspired by this captivating idea, in this work, we build a high-quality Remote Sensing Image Captioning dataset (RSICap) that facilitates the development of large VLMs in the RS field. Unlike previous RS datasets that either employ model-generated captions or short descriptions, RSICap comprises 2,585 human-annotated captions with rich and high-quality information. This dataset offers detailed descriptions for each image, encompassing scene descriptions (e.g., residential area, airport, or farmland) as well as object information (e.g., color, shape, quantity, absolute position, etc). To facilitate the evaluation of VLMs in the field of RS, we also provide a benchmark evaluation dataset called RSIEval. This dataset consists of human-annotated captions and visual question-answer pairs, allowing for a comprehensive assessment of VLMs in the context of RS.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 22 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding

    cs.CV 2026-07 conditional novelty 6.0 of 10

    A training-free evidence-selection and topology-preserving packaging pipeline improves frozen VLMs on ultra-high-resolution remote sensing VQA without multi-round search.

  2. Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewards

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A few-shot RLVR method using only rule-based rewards lifts a 2B vision-language model's remote sensing accuracy by double digits, with 128 examples rivaling thousands.

  3. Enhancing Remote Sensing Vision-Language Models Through MLLM and LLM-Based High-Quality Image-Text Dataset Generation

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A two-stage method (MpGI) produces a 210K-image, 1.26M-caption remote sensing dataset and state-of-the-art CLIP and CoCa models.

  4. GeoMag: A Vision-Language Model for Pixel-level Fine-Grained Remote Sensing Image Parsing

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A remote sensing vision-language model that uses task-aware resolution adjustment and attention-based cropping to perform pixel-level segmentation alongside image- and region-level tasks.

  5. A Satellite-Ground Synergistic Large Vision-Language Model System for Earth Observation

    cs.NI 2025-07 conditional novelty 6.0 of 10

    SpaceVerse jointly decides where to run vision-language inference in LEO satellite networks and compresses task-irrelevant image regions before downlink, improving accuracy and cutting latency versus baselines.

  6. GeoProg3D: Compositional Visual Reasoning for City-Scale 3D Language Fields

    cs.CV 2025-06 conditional novelty 6.0 of 10

    GeoProg3D combines a georeferenced hierarchical 3D language field, geographic vision APIs, and LLM-generated programs to answer natural-language queries about city-scale 3D scenes, and includes a new 952-query benchma...

  7. UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding

    cs.CV 2025-06 conditional novelty 6.0 of 10

    A fine-tuned small multimodal LLM outperforms much larger general models on urban tasks in a new benchmark, with caveats about benchmark overlap with training data.

  8. Chain-of-Talkers (CoTalk): Fast Human Annotation of Dense Image Captions

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Chain-of-Talkers (CoTalk) has annotators sequentially dictate only the missing visual details, and it reports modest gains in annotation speed and caption density over parallel typed annotation.

  9. SARChat-Bench-2M: A Multi-Task Vision-Language Benchmark for SAR Image Interpretation

    cs.CL 2025-02 conditional novelty 6.0 of 10

    SARChat-2M is a 2M-sample, six-task instruction-tuning dataset and benchmark for vision-language models on synthetic aperture radar imagery.

  10. GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing

    cs.CV 2025-01 conditional novelty 6.0 of 10

    GeoPixel brings pixel-level grounding to remote sensing large multimodal models for the first time, with a new dataset and benchmark built from iSAID.

  11. GeoPix: Multi-Modal Large Language Model for Pixel-level Image Understanding in Remote Sensing

    cs.CV 2025-01 conditional novelty 6.0 of 10

    GeoPix extends multimodal language models for remote sensing to pixel-level referring segmentation through a mask predictor, a class-wise learnable memory, and a new 65,463-image instruction dataset.

  12. EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues

    cs.CV 2024-12 conditional novelty 6.0 of 10

    EarthDial is a 4B-parameter remote sensing chatbot trained on 11.11M instruction pairs to handle multi-resolution, multi-spectral, and multi-temporal satellite imagery, and it reports gains over prior VLMs on dozens o...

  13. RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts

    cs.CV 2024-12 conditional novelty 6.0 of 10

    RSUniVLM is a 1-billion-parameter remote sensing vision-language model that unifies image-, region-, and pixel-level tasks plus multi-image change analysis, achieving state-of-the-art visual grounding on VRSBench and ...

  14. GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks

    cs.CV 2024-11 conditional novelty 6.0 of 10

    State-of-the-art vision-language models answer only 41.7% of GEOBench-VLM multiple-choice questions correctly, roughly double random chance.

  15. FrogDogNet: Fourier frequency Retained visual prompt Output Guidance for Domain Generalization of CLIP in Remote Sensing

    cs.CV 2025-04 conditional novelty 5.0 of 10

    FrogDogNet applies Fourier filtering and self-attention to CLIP visual features before prompt learning, reporting new state-of-the-art remote sensing domain generalization results on four benchmarks.

  16. Multi-Agent Geospatial Copilots for Remote Sensing Workflows

    cs.LG 2025-01 conditional novelty 5.0 of 10

    A hybrid multi-agent orchestrator (composition plus iterative reassessment) reports 60.3% agentic correctness on generated remote sensing workflows, about 17 percentage points above the single-agent GeoLLM-Engine baseline.

  17. UniRS: Unifying Multi-temporal Remote Sensing Tasks through Vision Language Models

    cs.CV 2024-12 conditional novelty 5.0 of 10

    A single vision-language model is fine-tuned to handle three remote sensing input types and reports state-of-the-art results on VQA, change captioning, and video classification benchmarks.

  18. LHRS-Bot-Nova: Improved Multimodal Large Language Model for Remote Sensing Vision-Language Interpretation

    cs.CV 2024-11 conditional novelty 5.0 of 10

    A remote sensing chatbot with recaptioned image-text data and a mixture-of-experts visual bridge reports gains over prior general and remote sensing models, but no code or data are released yet.

  19. REO-VLM: Transforming VLM to Meet Regression Challenges in Earth Observation

    cs.CV 2024-12 reject novelty 4.0 of 10

    A vision-language model for Earth observation that adds numeric biomass regression to generative question answering, with R^2 up to 0.36 and patch counting still failing.

  20. MME-Survey: A Comprehensive Survey on Evaluation of Multimodal LLMs

    cs.CV 2024-11 conditional novelty 4.0 of 10

    A broad survey that organizes MLLM evaluation benchmarks into capability categories, explains benchmark construction and scoring methods, and identifies gaps in current evaluation practice.

  21. Visual Large Language Models for Generalized and Specialized Applications

    cs.CV 2025-01 conditional novelty 3.0 of 10

    This paper reviews and taxonomizes VLLM applications into vision-to-text, vision-to-action, and text-to-vision, adding ethics and future-work discussion.

  22. Large Vision-Language Models for Remote Sensing Visual Question Answering

    cs.CV 2024-11 reject novelty 2.0 of 10

    A generative vision-language model finetuned on remote-sensing data is claimed to beat baseline models on the RSVQAxBEN benchmark, but the supporting experimental details are missing.

Pith tools