REVIEW 7 cited by
MapQA: A Dataset for Question Answering on Choropleth Maps
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Choropleth maps are a common visual representation for region-specific tabular data and are used in a number of different venues (newspapers, articles, etc). These maps are human-readable but are often challenging to deal with when trying to extract data for screen readers, analyses, or other related tasks. Recent research into Visual-Question Answering (VQA) has studied question answering on human-generated charts (ChartQA), such as bar, line, and pie charts. However, little work has paid attention to understanding maps; general VQA models, and ChartQA models, suffer when asked to perform this task. To facilitate and encourage research in this area, we present MapQA, a large-scale dataset of ~800K question-answer pairs over ~60K map images. Our task tests various levels of map understanding, from surface questions about map styles to complex questions that require reasoning on the underlying data. We present the unique challenges of MapQA that frustrate most strong baseline algorithms designed for ChartQA and general VQA tasks. We also present a novel algorithm, Visual Multi-Output Data Extraction based QA (V-MODEQA) for MapQA. V-MODEQA extracts the underlying structured data from a map image with a multi-output model and then performs reasoning on the extracted data. Our experimental results show that V-MODEQA has better overall performance and robustness on MapQA than the state-of-the-art ChartQA and VQA algorithms by capturing the unique properties in map question answering.
Forward citations
Cited by 7 Pith papers
-
TaskGalaxy: Scaling Multi-modal Instruction Fine-tuning with Tens of Thousands Vision Task Types
The authors release TaskGalaxy, a 413k-sample multimodal instruction dataset with 19,227 hierarchically organized task types, and report consistent benchmark gains when it is added to LLaVA-v1.5 and InternVL-Chat-v1.0.
-
Do Maps Still Matter for Machines: Revisiting the Role of Choropleth Maps in Foundation Model Spatial Understanding
On a new controlled benchmark, feeding multimodal AI both GeoJSON and a choropleth map beats either alone, but map-only input is weaker than data-only input.
-
SiGMA: Sign-Guided Merging and Adaptation for Multimodal Continual Instruction Tuning
SiGMA uses parameter-sign alignment between prior and new LoRA updates to guide training and merging, reducing negative interference and improving continual instruction tuning of a multimodal LLM on two benchmarks.
-
Spectral Imbalance Causes Forgetting in Low-Rank Continual Adaptation
Balancing the singular values of LoRA task updates, plus orthogonality to past gradients, reduces backward and forward forgetting in continual adaptation of vision-language models.
-
CoMemo: LVLMs Need Image Context with Image Memory
CoMemo adds a cross-attention image-memory path and thumbnail-anchored position encoding to reduce visual neglect in long-context and multi-image LVLM tasks.
-
Mixed-R1: Unified Reward Perspective For Reasoning Capability in Multimodal Large Language Models
Mixed-R1 uses four reward types under GRPO, including a new bidirectional max-average token similarity (BMAS) reward, and lifts MLLM reasoning benchmarks by 2-5%.
-
ChartMind: A Comprehensive Benchmark for Complex Real-world Multimodal Chart Question Answering
ChartMind is a new bilingual chart QA benchmark, and ChartLLM's structured context extraction yields higher scores than three existing prompting paradigms in the paper's evaluations.
Discussion (0). Continue with ORCID to comment.