Pith. sign in

Learning to Count Objects in Natural Images for Visual Question Answering

3 Pith papers cite this work. Polarity classification is still indexing.

3 Pith papers citing it
abstract

Visual Question Answering (VQA) models have struggled with counting objects in natural images so far. We identify a fundamental problem due to soft attention in these models as a cause. To circumvent this problem, we propose a neural network component that allows robust counting from object proposals. Experiments on a toy task show the effectiveness of this component and we obtain state-of-the-art accuracy on the number category of the VQA v2 dataset without negatively affecting other categories, even outperforming ensemble models with our single model. On a difficult balanced pair metric, the component gives a substantial improvement in counting over a strong baseline by 6.6%.

fields

cs.CV 2 cs.AI 1

years

2026 3

verdicts

CONDITIONAL 3

representative citing papers

HoloCount: A Holistic Visual Counting Benchmark for MLLMs

cs.CV · 2026-07-07 · conditional · novelty 6.0

HoloCount is a three-tier visual counting benchmark showing that MLLMs fail systematically on analytical reasoning, high-density scenes, and linguistic prior conflicts, with even the best models dropping below 50% accuracy on dense counting.

citing papers explorer

Showing 3 of 3 citing papers.

  • The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Counting cs.CV · 2026-05-18 · conditional · none · ref 61 · internal anchor

    MixCount provides a scalable synthetic dataset for mixed-object counting that improves state-of-the-art models on real benchmarks, cutting MAE by 20.14% on FSC-147 and 18.3% on PairTally.

  • HoloCount: A Holistic Visual Counting Benchmark for MLLMs cs.CV · 2026-07-07 · conditional · none · ref 50 · internal anchor

    HoloCount is a three-tier visual counting benchmark showing that MLLMs fail systematically on analytical reasoning, high-density scenes, and linguistic prior conflicts, with even the best models dropping below 50% accuracy on dense counting.

  • Blind-Spots-Bench: Evaluating Blind Spots in Multimodal Models cs.AI · 2026-07-09 · conditional · none · ref 70 · internal anchor

    A 235-item multimodal stress-test shows frontier closed models outpace open-weight peers by ~10% and leaves shared failures on counting, spatial, and character-level tasks.