REVIEW 2 cited by
Hierarchical Question-Image Co-Attention for Visual Question Answering
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
A number of recent works have proposed attention models for Visual Question Answering (VQA) that generate spatial maps highlighting image regions relevant to answering the question. In this paper, we argue that in addition to modeling "where to look" or visual attention, it is equally important to model "what words to listen to" or question attention. We present a novel co-attention model for VQA that jointly reasons about image and question attention. In addition, our model reasons about the question (and consequently the image via the co-attention mechanism) in a hierarchical fashion via a novel 1-dimensional convolution neural networks (CNN). Our model improves the state-of-the-art on the VQA dataset from 60.3% to 60.5%, and from 61.6% to 63.3% on the COCO-QA dataset. By using ResNet, the performance is further improved to 62.1% for VQA and 65.4% for COCO-QA.
Forward citations
Cited by 2 Pith papers
-
A Survey on Large Language Models in Multimodal Recommender Systems
A literature survey that categorizes LLM-based multimodal recommendation methods into prompting, training, and data-adaptation families and compiles datasets and metrics.
-
Using Large Language Models for education managements in Vietnamese with low resources
A framework that fine-tunes Bloom and Vistral on a synthetic Vietnamese educational-management QA dataset, with Vistral scoring higher but with no external baseline.
Discussion (0). Continue with ORCID to comment.