The reviewed record of science sign in
Pith

arxiv: 2111.08896 · v3 · pith:5ZKPT7S4 · submitted 2021-11-17 · cs.CL · cs.CV

Achieving Human Parity on Visual Question Answering

Ming Yan , Haiyang Xu , Chenliang Li , Junfeng Tian , Bin Bi , Wei Wang , Weihua Chen , Xianzhe Xu
show 9 more authors
Fan Wang Zheng Cao Zhicheng Zhang Qiyu Zhang Ji Zhang Songfang Huang Fei Huang Luo Si Rong Jin
This is my paper

Reviewed by Pith T0 review T1 audit T2 compute T3 formal T4 kernel pith:5ZKPT7S4record.jsonopen to challenge →

classification cs.CL cs.CV
keywords visualhumanquestionresearchanalysisansweringimagetask
0
0 comments X
read the original abstract

The Visual Question Answering (VQA) task utilizes both visual image and language analysis to answer a textual question with respect to an image. It has been a popular research topic with an increasing number of real-world applications in the last decade. This paper describes our recent research of AliceMind-MMU (ALIbaba's Collection of Encoder-decoders from Machine IntelligeNce lab of Damo academy - MultiMedia Understanding) that obtains similar or even slightly better results than human being does on VQA. This is achieved by systematically improving the VQA pipeline including: (1) pre-training with comprehensive visual and textual feature representation; (2) effective cross-modal interaction with learning to attend; and (3) A novel knowledge mining framework with specialized expert modules for the complex VQA task. Treating different types of visual questions with corresponding expertise needed plays an important role in boosting the performance of our VQA architecture up to the human level. An extensive set of experiments and analysis are conducted to demonstrate the effectiveness of the new research work.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Flamingo: a Visual Language Model for Few-Shot Learning

    cs.CV 2022-04 unverdicted novelty 7.0

    Flamingo models reach new state-of-the-art few-shot results on image and video tasks by bridging frozen vision and language models with cross-attention layers trained on interleaved web-scale data.