Pith. sign in

Revisiting EmbodiedQA: A Simple Baseline and Beyond

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it
abstract

In Embodied Question Answering (EmbodiedQA), an agent interacts with an environment to gather necessary information for answering user questions. Existing works have laid a solid foundation towards solving this interesting problem. But the current performance, especially in navigation, suggests that EmbodiedQA might be too challenging for the contemporary approaches. In this paper, we empirically study this problem and introduce 1) a simple yet effective baseline that achieves promising performance; 2) an easier and practical setting for EmbodiedQA where an agent has a chance to adapt the trained model to a new environment before it actually answers users questions. In this new setting, we randomly place a few objects in new environments, and upgrade the agent policy by a distillation network to retain the generalization ability from the trained model. On the EmbodiedQA v1 benchmark, under the standard setting, our simple baseline achieves very competitive results to the-state-of-the-art; in the new setting, we found the introduced small change in settings yields a notable gain in navigation.

fields

cs.CV 1

years

2019 1

verdicts

CONDITIONAL 1

representative citing papers

Walking with MIND: Mental Imagery eNhanceD Embodied QA

cs.CV · 2019-08-05 · conditional · novelty 6.0

A mental imagery module that predicts future views and treats them as short-term subgoals improves an embodied agent's navigation and question-answering accuracy in simulation.

citing papers explorer

Showing 1 of 1 citing paper.

  • Walking with MIND: Mental Imagery eNhanceD Embodied QA cs.CV · 2019-08-05 · conditional · none · ref 31 · internal anchor

    A mental imagery module that predicts future views and treats them as short-term subgoals improves an embodied agent's navigation and question-answering accuracy in simulation.