Pith. sign in

REVIEW

Voxel-informed Language Grounding

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2205.09710 v1 pith:KNQN43TL submitted 2022-05-19 cs.CL cs.AIcs.CV

Rodolfo Corona , Shizhan Zhu , Dan Klein , Trevor Darrell This is my paper
classification cs.CLcs.AIcs.CV
keywords languagegroundingmodelnaturalsnarevoxel-informedabsoluteaccuracy
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Natural language applied to natural 2D images describes a fundamentally 3D world. We present the Voxel-informed Language Grounder (VLG), a language grounding model that leverages 3D geometric information in the form of voxel maps derived from the visual input using a volumetric reconstruction model. We show that VLG significantly improves grounding accuracy on SNARE, an object reference game task. At the time of writing, VLG holds the top place on the SNARE leaderboard, achieving SOTA results with a 2.0% absolute improvement.

Discussion (0). Sign in to comment.

Pith tools