Canny edges from an RGB image are projected into 3D, encoded with flipped TSDF, and fused with depth in a U-Net based CNN, improving semantic scene completion by about 3 points on SUNCG while matching complex two-stage methods on NYU.
Semantic Scene Completion Combining Colour and Depth: preliminary experiments
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Semantic scene completion is the task of producing a complete 3D voxel representation of volumetric occupancy with semantic labels for a scene from a single-view observation. We built upon the recent work of Song et al. (CVPR 2017), who proposed SSCnet, a method that performs scene completion and semantic labelling in a single end-to-end 3D convolutional network. SSCnet uses only depth maps as input, even though depth maps are usually obtained from devices that also capture colour information, such as RGBD sensors and stereo cameras. In this work, we investigate the potential of the RGB colour channels to improve SSCnet.
fields
cs.CV 1years
2019 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
EdgeNet: Semantic Scene Completion from a Single RGB-D Image
Canny edges from an RGB image are projected into 3D, encoded with flipped TSDF, and fused with depth in a U-Net based CNN, improving semantic scene completion by about 3 points on SUNCG while matching complex two-stage methods on NYU.