REVIEW 2 cited by
Two Stream 3D Semantic Scene Completion
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Inferring the 3D geometry and the semantic meaning of surfaces, which are occluded, is a very challenging task. Recently, a first end-to-end learning approach has been proposed that completes a scene from a single depth image. The approach voxelizes the scene and predicts for each voxel if it is occupied and, if it is occupied, the semantic class label. In this work, we propose a two stream approach that leverages depth information and semantic information, which is inferred from the RGB image, for this task. The approach constructs an incomplete 3D semantic tensor, which uses a compact three-channel encoding for the inferred semantic information, and uses a 3D CNN to infer the complete 3D semantic tensor. In our experimental evaluation, we show that the proposed two stream approach substantially outperforms the state-of-the-art for semantic scene completion.
Forward citations
Cited by 2 Pith papers
-
EdgeNet: Semantic Scene Completion from a Single RGB-D Image
Canny edges from an RGB image are projected into 3D, encoded with flipped TSDF, and fused with depth in a U-Net based CNN, improving semantic scene completion by about 3 points on SUNCG while matching complex two-stag...
-
Cascaded Context Pyramid for Full-Resolution 3D Semantic Scene Completion
A cascaded context pyramid network with guided residual refinement achieves state-of-the-art full-resolution 3D semantic scene completion from a single depth map on SUNCG and NYU datasets.
Discussion (0). Continue with ORCID to comment.