Pith. sign in

REVIEW 3 major objections 5 minor 49 references

VisHall3D: Monocular Semantic Scene Completion from Reconstructing the Visible Regions to Hallucinating the Invisible Regions

T0 review · 3 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Two-stage visible-then-hidden pipeline sets state of the art for monocular 3D scene completion.

desk verdict VisHall3D is a legitimate SOTA step in monocular SSC with a clean two-stage decomposition, but the load-bearing visibility split inherits every depth-prior error and isn't validated, and one mechanism description contradicts itself. read the letter →

arxiv 2507.19188 v1 pith:LPAW7ZRQ submitted 2025-07-25 cs.CV

Haoang Lu , Yuanqi Su , Xiaoning Zhang , Longjun Gao , Yu Xue , Le Wang This is my paper · ORCID
classification cs.CV
keywords monocularsemanticscenecompletionvisualfrontierhallucinationnetworkmaskedautoencoder3Doccupancypredictionautonomousdrivingdepth-guidedvoxelreconstruction
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that monocular semantic scene completion improves when the task is split into two explicit stages: first reconstruct the visible surfaces, then hallucinate the occluded and out-of-view geometry. Existing single-stage methods entangle these two jobs, which mixes features of visible and invisible regions and produces geometrically inconsistent volumes. The authors build VisHall3D around this split and report state-of-the-art results on SemanticKITTI and SSCBench-KITTI-360, beating stereo and temporal methods on some metrics. A sympathetic reading is that the paper shows explicit visibility decomposition is a design principle, not just a training trick.

What carries the argument

The load-bearing object is the visual frontier: the boundary surface between voxels directly seen by the camera and voxels hidden behind them. It is computed by comparing each voxel's projected depth against an estimated depth map, V={v | d_v < D(x_v,y_v)+theta_d}, represented by a truncated unsigned distance field that decays sharply away from the frontier, and refined by 3D deformable attention over image-lifted features. The second stage, OcclusionMAE, is a denoising masked autoencoder that injects the noise level into the features via adaptive batch normalization and completes the whole volume with a 3D U-Net. Together the split turns one ill-posed end-to-end problem into two more specialized subproblems.

What would settle it

Replace the MobileStereoNet depth prior with ground-truth LiDAR depth during inference on SemanticKITTI: if the visible-versus-invisible split is the mechanism behind the gains, the performance improvement over single-stage baselines should shrink dramatically, and errors on thin poles, reflective surfaces, and distant objects should visibly align with the depth prior's failures.

Watch

Extended reading notes

Core claim

VisHall3D decomposes monocular semantic scene completion into a vision stage and a hallucination stage. VisFrontierNet first identifies the visual frontier by comparing each voxel's projected depth against a learned depth map, encodes the boundary with a truncated unsigned distance field, and refines visible-voxel features with 3D deformable attention. OcclusionMAE then takes the noisy visible predictions and denoises them conditionally on an injected noise level using a 3D U-Net, generating occupancy for the full volume. On the SemanticKITTI hidden test set the method reaches IoU 46.50 and mIoU 17.46, and on SSCBench-KITTI-360 IoU 49.12 and mIoU 20.95. The authors attribute the gains to decoupling visible reconstruction from invisible hallucination, which they argue mitigates feature entanglement and geometric inconsistency.

Load-bearing premise

The split between visible and invisible voxels is inherited from the depth map produced by MobileStereoNet; where that depth prior is wrong, voxels are labeled into the wrong stage, and the claimed benefit of decoupling may not survive.

Editorial extensions

If this is right

  • On SemanticKITTI, the reported mIoU of 17.46% exceeds all compared monocular, stereo, and temporal methods, and the IoU of 46.50% is the highest in the table.
  • On SSCBench-KITTI-360, mIoU of 20.95% beats the previous best monocular method by 0.90% and surpasses early LiDAR-based methods.
  • Ablations show each component contributes to the reported gains: the unsigned distance encoding raises IoU by 4.33, adding OcclusionMAE raises mIoU by 0.88, feature refinement adds 0.60, and the denoising mechanism adds 0.47.
  • The noise ablation shows that horizontal perturbation hurts more than depth perturbation, which is consistent with the claim that depth estimates are the main source of uncertainty in visible-region reconstruction.
  • Despite the two-stage design, the model reports parameters comparable to the prior state-of-the-art and a faster inference time, suggesting the decoupling does not come at a large computational cost.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If decoupling is the actual source of the gains, error analysis should show that mislabeled visible-versus-occluded voxels concentrate where the depth prior fails, a prediction that could be tested by inspecting per-voxel mistakes against LiDAR ground truth.
  • The visible-then-invisible design may transfer to other ill-posed 3D reconstruction tasks, such as multi-frame or multi-camera occupancy prediction, where a measured surface and a hallucinated interior are naturally distinct subproblems.
  • The noise injection scheme opens a design space for denoising-based hallucination networks; one could anneal the noise schedule during training instead of keeping a fixed range, or adapt the noise ranges per object class.
  • Because the visual frontier inherits the depth prior, end-to-end training of the depth estimator together with the decoupling objective could plausibly push the reported numbers higher, though the paper does not explore that route.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. VisHall3D is a two-stage monocular semantic scene completion framework. The first stage, VisFrontierNet, identifies the visual frontier from an estimated depth map, computes a truncated unsigned distance encoding of the frontier, and refines 3D features with deformable attention. The second stage, OcclusionMAE, is a denoising masked autoencoder with a 3D U-Net that ingests the visible-voxel predictions with injected noise and generates the complete occupancy grid. The authors report state-of-the-art results on SemanticKITTI (mIoU 17.46, IoU 46.50) and SSCBench-KITTI-360 (mIoU 20.95, IoU 49.12), and provide ablations on the SemanticKITTI validation set.

Significance. If the reported results hold, VisHall3D achieves a clear improvement over prior monocular scene completion methods, including recent temporal and stereo approaches. The two-stage decomposition of visible-region reconstruction and invisible-region hallucination is a conceptually appealing and falsifiable design. The paper provides extensive benchmark comparisons, complexity measurements, and a reasonable set of ablations. The main caveat is that the central decoupling claim rests on the reliability of the estimated depth map used to define the visible/invisible split; the paper does not yet provide direct evidence that this split is accurate or that the benefit is specifically due to the decoupling rather than to the additional capacity and training changes.

major comments (3)
  1. [Sec. 3.3, Eq. (6)] The text states that the noise added by AddNoise 'does not alter the original semantics ... but only perturbs geometric information,' yet Eq. (6) randomly assigns each visible voxel a value from a neighboring voxel within ranges Rh and Rd. Since the assigned value includes the semantic class (or predicted class distribution), the neighbor may carry a different class, directly contradicting the claim. Please redefine the noise as a geometric perturbation (for example, spatial jitter of voxel coordinates) or revise the claim accordingly and analyze whether class changes actually occur in practice.
  2. [Sec. 3.2, Eq. (2)] The visible/occluded split V is computed entirely from the MobileStereoNet depth estimate D, but the paper provides no evaluation of how well this mask approximates true visibility or ground-truth occupancy. With the tuned threshold θ_d = 3.5 m (Table 5) and 0.2 m voxels, V labels a roughly 17-voxel shell behind the estimated surface as visible. Any systematic depth error (e.g., at long range, on thin structures, or on reflective surfaces) propagates into the training signal of VisFrontierNet and the conditioning of OcclusionMAE. Please report the accuracy of V against a ground-truth visibility oracle (for example, a mask rendered from accumulated LiDAR scans) and include an experiment using oracle depth to isolate the effect of the depth prior on the claimed decoupling benefit.
  3. [Sec. 4.3, Table 4] The component-wise ablation is cumulative. The row '+ OcclusionMAE w/o Denoising' simultaneously introduces the visible/invisible split, the two-stage training procedure, and the second network; the reported +0.88 mIoU therefore conflates these changes and does not isolate the benefit of the decoupling itself. A non-cumulative ablation (for example, removing OcclusionMAE from the full model, or adding only the visible/invisible split to the baseline without the second stage) is needed to support the central claim that the two-stage decomposition drives the improvement.
minor comments (5)
  1. [Table 1] Some entries in the Symphonize row appear to be missing separators (e.g., '23.103.201.90' and '2.0016.10'); please reformat the table to make all numeric entries unambiguous.
  2. [Sec. 4.2] The text refers to 'SCSCNet [34]'; the referenced method is SSCNet, so the name should be corrected.
  3. [Sec. 3.3, Eq. (7)] The notation δ^2 in the adaptive batch normalization equation is not defined; please state explicitly that it denotes the variance of the features.
  4. [Table 5] The abbreviation 'OOV' in the table header is not defined in the text; please spell out 'out-of-view' at first use.
  5. [Sec. 4.3, Table 6] The noise ablation was conducted with θ_d = 2.5 m, while Table 5 indicates that the best threshold is 3.5 m. Please discuss the interaction or justify the choice, since the noise parameters may behave differently at the optimal threshold.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the reported gains are measured against held-out ground truth, and the visible/invisible split comes from an external depth estimator rather than from the target labels.

full rationale

The derivation chain is self-contained with respect to the claimed quantities. Equation 2 defines the visible set V using the estimated depth map D from MobileStereoNet and a relaxation threshold theta_d, while Equation 3 encodes unsigned distance to that same estimated frontier. These are geometric inputs, not fitted values of the reported IoU/mIoU, and neither equation is re-derived from the occupancy labels it helps predict. The networks are trained with cross-entropy, Scene-Class Affinity, and depth losses against benchmark ground truth, and all headline numbers are computed on held-out test sets of SemanticKITTI and SSCBench-KITTI-360. Theta_d and the OcclusionMAE noise ranges are tuned on validation and disclosed in Tables 5 and 6; this is standard hyperparameter selection, not a prediction from fitted data. The paper contains no load-bearing self-citation chain: the cited prior works, including Symphonies, MonoScene, VoxFormer, MobileStereoNet, and MAE, are external sources, and the architecture borrows components from them without invoking a same-author uniqueness theorem. The main residual risk, that the visual frontier split inherits errors from the depth prior, is a correctness and robustness concern about an external dependency, not a circularity in the derivation, because no equation reduces to its own input or to a renamed fit.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The central result depends on the external depth prior's accuracy for the visible/invisible split, on the assumption that neighbor-sampling noise preserves semantics (contested), and on several tuning constants (theta_d, R_h, R_d, gamma, theta) selected on the validation set. No invented entities are introduced.

free parameters (5)
  • Invisibility threshold theta_d = 3.5 m (tuned on SemanticKITTI validation)
    Defines which voxels count as visible in Eq (2); chosen for best validation mIoU in Tab. 5.
  • Noise range horizontal R_h = 0 voxel (best in Tab. 6, under theta_d=2.5)
    Sampling range for neighbor replacement noise in OcclusionMAE; tuned on validation.
  • Noise range depth R_d = 3 voxels (best in Tab. 6, under theta_d=2.5)
    Depth-direction neighbor sampling range; tuned on validation.
  • Unsigned distance decay factor gamma = 10
    Hand-chosen constant in Eq (3) 'for sharp decaying' of the distance encoding.
  • Unsigned distance truncation theta = 1
    Hand-chosen truncation range in Eq (3) for the unsigned distance map.
assumptions (4)
  • domain assumption The pretrained MobileStereoNet depth map D accurately determines the visual frontier (Eq 2).
    The entire visible/occluded split depends on estimated depth D being close to true depth; depth errors directly misclassify voxels. Sec 3.1 and Sec 4.1.
  • domain assumption Ground-truth occupancy from accumulated LiDAR frames defines occluded and out-of-view regions as the hallucination target.
    Standard SSC assumption that multi-frame LiDAR accumulation is the correct ground truth for 'invisible' regions; Sec 4.1.
  • ad hoc to paper Neighbor sampling in AddNoise preserves semantic class (only perturbs geometry).
    Sec 3.3 asserts noise does not alter semantics, but randomly assigning a neighboring voxel's value can change the class at boundaries, so this premise is not guaranteed and is internally inconsistent.
  • domain assumption MonoScene's Scene-Class Affinity Loss improves geometry/semantics consistency in this architecture.
    Adopted from MonoScene [3] as prior art; assumed effective without re-derivation. Sec 3.4.

how reviews work

0 comments
Cite this review

Pith. "Pith review of VisHall3D: Monocular Semantic Scene Completion from Reconstructing the Visible Regions to Hallucinating the Invisible Regions." pith.science (2026). https://pith.science/paper/LPAW7ZRQ

@misc{pith2026250719188,
  author       = {Pith},
  title        = {Pith review of: VisHall3D: Monocular Semantic Scene Completion from Reconstructing the Visible Regions to Hallucinating the Invisible Regions},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LPAW7ZRQ}},
  note         = {Machine review of arXiv:2507.19188}
}
read the original abstract

This paper introduces VisHall3D, a novel two-stage framework for monocular semantic scene completion that aims to address the issues of feature entanglement and geometric inconsistency prevalent in existing methods. VisHall3D decomposes the scene completion task into two stages: reconstructing the visible regions (vision) and inferring the invisible regions (hallucination). In the first stage, VisFrontierNet, a visibility-aware projection module, is introduced to accurately trace the visual frontier while preserving fine-grained details. In the second stage, OcclusionMAE, a hallucination network, is employed to generate plausible geometries for the invisible regions using a noise injection mechanism. By decoupling scene completion into these two distinct stages, VisHall3D effectively mitigates feature entanglement and geometric inconsistency, leading to significantly improved reconstruction quality. The effectiveness of VisHall3D is validated through extensive experiments on two challenging benchmarks: SemanticKITTI and SSCBench-KITTI-360. VisHall3D achieves state-of-the-art performance, outperforming previous methods by a significant margin and paves the way for more accurate and reliable scene understanding in autonomous driving and other applications.

Figures

Figures reproduced from arXiv: 2507.19188 by the authors.

Figure 1
Figure 1. Visualization of the decoupling of prediction for visible regions and hallucination for invisible regions: (a) Division of visible [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Overview of our method and the structure of each module. (a) The pipeline of our proposed VisFrontierNet, including unsigned [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Illustration of the visual frontier from side view. The [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Visual comparison of Hard Lifting and our Unsigned [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]
Figure 5
Figure 5. Figure 5: Qualitative visual comparison with Monoscene[ [PITH_FULL_IMAGE:figures/full_fig_p005_5.png]

Review history (2 revisions) →

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

49 extracted references · 33 canonical work pages

  1. [1]

    Se- mantickitti: A dataset for semantic scene understanding of lidar sequences

    Jens Behley, Martin Garbade, Andres Milioto, Jan Quen- zel, Sven Behnke, Cyrill Stachniss, and Jurgen Gall. Se- mantickitti: A dataset for semantic scene understanding of lidar sequences. InProceedings of the IEEE/CVF inter- national conference on computer vision, pages 9297–9307,

  2. [2]

    Cascade r-cnn: High quality object detection and instance segmentation.IEEE transactions on pattern analysis and machine intelligence, 43(5):1483–1498, 2019

    Zhaowei Cai and Nuno Vasconcelos. Cascade r-cnn: High quality object detection and instance segmentation.IEEE transactions on pattern analysis and machine intelligence, 43(5):1483–1498, 2019. 3

    work page 2019

  3. [3]

    Monoscene: Monoc- ular 3d semantic scene completion

    Anh-Quan Cao and Raoul De Charette. Monoscene: Monoc- ular 3d semantic scene completion. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3991–4001, 2022. 1, 2, 3, 5, 6, 7

    work page 2022

  4. [4]

    End-to- end object detection with transformers

    Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. End-to- end object detection with transformers. InEuropean confer- ence on computer vision, pages 213–229. Springer, 2020. 3

    2020

  5. [5]

    Epro-pnp: Generalized end-to-end prob- abilistic perspective-n-points for monocular object pose es- timation

    Hansheng Chen, Pichao Wang, Fan Wang, Wei Tian, Lu Xiong, and Hao Li. Epro-pnp: Generalized end-to-end prob- abilistic perspective-n-points for monocular object pose es- timation. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2781–2790,

    work page

  6. [6]

    S3cnet: A sparse semantic scene completion net- work for lidar point clouds

    Ran Cheng, Christopher Agia, Yuan Ren, Xinhai Li, and Liu Bingbing. S3cnet: A sparse semantic scene completion net- work for lidar point clouds. InConference on Robot Learn- ing, pages 2148–2161. PMLR, 2021. 2

    work page 2021

  7. [7]

    Fast r-cnn

    Ross Girshick. Fast r-cnn. InProceedings of the IEEE inter- national conference on computer vision, pages 1440–1448,

  8. [8]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. InProceed- ings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016. 4

    2016

Show all 49 references
  1. [9]

    Masked autoencoders are scalable vision learners

    Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll´ar, and Ross Girshick. Masked autoencoders are scalable vision learners. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 16000– 16009, 2022. 3

    2022

  2. [10]

    Arbitrary style transfer in real-time with adaptive instance normalization

    Xun Huang and Serge Belongie. Arbitrary style transfer in real-time with adaptive instance normalization. InProceed- ings of the IEEE international conference on computer vi- sion, pages 1501–1510, 2017. 5

    2017

  3. [11]

    Tri-perspective view for vision- based 3d semantic occupancy prediction

    Yuanhui Huang, Wenzhao Zheng, Yunpeng Zhang, Jie Zhou, and Jiwen Lu. Tri-perspective view for vision- based 3d semantic occupancy prediction. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9223–9232, 2023. 2, 6, 7

    2023

  4. [12]

    Sym- phonize 3d semantic scene completion with contextual in- stance queries

    Haoyi Jiang, Tianheng Cheng, Naiyu Gao, Haoyang Zhang, Tianwei Lin, Wenyu Liu, and Xinggang Wang. Sym- phonize 3d semantic scene completion with contextual in- stance queries. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20258– 202...

    2024

  5. [13]

    Spidepth: Strengthened pose informa- tion for self-supervised monocular depth estimation.arXiv preprint arXiv:2404.12501, 2024

    Mykola Lavreniuk. Spidepth: Strengthened pose informa- tion for self-supervised monocular depth estimation.arXiv preprint arXiv:2404.12501, 2024. 2

    2024 arXiv

  6. [14]

    Bridging stereo geometry and bev repre- sentation with reliable mutual interaction for semantic scene completion.arXiv preprint arXiv:2303.13959, 2023

    Bohan Li, Yasheng Sun, Zhujin Liang, Dalong Du, Zhuanghui Zhang, Xiaofeng Wang, Yunnan Wang, Xin Jin, and Wenjun Zeng. Bridging stereo geometry and bev repre- sentation with reliable mutual interaction for semantic scene completion.arXiv preprint arXiv:2303.13959, 2023. 2, 6, 7

    2023 arXiv

  7. [15]

    Hierarchical temporal context learning for camera-based semantic scene comple- tion.arXiv preprint arXiv:2407.02077, 2024

    Bohan Li, Jiajun Deng, Wenyao Zhang, Zhujin Liang, Da- long Du, Xin Jin, and Wenjun Zeng. Hierarchical temporal context learning for camera-based semantic scene comple- tion.arXiv preprint arXiv:2407.02077, 2024. 6, 7

    2024 arXiv

  8. [16]

    Mask dino: Towards a unified transformer-based framework for object detection and segmentation

    Feng Li, Hao Zhang, Huaizhe Xu, Shilong Liu, Lei Zhang, Lionel M Ni, and Heung-Yeung Shum. Mask dino: Towards a unified transformer-based framework for object detection and segmentation. InProceedings of the IEEE/CVF con- ference on computer vision and pattern recognition, pag...

    2023

  9. [17]

    Dfa3d: 3d deformable attention for 2d-to-3d feature lifting

    Hongyang Li, Hao Zhang, Zhaoyang Zeng, Shilong Liu, Feng Li, Tianhe Ren, and Lei Zhang. Dfa3d: 3d deformable attention for 2d-to-3d feature lifting. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 6684–6693, 2023. 5

    2023

  10. [18]

    Depth based semantic scene completion with position importance aware loss.IEEE Robotics and Automation Letters, 5(1):219–226, 2019

    Jie Li, Yu Liu, Xia Yuan, Chunxia Zhao, Roland Sieg- wart, Ian Reid, and Cesar Cadena. Depth based semantic scene completion with position importance aware loss.IEEE Robotics and Automation Letters, 5(1):219–226, 2019. 2

    2019

  11. [19]

    Anisotropic convolutional networks for 3d semantic scene completion

    Jie Li, Kai Han, Peng Wang, Yu Liu, and Xia Yuan. Anisotropic convolutional networks for 3d semantic scene completion. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3351– 3359, 2020. 2

    2020

  12. [20]

    V oxformer: Sparse voxel transformer for camera- based 3d semantic scene completion

    Yiming Li, Zhiding Yu, Christopher Choy, Chaowei Xiao, Jose M Alvarez, Sanja Fidler, Chen Feng, and Anima Anand- kumar. V oxformer: Sparse voxel transformer for camera- based 3d semantic scene completion. InProceedings of the IEEE/CVF conference on computer vision and pattern ...

    2023

  13. [21]

    Ss- cbench: A large-scale 3d semantic scene completion bench- mark for autonomous driving

    Yiming Li, Sihang Li, Xinhao Liu, Moonjun Gong, Kenan Li, Nuo Chen, Zijun Wang, Zhiheng Li, Tao Jiang, Fisher Yu, Yue Wang, Hang Zhao, Zhiding Yu, and Chen Feng. Ss- cbench: A large-scale 3d semantic scene completion bench- mark for autonomous driving. In2024 IEEE/RSJ Interna-...

  14. [22]

    Bevformer: Learning bird’s-eye-view representation from multi-camera images via spatiotemporal transformers

    Zhiqi Li, Wenhai Wang, Hongyang Li, Enze Xie, Chong- hao Sima, Tong Lu, Yu Qiao, and Jifeng Dai. Bevformer: Learning bird’s-eye-view representation from multi-camera images via spatiotemporal transformers. 2

  15. [23]

    Diversity matters: Fully exploiting depth clues for reliable monocular 3d object detection

    Zhuoling Li, Zhan Qu, Yang Zhou, Jianzhuang Liu, Haoqian Wang, and Lihui Jiang. Diversity matters: Fully exploiting depth clues for reliable monocular 3d object detection. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 2791–2800, 2022. 2

    2022

  16. [24]

    Fb-occ: 3d occupancy prediction based on forward-backward view transformation

    Zhiqi Li, Zhiding Yu, David Austin, Mingsheng Fang, Shiyi Lan, Jan Kautz, and Jose M Alvarez. Fb-occ: 3d occupancy prediction based on forward-backward view transformation. arXiv preprint arXiv:2307.01492, 2023. 2

    2023 arXiv

  17. [25]

    Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3292–3310, 2022

    Yiyi Liao, Jun Xie, and Andreas Geiger. Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d.IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3292–3310, 2022. 1, 6, 7

    2022

  18. [26]

    Occtransformer: Improving bev- former for 3d camera-only occupancy prediction.arXiv preprint arXiv:2402.18140, 2024

    Jian Liu, Sipeng Zhang, Chuixin Kong, Wenyuan Zhang, Yuhang Wu, Yikang Ding, Borun Xu, Ruibo Ming, Donglai Wei, and Xianming Liu. Occtransformer: Improving bev- former for 3d camera-only occupancy prediction.arXiv preprint arXiv:2402.18140, 2024. 2

    2024 arXiv

  19. [27]

    Autoshape: Real-time shape-aware monoc- ular 3d object detection

    Zongdai Liu, Dingfu Zhou, Feixiang Lu, Jin Fang, and Liangjun Zhang. Autoshape: Real-time shape-aware monoc- ular 3d object detection. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 15641– 15650, 2021. 2

    2021

  20. [28]

    M3dssd: Monocular 3d single stage object detector

    Shujie Luo, Hang Dai, Ling Shao, and Yong Ding. M3dssd: Monocular 3d single stage object detector. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 6145–6154, 2021. 2

    2021

  21. [29]

    Occdepth: A depth-aware method for 3d semantic scene completion

    Ruihang Miao, Weizhou Liu, Mingrui Chen, Zheng Gong, Weixin Xu, Chen Hu, and Shuchang Zhou. Occdepth: A depth-aware method for 3d semantic scene completion. arXiv preprint arXiv:2302.13540, 2023. 1

    2023 arXiv

  22. [30]

    Lift, splat, shoot: Encoding images from arbitrary camera rigs by implicitly unproject- ing to 3d

    Jonah Philion and Sanja Fidler. Lift, splat, shoot: Encoding images from arbitrary camera rigs by implicitly unproject- ing to 3d. InProceedings of the European Conference on Computer Vision, 2020. 5

    2020

  23. [31]

    Semantic scene completion using local deep implicit functions on lidar data.IEEE transactions on pattern analysis and machine intelligence, 44(10):7205– 7218, 2021

    Christoph B Rist, David Emmerichs, Markus Enzweiler, and Dariu M Gavrila. Semantic scene completion using local deep implicit functions on lidar data.IEEE transactions on pattern analysis and machine intelligence, 44(10):7205– 7218, 2021. 2

    2021

  24. [32]

    Lmscnet: Lightweight multiscale 3d semantic com- pletion

    Luis Roldao, Raoul De Charette, and Anne Verroust- Blondet. Lmscnet: Lightweight multiscale 3d semantic com- pletion. In2020 International Conference on 3D Vision (3DV), pages 111–119. IEEE, 2020. 7

    2020

  25. [33]

    Mobilestereonet: Towards lightweight deep net- works for stereo matching

    Faranak Shamsafar, Samuel Woerz, Rafia Rahim, and An- dreas Zell. Mobilestereonet: Towards lightweight deep net- works for stereo matching. InProceedings of the ieee/cvf winter conference on applications of computer vision, pages 2417–2426, 2022. 6

    2022

  26. [34]

    Semantic scene com- pletion from a single depth image

    Shuran Song, Fisher Yu, Andy Zeng, Angel X Chang, Mano- lis Savva, and Thomas Funkhouser. Semantic scene com- pletion from a single depth image. InProceedings of the IEEE conference on computer vision and pattern recogni- tion, pages 1746–1754, 2017. 2, 7

    2017

  27. [35]

    Sparse r-cnn: End-to-end ob- ject detection with learnable proposals

    Peize Sun, Rufeng Zhang, Yi Jiang, Tao Kong, Chen- feng Xu, Wei Zhan, Masayoshi Tomizuka, Lei Li, Zehuan Yuan, Changhu Wang, et al. Sparse r-cnn: End-to-end ob- ject detection with learnable proposals. InProceedings of the IEEE/CVF conference on computer vision and pattern rec...

    2021

  28. [36]

    Not all voxels are equal: Hardness-aware semantic scene completion with self- distillation

    Song Wang, Jiawei Yu, Wentong Li, Wenyu Liu, Xiaolu Liu, Junbo Chen, and Jianke Zhu. Not all voxels are equal: Hardness-aware semantic scene completion with self- distillation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14792– 14...

    2024

  29. [37]

    H2gformer: Horizontal-to-global voxel transformer for 3d semantic scene completion

    Yu Wang and Chao Tong. H2gformer: Horizontal-to-global voxel transformer for 3d semantic scene completion. InPro- ceedings of the AAAI Conference on Artificial Intelligence, pages 5722–5730, 2024. 1, 2, 6

    2024

  30. [38]

    Surroundocc: Multi-camera 3d occu- pancy prediction for autonomous driving

    Yi Wei, Linqing Zhao, Wenzhao Zheng, Zheng Zhu, Jie Zhou, and Jiwen Lu. Surroundocc: Multi-camera 3d occu- pancy prediction for autonomous driving. InProceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 21729–21740, 2023. 6

    2023

  31. [39]

    Instance-aware monocular 3d semantic scene comple- tion.IEEE Transactions on Intelligent Transportation Sys- tems, 25(7):6543–6554, 2024

    Haihong Xiao, Hongbin Xu, Wenxiong Kang, and Yuqiong Li. Instance-aware monocular 3d semantic scene comple- tion.IEEE Transactions on Intelligent Transportation Sys- tems, 25(7):6543–6554, 2024. 6, 7

    2024

  32. [40]

    Sparse single sweep lidar point cloud segmentation via learning contextual shape priors from scene completion

    Xu Yan, Jiantao Gao, Jie Li, Ruimao Zhang, Zhen Li, Rui Huang, and Shuguang Cui. Sparse single sweep lidar point cloud segmentation via learning contextual shape priors from scene completion. InProceedings of the AAAI conference on artificial intelligence, pages 3101–3109, 2021. 2

    2021

  33. [41]

    Depthssc: Depth- spatial alignment and dynamic voxel resolution for monoc- ular 3d semantic scene completion.arXiv preprint arXiv:2311.17084, 2023

    Jiawei Yao and Jusheng Zhang. Depthssc: Depth- spatial alignment and dynamic voxel resolution for monoc- ular 3d semantic scene completion.arXiv preprint arXiv:2311.17084, 2023. 2, 6, 7

    2023 arXiv

  34. [42]

    Ndc-scene: Boost monocular 3d semantic scene completion in normalized de- vice coordinates space

    Jiawei Yao, Chuming Li, Keqiang Sun, Yingjie Cai, Hao Li, Wanli Ouyang, and Hongsheng Li. Ndc-scene: Boost monocular 3d semantic scene completion in normalized de- vice coordinates space. In2023 IEEE/CVF International Conference on Computer Vision (ICCV), pages 9421–9431. IEEE...

    2023

  35. [43]

    Context and geometry aware voxel transformer for semantic scene completion

    Zhu Yu, Runmin Zhang, Jiacheng Ying, Junchen Yu, Xiaohai Hu, Lun Luo, Si-Yuan Cao, and Hui-liang Shen. Context and geometry aware voxel transformer for semantic scene completion. InAdvances in Neural Information Processing Systems, pages 1531–1555, 2024. 1, 2, 6, 7

    2024

  36. [44]

    Monodetr: Depth- guided transformer for monocular 3d object detection

    Renrui Zhang, Han Qiu, Tai Wang, Ziyu Guo, Ziteng Cui, Yu Qiao, Hongsheng Li, and Peng Gao. Monodetr: Depth- guided transformer for monocular 3d object detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9155–9166, 2023. 2

    2023

  37. [45]

    Objects are differ- ent: Flexible monocular 3d object detection

    Yunpeng Zhang, Jiwen Lu, and Jie Zhou. Objects are differ- ent: Flexible monocular 3d object detection. InProceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition, pages 3289–3298, 2021. 2

    2021

  38. [46]

    Occformer: Dual-path transformer for vision-based 3d semantic occu- pancy prediction

    Yunpeng Zhang, Zheng Zhu, and Dalong Du. Occformer: Dual-path transformer for vision-based 3d semantic occu- pancy prediction. InProceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 9433–9443,

  39. [47]

    Monoocc: Digging into monocular semantic occu- pancy prediction

    Yupeng Zheng, Xiang Li, Pengfei Li, Yuhang Zheng, Bu Jin, Chengliang Zhong, Xiaoxiao Long, Hao Zhao, and Qichao Zhang. Monoocc: Digging into monocular semantic occu- pancy prediction. In2024 IEEE International Conference on Robotics and Automation (ICRA), pages 18398–18405. IE...

    2024

  40. [48]

    Ob- jects as points.arXiv preprint arXiv:1904.07850, 2019

    Xingyi Zhou, Dequan Wang, and Philipp Kr ¨ahenb¨uhl. Ob- jects as points.arXiv preprint arXiv:1904.07850, 2019. 2

    1904 arXiv

  41. [49]

    Deformable detr: Deformable trans- formers for end-to-end object detection.arXiv preprint arXiv:2010.04159, 2020

    Xizhou Zhu, Weijie Su, Lewei Lu, Bin Li, Xiaogang Wang, and Jifeng Dai. Deformable detr: Deformable trans- formers for end-to-end object detection.arXiv preprint arXiv:2010.04159, 2020. 3, 5

    2010 arXiv

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.