Pith. sign in

REVIEW 4 major objections 4 minor 89 references

UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulation

T0 review · 4 major / 4 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read UrbanCAD builds a photorealistic, part-controllable 3D vehicle from a single urban image by retrieving a handcrafted CAD model and optimizing only its material albedo, and shows that the result can populate driving simulators with rare…

desk verdict UrbanCAD is a well-built system that advances the photorealism-controllability trade-off for single-image vehicle assets, but the 'digital twin' claim outruns the evidence, and the headline metrics are distribution-level rather than per-instance. read the letter →

arxiv 2411.19292 v2 pith:BINWSBSD submitted 2024-11-28 cs.CV

Yichong Lu , Yichi Cai , Shangzhan Zhang , Hongyu Zhou , Haoji Hu , Huimin Yu , Andreas Geiger , Yiyi Liao This is my paper · ORCID
classification cs.CV
keywords 3DvehiclereconstructionCADretrievalmaterialoptimizationdrivingsimulationphotorealisticrenderingout-of-distributionscenariosproceduralmaterialsurbanscene
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

UrbanCAD proposes a way to build a photorealistic, part-controllable 3D digital twin of a vehicle from a single urban photograph. Instead of reconstructing geometry from pixels, it retrieves the most similar handcrafted CAD model from a large free library and then optimizes only the appearance of its metal and rubber parts to match the photo, keeping the artist-designed geometry, glass, and roughness fixed. The claimed payoff is that the result is as editable as a game-engine asset while rendering convincingly from all 360 degrees, so it can be inserted into reconstructed street scenes and used to synthesize rare safety-critical situations like opened doors. The paper argues this closes the usual trade-off between photorealism and controllability in driving simulation, and demonstrates the point by showing that perception models keep accuracy on in-distribution renderings but degrade on the out-of-distribution scenarios the method can produce.

What carries the argument

The central mechanism is a retrieval-optimization loop that treats geometry, material structure, and lighting as fixed expert priors and only tunes a small set of appearance parameters. Retrieval uses a joint image–3D encoder to find the CAD model most semantically similar to the segmented vehicle image; part-aware material assignment uses ControlNet to turn material-index renderings into realistic images that Grounded SAM can segment by component name; and material optimization converts procedural node graphs into albedo, normal, and roughness textures, then minimizes a masked statistical loss, a Gram-matrix VGG loss, and an RGB loss against the reference view. For scene insertion, fisheye images are stitched into panoramas, the sky is converted to HDR, and the nearest environment map is chosen for spatially varying lighting before compositing the vehicle over a 3DGS background.

What would settle it

Render an UrbanCAD twin from the viewpoint opposite the input photo and compare its silhouette and visible components (wheel arches, mirrors, window shape) against a LiDAR scan or dense multi-view capture of the same real vehicle instance; if the unseen-side geometry is visibly wrong or the silhouette IoU is low, the retrieval assumption fails. A targeted test is a rare vehicle type like a heavy-duty truck, which the paper's own failure cases indicate can already produce unsatisfactory matches.

Watch

Extended reading notes

Core claim

The central discovery, on the paper's own terms, is that a retrieval-optimization paradigm can preserve the fine-grained priors of handcrafted CAD models while still adapting to real observations. Given a segmented input vehicle, the method first retrieves a CAD model using a cross-modal encoder that aligns images and 3D shapes in a shared latent space, then matches its pose by DINO feature similarity. It assigns artist-made procedural materials to each part by recognizing semantic components with a vision-language segmentation model on ControlNet-augmented renderings, and finally optimizes only the albedo of metal and rubber material graphs through physically based differentiable rendering, leaving glass and roughness as fixed priors. The resulting models support 360-degree rendering, component editing, material transfer, and relighting, and can be inserted into 3D Gaussian Splatting backgrounds using fisheye-derived HDR environment maps.

Load-bearing premise

The load-bearing premise is that the free CAD library already contains a model whose geometry and part layout are close enough to the observed vehicle that recoloring only the metal and rubber parts makes it look like the real vehicle from every angle, including the occluded sides never visible in the single input photo.

Editorial extensions

If this is right

  • Driving simulators could populate scenes with realistic, editable vehicles derived from ordinary street photos rather than manual modeling.
  • Rare safety-critical configurations such as open doors, collisions, or inverted vehicles become renderable assets that can be animated in a physics engine.
  • Perception models can be stress-tested on out-of-distribution data generated by the same pipeline that produces in-distribution data, exposing accuracy drops.
  • Because retrieval preserves part-disentangled geometry, material and component edits transfer directly between vehicles.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The method's ceiling is set by library coverage: a vehicle type absent from the CAD collection will fall back to a poor retrieval, so extending the library with generated or procedurally varied CAD bodies is the most direct path to broader applicability.
  • The geometry-mismatch limitation is acknowledged by the authors; a natural follow-up is to add lightweight per-part deformation or scaling to the retrieved model so that silhouette and wheelbase match the observed vehicle before appearance optimization.
  • The spatially varying lighting approximation (nearest fisheye environment map) will degrade for vehicles far from the capture rig; estimating a continuous lighting field from the fisheye sequence is a testable extension.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 4 minor

Summary. UrbanCAD proposes a retrieval-optimization pipeline for creating controllable, photorealistic 3D vehicle assets from a single urban image. Given one segmented vehicle image, the method retrieves a semantically similar CAD model from Objaverse using CLIP/OpenShape features, assigns part-aware material priors from Adobe's procedural material library by recognizing CAD part semantics with ControlNet and Grounded SAM, and then optimizes the albedo of metal and rubber materials via differentiable rendering. The resulting vehicle can be rendered in 360 degrees, edited at the part level, relit, transferred to other materials, and inserted into reconstructed urban backgrounds using fisheye-based HDR lighting estimation and 3D Gaussian Splatting. The paper evaluates photorealism with FID/KID/LPIPS against reconstruction and texturing baselines, and assesses downstream perception performance on in-distribution and out-of-distribution (door-opening) scenarios.

Significance. If the claims hold, UrbanCAD would be a practical and scalable alternative to both handcrafted simulator assets and neural reconstruction: it preserves part-level controllability while producing renderings that are competitive with or better than state-of-the-art single-view reconstruction and texturing baselines. The paper is honest about several limitations, including geometric mismatch and failure cases, and it provides a fairly complete system description with ablations, lighting estimation comparisons, and downstream perception experiments. The main gap is that the headline 'digital twin' and photorealism claims are supported by distribution-level metrics and by matched-pose LPIPS, rather than by per-instance geometric or novel-view fidelity on the actual vehicles used in the experiments. The system is nonetheless a meaningful step toward controllable urban simulation assets, provided the evidence is strengthened.

major comments (4)
  1. [§5.2, Table 1 and §8.1] The headline photorealism comparison rests on FID and KID computed between 360-degree renderings of 30 retrieved CAD models and 1800 real car images from [67]. These are distribution-level metrics: they do not measure whether the rendered model matches the specific input vehicle, and they are reported without error bars, confidence intervals, or significance tests. The accompanying observation that Paint3D performs better on KID shows that the ranking is not uniform across metrics, so the claim that UrbanCAD 'outperforms baselines in terms of photorealism' needs per-instance evidence or at least repeated-seed and statistical validation.
  2. [§6, §10.3, Table 6] The paper explicitly concedes in Section 6 that 'the geometries of our created CAD models are not the same as the vehicles in the input image,' and Section 10.3 lists defective or rare models as failure cases. Yet the central 'digital twin' claim and the out-of-distribution conclusion require unseen-side geometric fidelity. Table 6 reports Chamfer distance and volume IoU on a ShapeNet-to-Objaverse retrieval task, not on the KITTI-360 or MVMC vehicles used in the main experiments, so it does not validate the actual digital twins produced in the paper. A per-instance geometry evaluation on the evaluated datasets (for example, against LiDAR scans or multi-view masks where available) is needed to justify the 'digital twin' terminology and the safety-critical OOD claims.
  3. [§3.3 and supplementary §7.5] Material optimization is deliberately restricted: only the albedo of metal and rubber materials is optimized, glass is assigned without optimization, and roughness is fixed. This is a reasonable engineering choice given the single-view setting, but the LPIPS number in Table 1 is computed only under the matched input pose, so it cannot verify that the optimized materials are correct on unseen sides. The claim of 'photorealistic 360-degree rendering' is therefore not fully supported by the optimization objective, which operates on mean/variance, Gram-matrix, and masked RGB losses rather than pixel-aligned appearance.
  4. [§5.3, Table 3] The out-of-distribution conclusion is based on 150 frames of five door-opening/closing scenarios and compares against the same vehicles with closed doors. Without a real-world OOD set (for example, actual images of vehicles with open doors) or an alternative synthetic OOD generator, the performance drop in Table 3 does not establish that the drop is caused by the realism of UrbanCAD's OOD data; it may be induced by any novel object configuration. I recommend adding a control experiment or tempering the claim to 'on our generated OOD data.'
minor comments (4)
  1. [§4.2] The heading 'Background Reconstruction and Compostion' contains a typo; it should read 'Composition.'
  2. [supplementary §8.1] The text says 'we report the LIPIS scores'; this should be 'LPIPS scores.'
  3. [supplementary §7.3 and §7.5] The material-index IOU threshold (0.5) and the loss weights in Eq. (9) are free parameters, but no sensitivity analysis is provided for either; a brief ablation or discussion would strengthen confidence in the method's robustness.
  4. [supplementary §10.4, Table 6] The geometry-quality comparison reports Chamfer distance and volume IoU without specifying the alignment procedure, units, or normalization used for the ShapeNet-to-Objaverse retrieval, which makes the numbers difficult to interpret or reproduce.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the central pipeline is a retrieval-plus-fitting system whose photorealism and OOD claims are checked against external data, not against its own optimization targets.

full rationale

UrbanCAD's derivation chain is a retrieval-plus-fitting pipeline: semantic CAD retrieval (Sec. 3.1), part-aware material prior retrieval (Sec. 3.2), albedo optimization against the input view (Sec. 3.3), fisheye lighting estimation (Sec. 4.1), and 3DGS background reconstruction (Sec. 4.2). The photorealism claims are not defined by the optimization targets: FID/KID in Table 1 compare 360-degree renderings of 30 models to 1800 images from the external CompCars dataset [67], and the OOD door-opening evaluation (Table 3) uses a geometric edit not present in the input view. The LPIPS numbers under matched poses are fitting diagnostics rather than predictions and are not used to support novel-view conclusions. The paper's self-citations (KITTI-360 [34], HUGS [82], and the pose-matching reference [11]) are external benchmarks or implementation tools, not the sole justification of the central claim. The Section 6 concession that retrieved geometry differs from the input vehicle weakens the 'digital twin' wording, but that is an overclaim or validation gap, not circularity. No equation is defined in terms of its target, no fitted parameter is renamed as a prediction, and no load-bearing claim reduces to a self-citation chain.

Assumptions & free parameters 3 free parameters · 6 assumptions · 0 invented entities

The central result does not introduce new physical entities. Its dependencies are mostly pre-trained neural models, a CAD repository, a procedural material library, and several hand-set hyperparameters. The most consequential premises are the validity of the FID/KID measurement and the assumption that a semantically retrieved CAD model is close enough to the target vehicle for material-only optimization to produce a convincing digital twin.

free parameters (3)
  • material optimization loss weights = lambda_stat=0.1, lambda_vgg=1, lambda_rgb=1
    Chosen by hand in Eq. 9 of the supplementary; no ablation or sensitivity analysis is reported.
  • material-index IOU threshold = 0.5
    Used to classify active materials into semantic components in Section 7.3; set by hand with no sensitivity analysis.
  • car body material prior (painted vs unpainted) = user-selected via UI
    Section 7.5 recommends user selection of the car body material prior, introducing a manual choice that affects output photorealism.
assumptions (6)
  • domain assumption CLIP and OpenShape encoders map 2D images and 3D CAD models into a shared space where cosine similarity reflects semantic and geometric similarity.
    Section 3.1 relies on OpenShape for retrieval; no independent retrieval accuracy evaluation on the test set is reported beyond qualitative examples.
  • domain assumption Canny-based ControlNet augmentation preserves component positions so Grounded SAM can reliably label material zones.
    Section 3.2 and Section 7.3 use ControlNet-augmented renderings for part recognition; recognition quality is demonstrated only on selected examples.
  • standard math The differentiable microfacet BRDF renderer and DiffMat material graph conversion produce material parameters that can be optimized and rendered faithfully.
    Section 3.3 relies on DiffMat v2 and InvRenderNet; assumed correct for albedo, roughness, and normal rendering.
  • domain assumption LDR-to-HDR fisheye panorama conversion and environment map selection provide lighting accurate enough for photorealistic insertion.
    Section 4.1; the paper itself reports artifacts in shadow regions and inaccuracy far from fisheye cameras in Sections 6 and 10.1.
  • domain assumption FID and KID between 360-degree renderings and a real-car dataset (CompCars) form a valid measure of per-vehicle photorealism.
    Section 5.2 uses FID and KID as the headline photorealism metric; these are distribution-level metrics that may not reflect fidelity of individual digital twins.
  • domain assumption Perception model performance drop on UrbanCAD door-opening data is attributable to the out-of-distribution configuration rather than a general synthetic-rendering domain gap.
    Section 5.3 and Table 3; reference images with closed doors provide the control, but no real OOD ground truth or statistical testing is given.

how reviews work

0 comments
Cite this review

Pith. "Pith review of UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulation." pith.science (2026). https://pith.science/paper/BINWSBSD

@misc{pith2026241119292,
  author       = {Pith},
  title        = {Pith review of: UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/BINWSBSD}},
  note         = {Machine review of arXiv:2411.19292}
}
read the original abstract

Photorealistic 3D vehicle models with high controllability are essential for autonomous driving simulation and data augmentation. While handcrafted CAD models provide flexible controllability, free CAD libraries often lack the high-quality materials necessary for photorealistic rendering. Conversely, reconstructed 3D models offer high-fidelity rendering but lack controllability. In this work, we introduce UrbanCAD, a framework that generates highly controllable and photorealistic 3D vehicle digital twins from a single urban image, leveraging a large collection of free 3D CAD models and handcrafted materials. To achieve this, we propose a novel pipeline that follows a retrieval-optimization manner, adapting to observational data while preserving fine-grained expert-designed priors for both geometry and material. This enables vehicles' realistic 360-degree rendering, background insertion, material transfer, relighting, and component manipulation. Furthermore, given multi-view background perspective and fisheye images, we approximate environment lighting using fisheye images and reconstruct the background with 3DGS, enabling the photorealistic insertion of optimized CAD models into rendered novel view backgrounds. Experimental results demonstrate that UrbanCAD outperforms baselines in terms of photorealism. Additionally, we show that various perception models maintain their accuracy when evaluated on UrbanCAD with in-distribution configurations but degrade when applied to realistic out-of-distribution data generated by our method. This suggests that UrbanCAD is a significant advancement in creating photorealistic, safety-critical driving scenarios for downstream applications.

Figures

Figures reproduced from arXiv: 2411.19292 by the authors.

Figure 1
Figure 1. UrbanCAD automatically builds photorealistic and highly controllable digital twins from a single urban image and a large collection of 3D CAD models and handcrafted materials, supporting various editing operations (top). The produced CAD models can be photorealistically inserted into various background scenes and rendered in novel views, synthesizing challenging out-of-distribution (OOD) scenarios with high fidelity… view at source ↗
Figure 2
Figure 2. Overview of UrbanCAD. Given a single view input image, we first perform CAD model retrieval and retrieval-based material optimization to create photorealistic and highly controllable vehicle digital twins (left). Given multi-view background images, we then perform realistic vehicle insertion to create various synthetic data for self-driving system testing (right). serve as effective material priors. Consequently, we… view at source ↗
Figure 3
Figure 3. Window recognition results on colored material design, retrieved CAD rendering, and augmented data by ControlNet [78]. microfacet BRDF [27] model. To obtain the per-pixel mate￾rial parameters A, N, and R, we use the UV sampling func￾tion Sample to sample the material textures Auv, Nuv, and Ruv from the per-pixel texture (UV) coordinates UV of the UV map rendered in the matched pose (see supple￾mentary Section 7.2). … view at source ↗
Figures from the paper (18 more)
Figure 4
Figure 4. Figure 4: Qualitative results on KITTI-360 for novel view synthesis from reference (Ref.) and rotated (rot.) viewpoints. UrbanCAD produces more robust and realistic results at the novel viewpoint compared to the baselines. Please refer to the supplementary Section 7.7 for detail…
Figure 5
Figure 5. Figure 5: More pairs of 3D vehicles after CAD model retrieval and material optimization (right) alongside the input single-view segmented vehicles (left). UrbanCAD produces photorealistic 3D vehicles with different categories given single-view inputs. CAD model renderings under …
Figure 7
Figure 7. Figure 7: More qualitative results on KITTI-360 for novel view synthesis from reference (Ref.) and rotated (rot.) viewpoints [PITH_FULL_IMAGE:figures/full_fig_p014_7.png]
Figure 8
Figure 8. Figure 8: Pose matching results. It shows that the pose of retrieved [PITH_FULL_IMAGE:figures/full_fig_p014_8.png]
Figure 9
Figure 9. Figure 9: Symmetric material design. Different colors represent different material indexes. rial assignment results on tiny components of CAD models. 7.5. Material Optimization Since there is no exact correspondence between rendered and reference pixels, we use a part-level loss…
Figure 10
Figure 10. Figure 10: Illustration of Semantic-based Part-aware Material Prior Retrieval Module. To accurately recognize the semantic meaning of [PITH_FULL_IMAGE:figures/full_fig_p015_10.png]
Figure 11
Figure 11. Figure 11: Disentangled geometry of handcrafted CAD model. Different colors represent different disentangled geometry. we crop the upper part of the panorama representing the skydome and feed it into the ChatSim [64] LDR to HDR prediction network. After obtaining the HDR panoram…
Figure 12
Figure 12. Figure 12 [PITH_FULL_IMAGE:figures/full_fig_p015_12.png]
Figure 13
Figure 13. Figure 13: Two types of car body materials with different rough [PITH_FULL_IMAGE:figures/full_fig_p016_13.png]
Figure 14
Figure 14. Figure 14: LDR to HDR reconstruction pipeline. The upper half obtains the HDR panorama from the LDR input. The other half stitches [PITH_FULL_IMAGE:figures/full_fig_p017_14.png]
Figure 15
Figure 15. Figure 15: Illustration of our synthetic data during self-driving system testing. [PITH_FULL_IMAGE:figures/full_fig_p018_15.png]
Figure 17
Figure 17. Figure 17: Realistic Insertion. (a) Target material (b) Source model (c) Material transferred model [PITH_FULL_IMAGE:figures/full_fig_p018_17.png]
Figure 16
Figure 16. Figure 16: More corner cases. 9.2. Relighting Realistic insertion results are shown in [PITH_FULL_IMAGE:figures/full_fig_p018_16.png]
Figure 18
Figure 18. Figure 18: Material Transfer. 6 [PITH_FULL_IMAGE:figures/full_fig_p018_18.png]
Figure 19
Figure 19. Figure 19: Novel View Synthesis 9.4. Novel view rendering We showcase our novel view rendering results after recon￾structing the background using the implicit function and in￾serting our produced vehicle model, as shown in [PITH_FULL_IMAGE:figures/full_fig_p019_19.png]
Figure 20
Figure 20. Figure 20: Quality results on self-driving perception system. [PITH_FULL_IMAGE:figures/full_fig_p019_20.png]
Figure 21
Figure 21. Figure 21: Failure Cases sun. However, our method may have limitations in estimat￾ing the lighting for objects in the shadow. This is due to the presence of overexposed areas in the fisheye camera’s cap￾tured image. When these overexposed areas are combined into a panorama, they…
Figure 22
Figure 22. Figure 22: Lighting estimation comparison between ours, DiffusionLight [ [PITH_FULL_IMAGE:figures/full_fig_p020_22.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

89 extracted references · 56 canonical work pages

  1. [67]

    Havs.an, Thibault Groueix, Valentin Deschaintre, and Shuang Zhao

    Kai Yan, Fujun Luan, Milovs. Havs.an, Thibault Groueix, Valentin Deschaintre, and Shuang Zhao. Psdr-room: Single photo to scene using differentiable rendering. SIGGRAPH Asia 2023 Conference Papers, 2023. 3, 4

    work page 2023

  2. [1]

    https://stock.adobe.com/3d-assets

    Adobe stock. https://stock.adobe.com/3d-assets. 2, 3, 6

  3. [2]

    https://www.blender.org/

    Blender. https://www.blender.org/. 5

  4. [3]

    Gpt-4 technical report

    OpenAI Josh Achiam, Steven Adler, Sandhini Agarwal, and etc. Gpt-4 technical report. 2023. 4

    2023

  5. [4]

    Deep vit features as dense visual descriptors

    Shirzad Amir, Yossi Gandelsman, Shai Bagon, and Tali Dekel. Deep vit features as dense visual descriptors. ArXiv, abs/2112.05814, 2021. 1

    arXiv 2021

  6. [5]

    Chang, and Matthias Nießner

    Armen Avetisyan, Manuel Dahnert, Angela Dai, Manolis Savva, Angel X. Chang, and Matthias Nießner. Scan2cad: Learning cad model alignment in rgb-d scans. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 2609–2618, 2018. 3

    2019

  7. [6]

    Demystifying mmd gans

    Mikołaj Bi ´nkowski, Danica J Sutherland, Michael Arbel, and Arthur Gretton. Demystifying mmd gans. arXiv preprint arXiv:1801.01401, 2018. 6

    arXiv 2018

  8. [7]

    Mesh2tex: Generating mesh textures from image queries

    Alexey Bokhovkin, Shubham Tulsiani, and Angela Dai. Mesh2tex: Generating mesh textures from image queries. 2023 IEEE/CVF International Conference on Computer Vi- sion (ICCV), pages 8884–8894, 2023. 3

    2023

Show all 89 references
  1. [8]

    Yolact: Real-time instance segmentation

    Daniel Bolya, Chong Zhou, Fanyi Xiao, and Yong Jae Lee. Yolact: Real-time instance segmentation. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pages 9156–9165, 2019. 7

    2019

  2. [9]

    Inverseform: A loss function for structured boundary-aware segmentation

    Shubhankar Borse, Ying Wang, Yizhe Zhang, and Fatih Porikli. Inverseform: A loss function for structured boundary-aware segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5901–5911, 2021. 4

    2021

  3. [10]

    Chang, Thomas A

    Angel X. Chang, Thomas A. Funkhouser, Leonidas J. Guibas, Pat Hanrahan, Qi-Xing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, Jianxiong Xiao, L. Yi, and Fisher Yu. Shapenet: An information-rich 3d model repository. ArXiv, abs/1512.03012, 2015. 4

    2015 arXiv

  4. [11]

    Learn- ing 3d-aware gans from unposed images with template fea- ture field

    Xinya Chen, Hanlei Guo, Yanrui Bin, Shangzhan Zhang, Yuanbo Yang, Yue Wang, Yujun Shen, and Yiyi Liao. Learn- ing 3d-aware gans from unposed images with template fea- ture field. ArXiv, abs/2404.05705, 2024. 1

    2024 arXiv

  5. [12]

    Schwing, Alexan- der Kirillov, and Rohit Girdhar

    Bowen Cheng, Ishan Misra, Alexander G. Schwing, Alexan- der Kirillov, and Rohit Girdhar. Masked-attention mask transformer for universal image segmentation. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 1280–1289, 2021. 7

    2022

  6. [13]

    The cityscapes dataset for semantic urban scene understanding

    Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. The cityscapes dataset for semantic urban scene understanding. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), p...

    2016

  7. [14]

    Wong, Yunfan Jiang, Chen Wang, Cem Gokmen, Ruohan Zhang, Jiajun Wu, and Fei-Fei Li

    Tianyuan Dai, J. Wong, Yunfan Jiang, Chen Wang, Cem Gokmen, Ruohan Zhang, Jiajun Wu, and Fei-Fei Li. Acdc: Automated creation of digital cousins for robust policy learn- ing. 2024. 3, 1

    2024

  8. [15]

    Objaverse: A universe of annotated 3d objects

    Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi. Objaverse: A universe of annotated 3d objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Rec...

    2023

  9. [16]

    Carla: An open urban driv- ing simulator

    Alexey Dosovitskiy, German Ros, Felipe Codevilla, Anto- nio Lopez, and Vladlen Koltun. Carla: An open urban driv- ing simulator. In Conference on robot learning, pages 1–16. PMLR, 2017. 2, 3

    2017

  10. [17]

    St ¨uckler, and B

    Francis Engelmann, J. St ¨uckler, and B. Leibe. Samp: Shape and motion priors for 4d vehicle reconstruction. 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), pages 400–408, 2017. 3

    2017

  11. [18]

    Virtual worlds as proxy for multi-object tracking anal- ysis

    Adrien Gaidon, Qiao Wang, Yohann Cabon, and Eleonora Vig. Virtual worlds as proxy for multi-object tracking anal- ysis. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 4340–4349, 2016. 3

    2016

  12. [19]

    Diffcad: Weakly-supervised probabilistic cad model retrieval and alignment from an rgb image

    Daoyi Gao, D ´avid Rozenberszki, Stefan Leutenegger, and Angela Dai. Diffcad: Weakly-supervised probabilistic cad model retrieval and alignment from an rgb image. ArXiv, abs/2311.18610, 2023. 3

    2023 arXiv

  13. [20]

    Gatys, Alexander S

    Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. Image style transfer using convolutional neural networks. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2414–2423, 2016. 5, 2

    2016

  14. [21]

    Roca: Ro- bust cad model retrieval and alignment from a single image

    Can G ¨umeli, Angela Dai, and Matthias Nießner. Roca: Ro- bust cad model retrieval and alignment from a single image. 2022 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 4012–4021, 2021. 3

    2022

  15. [22]

    Streetsurf: Extending multi-view implicit surface reconstruction to street views

    Jianfei Guo, Nianchen Deng, Xinyang Li, Yeqi Bai, Bo- tian Shi, Chiyu Wang, Chenjing Ding, Dongliang Wang, and Yikang Li. Streetsurf: Extending multi-view implicit surface reconstruction to street views. ArXiv, abs/2306.04988, 2023. 3

    2023 arXiv

  16. [23]

    Zhang, Shaoqing Ren, and Jian Sun

    Kaiming He, X. Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. 2016 IEEE Confer- ence on Computer Vision and Pattern Recognition (CVPR) , pages 770–778, 2015. 8

    2016

  17. [24]

    Openlrm: Open-source large reconstruction models

    Zexin He and Tengfei Wang. Openlrm: Open-source large reconstruction models. https://github.com/3DTopia/ OpenLRM, 2023. 4

    2023

  18. [25]

    Gans trained by a two time-scale update rule converge to a local nash equilib- rium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilib- rium. Advances in neural information processing systems , 30, 2017. 6

    2017

  19. [26]

    Lrm: Large reconstruction model for single image to 3d

    Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. Lrm: Large reconstruction model for single image to 3d. arXiv preprint arXiv:2311.04400, 2023. 2, 6, 4

    2023 arXiv

  20. [27]

    Real shading in unreal engine

    Brian Karis and Epic Games. Real shading in unreal engine

  21. [28]

    Physically Based Shading Theory Practice, 4(3):1,

    Proc. Physically Based Shading Theory Practice, 4(3):1,

  22. [29]

    Girshick, Carsten Rother, and Piotr Doll ´ar

    Alexander Kirillov, Kaiming He, Ross B. Girshick, Carsten Rother, and Piotr Doll ´ar. Panoptic segmentation. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 9396–9405, 2018. 6

    2019

  23. [30]

    Berg, Wan-Yen Lo, Piotr Doll ´ar, and 9 Ross B

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer White- head, Alexander C. Berg, Wan-Yen Lo, Piotr Doll ´ar, and 9 Ross B. Girshick. Segment anything. 2023 IEEE/CVF In- ternational Conference on Computer Vision (ICCV)...

    2023

  24. [31]

    Guibas, Andrea Tagliasacchi, Frank Dellaert, and Thomas A

    Abhijit Kundu, Kyle Genova, Xiaoqi Yin, Alireza Fathi, Car- oline Pantofaru, Leonidas J. Guibas, Andrea Tagliasacchi, Frank Dellaert, and Thomas A. Funkhouser. Panoptic neural fields: A semantic object-aware neural scene representation. 2022 IEEE/CVF Conference on Computer Vis...

    2022

  25. [32]

    Patch2cad: Patchwise embedding learning for in-the- wild shape retrieval from a single image

    Weicheng Kuo, Anelia Angelova, Tsung-Yi Lin, and Angela Dai. Patch2cad: Patchwise embedding learning for in-the- wild shape retrieval from a single image. 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 12569–12579, 2021. 3

    2021

  26. [33]

    End-to-end procedural material capture with proxy-free mixed-integer optimization

    Beichen Li, Liang Shi, and Wojciech Matusik. End-to-end procedural material capture with proxy-free mixed-integer optimization. ACM Transactions on Graphics (TOG) , 42: 1 – 15, 2023. 4

    2023

  27. [34]

    Inverse ren- dering for complex indoor scenes: Shape, spatially-varying lighting and svbrdf from a single image

    Zhengqin Li, Mohammad Shafiei, Ravi Ramamoorthi, Kalyan Sunkavalli, and Manmohan Chandraker. Inverse ren- dering for complex indoor scenes: Shape, spatially-varying lighting and svbrdf from a single image. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CV...

    2020

  28. [35]

    Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d

    Yiyi Liao, Jun Xie, and Andreas Geiger. Kitti-360: A novel dataset and benchmarks for urban scene understanding in 2d and 3d. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(3):3292–3310, 2022. 5, 6

    2022

  29. [36]

    Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll ´ar, and C

    Tsung-Yi Lin, Michael Maire, Serge J. Belongie, James Hays, Pietro Perona, Deva Ramanan, Piotr Doll ´ar, and C. Lawrence Zitnick. Microsoft coco: Common objects in context. In European Conference on Computer Vision, 2014. 5

    2014

  30. [37]

    Forsyth, Jia- Bin Huang, Anand Bhattad, and Shenlong Wang

    Zhi Lin, Bohan Liu, Yi-Ting Chen, David A. Forsyth, Jia- Bin Huang, Anand Bhattad, and Shenlong Wang. Urbanir: Large-scale urban scene inverse rendering from a single video. ArXiv, abs/2306.09349, 2023. 3

    2023 arXiv

  31. [38]

    Are nerfs ready for autonomous driving? towards closing the real-to-simulation gap

    Carl Lindstrom, Georg Hess, Adam Lilja, Maryam Fatemi, Lars Hammarstrand, Christoffer Petersson, and Lennart Svensson. Are nerfs ready for autonomous driving? towards closing the real-to-simulation gap. ArXiv, abs/2403.16092,

    arXiv

  32. [39]

    Real-time neural rasterization for large scenes

    Jeffrey Yunfan Liu, Yun Chen, Ze Yang, Jingkang Wang, Sivabalan Manivasagam, and Raquel Urtasun. Real-time neural rasterization for large scenes. 2023 IEEE/CVF In- ternational Conference on Computer Vision (ICCV) , pages 8382–8393, 2023. 3

    2023

  33. [40]

    Openshape: Scaling up 3d shape representation towards open-world understanding

    Minghua Liu, Ruoxi Shi, Kaiming Kuang, Yinhao Zhu, Xu- anlin Li, Shizhong Han, Hong Cai, Fatih Porikli, and Hao Su. Openshape: Scaling up 3d shape representation towards open-world understanding. Advances in Neural Information Processing Systems, 36, 2024. 3, 4

    2024

  34. [41]

    Swin transformer: Hierarchical vision transformer using shifted windows.2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 9992–10002, 2021

    Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows.2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 9992–10002, 2021. 8

    2021

  35. [42]

    Neuroncap: Photorealistic closed- loop safety testing for autonomous driving

    William Ljungbergh, Adam Tonderski, Joakim Johnan- der, Holger Caesar, Kalle ˚Astr¨om, Michael Felsberg, and Christoffer Petersson. Neuroncap: Photorealistic closed- loop safety testing for autonomous driving. ArXiv, abs/2404.07762, 2024. 3

    2024 arXiv

  36. [43]

    Wonder3d: Single image to 3d using cross-domain diffusion

    Xiaoxiao Long, Yuanchen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, and Wenping Wang. Wonder3d: Single image to 3d using cross-domain diffusion. ArXiv, abs/2310.15008, 2023. 2, 6, 4

    arXiv

  37. [44]

    Urban radiance field representa- tion with deformable neural mesh primitives

    Fan Lu, Yan Xu, Guang Chen, Hongsheng Li, Kwan-Yee Lin, and Changjun Jiang. Urban radiance field representa- tion with deformable neural mesh primitives. InProceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 465–476, 2023. 3

    2023

  38. [45]

    Nerf in the wild: Neural radiance fields for uncon- strained photo collections

    Ricardo Martin-Brualla, Noha Radwan, Mehdi SM Sajjadi, Jonathan T Barron, Alexey Dosovitskiy, and Daniel Duck- worth. Nerf in the wild: Neural radiance fields for uncon- strained photo collections. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogn...

    2021

  39. [46]

    Latent-nerf for shape-guided gener- ation of 3d shapes and textures

    Gal Metzer, Elad Richardson, Or Patashnik, Raja Giryes, and Daniel Cohen-Or. Latent-nerf for shape-guided gener- ation of 3d shapes and textures. 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 12663–12673, 2022. 3, 6, 2, 4

    2023

  40. [47]

    Autorf: Learning 3d object radiance fields from single view observations

    Norman M ¨uller, Andrea Simonelli, Lorenzo Porzi, Samuel Rota Bul `o, Matthias Nießner, and Peter Kontschieder. Autorf: Learning 3d object radiance fields from single view observations. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 3961–3970...

    2022

  41. [48]

    Diffusionlight: Light probes for free by painting a chrome ball

    Pakkapon Phongthawee, Worameth Chinchuthakun, Non- taphat Sinsunthithet, Amit Raj, Varun Jampani, Pramook Khungurn, and Supasorn Suwajanakorn. Diffusionlight: Light probes for free by painting a chrome ball. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (...

    2024

  42. [49]

    Lightsim: Neural lighting simulation for urban scenes

    Ava Pun, Gary Sun, Jingkang Wang, Yun Chen, Ze Yang, Sivabalan Manivasagam, Wei-Chiu Ma, and Raquel Urta- sun. Lightsim: Neural lighting simulation for urban scenes. ArXiv, abs/2312.06654, 2023. 3, 5

    2023 arXiv

  43. [50]

    Hierarchical text-conditional image gener- ation with clip latents

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image gener- ation with clip latents. ArXiv, abs/2204.06125, 2022. 3

    2022 arXiv

  44. [51]

    Real-time flying object detection with yolov8

    Dillon Reis, Jordan Kupec, Jacqueline Hong, and Ahmad Daoudi. Real-time flying object detection with yolov8. ArXiv, abs/2305.09972, 2023. 7

    2023 arXiv

  45. [52]

    Urban radiance fields

    Konstantinos Rematas, Andrew Liu, Pratul P Srini- vasan, Jonathan T Barron, Andrea Tagliasacchi, Thomas Funkhouser, and Vittorio Ferrari. Urban radiance fields. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 12932–12942, 2022. 2, 3

    2022

  46. [53]

    Grounded sam: Assembling open-world models for diverse visual tasks

    Tianhe Ren, Shilong Liu, Ailing Zeng, Jing Lin, Kun- chang Li, He Cao, Jiayu Chen, Xinyu Huang, Yukang Chen, Feng Yan, Zhaoyang Zeng, Hao Zhang, Feng Li, Jie Yang, 10 Hongyang Li, Qing Jiang, and Lei Zhang. Grounded sam: Assembling open-world models for diverse visual tasks. A...

    2024 arXiv

  47. [54]

    Adv3d: Generat- ing safety-critical 3d objects through closed-loop simulation

    Jay Sarva, Jingkang Wang, James Tu, Yuwen Xiong, Siva- balan Manivasagam, and Raquel Urtasun. Adv3d: Generat- ing safety-critical 3d objects through closed-loop simulation. In Conference on Robot Learning, 2023. 3

    2023

  48. [55]

    Airsim: High-fidelity visual and physical simulation for autonomous vehicles

    Shital Shah, Debadeepta Dey, Chris Lovett, and Ashish Kapoor. Airsim: High-fidelity visual and physical simulation for autonomous vehicles. In Field and Service Robotics: Re- sults of the 11th International Conference , pages 621–635. Springer, 2018. 3

    2018

  49. [56]

    Match: Differentiable material graphs for procedural mate- rial capture

    Liang Shi, Beichen Li, Milo ˇs Ha ˇsan, Kalyan Sunkavalli, Tamy Boubekeur, Radomir Mech, and Wojciech Matusik. Match: Differentiable material graphs for procedural mate- rial capture. ACM Transactions on Graphics (TOG), 39(6): 1–15, 2020. 2, 4

    2020

  50. [57]

    Recent advances in im- plicit representation-based 3d shape generation

    Jiali Sun, Tong Wu, and Lin Gao. Recent advances in im- plicit representation-based 3d shape generation. Visual Intel- ligence, 2:1–13, 2024. 2

    2024

  51. [58]

    Block-nerf: Scalable large scene neural view synthesis

    Matthew Tancik, Vincent Casser, Xinchen Yan, Sabeek Prad- han, Ben Mildenhall, Pratul P Srinivasan, Jonathan T Barron, and Henrik Kretzschmar. Block-nerf: Scalable large scene neural view synthesis. InProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Reco...

    2022

  52. [59]

    Estimating spatially-varying lighting in urban scenes with disentangled representation

    Jiajun Tang, Yongjie Zhu, Haoyu Wang, Jun Hoong Chan, Si Li, and Boxin Shi. Estimating spatially-varying lighting in urban scenes with disentangled representation. In European Conference on Computer Vision, 2022. 7, 8

    2022

  53. [60]

    Richter, Ren ´e Ranftl, Zhuwen Li, Vladlen Koltun, and Thomas Brox

    Maxim Tatarchenko, Stephan R. Richter, Ren ´e Ranftl, Zhuwen Li, Vladlen Koltun, and Thomas Brox. What do single-view 3d reconstruction networks learn? 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 3400–3409, 2019. 3

    2019

  54. [61]

    Mikaela Angelina Uy, Jingwei Huang, Minhyuk Sung, Tolga Birdal, and Leonidas J. Guibas. Deformation-aware 3d model embedding and retrieval. In European Conference on Computer Vision, 2020. 3

    2020

  55. [62]

    Advsim: Generating safety-critical scenar- ios for self-driving vehicles

    Jingkang Wang, Ava Pun, James Tu, Sivabalan Mani- vasagam, Abbas Sadat, Sergio Casas, Mengye Ren, and Raquel Urtasun. Advsim: Generating safety-critical scenar- ios for self-driving vehicles. 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 990...

    2021

  56. [63]

    Cadsim: Robust and scalable in-the- wild 3d reconstruction for controllable sensor simulation

    Jingkang Wang, Sivabalan Manivasagam, Yun Chen, Ze Yang, Ioan Andrei Bˆarsan, Anqi Joyce Yang, Wei-Chiu Ma, and Raquel Urtasun. Cadsim: Robust and scalable in-the- wild 3d reconstruction for controllable sensor simulation. In Conference on Robot Learning, 2023. 2, 3

    2023

  57. [64]

    Neural fields meet explicit geo- metric representations for inverse rendering of urban scenes

    Zian Wang, Tianchang Shen, Jun Gao, Sheng Yu Huang, Jacob Munkberg, Jon Hasselgren, Zan Gojcic, Wenzheng Chen, and Sanja Fidler. Neural fields meet explicit geo- metric representations for inverse rendering of urban scenes. 2023 IEEE/CVF Conference on Computer Vision and Pat- ...

    2023

  58. [65]

    Editable scene simulation for autonomous driving via collaborative llm- agents

    Yuxi Wei, Zi Wang, Yifan Lu, Chenxin Xu, Changxing Liu, Hao Zhao, Siheng Chen, and Yanfeng Wang. Editable scene simulation for autonomous driving via collaborative llm- agents. ArXiv, abs/2402.05746, 2024. 5, 3, 7, 8

    2024 arXiv

  59. [66]

    Behind the scenes: Density fields for single view reconstruction

    Felix Wimbauer, Nan Yang, Christian Rupprecht, and Daniel Cremers. Behind the scenes: Density fields for single view reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9076– 9086, 2023. 2, 3

    2023

  60. [68]

    Yang, Ping Luo, Chen Change Loy, and Xiaoou Tang

    L. Yang, Ping Luo, Chen Change Loy, and Xiaoou Tang. A large-scale car dataset for fine-grained categorization and verification. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3973–3981, 2015. 6, 4

    2015

  61. [69]

    Unisim: A neural closed-loop sensor simulator

    Ze Yang, Yun Chen, Jingkang Wang, Sivabalan Mani- vasagam, Wei-Chiu Ma, Anqi Joyce Yang, and Raquel Ur- tasun. Unisim: A neural closed-loop sensor simulator. 2023 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 1389–1399, 2023. 2, 3

    2023

  62. [70]

    Reconstructing objects in-the-wild for realistic sensor simulation

    Ze Yang, Sivabalan Manivasagam, Yun Chen, Jingkang Wang, Rui Hu, and Raquel Urtasun. Reconstructing objects in-the-wild for realistic sensor simulation. 2023 IEEE In- ternational Conference on Robotics and Automation (ICRA), pages 11661–11668, 2023. 2

    2023

  63. [71]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Siyi Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. ArXiv, abs/2308.06721, 2023. 4

    2023 arXiv

  64. [72]

    Photoscene: Photorealistic material and lighting transfer for indoor scenes

    Yu-Ying Yeh, Zhengqin Li, Yannick Hold-Geoffroy, Rui Zhu, Zexiang Xu, Milo ˇs Ha ˇsan, Kalyan Sunkavalli, and Manmohan Chandraker. Photoscene: Photorealistic material and lighting transfer for indoor scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patt...

    2022

  65. [73]

    Texturedreamer: Image-guided texture syn- thesis through geometry-aware diffusion

    Yu-Ying Yeh, Jia-Bin Huang, Changil Kim, Lei Xiao, Thu Nguyen-Phuoc, Numair Khan, Cheng Zhang, Manmo- han Krishna Chandraker, Carl Marshall, Zhao Dong, and Zhengqin Li. Texturedreamer: Image-guided texture syn- thesis through geometry-aware diffusion. 2024 IEEE/CVF Conference ...

    2024

  66. [74]

    pixelnerf: Neural radiance fields from one or few images

    Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa. pixelnerf: Neural radiance fields from one or few images. 2021 IEEE/CVF Conference on Computer Vision and Pat- tern Recognition (CVPR), pages 4576–4585, 2020. 6, 2, 4

    2021

  67. [75]

    Inpaint anything: Segment anything meets image inpainting

    Tao Yu, Runsen Feng, Ruoyu Feng, Jinming Liu, Xin Jin, Wenjun Zeng, and Zhibo Chen. Inpaint anything: Segment anything meets image inpainting. ArXiv, abs/2304.06790,

    arXiv

  68. [76]

    Paint3d: Paint anything 3d with lighting-less texture diffusion mod- els

    Xianfang Zeng, Xin Chen, Zhongqi Qi, Wen Liu, Zibo Zhao, Zhibin Wang, Bin Fu, Yong Liu, and Gang Yu. Paint3d: Paint anything 3d with lighting-less texture diffusion mod- els. 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 4252–4262, 2023. 3, 6, 2, 4

    2024

  69. [77]

    Zhang, Gengshan Yang, Shubham Tulsiani, and Deva Ramanan

    Jason Y . Zhang, Gengshan Yang, Shubham Tulsiani, and Deva Ramanan. Ners: Neural reflectance surfaces for sparse- 11 view 3d reconstruction in the wild. In Neural Information Processing Systems, 2021. 6, 7, 8

    2021

  70. [78]

    Cat: Closed-loop adversarial training for safe end-to-end driving

    Linrui Zhang, Zhenghao Peng, Quanyi Li, and Bolei Zhou. Cat: Closed-loop adversarial training for safe end-to-end driving. ArXiv, abs/2310.12432, 2023. 5

    2023 arXiv

  71. [79]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pages 3813–3824, 2023. 4, 5, 3

    2023

  72. [80]

    Efros, Eli Shecht- man, and Oliver Wang

    Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. 2018 IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 586–595, 2018. 6

    2018

  73. [81]

    Nerflets: Local radiance fields for efficient structure-aware 3d scene representation from 2d supervision

    Xiaoshuai Zhang, Abhijit Kundu, Thomas Funkhouser, Leonidas Guibas, Hao Su, and Kyle Genova. Nerflets: Local radiance fields for efficient structure-aware 3d scene representation from 2d supervision. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Reco...

    2023

  74. [82]

    Fast segment any- thing

    Xu Zhao, Wen-Yan Ding, Yongqi An, Yinglong Du, Tao Yu, Min Li, Ming Tang, and Jinqiao Wang. Fast segment any- thing. ArXiv, abs/2306.12156, 2023. 5, 3

    2023 arXiv

  75. [83]

    Hugs: Holistic urban 3d scene understanding via gaus- sian splatting

    Hongyu Zhou, Jiahao Shao, Lu Xu, Dongfeng Bai, Weichao Qiu, Bingbing Liu, Yue Wang, Andreas Geiger, and Yiyi Liao. Hugs: Holistic urban 3d scene understanding via gaus- sian splatting. arXiv preprint arXiv:2403.12722, 2024. 2, 3, 5, 6 12 UrbanCAD: Towards Highly Controllable a...

    2024 arXiv

  76. [84]

    CAD Model Filtering Our method requires the CAD models to have correct mate- rial index assignment to support automatic coloring

    UrbanCAD Implementation Details 7.1. CAD Model Filtering Our method requires the CAD models to have correct mate- rial index assignment to support automatic coloring. How- ever, we observe that in free CAD model libraries, there are small parts of handcrafted CAD models withou...

  77. [85]

    Implementation Details of Experiments 8.1. Baselines Implementation During appearance comparison, we evaluate 1800 images of 30 models rendered from 360 ◦ views and report FID/KID scores comparing with 1800 reference images collected from [67]. Besides, we report the LIPIS sco...

  78. [86]

    We input our single-view images to the PixelNeRF and rendered the reconstructed neural radiance field in 360◦ with 180 frames

    to evaluate the performance. We input our single-view images to the PixelNeRF and rendered the reconstructed neural radiance field in 360◦ with 180 frames. Wonder3D. Wonder3D [42] is a image-based single view 3D generation method using diffusion priors. We use the official pre...

  79. [87]

    Separate Selection

    Functionality Since our created vehicle models are fully controllable, we showcase more editing results including component editing, relighting, material transfer, 360 ◦ rotation, and novel view rendering. 9.1. Component Editing Our produced 3D vehicle models support easy comp...

  80. [88]

    Lighting Estimation Comparison We conduct lighting estimation comparison experiments with three baselines as shown in Fig

    Additional Experiments and Analysis 10.1. Lighting Estimation Comparison We conduct lighting estimation comparison experiments with three baselines as shown in Fig. 22. (1) lighting es- timation method using the generative model: Diffusion- Light [47]. (2) lighting estimation ...

  81. [89]

    However, our method may be used to create some false urban scenes, leading to some social problems

    Broader Impact UrbanCAD may help the development of self-driving sim- ulation technology, which can further encourage the devel- opment of the self-driving industry. However, our method may be used to create some false urban scenes, leading to some social problems. 8

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.