Pith. sign in

REVIEW 4 major objections 5 minor 77 references

Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusion

T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read A single satellite image can be turned into a detailed, colorized 3D city model in about one minute by cascaded latent diffusion over sparse voxel grids, with higher fidelity than prior city generation models.

desk verdict Sat2City's architecture and dataset are worth a look, but the paper does not actually demonstrate generation from a single satellite image: the experiments condition on height maps rendered from the target meshes and compare against unconditional baselines. read the letter →

arxiv 2507.04403 v1 pith:AZIUGIO6 submitted 2025-07-06 cs.CV

classification cs.CV
keywords 3Dcitygenerationsatelliteimagetolatentdiffusionmodelssparsevoxelgridscascadedurbanappearancemodelingsyntheticdatasetheight-mapconditioning
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Sat2City sets out to establish that a single satellite image, reduced to a height map, carries enough information to generate a full 3D city with explicit geometry and color, not just novel rendered views. The paper argues that the right representation—sparse voxel grids with a multi-scale appearance hierarchy—lets latent diffusion recover city-scale structures that neural-rendering baselines cannot. To train such a model, it introduces a synthetic dataset of artist-designed 3D cities paired with satellite-view height maps, and on this dataset it reports higher geometric fidelity and user-rated appearance than existing city generation models, with inference taking about one minute per scene. A sympathetic reader would take the central claim as: joint, 3D-supervised generation on sparse voxel latents is a viable and scalable route from satellite imagery to explicit 3D cities.

What carries the argument

The carrying mechanism is a variational autoencoder with three latent bottlenecks over sparse voxel grids: a densified neck encodes overall occupancy, a sparse neck encodes surface geometry and records voxel pruning decisions, and a re-hash neck coarsens the appearance feature grid by repeated factors of two using trilinear interpolation to supply multi-scale context. Inverse sampling supervises per-vertex color implicitly: decoded color features are trilinearly sampled onto the colorized point cloud and an MLP predicts point colors, avoiding the smoothing and blending failures of direct color splatting. A cascaded latent diffusion pipeline denoises the three levels in sequence—dense geometry, sparse geometry, hierarchical appearance—conditioning each stage on the previous one and using the recorded pruning decisions to keep appearance aligned with the evolving surface.

What would settle it

Apply the trained model to a set of real satellite images with co-registered, colorized 3D city tiles, extract height maps, and compare generated geometries and appearances against the ground-truth tiles using Chamfer distance, EMD, and a user study; if the geometric metrics on real inputs fall to the level of the rendering-based baselines, or if the model visibly hallucinates or collapses city blocks, the claimed superiority and transferability are falsified.

Watch

Extended reading notes

Core claim

On its own terms, the paper's discovery is that city-scale 3D generation from a single satellite image can be performed as direct synthesis of explicit geometry and appearance, rather than as neural rendering of a latent scene. The authors show that a sparse voxel latent can carry both occupancy and color, provided appearance is encoded in multi-level coarsened feature grids and supervised implicitly through the original colorized point cloud. This design sidesteps the viewpoint-limited rendering artifacts of GAN- and neural-rendering-based city generators and the point-density scaling wall of point-cloud diffusion. Experiments on the new dataset report lower geometric MMD and higher coverage than the unconditional scene-generation baselines it compares against, and higher user-study scores than the rendering-based city generators.

Load-bearing premise

The load-bearing premise is that rendered height maps with contrast-scaling noise capture the same information content and noise structure as real satellite-derived elevation maps, so models trained on synthetic pairs will transfer to real satellite inputs; the paper states that real-world evaluation is still pending.

Editorial extensions

If this is right

  • If the central claim holds, a single satellite image is enough conditioning to reconstruct explicit, colorized 3D city geometry, not merely novel 2D views.
  • Because geometry and appearance are generated jointly as voxel attributes, downstream applications such as digital twins, games, and planning can consume the output mesh directly without multi-view reconstruction.
  • The cascaded conditioning scheme implies that geometry errors can be corrected progressively: the dense occupancy stage filters false volumes, and sparse-stage pruning keeps appearance aligned to surfaces.
  • The ablations indicate that multi-scale re-hashed appearance context is necessary for stable color optimization in sparse voxel VAEs, a design constraint for future 3D latent diffusion models.
  • On the synthetic dataset, the method sets new quantitative reference points: lower geometric MMD and higher coverage than the unconditional scene-generation baselines, and higher user ratings than the rendering-based city generators.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • An untested but plausible implication is that the same cascade will transfer to real satellite-derived elevation maps, because the authors' preliminary real-data processing found smaller Chamfer distances between height-map-derived point clouds and colorized ground truth than on synthetic data; that comparison, however, is not itself evidence about generation quality.
  • The Re-Hash plus inverse-sampling recipe could transfer to other sparse-voxel generation tasks where appearance must be smooth, such as texturing reconstructed meshes from sparse sensor data.
  • A concrete next test would replace synthetic contrast-scaled height maps with height maps produced by monocular elevation estimation from real satellite imagery and measure whether the cascaded diffusion still prunes false occupancy correctly; the paper does not yet show this.
  • If real-world fine-tuning is added, the automated data pipeline and roughly one-minute-per-scene inference could make city-scale digital twins inexpensive to build.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper introduces Sat2City, a cascaded latent diffusion framework that generates 3D city geometry and appearance from a single satellite image. The method encodes a colorized point cloud into sparse voxel grids with a triplet-bottleneck VAE (dense, sparse, and Re-Hash multi-level appearance latents) and uses three sequentially conditioned diffusion stages to recover geometry and color. The authors also introduce a synthetic dataset of Blender-rendered cities paired with simulated height maps, and they report geometric (COV, MMD) and perceptual (user study) comparisons against existing city generation baselines. The central claim is that the framework generates detailed 3D structures from a single satellite image with superior fidelity.

Significance. The architectural contributions—cascaded latent diffusion, the Re-Hash multi-scale appearance bottleneck, and inverse sampling for per-vertex color supervision—are reasonable and potentially useful for large-scale 3D scene generation, and the synthetic dataset may be a valuable resource for the community. If the full satellite-to-3D pipeline were validated, the work would be a meaningful step toward practical city-scale generation. However, the experimental evidence as presented does not support the title and abstract claim of generation 'from a single satellite image': the evaluated conditioning input is a height map rendered from the same artist mesh that provides the reference point cloud, and the quantitative comparisons are against unconditional baselines. The real-world extension is explicitly left to future work in Supplementary Section 7. The paper therefore promises more than it currently delivers, and the load-bearing claims need additional validation before publication.

major comments (4)
  1. [§3.3 and Eq. (4)] The evaluated pipeline is not 'from a single satellite image.' Section 3.3 describes how height maps are rendered in Blender from the same artist mesh that supplies the reference point cloud, and Eq. (4) conditions the dense latent diffusion on the point cloud lifted from that height map. The satellite-to-height-map step appears only in Supplementary Section 7 and is not part of the model evaluated in Tables 2 and 3. This is a load-bearing gap between the stated contribution and the experiments. The authors should either evaluate the complete pipeline on real or held-out satellite images, or substantially revise the claims to say the method generates 3D cities from (noisy) height maps.
  2. [Table 2] The geometric comparison is confounded. NFD and BlockFusion are unconditional generators, while Sat2City is conditioned on a height map that is derived from the same mesh that defines the reference point cloud. A near-deterministic height-map-to-surface lifting could plausibly achieve COV(CD)=100.00 under this protocol, so the reported COV and MMD values do not demonstrate superior generative fidelity. The paper should compare against conditional baselines (e.g., a model conditioned on the same height map, or Sat2City with the conditioning corrupted or removed) and should report diversity metrics to show that the diffusion output is not simply reconstructing the condition.
  3. [Table 3] The appearance comparison against Sat2Scene* is not informative as evidence of superiority. Sat2Scene* is retrained on the proposed dataset at roughly 14 points per square meter, whereas Sat2Scene was designed for point cloud densities around 400 points per square meter. The resulting failure of Sat2Scene* can be attributed to a mismatch between the method's requirements and the data density, not to a fundamental superiority of Sat2City. If this comparison is kept, it should be framed as a stress test, and the authors should also present a density-matched setting or an alternative appearance baseline.
  4. [Supplementary Section 7] The real-world evidence reported in the supplementary does not validate the central claim. The Chamfer distance of 0.0977 is computed between point clouds derived from inferred height maps and colorized ground-truth point clouds, not between Sat2City's 3D outputs and ground truth on real satellite inputs. The text explicitly states that real-world evaluation remains pending. The 'Spoiler alert' paragraph describes a data collection pipeline but does not include any generated 3D city from an actual satellite image. Claims of generalizability to real satellite data are therefore unsupported by the presented experiments.
minor comments (5)
  1. [§1] There is a typo in the introduction: 'appeance' should be 'appearance'.
  2. [§4.1 / Table 2] The COV and MMD metrics are reported with inconsistent precision (e.g., 100.00 vs 60.00), and the table caption would benefit from explicitly stating that 'Ours' uses a conditional protocol while the baselines are unconditional; this distinction is currently only in the note.
  3. [Eq. (4)] The conditioning symbol c(Ph) is not defined in the main text; it should be clarified that c(·) denotes the point encoder and condition projection described in Supplementary Section 6.2.
  4. [Table 4 (Supplementary)] The user-study questions for GPQ and GSC are identical to those for TPQ and TSC, which undermines the intended distinction between appearance-only and geometry-only evaluation; the authors should provide distinct questions or explain the intended difference.
  5. [Supplementary Section 7] The heading 'Spoiler alert' is informal and out of place in a journal submission; consider renaming to something like 'Preliminary real-world data pipeline'.

Circularity Check

2 steps flagged · score 6.0 of 10

The headline 'superior fidelity' result is driven by an evaluation in which the conditioning height map is rendered from the same reference mesh that is used as ground truth; the comparison to unconditional baselines therefore measures reconstruction of the condition's source rather than independent 3D city generation from satellite imagery.

  1. self definitional [Section 3.3, Sat2City Dataset construction; Eq. (4) in Section 3.2]
    "The height field is then simulated in blender by mapping the texture coordinates of the elevation axis (in this case, the y-axis) into grayscale, with the lowest and highest elevations being linearly assigned to 0 and 255, respectively."

    The conditioning input Ph is rendered from the same artist mesh whose sampled point cloud is the reference for all geometric metrics. Eq. (4) conditions the dense geometry latent on c(Ph), so the target geometry is the source of the input. The model is therefore always asked to recover the mesh that generated its condition; the resulting COV(CD)=100.00 in Table 2 is the visible signature of this construction, and the favorable MMD values reduce to the dataset construction rather than to an independent generative capability.

  2. fitted input called prediction [Section 4.2, Table 2 and caption]
    "Results for NFD and BlockFusion are obtained through unconditional generation methods [54], while our Sat2City framework operates as a conditional generation pipeline."

    The comparison is asymmetric by construction: NFD and BlockFusion must generate without access to the test mesh, while Sat2City receives a height map rendered from that same mesh as its condition. The claimed 98.1% COV(CD) improvement and the 100.00 COV value are therefore a measure of how faithfully the model reconstructs the condition's source, not of superior city generation. The 'prediction' of geometry is statistically anchored to the reference by the target-derived condition, so the headline fidelity claim is forced by the evaluation protocol.

full rationale

The cascaded latent diffusion architecture itself is self-contained: Re-Hash, inverse sampling, and the triplet VAE are described with equations and are not circularly defined in terms of the evaluation. No load-bearing self-citation chain is present. However, the central claim 'generates detailed 3D structures from a single satellite image, achieving superior fidelity' is supported by a protocol whose condition is a Blender-rendered height map derived from the reference mesh, and the quantitative comparison is made against unconditional baselines. This makes the geometry metrics largely a reconstruction test of a target-derived input, not a test of generation from an independent satellite observation. The supplementary explicitly states that real-world evaluation remains pending and reports Chamfer distances for height-map-derived point clouds rather than for Sat2City outputs on satellite imagery, so the real-world transfer claim is not demonstrated in the paper. These issues warrant a circularity score of 6 because the headline superiority result reduces, in the reported evaluation, to conditioning on information taken from the reference outputs.

Assumptions & free parameters 7 free parameters · 5 assumptions · 0 invented entities

The central claim depends on the architecture's ability to learn from synthetic data and transfer to real inputs, plus several hand-chosen loss weights and training hyperparameters. None of these are derived from first principles; all are empirical choices made on the synthetic dataset.

free parameters (7)
  • VAE loss weight lambda_0 = 20
    Weight for binary cross-entropy occupancy loss in Eq. (7), chosen by hand.
  • VAE loss weight lambda_1 = 50
    Weight for L1 normal loss in Eq. (7), chosen by hand.
  • VAE loss weight lambda_2 = 0.03
    Weight for KL divergence in Eq. (7), chosen by hand.
  • VAE loss weight lambda_3 = 50
    Weight for point color L1 loss in Eq. (7), chosen by hand.
  • Dual-stage training switch epoch E = 10
    Epoch at which appearance training starts; chosen by hand.
  • Re-Hash hierarchy depth n = 4
    Number of coarsening levels in the Re-Hash neck; chosen by hand.
  • Height map contrast-scaling noise strength = not specified
    Section 3.3 and Figure 3 apply contrast scaling to render noise-corrupted height maps; the amount is not quantified, so the conditioning distribution is not reproducible.
assumptions (5)
  • domain assumption The synthetic Blender city meshes are representative of real urban geometry and appearance distributions at city scale.
    Section 3.3 constructs the dataset from artist-designed meshes; real-world validity is unverified.
  • domain assumption A single height-map-derived point cloud Ph carries sufficient information to condition the recovery of detailed 3D geometry and appearance.
    Eq. (4) conditions dense geometry generation on c(Ph); this assumes the height map does not underdetermine the city.
  • domain assumption Stage-wise training of the cascaded diffusion (training each Psi on ground-truth or decoded conditions) yields a valid joint distribution at inference when chained.
    Section 3.2 factorizes the joint density in Eqs. (4)-(6), but no training-time sampling from the previous stage's posterior is described, so train/inference distribution shift is unaddressed.
  • domain assumption XCube's sparse voxel hierarchy and NKSR's surface-fitting decoder remain stable when extended to appearance decoding with the Re-Hash bottleneck.
    The method builds on XCube [39] and NKSR [20] with modifications; no formal guarantee is provided.
  • domain assumption The inverse sampling loss (Eq. 2) via trilinear interpolation at point locations provides a faithful and sufficient supervision signal for per-vertex color attributes.
    Figure 5 argues direct splatting artifacts motivate this choice; no analysis beyond qualitative ablations.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusion." pith.science (2026). https://pith.science/paper/AZIUGIO6

@misc{pith2026250704403,
  author       = {Pith},
  title        = {Pith review of: Sat2City: 3D City Generation from A Single Satellite Image with Cascaded Latent Diffusion},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/AZIUGIO6}},
  note         = {Machine review of arXiv:2507.04403}
}
read the original abstract

Recent advancements in generative models have enabled 3D urban scene generation from satellite imagery, unlocking promising applications in gaming, digital twins, and beyond. However, most existing methods rely heavily on neural rendering techniques, which hinder their ability to produce detailed 3D structures on a broader scale, largely due to the inherent structural ambiguity derived from relatively limited 2D observations. To address this challenge, we propose Sat2City, a novel framework that synergizes the representational capacity of sparse voxel grids with latent diffusion models, tailored specifically for our novel 3D city dataset. Our approach is enabled by three key components: (1) A cascaded latent diffusion framework that progressively recovers 3D city structures from satellite imagery, (2) a Re-Hash operation at its Variational Autoencoder (VAE) bottleneck to compute multi-scale feature grids for stable appearance optimization and (3) an inverse sampling strategy enabling implicit supervision for smooth appearance transitioning.To overcome the challenge of collecting real-world city-scale 3D models with high-quality geometry and appearance, we introduce a dataset of synthesized large-scale 3D cities paired with satellite-view height maps. Validated on this dataset, our framework generates detailed 3D structures from a single satellite image, achieving superior fidelity compared to existing city generation models.

Figures

Figures reproduced from arXiv: 2507.04403 by the authors.

Figure 1
Figure 1. We present Sat2City, a novel framework for generating high-fidelity 3D city models with detailed geometry and appear￾ance from a single satellite observation, in ∼ 1 minute, using cas￾caded latent diffusion. This process is achieved even without the need for auxiliary inputs like segmentation map. within urban environments. These methods are restricted to rendering cities from a highly limited set of viewpoints and … view at source ↗
Figure 3
Figure 3. Raw Input Data. The colorized point cloud PC and height map-derived conditional point cloud Ph are normalized for visualization, with Ph upsampled to enhance distribution clarity. where XD and XS respectively capture dense and sparse geometric features while {XCk} n k=0 encodes hierarchical appearance details through n progressively coarsen levels (Section 3.1). Following this encoding phase, the latent diffusion mo… view at source ↗
Figure 5
Figure 5. Direct Point Cloud Voxelization and Inverse Sam￾pling Process. Examples of challenging scenarios in per-vertex color attribute learning, illustrated using a dense point cloud gen￾erated from the ShapeNet dataset [3] for the easy of demonstration. it offers direct supervision, reducing ambiguity. However, directly performing per-vertex color attribute learning is challenging. As illustrated in [PITH_FULL_IMAGE:figur… view at source ↗
Figures from the paper (13 more)
Figure 6
Figure 6. Figure 6: Inference pipeline of Sat2City. pipeline, where later stages incorporate contents from ear￾lier stages, as illustrated in [PITH_FULL_IMAGE:figures/full_fig_p005_6.png]
Figure 8
Figure 8. Figure 8: Qualitative Comparison with CityDreamer [55]. CityDreamer requires both segmentation and height maps, while Sat2City relies solely on height maps. CityDreamer generates 2D city renderings, reconstructed into meshes via MASt3R [26]. tions and compute three widely used m…
Figure 9
Figure 9. Figure 9: Qualitative Comparison with Sat2Scene [30] Trained on Our Dataset. Since Sat2Scene lacks geometry generation, we provide ground truth point clouds as input, whereas Sat2City gen￾erates geometry from noised height maps. implement Sat2Scene on our dataset using its offic…
Figure 11
Figure 11. Figure 11: Ablation on cascaded latent diffusion. w/o Inverse Sampling Ours [PITH_FULL_IMAGE:figures/full_fig_p008_11.png]
Figure 10
Figure 10. Figure 10: Ablation on Re-Hash operation. Note that the Single￾dense and Dual-sparse variants produce zero values consistently throughout the training process. 4.3. Ablations Bottleneck Design. The primary objective of our Re-Hash neck and its dual-stage training is to ensure st…
Figure 13
Figure 13. Figure 13: Height Map Rendering in Blender. and processed through an MLP-based output head to gen￾erate per-vertex appearance attributes, ensuring spatial con￾sistency across the generated 3D scene. Diffusion model with parameter Ψ. A widely adopted forward diffusion step (addin…
Figure 14
Figure 14. Figure 14: Real-world dataset includes diverse morphologies. [PITH_FULL_IMAGE:figures/full_fig_p014_14.png]
Figure 15
Figure 15. Figure 15: Raw data example for one scene in Figure [PITH_FULL_IMAGE:figures/full_fig_p014_15.png]
Figure 16
Figure 16. Figure 16: Orthographic camera view for synthetic satellite im [PITH_FULL_IMAGE:figures/full_fig_p014_16.png]
Figure 17
Figure 17. Figure 17: Exploring the original artist-designed mesh model. [PITH_FULL_IMAGE:figures/full_fig_p015_17.png]
Figure 18
Figure 18. Figure 18: More views on entire sampled point cloud. [PITH_FULL_IMAGE:figures/full_fig_p015_18.png]
Figure 19
Figure 19. Figure 19: More views on zoomed-in sampled point cloud. [PITH_FULL_IMAGE:figures/full_fig_p016_19.png]
Figure 20
Figure 20. Figure 20: More results. 6 [PITH_FULL_IMAGE:figures/full_fig_p017_20.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

77 extracted references · 36 canonical work pages

  1. [1]

    Componerf: Text-guided multi-object compositional nerf with editable 3d scene lay- out

    Haotian Bai, Yuanhuiyi Lyu, Lutao Jiang, Sijia Li, Haonan Lu, Xiaodong Lin, and Lin Wang. Componerf: Text-guided multi-object compositional nerf with editable 3d scene lay- out. arXiv preprint arXiv:2303.13843, 2023. 2

  2. [2]

    Persistent nature: A generative model of un- bounded 3d worlds

    Lucy Chai, Richard Tucker, Zhengqi Li, Phillip Isola, and Noah Snavely. Persistent nature: A generative model of un- bounded 3d worlds. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition , pages 20863–20874, 2023. 3

  3. [3]

    Shapenet: An information-rich 3d model repository

    Angel X Chang, Thomas Funkhouser, Leonidas Guibas, Pat Hanrahan, Qixing Huang, Zimo Li, Silvio Savarese, Manolis Savva, Shuran Song, Hao Su, et al. Shapenet: An information-rich 3d model repository. arXiv preprint arXiv:1512.03012, 2015. 4

  4. [4]

    Meshxl: Neural coordinate field for generative 3d foundation models

    Sijin Chen, Xin Chen, Anqi Pang, Xianfang Zeng, Wei Cheng, Yijun Fu, Fukun Yin, Yanru Wang, Zhibin Wang, Chi Zhang, et al. Meshxl: Neural coordinate field for generative 3d foundation models. arXiv preprint arXiv:2405.20853 ,

  5. [5]

    Meshanything: Artist-created mesh generation with au- toregressive transformers

    Yiwen Chen, Tong He, Di Huang, Weicai Ye, Sijin Chen, Ji- axiang Tang, Xin Chen, Zhongang Cai, Lei Yang, Gang Yu, et al. Meshanything: Artist-created mesh generation with au- toregressive transformers. arXiv preprint arXiv:2406.10163, 2024

  6. [6]

    Meshany- thing v2: Artist-created mesh generation with adjacent mesh tokenization

    Yiwen Chen, Yikai Wang, Yihao Luo, Zhengyi Wang, Zilong Chen, Jun Zhu, Chi Zhang, and Guosheng Lin. Meshany- thing v2: Artist-created mesh generation with adjacent mesh tokenization. arXiv preprint arXiv:2408.02555, 2024. 2

  7. [7]

    Scene- dreamer: Unbounded 3d scene generation from 2d image collections

    Zhaoxi Chen, Guangcong Wang, and Ziwei Liu. Scene- dreamer: Unbounded 3d scene generation from 2d image collections. IEEE transactions on pattern analysis and ma- chine intelligence, 2023. 3

  8. [8]

    Progressive3d: Progres- sively local editing for text-to-3d content creation with com- plex semantic prompts

    Xinhua Cheng, Tianyu Yang, Jianan Wang, Yu Li, Lei Zhang, Jian Zhang, and Li Yuan. Progressive3d: Progres- sively local editing for text-to-3d content creation with com- plex semantic prompts. arXiv preprint arXiv:2310.11784 ,

Show all 77 references
  1. [9]

    Set-the-scene: Global-local training for generating controllable nerf scenes

    Dana Cohen-Bar, Elad Richardson, Gal Metzer, Raja Giryes, and Daniel Cohen-Or. Set-the-scene: Global-local training for generating controllable nerf scenes. In Proceedings of the IEEE/CVF International Conference on Computer Vi- sion, pages 2920–2929, 2023. 2

  2. [10]

    Streetscapes: Large-scale consistent street view generation using autore- gressive video diffusion

    Boyang Deng, Richard Tucker, Zhengqi Li, Leonidas Guibas, Noah Snavely, and Gordon Wetzstein. Streetscapes: Large-scale consistent street view generation using autore- gressive video diffusion. In ACM SIGGRAPH 2024 Confer- ence Papers, pages 1–11, 2024. 1, 3

  3. [11]

    Citycraft: A real crafter for 3d city generation

    Jie Deng, Wenhao Chai, Junsheng Huang, Zhonghan Zhao, Qixuan Huang, Mingyan Gao, Jianshu Guo, Shengyu Hao, Wenhao Hu, Jenq-Neng Hwang, et al. Citycraft: A real crafter for 3d city generation. arXiv preprint arXiv:2406.04983, 2024. 2

  4. [12]

    Diffusion models beat gans on image synthesis

    Prafulla Dhariwal and Alexander Nichol. Diffusion models beat gans on image synthesis. Advances in neural informa- tion processing systems, 34:8780–8794, 2021. 1, 2

  5. [13]

    Syncity: Training-free gen- eration of 3d worlds

    Paul Engstler, Aleksandar Shtedritski, Iro Laina, Christian Rupprecht, and Andrea Vedaldi. Syncity: Training-free gen- eration of 3d worlds. arXiv:2503.16420, 2025. 3

  6. [14]

    Disentangled 3d scene genera- tion with layout learning

    Dave Epstein, Ben Poole, Ben Mildenhall, Alexei A Efros, and Aleksander Holynski. Disentangled 3d scene genera- tion with layout learning. arXiv preprint arXiv:2402.16936,

  7. [15]

    Blender - a 3d modeling and animation software, 2025

    Blender Foundation. Blender - a 3d modeling and animation software, 2025. Version 4.2, accessed: 2025-02-19. 5

  8. [16]

    Scenescape: Text-driven consistent scene generation

    Rafail Fridman, Amit Abecasis, Yoni Kasten, and Tali Dekel. Scenescape: Text-driven consistent scene generation. Ad- vances in Neural Information Processing Systems, 36, 2024. 2, 3

  9. [17]

    Gancraft: Unsupervised 3d neural rendering of minecraft worlds

    Zekun Hao, Arun Mallya, Serge Belongie, and Ming-Yu Liu. Gancraft: Unsupervised 3d neural rendering of minecraft worlds. In Proceedings of the IEEE/CVF International Con- ference on Computer Vision, pages 14072–14082, 2021. 3

  10. [18]

    Lrm: Large reconstruction model for single image to 3d

    Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. Lrm: Large reconstruction model for single image to 3d. arXiv preprint arXiv:2311.04400, 2023. 2

  11. [19]

    Benchmarking implicit neu- ral representation and geometric rendering in real-time rgb-d slam

    Tongyan Hua and Lin Wang. Benchmarking implicit neu- ral representation and geometric rendering in real-time rgb-d slam. In Proceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition , pages 21346–21356,

  12. [20]

    Neural kernel surface re- construction

    Jiahui Huang, Zan Gojcic, Matan Atzmon, Or Litany, Sanja Fidler, and Francis Williams. Neural kernel surface re- construction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 4369– 4379, 2023. 3, 1

  13. [21]

    Neural wavelet-domain diffusion for 3d shape generation

    Ka-Hei Hui, Ruihui Li, Jingyu Hu, and Chi-Wing Fu. Neural wavelet-domain diffusion for 3d shape generation. In SIG- GRAPH Asia 2022 Conference Papers, pages 1–9, 2022. 3, 6

  14. [22]

    A general frame- work to boost 3d gs initialization for text-to-3d generation by lexical richness

    Lutao Jiang, Hangyu Li, and Lin Wang. A general frame- work to boost 3d gs initialization for text-to-3d generation by lexical richness. In Proceedings of the 32nd ACM Interna- tional Conference on Multimedia , pages 6803–6812, 2024. 2

  15. [23]

    Eslam: Efficient dense slam system based on hybrid representation of signed distance fields

    Mohammad Mahdi Johari, Camilla Carta, and Franc ¸ois Fleuret. Eslam: Efficient dense slam system based on hybrid representation of signed distance fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17408–17419, 2023. 3

  16. [24]

    3d gaussian splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimk ¨uhler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph., 42(4):139–1,

  17. [25]

    Nuiscene: Exploring efficient generation of unbounded out- door scenes

    Han-Hung Lee, Qinghong Han, and Angel X Chang. Nuiscene: Exploring efficient generation of unbounded out- door scenes. arXiv:2503.16375, 2025. 3

  18. [26]

    Ground- ing image matching in 3d with mast3r

    Vincent Leroy, Yohann Cabon, and J´erˆome Revaud. Ground- ing image matching in 3d with mast3r. In European Confer- ence on Computer Vision , pages 71–91. Springer, 2024. 6, 7

  19. [27]

    Syntheocc: Synthesize 9 geometric-controlled street view images through 3d semantic mpis

    Leheng Li, Weichao Qiu, Yingjie Cai, Xu Yan, Qing Lian, Bingbing Liu, and Ying-Cong Chen. Syntheocc: Synthesize 9 geometric-controlled street view images through 3d semantic mpis. arXiv preprint arXiv:2410.00337, 2024. 1, 3

  20. [28]

    Crossviewdiff: A cross-view diffusion model for satellite- to-street view synthesis

    Weijia Li, Jun He, Junyan Ye, Huaping Zhong, Zhi- meng Zheng, Zilong Huang, Dahua Lin, and Conghui He. Crossviewdiff: A cross-view diffusion model for satellite- to-street view synthesis. arXiv preprint arXiv:2408.14765 , 2024

  21. [29]

    Sat2vid: Street-view panoramic video synthesis from a single satellite image

    Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Rongjun Qin, Marc Pollefeys, and Martin R Oswald. Sat2vid: Street-view panoramic video synthesis from a single satellite image. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 12436–12445, 2021. 1

  22. [30]

    Sat2scene: 3d urban scene genera- tion from satellite images with diffusion

    Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, and Martin R Oswald. Sat2scene: 3d urban scene genera- tion from satellite images with diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7141–7150, 2024. 1, 2, 3, 6, 7

  23. [31]

    Infinicity: Infinite-scale city synthesis

    Chieh Hubert Lin, Hsin-Ying Lee, Willi Menapace, Menglei Chai, Aliaksandr Siarohin, Ming-Hsuan Yang, and Sergey Tulyakov. Infinicity: Infinite-scale city synthesis. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 22808–22818, 2023. 1, 3

  24. [32]

    World- craft: Photo-realistic 3d world creation and customization via llm agents

    Xinhang Liu, Chi-Keung Tang, and Yu-Wing Tai. World- craft: Photo-realistic 3d world creation and customization via llm agents. arXiv preprint arXiv:2502.15601, 2025. 2

  25. [33]

    Urban architect: Steerable 3d urban scene generation with layout prior

    Fan Lu, Kwan-Yee Lin, Yan Xu, Hongsheng Li, Guang Chen, and Changjun Jiang. Urban architect: Steerable 3d urban scene generation with layout prior. arXiv preprint arXiv:2404.06780, 2024. 1, 3

  26. [34]

    Geometry-aware satellite- to-ground image synthesis for urban areas

    Xiaohu Lu, Zuoyue Li, Zhaopeng Cui, Martin R Oswald, Marc Pollefeys, and Rongjun Qin. Geometry-aware satellite- to-ground image synthesis for urban areas. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 859–867, 2020. 1

  27. [35]

    Infinicube: Unbounded and con- trollable dynamic 3d driving scene generation with world- guided video models

    Yifan Lu, Xuanchi Ren, Jiawei Yang, Tianchang Shen, Zhangjie Wu, Jun Gao, Yue Wang, Siheng Chen, Mike Chen, Sanja Fidler, et al. Infinicube: Unbounded and con- trollable dynamic 3d driving scene generation with world- guided video models. arXiv preprint arXiv:2412.03934 ,

  28. [36]

    Nerf: Representing scenes as neural radiance fields for view syn- thesis

    Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view syn- thesis. Communications of the ACM , 65(1):99–106, 2021. 4

  29. [37]

    Dreamfusion: Text-to-3d using 2d diffusion

    Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Milden- hall. Dreamfusion: Text-to-3d using 2d diffusion. arXiv preprint arXiv:2209.14988, 2022. 2

  30. [38]

    Sat2density: Faithful density learning from satellite-ground image pairs

    Ming Qian, Jincheng Xiong, Gui-Song Xia, and Nan Xue. Sat2density: Faithful density learning from satellite-ground image pairs. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3683–3692, 2023. 1

  31. [39]

    Xcube: Large-scale 3d generative modeling using sparse voxel hierarchies

    Xuanchi Ren, Jiahui Huang, Xiaohui Zeng, Ken Museth, Sanja Fidler, and Francis Williams. Xcube: Large-scale 3d generative modeling using sparse voxel hierarchies. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4209–4219, 2024. 2, ...

  32. [40]

    Scube: Instant large-scale scene reconstruction using voxsplats

    Xuanchi Ren, Yifan Lu, Hanxue Liang, Zhangjie Wu, Huan Ling, Mike Chen, Sanja Fidler, Francis Williams, and Jiahui Huang. Scube: Instant large-scale scene reconstruction using voxsplats. arXiv preprint arXiv:2410.20030, 2024. 2, 3, 4

  33. [41]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 4

  34. [42]

    Progressive distillation for fast sampling of diffusion models

    Tim Salimans and Jonathan Ho. Progressive distillation for fast sampling of diffusion models. arXiv preprint arXiv:2202.00512, 2022. 1

  35. [43]

    Urbanworld: An urban world model for 3d city generation

    Yu Shang, Jiansheng Chen, Hangyu Fan, Jingtao Ding, Jie Feng, and Yong Li. Urbanworld: An urban world model for 3d city generation. arXiv preprint arXiv:2407.11965, 2024. 2

  36. [44]

    Geometry-guided street-view panorama synthesis from satellite imagery

    Yujiao Shi, Dylan Campbell, Xin Yu, and Hongdong Li. Geometry-guided street-view panorama synthesis from satellite imagery. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(12):10009–10022, 2022. 1

  37. [45]

    3d neural field generation using triplane diffusion

    J Ryan Shue, Eric Ryan Chan, Ryan Po, Zachary Ankner, Jiajun Wu, and Gordon Wetzstein. 3d neural field generation using triplane diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 20875–20886, 2023. 6

  38. [46]

    Meshgpt: Generating triangle meshes with decoder-only transformers

    Yawar Siddiqui, Antonio Alliegro, Alexey Artemov, Ta- tiana Tommasi, Daniele Sirigatti, Vladislav Rosov, Angela Dai, and Matthias Nießner. Meshgpt: Generating triangle meshes with decoder-only transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patte...

  39. [47]

    Denoising diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502, 2020. 5

  40. [48]

    Direct voxel grid optimization: Super-fast convergence for radiance fields reconstruction

    Cheng Sun, Min Sun, and Hwann-Tzong Chen. Direct voxel grid optimization: Super-fast convergence for radiance fields reconstruction. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 5459– 5469, 2022. 4

  41. [49]

    Edgerunner: Auto-regressive auto-encoder for artistic mesh generation

    Jiaxiang Tang, Zhaoshuo Li, Zekun Hao, Xian Liu, Gang Zeng, Ming-Yu Liu, and Qinsheng Zhang. Edgerunner: Auto-regressive auto-encoder for artistic mesh generation. arXiv preprint arXiv:2409.18114, 2024. 2

  42. [50]

    Cloudcompare (version 2.12.4) [gpl software], 2025

    CloudCompare Development Team. Cloudcompare (version 2.12.4) [gpl software], 2025. Retrieved on 2025-02-19. 5

  43. [51]

    Co- slam: Joint coordinate and sparse parametric encodings for neural real-time slam

    Hengyi Wang, Jingwen Wang, and Lourdes Agapito. Co- slam: Joint coordinate and sparse parametric encodings for neural real-time slam. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 13293–13302, 2023. 3

  44. [52]

    Llama-mesh: Unifying 3d mesh generation with language models

    Zhengyi Wang, Jonathan Lorraine, Yikai Wang, Hang Su, Jun Zhu, Sanja Fidler, and Xiaohui Zeng. Llama-mesh: Unifying 3d mesh generation with language models. arXiv preprint arXiv:2411.09595, 2024. 2

  45. [53]

    Pivotmesh: Generic 3d mesh generation via pivot ver- tices guidance

    Haohan Weng, Yikai Wang, Tong Zhang, CL Chen, and Jun Zhu. Pivotmesh: Generic 3d mesh generation via pivot ver- tices guidance. arXiv preprint arXiv:2405.16890, 2024. 2 10

  46. [54]

    Blockfusion: Expandable 3d scene gen- eration using latent tri-plane extrapolation

    Zhennan Wu, Yang Li, Han Yan, Taizhang Shang, Weixuan Sun, Senbo Wang, Ruikai Cui, Weizhe Liu, Hiroyuki Sato, Hongdong Li, et al. Blockfusion: Expandable 3d scene gen- eration using latent tri-plane extrapolation. ACM Transac- tions on Graphics (TOG), 43(4):1–17, 2024. 6

  47. [55]

    Citydreamer: Compositional generative model of unbounded 3d cities

    Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, and Ziwei Liu. Citydreamer: Compositional generative model of unbounded 3d cities. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9666– 9675, 2024. 1, 2, 3, 6, 7

  48. [56]

    Gaussiancity: Generative gaussian splatting for unbounded 3d city generation

    Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, and Ziwei Liu. Gaussiancity: Generative gaussian splatting for unbounded 3d city generation. arXiv preprint arXiv:2406.06526, 2024. 1, 3

  49. [57]

    Gamus: A geometry-aware multi-modal semantic segmentation benchmark for remote sensing data

    Zhitong Xiong, Sining Chen, Yi Wang, Lichao Mou, and Xiao Xiang Zhu. Gamus: A geometry-aware multi-modal semantic segmentation benchmark for remote sensing data. arXiv preprint arXiv:2305.14914, 2023. 2

  50. [58]

    Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models

    Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, and Ying Shan. Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models. arXiv preprint arXiv:2404.07191 ,

  51. [59]

    Geospecific view generation – geometry-context aware high-resolution ground view infer- ence from satellite views, 2024

    Ningli Xu and Rongjun Qin. Geospecific view generation – geometry-context aware high-resolution ground view infer- ence from satellite views, 2024. 1

  52. [60]

    Sketch2scene: Au- tomatic generation of interactive 3d game scenes from user’s casual sketches

    Yongzhi Xu, Yonhon Ng, Yifu Wang, Inkyu Sa, Yunfei Duan, Yang Li, Pan Ji, and Hongdong Li. Sketch2scene: Au- tomatic generation of interactive 3d game scenes from user’s casual sketches. arXiv preprint arXiv:2408.04567, 2024. 2, 3

  53. [61]

    Pointflow: 3d point cloud generation with continuous normalizing flows

    Guandao Yang, Xun Huang, Zekun Hao, Ming-Yu Liu, Serge Belongie, and Bharath Hariharan. Pointflow: 3d point cloud generation with continuous normalizing flows. In Proceed- ings of the IEEE/CVF international conference on computer vision, pages 4541–4550, 2019. 6

  54. [62]

    Depth anything: Unleashing the power of large-scale unlabeled data

    Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao. Depth anything: Unleashing the power of large-scale unlabeled data. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10371–10381, 2024. 2

  55. [63]

    Procedu- ral generation of 3d scenes for urban landscape based on remote sensing images

    Shuqin Yang, Haopu Yuan, Tianqi Wang, Rui Zhong, Cheng- gang Song, Ying Fu, Wenyi Ge, and Xia Yuan. Procedu- ral generation of 3d scenes for urban landscape based on remote sensing images. In 2024 IEEE International Con- ference on Advanced Video and Signal Based Surveillance ...

  56. [64]

    Urbangiraffe: Representing urban scenes as compositional generative neural feature fields

    Yuanbo Yang, Yifei Yang, Hanlei Guo, Rong Xiong, Yue Wang, and Yiyi Liao. Urbangiraffe: Representing urban scenes as compositional generative neural feature fields. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9199–9210, 2023. 1, 3

  57. [65]

    Scene123: One prompt to 3d scene genera- tion via video-assisted and consistency-enhanced mae.arXiv preprint arXiv:2408.05477, 2024

    Yiying Yang, Fukun Yin, Jiayuan Fan, Xin Chen, Wanzhang Li, and Gang Yu. Scene123: One prompt to 3d scene genera- tion via video-assisted and consistency-enhanced mae.arXiv preprint arXiv:2408.05477, 2024. 2, 3

  58. [66]

    Dreamscape: 3d scene creation via gaussian splatting joint correlation modeling

    Xuening Yuan, Hongyu Yang, Yueming Zhao, and Di Huang. Dreamscape: 3d scene creation via gaussian splatting joint correlation modeling. arXiv preprint arXiv:2404.09227 ,

  59. [67]

    Lagem: A large geometry model for 3d representation learning and diffusion

    Biao Zhang and Peter Wonka. Lagem: A large geometry model for 3d representation learning and diffusion. arXiv preprint arXiv:2410.01295, 2024. 2

  60. [68]

    3dshape2vecset: A 3d shape representation for neu- ral fields and generative diffusion models.ACM Transactions on Graphics (TOG), 42(4):1–16, 2023

    Biao Zhang, Jiapeng Tang, Matthias Niessner, and Peter Wonka. 3dshape2vecset: A 3d shape representation for neu- ral fields and generative diffusion models.ACM Transactions on Graphics (TOG), 42(4):1–16, 2023. 2

  61. [69]

    Clay: A controllable large-scale generative model for creat- ing high-quality 3d assets

    Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, and Jingyi Yu. Clay: A controllable large-scale generative model for creat- ing high-quality 3d assets. ACM Transactions on Graphics (TOG), 43(4):1–20, 2024. 2

  62. [70]

    3d- scenedreamer: Text-driven 3d-consistent scene generation

    Songchun Zhang, Yibo Zhang, Quan Zheng, Rui Ma, Wei Hua, Hujun Bao, Weiwei Xu, and Changqing Zou. 3d- scenedreamer: Text-driven 3d-consistent scene generation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10170–10180, 2024. 2, 3

  63. [71]

    Cityx: Controllable procedural con- tent generation for unbounded 3d cities

    Shougao Zhang, Mengqi Zhou, Yuxi Wang, Chuanchen Luo, Rongyu Wang, Yiwei Li, Xucheng Yin, Zhaoxiang Zhang, and Junran Peng. Cityx: Controllable procedural con- tent generation for unbounded 3d cities. arXiv preprint arXiv:2407.17572, 2024. 2

  64. [72]

    Scenex: Procedural control- lable large-scale scene generation via large-language models

    Mengqi Zhou, Jun Hou, Chuanchen Luo, Yuxi Wang, Zhaox- iang Zhang, and Junran Peng. Scenex: Procedural control- lable large-scale scene generation via large-language models. arXiv preprint arXiv:2403.15698, 2024. 2

  65. [73]

    Gala3d: Towards text-to-3d complex scene generation via layout-guided generative gaussian splatting

    Xiaoyu Zhou, Xingjian Ran, Yajiao Xiong, Jinlin He, Zhi- wei Lin, Yongtao Wang, Deqing Sun, and Ming-Hsuan Yang. Gala3d: Towards text-to-3d complex scene generation via layout-guided generative gaussian splatting. arXiv preprint arXiv:2402.07207, 2024. 2

  66. [74]

    Nice-slam: Neural implicit scalable encoding for slam

    Zihan Zhu, Songyou Peng, Viktor Larsson, Weiwei Xu, Hu- jun Bao, Zhaopeng Cui, Martin R Oswald, and Marc Polle- feys. Nice-slam: Neural implicit scalable encoding for slam. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 12786–1279...

  67. [75]

    Implementation Details Our method is primarily implemented based on the sparse 3D structure provided by XCube [39] and the surface fit- ting network from NKSR [20]

    More Technical details 6.1. Implementation Details Our method is primarily implemented based on the sparse 3D structure provided by XCube [39] and the surface fit- ting network from NKSR [20]. For V AE training, we use 4 Nvidia A800-SXM4-80GB GPUs, while only the diffusion of ...

  68. [76]

    Discussion Limitations. The evaluation of our approach on real-world datasets remains pending, as obtaining high-resolution col- orized point clouds precisely aligned with remote sensing elevation maps necessitates considerable resource alloca- tion and may encounter limitatio...

  69. [77]

    Very Poor

    More About Evaluations 8.1. User Study Settings Table 4 presents our user study design, where participants were instructed to rate images based on the provided ques- tions. The evaluation follows a 10-point scale, where 1 indicates “Very Poor” and 10 represents “Excellent.” Fo...

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.