REVIEW 3 major objections 7 minor 4 cited by
4D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitives
T0 review · 3 major / 7 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read The paper introduces native 4D Gaussian primitives—Gaussians defined in space and time—as a single explicit representation for dynamic scenes, claiming the first real-time, high-resolution, photorealistic novel view synthesis on complex…
desk verdict Solid extension of the authors' ICLR 4DGS work, with useful applications and compression, but the abstract's 'first real-time high-resolution' claim is contradicted by its own Table 1. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the 4D Gaussian with mean µ and covariance Σ = R S S^T R^T, where S is a 4D scale matrix and R is a 4D rotation encoded by a pair of quaternions (left and right isotropic rotations). Its work is to make time a coordinate rather than a conditioning input: given a query timestamp t, equation (9) produces a conditional 3D Gaussian for splatting and a marginal 1D Gaussian p(t) for temporal gating, so the existing 3D Gaussian rasterizer can be adapted with negligible overhead. The 4D Spherindrical Harmonics carry appearance evolution in time and direction.
What would settle it
Render a scene containing a small object rotating rapidly around its own center (e.g., a spinning wheel or a twirling baton) and track the number of 4D Gaussians assigned to that object as render quality reaches a target PSNR: if the count grows steeply with rotation speed while rendering frame rate drops below real-time, the piecewise-linear trajectory assumption is the cause. A more direct check is to compute the model's implied optical flow (from conditional means) in a high-acceleration region and compare it with ground-truth flow, looking for systematic error at high curvature.
Extended reading notes
Core claim
The discovery is the native 4D Gaussian primitive: a 4D anisotropic Gaussian distribution over space and time, parameterized by a 4D mean, a diagonal scale, and a rotation built from a pair of quaternions. Because the conditional distribution of any multivariate Gaussian is Gaussian, at each time t the primitive yields a conditional 3D Gaussian—mean linear in t and covariance independent of t—and a marginal 1D Gaussian in time; the paper proves an unnormalized-Gaussian factorization that makes this splitting exact. This turns dynamic scene rendering into a 3D Gaussian splatting operation with an extra time-marginal weighting, and a 4D extension of spherical harmonics adds time-varying, view-dependent color. Trained end-to-end on rendering loss with densification in space and time, the representation produces state-of-the-art or competitive quality on the Plenoptic Video and Technicolor benchmarks while rendering around 100 fps, and the same primitives are shown to support video-to-4D generation, urban driving scene reconstruction, and 4D segmentation.
Load-bearing premise
The load-bearing assumption is that each 4D Gaussian's spatial mean moves along a straight line in time (its conditional mean is linear in t), so all real motion must be approximated piecewise by many primitives; if a scene's dynamics cannot be captured this way without exploding the primitive count, the real-time and quality claims weaken.
Editorial extensions
If this is right
- If the claim is right, real-time dynamic novel view synthesis no longer requires per-frame reconstruction or deformation networks: one explicit 4D primitive set is trained end-to-end from multi-view video and renders at interactive rates.
- The same 4D Gaussians can drive downstream tasks—4D generation from monocular video with score distillation, dynamic urban scene reconstruction with LiDAR initialization, and multi-granularity 4D segmentation—without changing the underlying representation.
- Compact variants (residual vector quantization of shape and color attributes, mask-based pruning of insignificant Gaussians, half-precision positions, 8-bit opacity) shrink a scene from over 1 GB to about 57 MB with roughly 0.1 dB PSNR loss, making storage less prohibitive.
- Because rendering time depends mainly on how many Gaussians are active at a given time (filtered by p(t) < 0.05), rendering speed stays roughly constant as video length grows.
Reading between the lines
- A testable consequence the paper leaves implicit: if the piecewise-linear trajectory assumption holds, the number of primitives needed to represent a moving object should grow with the curvature of its motion, so a scene with many fast multi-axis rotations should require proportionally more 4D Gaussians than the same scene with translational motion.
- The conditional-mean linearity suggests a natural diagnostic: compare the rendered optical flow (which the paper extracts from conditional means) against ground-truth flow in regions of high acceleration; systematic underestimation of curvature would confirm the piecewise-linear limitation.
- One could extend the representation to higher-order motion (e.g., adding velocity or acceleration states per primitive) while keeping the same rendering pipeline; the paper's derivation suggests this would be a drop-in change to the conditional distribution formula.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper introduces 4D Gaussian Splatting (4DGS), a representation for dynamic scenes built from native 4D Gaussian primitives. Each primitive has a 4D mean and covariance, parameterized through 4D rotations and scales; at render time, the conditional 3D Gaussian at time t and the marginal temporal distribution are derived from the full 4D Gaussian, and appearance is modeled with a proposed 4D Spherindrical Harmonics basis. The representation is trained end-to-end with photometric supervision and is extended with compact variants (R-VQ, Huffman encoding, mask pruning), urban-scene adaptations with LiDAR and motion regularizations, video-to-4D generation with diffusion priors, and SAM-based 4D segmentation. Experiments cover Plenoptic Video, Technicolor, D-NeRF, Consistent4D, and Waymo dynamic scenes, reporting state-of-the-art or competitive quality and high rendering speed.
Significance. The technical core of the paper is sound: the derivation in Section 3.2 is standard multivariate-Gaussian conditioning, and the provided proof that the unnormalized Gaussian factorizes into conditional and marginal unnormalized Gaussians is correct. This yields a clean explicit primitive that can model appearance and disappearance without global tracking, and the paper demonstrates considerable breadth across reconstruction, compression, generation, and segmentation. The experiments are extensive and the compression results are practically valuable. However, the paper's headline claim of being the 'first solution to achieve real-time rendering of high-resolution, photorealistic novel views for complex dynamic scenes' is contradicted by the paper's own Table 1, which lists the prior 4D-Rotor-Gaussian method at 277 FPS with comparable PSNR. This overclaim is load-bearing because it is the stated central contribution in the abstract and introduction, and it must be corrected. The underlying representation and pipeline remain a useful contribution once the priority and speed claims are stated accurately.
major comments (3)
- [Abstract, Section 1, Section 8.1.2, Table 1] The paper's claim that 4DGS 'has been the first solution to achieve real-time rendering of high-resolution, photorealistic novel views for complex dynamic scenes' is contradicted by Table 1 on the paper's own evidence. 4D-Rotor-Gaussian [44], a prior SIGGRAPH 2024 method, is listed at 277 FPS with PSNR 31.62, while 4DGS is listed at 114 FPS with PSNR 32.01. The same table also makes the statement in Section 8.1.2 that 4DGS is 'the sole method capable of real-time rendering while delivering high-quality dynamic novel view synthesis' false as written. Additionally, the FPS figures in Table 1 are measured at 2x downsampled resolution (Section 8.1.1), so the 'high-resolution' component of the real-time claim is not established by the reported measurements. The abstract, introduction, and Section 8.1.2 should be revised to state the method's actual comparative position rather than a priority claim.
- [Table 2] Table 2 reports LPIPS 0.865 for 4DGSC, while 4DGS is 0.084 and the surrounding text states that the compact variant achieves 'significant improvement in compactness without significant compromise in quality.' An LPIPS of 0.865 is an order-of-magnitude outlier and appears to be a typo, likely 0.086 or 0.084. As printed, the table directly undermines the compression-quality claim, so the entry must be corrected and verified against the actual evaluation outputs.
- [Section 8.3.2, Table 7] The text states that a higher opacity threshold 'eliminates floaters in the scene, leading to a higher PSNR (33.46 vs. 30.48)', but Table 7 reports 33.81 vs. 33.53 for Sear Steak and 34.02 vs. 33.87 for Cut Beef. The numbers in the text appear in neither row, and the value 30.48 does not occur in the table. Since the section's conclusion about the pruning threshold depends on this comparison, the text and table need to be reconciled.
minor comments (7)
- [Section 7, Eq. (32)] The equation numbered (32) in Section 7 appears to be a placeholder: the displayed formula for sM contains the text '(32)' and no right-hand side, while Eq. (32) in Section 6 is the generative loss. The scale formula must be completed and renumbered to avoid the collision.
- [Table 3] The row labeled 'No-Time split' is not defined in the text; it is not clear which component of the densification or rendering pipeline is removed. Please define this ablation.
- [Section 8.2.1] The sentence 'suggest that the proposed general representation can also work well in such an ill-posed task' is a sentence fragment with a subject-verb disagreement; it should be attached to the preceding sentence about initialization.
- [Throughout] There are numerous typographical issues, including 'T raining', 'T echnicolor', 'Storge', 'T able', and 'sckit-image'; these should be corrected in a final pass.
- [Figure 6] The caption does not explain the color coding of the rendered optical flow; please add a brief description of the flow color convention.
- [Table 5] The table header 'Deform-GS C-DyNeRF' appears to concatenate two separate baseline entries; clarify the column structure so each method is identified individually.
- [Section 4.1] The piecewise-linear interpretation of motion is a useful and honest discussion, but the associated trade-off for very long videos is not quantified; a sentence on how the number of Gaussians grows with video length would strengthen this section.
Circularity Check
No circularity: the 4D Gaussian rendering chain is self-contained Gaussian algebra; the disclosed preliminary-version citation is not load-bearing.
full rationale
The derivation in Section 3 is self-contained. Equation (6) factorizes the 4D splat into a marginal time Gaussian and a conditional 3D Gaussian; Eq. (9) is the standard multivariate-Gaussian conditional mean/covariance formula; the determinant proof in Eqs. (15)-(19) verifies the unnormalized factorization used. The 'emergence' of coarse scene dynamics in Section 8.1.3 is a property of the fitted representation: optical flow is rendered from the optimized conditional means under photometric supervision only. It is not a fitted parameter renamed as a prediction, and no constant used in training is derived from the flow target. The only self-reference is the disclosed preliminary version [13], which is acknowledged in Section 1 and is not load-bearing because Section 3.2 re-derives the representation and all benchmark numbers are measured against externally reported baselines or released code. The abstract's 'first solution' priority claim is contradicted by the paper's own Table 1 (4D-Rotor-Gaussian at 277 FPS), but that is a factual overclaim about novelty, not a circular reduction; no equation in the paper reduces to its own input by construction.
Assumptions & free parameters
free parameters (6)
- Temporal Gaussian filter threshold =
p(t) < 0.05
- Initial time scaling =
half of the scene duration
- Opacity pruning threshold =
0.05
- Mask pruning threshold epsilon =
0.03
- Urban loss weights =
lambda_* (values not reported)
- Generative loss weights =
lambda_img=10,000, lambda_sds=1
assumptions (6)
- domain assumption A dynamic scene is approximated by alpha-compositing a set of 4D Gaussian primitives with factorized conditional spatial and marginal temporal distributions (Eq. 6).
- standard math The double-quaternion form in Eq. 8 parameterizes all 4D rotations, so the covariance R S S^T R^T spans all valid 4D Gaussian covariances.
- standard math The conditional/marginal factorization p(x,y,z,t) = p(t) p(x,y,z|t) holds for the unnormalized Gaussians used here.
- ad hoc to paper The 4D Spherindrical Harmonics basis cos(2*pi*n*t/T) Y_l^m(theta,phi) is orthonormal and complete enough for time- and view-dependent appearance.
- ad hoc to paper The marginal p(t) can be used as a temporal opacity filter, and Gaussians with p(t) < 0.05 can be discarded without materially changing the rendered image.
- domain assumption LiDAR point clouds provide accurate depth ground truth for urban scenes (Section 5).
invented entities (3)
-
4D Gaussian primitive
-
4D Spherindrical Harmonics (4DSH)
-
Scale-gated feature vector with scale mapping S(s)
Cite this review
Pith. "Pith review of 4D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitives." pith.science (2026). https://pith.science/paper/GBBXTQUV
@misc{pith2026241220720,
author = {Pith},
title = {Pith review of: 4D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitives},
year = {2026},
howpublished = {\url{https://pith.science/paper/GBBXTQUV}},
note = {Machine review of arXiv:2412.20720}
}
read the original abstract
Dynamic 3D scene representation and novel view synthesis are crucial for enabling immersive experiences required by AR/VR and metaverse applications. It is a challenging task due to the complexity of unconstrained real-world scenes and their temporal dynamics. In this paper, we reformulate the reconstruction of a time-varying 3D scene as approximating its underlying spatiotemporal 4D volume by optimizing a collection of native 4D primitives, i.e., 4D Gaussians, with explicit geometry and appearance modeling. Equipped with a tailored rendering pipeline, our representation can be end-to-end optimized using only photometric supervision while free viewpoint viewing at interactive frame rate, making it suitable for representing real world scene with complex dynamic. This approach has been the first solution to achieve real-time rendering of high-resolution, photorealistic novel views for complex dynamic scenes. To facilitate real-world applications, we derive several compact variants that effectively reduce the memory footprint to address its storage bottleneck. Extensive experiments validate the superiority of 4DGS in terms of visual quality and efficiency across a range of dynamic scene-related tasks (e.g., novel view synthesis, 4D generation, scene understanding) and scenarios (e.g., single object, indoor scenes, driving environments, synthetic and real data).
Forward citations
Cited by 4 Pith papers
-
On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting
Two MoE integration strategies (joint canonical MoDE vs. independent-then-route MoE-GS) improve dynamic Gaussian Splatting by composing complementary deformation priors.
-
E-4DGS: High-Fidelity Dynamic Reconstruction from the Multi-view Event Cameras
E-4DGS is a deformable 3D Gaussian Splatting method that reconstructs dynamic scenes directly from multi-view event camera streams, outperforming event-to-image baseline approaches.
-
EmbodiedOcc: Embodied 3D Occupancy Prediction for Vision-based Online Scene Understanding
EmbodiedOcc maintains an explicit global Gaussian memory that is progressively updated from monocular RGB frames, and it introduces a reorganized ScanNet benchmark for embodied 3D occupancy prediction.
-
NewtonGS: Physics-Structured Object-Level Neural Newtonian Dynamics for Gaussian Scene Animation
NewtonGS rolls out a 22-dimensional object state (pose, velocity, scale, mass, contact) with hybrid analytic and learned dynamics and maps it to all Gaussians of an object, beating analytic baselines on synthetic traj...
Reference graph
Works this paper leans on
-
[44]
In: ACM SIGGRAPH 2024 Conference Papers (2024)
Duan, Y., Wei, F., Dai, Q., He, Y., Chen, W., Chen, B.: 4d-rotor gaussian splatting: Towards efficient novel view synthesis for dynamic scenes. In: ACM SIGGRAPH 2024 Conference Papers (2024)
work page 2024
-
[1]
In: European Conference on Computer Vision (2020) 19
Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., Ng, R.: Nerf: Representing scenes as neural radi- ance fields for view synthesis. In: European Conference on Computer Vision (2020) 19
2020
-
[2]
In: IEEE International Conference on Com- puter Vision (2021)
Barron, J.T., Mildenhall, B., Tancik, M., Hedman, P., Martin-Brualla, R., Srinivasan, P.P.: Mip-nerf: A multiscale representation for anti-aliasing neural radiance fields. In: IEEE International Conference on Com- puter Vision (2021)
2021
-
[3]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Verbin, D., Hedman, P., Mildenhall, B., Zickler, T., Barron, J.T., Srinivasan, P.P.: Ref-nerf: Structured view-dependent appearance for neural radiance fields. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[4]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Li, T., Slavcheva, M., Zollhoefer, M., Green, S., Lassner, C., Kim, C., Schmidt, T., Love- grove, S., Goesele, M., Newcombe, R., et al.: Neural 3d video synthesis from multi-view video. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[5]
In: IEEE International Con- ference on Computer Vision (2023)
Wang, F., Tan, S., Li, X., Tian, Z., Liu, H.: Mixed neural voxels for fast multi-view video synthesis. In: IEEE International Con- ference on Computer Vision (2023)
2023
-
[6]
In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
Fridovich-Keil, S., Meanti, G., Warburg, F.R., Recht, B., Kanazawa, A.: K-planes: Explicit radiance fields in space, time, and appearance. In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
2023
-
[7]
In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
Cao, A., Johnson, J.: Hexplane: A fast rep- resentation for dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
2023
Show all 115 references
-
[8]
In: IEEE Con- ference on Computer Vision and Pattern Recognition (2023)
Attal, B., Huang, J.-B., Richardt, C., Zoll- hoefer, M., Kopf, J., O’Toole, M., Kim, C.: HyperReel: High-fidelity 6-DoF video with ray-conditioned sampling. In: IEEE Con- ference on Computer Vision and Pattern Recognition (2023)
2023
-
[9]
In: IEEE Con- ference on Computer Vision and Pattern Recognition (2021)
Pumarola, A., Corona, E., Pons-Moll, G., Moreno-Noguer, F.: D-nerf: Neural radiance fields for dynamic scenes. In: IEEE Con- ference on Computer Vision and Pattern Recognition (2021)
2021
-
[10]
IEEE Transactions on Visualization and Computer Graphics (2023)
Song, L., Chen, A., Li, Z., Chen, Z., Chen, L., Yuan, J., Xu, Y., Geiger, A.: Nerf- player: A streamable dynamic scene repre- sentation with decomposed neural radiance fields. IEEE Transactions on Visualization and Computer Graphics (2023)
2023
-
[11]
arXiv preprint (2022)
Abou-Chakra, J., Dayoub, F., S¨ underhauf, N.: Particlenerf: Particle based encoding for online neural radiance fields in dynamic scenes. arXiv preprint (2022)
2022
-
[12]
In: 3DV (2024)
Luiten, J., Kopanas, G., Leibe, B., Ramanan, D.: Dynamic 3d gaussians: Track- ing by persistent dynamic view synthesis. In: 3DV (2024)
2024
-
[13]
In: International Conference on Learning Representations (2024)
Yang, Z., Yang, H., Pan, Z., Zhu, X., Zhang, L.: Real-time photorealistic dynamic scene representation and rendering with 4d gaus- sian splatting. In: International Conference on Learning Representations (2024)
2024
-
[14]
In: European Conference on Computer Vision (2022)
Chen, A., Xu, Z., Geiger, A., Yu, J., Su, H.: Tensorf: Tensorial radiance fields. In: European Conference on Computer Vision (2022)
2022
-
[15]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Sun, C., Sun, M., Chen, H.-T.: Direct voxel grid optimization: Super-fast convergence for radiance fields reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[16]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Hu, T., Liu, S., Chen, Y., Shen, T., Jia, J.: Efficientnerf efficient neural radiance fields. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[17]
arXiv preprint (2023)
Chen, A., Xu, Z., Wei, X., Tang, S., Su, H., Geiger, A.: Factor fields: A unified frame- work for neural fields and beyond. arXiv preprint (2023)
2023
-
[18]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Fridovich-Keil, S., Yu, A., Tancik, M., Chen, Q., Recht, B., Kanazawa, A.: Plenoxels: Radiance fields without neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[19]
ACM Trans- actions on Graphics (2022)
M¨ uller, T., Evans, A., Schied, C., Keller, A.: Instant neural graphics primitives with a 20 multiresolution hash encoding. ACM Trans- actions on Graphics (2022)
2022
-
[20]
arXiv preprint (2020)
Zhang, K., Riegler, G., Snavely, N., Koltun, V.: Nerf++: Analyzing and improving neu- ral radiance fields. arXiv preprint (2020)
2020
-
[21]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Barron, J.T., Mildenhall, B., Verbin, D., Srinivasan, P.P., Hedman, P.: Mip-nerf 360: Unbounded anti-aliased neural radiance fields. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[22]
Barron, J.T., Mildenhall, B., Verbin, D., P. P. Srinivasan, Hedman, P.: Zip-nerf: Anti- aliased grid-based neural radiance fields. In: IEEE International Conference on Com- puter Vision (2023)
2023
-
[23]
ACM Trans- actions on Graphics (2023)
Kerbl, B., Kopanas, G., Leimk¨ uhler, T., Drettakis, G.: 3d gaussian splatting for real- time radiance field rendering. ACM Trans- actions on Graphics (2023)
2023
-
[24]
arXiv preprint (2024)
Chen, G., Wang, W.: A survey on 3d gaus- sian splatting. arXiv preprint (2024)
2024
-
[25]
Compu- tational Visual Media (2024)
Wu, T., Yuan, Y.-J., Zhang, L.-X., Yang, J., Cao, Y.-P., Yan, L.-Q., Gao, L.: Recent advances in 3d gaussian splatting. Compu- tational Visual Media (2024)
2024
-
[26]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Yu, Z., Chen, A., Huang, B., Sattler, T., Geiger, A.: Mip-splatting: Alias-free 3d gaussian splatting. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[27]
arXiv preprint (2024)
Liang, Z., Zhang, Q., Hu, W., Feng, Y., Zhu, L., Jia, K.: Analytic-splatting: Anti- aliased 3d gaussian splatting via analytic integration. arXiv preprint (2024)
2024
-
[28]
In: International Conference on Machine Learning (2024)
Cheng, K., Long, X., Yang, K., Yao, Y., Yin, W., Ma, Y., Wang, W., Chen, X.: Gaussian- pro: 3d gaussian splatting with progressive propagation. In: International Conference on Machine Learning (2024)
2024
-
[29]
arXiv preprint arXiv:2403.19615 (2024)
Song, X., Zheng, J., Yuan, S., Gao, H.- a., Zhao, J., He, X., Gu, W., Zhao, H.: Sa-gs: Scale-adaptive gaussian splatting for training-free anti-aliasing. arXiv preprint arXiv:2403.19615 (2024)
2024 arXiv
-
[30]
In: ACM Multimedia Conference (2024)
Ye, Z., Li, W., Liu, S., Qiao, P., Dou, Y.: Absgs: Recovering fine details in 3d gaussian splatting. In: ACM Multimedia Conference (2024)
2024
-
[31]
In: IEEE Conference on Com- puter Vision and Pattern Recognition (2024)
Gu´ edon, A., Lepetit, V.: Sugar: Surface- aligned gaussian splatting for efficient 3d mesh reconstruction and high-quality mesh rendering. In: IEEE Conference on Com- puter Vision and Pattern Recognition (2024)
2024
-
[32]
In: ACM SIGGRAPH 2024 Conference Papers, pp
Huang, B., Yu, Z., Chen, A., Geiger, A., Gao, S.: 2d gaussian splatting for geomet- rically accurate radiance fields. In: ACM SIGGRAPH 2024 Conference Papers, pp. 1–11 (2024)
2024
-
[33]
arXiv preprint (2024)
Yu, Z., Sattler, T., Geiger, A.: Gaussian opacity fields: Efficient and compact surface reconstruction in unbounded scenes. arXiv preprint (2024)
2024
-
[34]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Lee, J.C., Rho, D., Sun, X., Ko, J.H., Park, E.: Compact 3d gaussian representation for radiance field. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[35]
In: IEEE/ACM Transactions on Audio, Speech, and Language Processing (2021)
Zeghidour, N., Luebs, A., Omran, A., Skoglund, J., Tagliasacchi, M.: Sound- stream: An end-to-end neural audio codec. In: IEEE/ACM Transactions on Audio, Speech, and Language Processing (2021)
2021
-
[36]
In: Proceedings of the ACM on Computer Graphics and Interactive Techniques (2024)
Papantonakis, P., Kopanas, G., Kerbl, B., Lanvin, A., Drettakis, G.: Reducing the memory footprint of 3d gaussian splatting. In: Proceedings of the ACM on Computer Graphics and Interactive Techniques (2024)
2024
-
[37]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Niedermayr, S., Stumpfegger, J., Wester- mann, R.: Compressed 3d gaussian splat- ting for accelerated novel view synthesis. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[38]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Lu, T., Yu, M., Xu, L., Xiangli, Y., Wang, L., Lin, D., Dai, B.: Scaffold-gs: Structured 21 3d gaussians for view-adaptive rendering. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[39]
In: European Conference on Computer Vision (2024)
Chen, Y., Wu, Q., Cai, J., Harandi, M., Lin, W.: Hac: Hash-grid assisted context for 3d gaussian splatting compression. In: European Conference on Computer Vision (2024)
2024
-
[40]
In: IEEE Conference on Computer Vision and Pattern Recogni- tion (2023)
Yang, Z., Gao, X., Zhou, W., Jiao, S., Zhang, Y., Jin, X.: Deformable 3d gaus- sians for high-fidelity monocular dynamic scene reconstruction. In: IEEE Conference on Computer Vision and Pattern Recogni- tion (2023)
2023
-
[41]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Wu, G., Yi, T., Fang, J., Xie, L., Zhang, X., Wei, W., Liu, W., Tian, Q., Xinggang, W.: 4d gaussian splatting for real-time dynamic scene rendering. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[42]
arXiv preprint (2023)
Liang, Y., Khan, N., Li, Z., Nguyen-Phuoc, T., Lanman, D., Tompkin, J., Xiao, L.: Gaufre: Gaussian deformation fields for real- time dynamic novel view synthesis. arXiv preprint (2023)
2023
-
[43]
arXiv preprint (2023)
Kratimenos, A., Lei, J., Daniilidis, K.: Dynmf: Neural motion factorization for real- time dynamic view synthesis with 3d gaus- sian splatting. arXiv preprint (2023)
2023
-
[45]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Huang, Y.-H., Sun, Y.-T., Yang, Z., Lyu, X., Cao, Y.-P., Qi, X.: Sc-gs: Sparse-controlled gaussian splatting for editable dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[46]
In: ACM Transactions on Graphics (2024)
Xu, Z., Xu, Y., Yu, Z., Peng, S., Sun, J., Bao, H., Zhou, X.: Representing long vol- umetric video with temporal gaussian hier- archy. In: ACM Transactions on Graphics (2024)
2024
-
[47]
In: IEEE Conference on Computer Vision and Pattern Recogni- tion (2025)
Wang, Y., Yang, P., Xu, Z., Sun, J., Zhang, Z., Chen, Y., Bao, H., Peng, S., Zhou, X.: Freetimegs: Free gaussian prim- itives at anytime anywhere for dynamic scene reconstruction. In: IEEE Conference on Computer Vision and Pattern Recogni- tion (2025)
2025
-
[48]
In: Conference on Robot Learning (2017)
Dosovitskiy, A., Ros, G., Codevilla, F., Lopez, A., Koltun, V.: Carla: An open urban driving simulator. In: Conference on Robot Learning (2017)
2017
-
[49]
In: Field and Service Robotics: Results of the 11th International Conference (2018)
Shah, S., Dey, D., Lovett, C., Kapoor, A.: Airsim: High-fidelity visual and physi- cal simulation for autonomous vehicles. In: Field and Service Robotics: Results of the 11th International Conference (2018)
2018
-
[50]
In: IEEE Conference on Computer Vision and Pattern Recognition (2021)
Chen, Y., Rong, F., Duggal, S., Wang, S., Yan, X., Manivasagam, S., Xue, S., Yumer, E., Urtasun, R.: Geosim: Realistic video simulation via geometry-aware composition for self-driving. In: IEEE Conference on Computer Vision and Pattern Recognition (2021)
2021
-
[51]
In: International Conference on Learning Representations (2023)
Xie, Z., Zhang, J., Li, W., Zhang, F., Zhang, L.: S-nerf: Neural radiance fields for street views. In: International Conference on Learning Representations (2023)
2023
-
[52]
: Mars: An instance-aware, modu- lar and realistic simulator for autonomous driving
Wu, Z., Liu, T., Luo, L., Zhong, Z., Chen, J., Xiao, H., Hou, C., Lou, H., Chen, Y., Yang, R., et al. : Mars: An instance-aware, modu- lar and realistic simulator for autonomous driving. In: CAAI International Conference on Artificial Intelligence (2023). Springer
2023
-
[53]
In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
Yang, Z., Chen, Y., Wang, J., Manivasagam, S., Ma, W.-C., Yang, A.J., Urtasun, R.: Unisim: A neural closed-loop sensor simu- lator. In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
2023
-
[54]
arXiv preprint (2023)
Guo, J., Deng, N., Li, X., Bai, Y., Shi, B., Wang, C., Ding, C., Wang, D., Li, Y.: Streetsurf: Extending multi-view implicit surface reconstruction to street views. arXiv preprint (2023)
2023
-
[55]
arXiv preprint (2024)
Chen, Y., Zhang, J., Xie, Z., Li, W., 22 Zhang, F., Lu, J., Zhang, L.: S-nerf++: Autonomous driving simulation via neu- ral reconstruction and generation. arXiv preprint (2024)
2024
-
[56]
: Vastgaussian: Vast 3d gaussians for large scene reconstruction
Lin, J., Li, Z., Tang, X., Liu, J., Liu, S., Liu, J., Lu, Y., Wu, X., Xu, S., Yan, Y., et al. : Vastgaussian: Vast 3d gaussians for large scene reconstruction. In: IEEE Con- ference on Computer Vision and Pattern Recognition (2024)
2024
-
[57]
In: European Conference on Computer Vision (2024)
Yan, Y., Lin, H., Zhou, C., Wang, W., Sun, H., Zhan, K., Lang, X., Zhou, X., Peng, S.: Street gaussians for modeling dynamic urban scenes. In: European Conference on Computer Vision (2024)
2024
-
[58]
arXiv preprint (2024)
Liu, Y., Guan, H., Luo, C., Fan, L., Peng, J., Zhang, Z.: Citygaussian: Real-time high- quality large-scale scene rendering with gaussians. arXiv preprint (2024)
2024
-
[59]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Zhou, H., Shao, J., Xu, L., Bai, D., Qiu, W., Liu, B., Wang, Y., Geiger, A., Liao, Y.: Hugs: Holistic urban 3d scene under- standing via gaussian splatting. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[60]
In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
Turki, H., Zhang, J.Y., Ferroni, F., Ramanan, D.: Suds: Scalable urban dynamic scenes. In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
2023
-
[61]
: Emernerf: Emer- gent spatial-temporal scene decomposition via self-supervision
Yang, J., Ivanovic, B., Litany, O., Weng, X., Kim, S.W., Li, B., Che, T., Xu, D., Fidler, S., Pavone, M., et al. : Emernerf: Emer- gent spatial-temporal scene decomposition via self-supervision. In: International Con- ference on Learning Representations (2023)
2023
-
[62]
arXiv preprint (2024)
Huang, N., Wei, X., Zheng, W., An, P., Lu, M., Zhan, W., Tomizuka, M., Keutzer, K., Zhang, S.: Sˆ 3gaussian: Self-supervised street gaussians for autonomous driving. arXiv preprint (2024)
2024
-
[63]
arXiv preprint (2023)
Chen, Y., Gu, C., Jiang, J., Zhu, X., Zhang, L.: Periodic vibration gaussian: Dynamic urban scene reconstruction and real-time rendering. arXiv preprint (2023)
2023
-
[64]
In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
Jain, A., Mildenhall, B., Barron, J.T., Abbeel, P., Poole, B.: Zero-shot text-guided object generation with dream fields. In: IEEE Conference on Computer Vision and Pattern Recognition (2022)
2022
-
[65]
In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
Poole, B., Jain, A., Barron, J.T., Milden- hall, B.: Dreamfusion: Text-to-3d using 2d diffusion. In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
2023
-
[66]
In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
Lin, C.-H., Gao, J., Tang, L., Takikawa, T., Zeng, X., Huang, X., Kreis, K., Fidler, S., Liu, M.-Y., Lin, T.-Y.: Magic3d: High- resolution text-to-3d content creation. In: IEEE Conference on Computer Vision and Pattern Recognition (2023)
2023
-
[67]
In: International Conference on Learning Rep- resentations (2024)
Tang, J., Ren, J., Zhou, H., Liu, Z., Zeng, G.: Dreamgaussian: Generative gaussian splat- ting for efficient 3d content creation. In: International Conference on Learning Rep- resentations (2024)
2024
-
[68]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Yi, T., Fang, J., Wang, J., Wu, G., Xie, L., Zhang, X., Liu, W., Tian, Q., Wang, X.: Gaussiandreamer: Fast generation from text to 3d gaussians by bridging 2d and 3d diffusion models. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[69]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Chen, Z., Wang, F., Wang, Y., Liu, H.: Text- to-3d using gaussian splatting. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[70]
arXiv preprint (2024)
Gu, C., Yang, Z., Pan, Z., Zhu, X., Zhang, L.: Tetrahedron splatting for 3d generation. arXiv preprint (2024)
2024
-
[71]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Bahmani, S., Skorokhodov, I., Rong, V., Wetzstein, G., Guibas, L., Wonka, P., Tulyakov, S., Park, J.J., Tagliasacchi, A., Lindell, D.B.: 4d-fy: Text-to-4d generation using hybrid score distillation sampling. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[72]
: 23 Text-to-4d dynamic scene generation
Singer, U., Sheynin, S., Polyak, A., Ashual, O., Makarov, I., Kokkinos, F., Goyal, N., Vedaldi, A., Parikh, D., Johnson, J., et al. : 23 Text-to-4d dynamic scene generation. In: International Conference on Machine Learn- ing (2023)
2023
-
[73]
In: International Conference on Learning Rep- resentations (2024)
Jiang, Y., Zhang, L., Gao, J., Hu, W., Yao, Y.: Consistent4d: Consistent 360 ° dynamic object generation from monocular video. In: International Conference on Learning Rep- resentations (2024)
2024
-
[74]
In: International Conference on Learning Representations (2025)
Xie, Y., Yao, C.-H., Voleti, V., Jiang, H., Jampani, V.: SV4D: Dynamic 3d content generation with multi-frame and multi-view consistency. In: International Conference on Learning Representations (2025)
2025
-
[75]
arXiv preprint (2025)
Yao, C.-H., Xie, Y., Voleti, V., Jiang, H., Jampani, V.: SV4D2.0: Enhancing spatio- temporal consistency in multi-view video diffusion for high-quality 4d generation. arXiv preprint (2025)
2025
-
[76]
arXiv preprint (2023)
Ren, J., Pan, L., Tang, J., Zhang, C., Cao, A., Zeng, G., Liu, Z.: Dreamgaus- sian4d: Generative 4d gaussian splatting. arXiv preprint (2023)
2023
-
[77]
arXiv preprint (2023)
Yin, Y., Xu, D., Wang, Z., Zhao, Y., Wei, Y.: 4dgen: Grounded 4d content generation with spatial-temporal consistency. arXiv preprint (2023)
2023
-
[78]
In: European Conference on Computer Vision (2024)
Zeng, Y., Jiang, Y., Zhu, S., Lu, Y., Lin, Y., Zhu, H., Hu, W., Cao, X., Yao, Y.: Stag4d: Spatial-temporal anchored genera- tive 4d gaussians. In: European Conference on Computer Vision (2024)
2024
-
[79]
arXiv preprint (2024)
Pan, Z., Yang, Z., Zhu, X., Zhang, L.: Effi- cient4d: Fast dynamic 3d object generation from a single-view video. arXiv preprint (2024)
2024
-
[80]
In: European Conference on Computer Vision (2024)
Wu, Z., Yu, C., Jiang, Y., Cao, C., Wang, F., Bai, X.: Sc4d: Sparse-controlled video- to-4d generation and motion transfer. In: European Conference on Computer Vision (2024)
2024
-
[81]
arXiv preprint (2024)
Gao, Q., Xu, Q., Cao, Z., Mildenhall, B., Ma, W., Chen, L., Tang, D., Neumann, U.: Gaussianflow: Splatting gaussian dynam- ics for 4d content creation. arXiv preprint (2024)
2024
-
[82]
In: IEEE Conference on Computer Vision and Pattern Recognition (2025)
Wu, R., Gao, R., Poole, B., Trevithick, A., Zheng, C., Barron, J.T., Holynski, A.: CAT4D: Create Anything in 4D with Multi- View Video Diffusion Models. In: IEEE Conference on Computer Vision and Pattern Recognition (2025)
2025
-
[83]
In: IEEE International Conference on Com- puter Vision (2023)
Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., Lo, W.-Y., Dol- lar, P., Girshick, R.: Segment anything. In: IEEE International Conference on Com- puter Vision (2023)
2023
-
[84]
arXiv preprint (2024)
Ji, S., Wu, G., Fang, J., Cen, J., Yi, T., Liu, W., Tian, Q., Wang, X.: Segment any 4d gaussians. arXiv preprint (2024)
2024
-
[85]
arXiv preprint (2023)
Cen, J., Fang, J., Yang, C., Xie, L., Zhang, X., Shen, W., Tian, Q.: Segment any 3d gaussians. arXiv preprint (2023)
2023
-
[86]
In: IEEE International Conference on Com- puter Vision (2021)
Zhi, S., Laidlow, T., Leutenegger, S., Davi- son, A.J.: In-place scene labelling and under- standing with implicit scene representation. In: IEEE International Conference on Com- puter Vision (2021)
2021
-
[87]
In: IEEE Con- ference on Computer Vision and Pattern Recognition (2024)
Kim, C.M., Wu, M., Kerr, J., Goldberg, K., Tancik, M., Kanazawa, A.: Garfield: Group anything with radiance fields. In: IEEE Con- ference on Computer Vision and Pattern Recognition (2024)
2024
-
[88]
: Segment anything in 3d with nerfs
Cen, J., Zhou, Z., Fang, J., Shen, W., Xie, L., Jiang, D., Zhang, X., Tian, Q., et al. : Segment anything in 3d with nerfs. In: Advances in Neural Information Processing Systems (2023)
2023
-
[89]
arXiv preprint (2023)
Ye, M., Danelljan, M., Yu, F., Ke, L.: Gaus- sian grouping: Segment and edit anything in 3d scenes. arXiv preprint (2023)
2023
-
[90]
In: IEEE Conference 24 on Computer Vision and Pattern Recogni- tion (2024)
Ying, H., Yin, Y., Zhang, J., Wang, F., Yu, T., Huang, R., Fang, L.: Omniseg3d: Omniversal 3d segmentation via hierarchical contrastive learning. In: IEEE Conference 24 on Computer Vision and Pattern Recogni- tion (2024)
2024
-
[91]
In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
Chen, Y., Chen, Z., Zhang, C., Wang, F., Yang, X., Wang, Y., Cai, Z., Yang, L., Liu, H., Lin, G.: Gaussianeditor: Swift and con- trollable 3d editing with gaussian splatting. In: IEEE Conference on Computer Vision and Pattern Recognition (2024)
2024
-
[92]
IEEE Trans- actions on Visualization and Computer Graphics (2002)
Zwicker, M., Pfister, H., Van Baar, J., Gross, M.: Ewa splatting. IEEE Trans- actions on Visualization and Computer Graphics (2002)
2002
-
[93]
Pro- ceedings of the IRE (1952)
Huffman, D.A.: A method for the construc- tion of minimum-redundancy codes. Pro- ceedings of the IRE (1952)
1952
-
[94]
In: Advances in Neural Information Processing Systems (2021)
Xie, E., Wang, W., Yu, Z., Anandkumar, A., Alvarez, J.M., Luo, P.: Segformer: Sim- ple and efficient design for semantic seg- mentation with transformers. In: Advances in Neural Information Processing Systems (2021)
2021
-
[95]
In: International Confer- ence on Learning Representations (2024)
Liu, Y., Lin, C., Zeng, Z., Long, X., Liu, L., Komura, T., Wang, W.: Syncdreamer: Gen- erating multiview-consistent images from a single-view image. In: International Confer- ence on Learning Representations (2024)
2024
-
[96]
In: IEEE International Conference on Com- puter Vision (2023)
Liu, R., Wu, R., Van Hoorick, B., Tok- makov, P., Zakharov, S., Vondrick, C.: Zero- 1-to-3: Zero-shot one image to 3d object. In: IEEE International Conference on Com- puter Vision (2023)
2023
-
[97]
https://stability.ai/news/ stable-zero123-3d-generation (2023)
AI, S.: Stable Zero123: Quality 3D Object Generation from Sin- gle Images. https://stability.ai/news/ stable-zero123-3d-generation (2023)
2023
-
[98]
In: IEEE Conference on Computer Vision and Pattern Recognition (2018)
Zhang, R., Isola, P., Efros, A.A., Shechtman, E., Wang, O.: The unreasonable effective- ness of deep features as a perceptual metric. In: IEEE Conference on Computer Vision and Pattern Recognition (2018)
2018
-
[99]
In: Advances in Neu- ral Information Processing Systems (2012)
Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolu- tional neural networks. In: Advances in Neu- ral Information Processing Systems (2012)
2012
-
[100]
: Dataset and pipeline for multi-view light-field video
Sabater, N., Boisson, G., Vandame, B., Ker- biriou, P., Babon, F., Hog, M., Gendrot, R., Langlois, T., Bureller, O., Schubert, A., et al. : Dataset and pipeline for multi-view light-field video. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2017)
2017
-
[101]
In: IEEE Con- ference on Computer Vision and Pattern Recognition (2024)
Li, Z., Chen, Z., Li, Z., Xu, Y.: Space- time gaussian feature splatting for real-time dynamic view synthesis. In: IEEE Con- ference on Computer Vision and Pattern Recognition (2024)
2024
-
[102]
In: Advances in Neural Information Processing Systems (2024)
Lee, J., Won, C., Jung, H., Bae, I., Jeon, H.-G.: Fully explicit dynamic gaussian splat- ting. In: Advances in Neural Information Processing Systems (2024)
2024
-
[103]
ACM Transac- tions on Graphics (2019)
Lombardi, S., Simon, T., Saragih, J., Schwartz, G., Lehrmann, A., Sheikh, Y.: Neural volumes: learning dynamic render- able volumes from images. ACM Transac- tions on Graphics (2019)
2019
-
[104]
ACM Transactions on Graphics (2019)
Mildenhall, B., Srinivasan, P.P., Ortiz- Cayon, R., Kalantari, N.K., Ramamoorthi, R., Ng, R., Kar, A.: Local light field fusion: Practical view synthesis with prescriptive sampling guidelines. ACM Transactions on Graphics (2019)
2019
-
[105]
In: Advances in Neural Information Processing Systems (2022)
Li, L., Shen, Z., Wang, Z., Shen, L., Tan, P.: Streaming radiance fields for 3d video syn- thesis. In: Advances in Neural Information Processing Systems (2022)
2022
-
[106]
arXiv preprint (2024)
Cho, W.O., Cho, I., Kim, S., Bae, J., Uh, Y., Kim, S.J.: 4d scaffold gaussian splat- ting for memory efficient dynamic scene reconstruction. arXiv preprint (2024)
2024
-
[107]
arXiv preprint (2023) 25
Shi, X., Huang, Z., Bian, W., Li, D., Zhang, M., Cheung, K.C., See, S., Qin, H., Dai, J., Li, H.: Videoflow: Exploiting temporal cues for multi-frame optical flow estimation. arXiv preprint (2023) 25
2023
-
[108]
In: SIGGRAPH Asia Confer- ence Papers (2022)
Fang, J., Yi, T., Wang, X., Xie, L., Zhang, X., Liu, W., Nießner, M., Tian, Q.: Fast dynamic radiance fields with time-aware neural voxels. In: SIGGRAPH Asia Confer- ence Papers (2022)
2022
-
[109]
IEEE Transactions on Visualiza- tion and Computer Graphics (2024)
Gan, W., Xu, H., Huang, Y., Chen, S., Yokoya, N.: V4d: Voxel for 4d novel view synthesis. IEEE Transactions on Visualiza- tion and Computer Graphics (2024)
2024
-
[110]
arXiv preprint (2014)
Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint (2014)
2014
-
[111]
In: European Conference on Com- puter Vision (2016)
Rastegari, M., Ordonez, V., Redmon, J., Farhadi, A.: Xnor-net: Imagenet classifica- tion using binary convolutional neural net- works. In: European Conference on Com- puter Vision (2016)
2016
-
[112]
In: Advances in Neural Information Processing Systems (2022)
Wu, T., Zhong, F., Tagliasacchi, A., Cole, F., Oztireli, C.: Dˆ 2nerf: Self-supervised decoupling of dynamic and static objects from a monocular video. In: Advances in Neural Information Processing Systems (2022)
2022
-
[113]
In: ACM Transactions on Graphics (2021)
Park, K., Sinha, U., Hedman, P., Bar- ron, J.T., Bouaziz, S., Goldman, D.B., Martin-Brualla, R., Seitz, S.M.: Hypern- erf: A higher-dimensional representation for topologically varying neural radiance fields. In: ACM Transactions on Graphics (2021)
2021
-
[114]
: Scala- bility in perception for autonomous driving: Waymo open dataset
Sun, P., Kretzschmar, H., Dotiwalla, X., Chouard, A., Patnaik, V., Tsui, P., Guo, J., Zhou, Y., Chai, Y., Caine, B., et al. : Scala- bility in perception for autonomous driving: Waymo open dataset. In: IEEE Conference on Computer Vision and Pattern Recogni- tion (2020)
2020
-
[115]
In: IEEE Con- ference on Computer Vision and Pattern Recognition (2021) 26
Li, Z., Niklaus, S., Snavely, N., Wang, O.: Neural scene flow fields for space-time view synthesis of dynamic scenes. In: IEEE Con- ference on Computer Vision and Pattern Recognition (2021) 26
2021
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.