SparseGS: Sparse View Synthesis using 3D Gaussian Splatting
read the original abstract
3D Gaussian Splatting (3DGS) has recently enabled real-time rendering of unbounded 3D scenes for novel view synthesis. However, this technique requires dense training views to accurately reconstruct 3D geometry. A limited number of input views will significantly degrade reconstruction quality, resulting in artifacts such as "floaters" and "background collapse" at unseen viewpoints. In this work, we introduce SparseGS, an efficient training pipeline designed to address the limitations of 3DGS in scenarios with sparse training views. SparseGS incorporates depth priors, novel depth rendering techniques, and a pruning heuristic to mitigate floater artifacts, alongside an Unseen Viewpoint Regularization module to alleviate background collapses. Our extensive evaluations on the Mip-NeRF360, LLFF, and DTU datasets demonstrate that SparseGS achieves high-quality reconstruction in both unbounded and forward-facing scenarios, with as few as 12 and 3 input images, respectively, while maintaining fast training and real-time rendering capabilities.
This paper has not been read by Pith yet.
Forward citations
Cited by 11 Pith papers
-
Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography
Diagnoses PVFD optimization drift in sparse-view Gaussian tomography and introduces LADES controller using annealed dropout and population-based stopping to enhance volumetric fidelity.
-
From Uncertainty to Stability and Fidelity: Guiding Sparse-View 3D Gaussian Splatting with Fisher Information
Introduces Fisher Information-guided stereo augmentation and uncertainty-aware regularization to mitigate overfitting in sparse-view 3D Gaussian Splatting.
-
PanoPlane: Plane-Aware Panoramic Completion for Sparse-View Indoor 3D Gaussian Splatting
PanoPlane achieves up to 17.8% PSNR gains in sparse-view indoor novel view synthesis by using training-free plane-aware panoramic completion to supervise 3D Gaussian Splatting.
-
PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting
PairDropGS applies paired dropout-induced low-frequency consistency regularization and progressive scheduling to improve stability and quality in sparse-view 3D Gaussian Splatting over prior dropout methods.
-
Spatiotemporal Degradation-Aware 3D Gaussian Splatting for Realistic Underwater Scene Reconstruction
MarineSTD-GS disentangles true underwater scene appearance from video degradations by deriving degraded Gaussian colors from paired intrinsic Gaussians via a physical spatiotemporal model.
-
PairDropGS: Paired Dropout-Induced Consistency Regularization for Sparse-View Gaussian Splatting
PairDropGS uses paired dropout with low-frequency consistency regularization and progressive scheduling to stabilize and improve sparse-view 3D Gaussian Splatting.
-
Generative 3D Gaussians with Learned Density Control
DeG models 3D Gaussians via learned octree density and uses VecSeq Sobol re-indexing to turn set generation into sequence modeling, claiming SOTA quality in single-image-to-3D.
-
Sparse-View 3D Gaussian Splatting in the Wild
A new sparse-view 3D Gaussian splatting method for unconstrained scenes with distractors combines diffusion-based reference-guided refinement and sparsity-aware Gaussian replication to achieve better rendering quality.
-
DualSplat: Robust 3D Gaussian Splatting via Pseudo-Mask Bootstrapping from Reconstruction Failures
DualSplat bootstraps object-level pseudo-masks from initial 3DGS reconstruction failures using residuals and SAM2 to enable robust second-pass optimization in transient-heavy scenes.
-
RoDyGS: Robust Dynamic Gaussian Splatting for Casual Videos
RoDyGS separates static and dynamic elements in monocular videos using Gaussian splatting with regularization and introduces the Kubric-MRig benchmark for pose-free dynamic novel view synthesis.
-
A Survey on 3D Gaussian Splatting
A survey compiling principles, applications, benchmarks, and challenges of 3D Gaussian Splatting for explicit 3D scene representation.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.