Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians
read the original abstract
The recent 3D Gaussian splatting (3D-GS) has shown remarkable rendering fidelity and efficiency compared to NeRF-based neural scene representations. While demonstrating the potential for real-time rendering, 3D-GS encounters rendering bottlenecks in large scenes with complex details due to an excessive number of Gaussian primitives located within the viewing frustum. This limitation is particularly noticeable in zoom-out views and can lead to inconsistent rendering speeds in scenes with varying details. Moreover, it often struggles to capture the corresponding level of details at different scales with its heuristic density control operation. Inspired by the Level-of-Detail (LOD) techniques, we introduce Octree-GS, featuring an LOD-structured 3D Gaussian approach supporting level-of-detail decomposition for scene representation that contributes to the final rendering results. Our model dynamically selects the appropriate level from the set of multi-resolution anchor points, ensuring consistent rendering performance with adaptive LOD adjustments while maintaining high-fidelity rendering results.
This paper has not been read by Pith yet.
Forward citations
Cited by 31 Pith papers
-
GaussLite: Online Task-Conditioned 3D Gaussian Splatting for Real-Time Robotic Mapping
GaussLite conditions 3D Gaussian Splatting seeding density, gradient flow, and scaling on task relevance masks derived from LLM-parsed natural language and open-vocabulary detection, yielding +2.72 dB ROI PSNR gains o...
-
ZipSplat: Fewer Gaussians, Better Splats
ZipSplat uses multi-view token extraction followed by k-means clustering and attention to decode compact scene tokens into unconstrained 3D Gaussians, achieving SOTA pose-free results with ~6x fewer primitives.
-
Revisiting Photometric Ambiguity for Accurate Gaussian-Splatting Surface Reconstruction
AmbiSuR adds intrinsic photometric disambiguation and a self-indication module to Gaussian Splatting to resolve ambiguities and improve surface reconstruction accuracy.
-
ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstruction
ClipGStream enables scalable flicker-free reconstruction of long dynamic multi-view videos by performing stream optimization at the clip level with clip-independent spatio-temporal fields, residual anchor compensation...
-
RobotPan: A 360$^\circ$ Surround-View Robotic Vision System for Embodied Perception
RobotPan predicts metric-scaled compact 3D Gaussians from calibrated multi-view inputs via spherical coordinates and hierarchical voxel priors for real-time 360° robotic perception and reconstruction.
-
ProDiG: Progressive Diffusion-Guided Gaussian Splatting for Aerial to Ground Reconstruction
ProDiG progressively transforms aerial Gaussian splats into coherent ground-level 3D reconstructions via diffusion guidance and specialized attention modules.
-
EAG-PT: Emission-Aware Gaussians and Path Tracing for Diffuse Indoor Scene Reconstruction and Editing
EAG-PT reconstructs indoor scenes with emission-separated 2D Gaussians and uses path tracing for physically consistent editing of diffuse global illumination.
-
Structure-Aware Gaussian Splatting for Large-Scale Scene Reconstruction
SIG frequency scheduler and sphere-constrained Gaussians enable more efficient and higher-quality 3D Gaussian Splatting for large-scale scenes by synchronizing supervision with representation frequencies.
-
PointSplat: Compact Gaussian Splatting via Human-Centric Prediction
PointSplat infers compact Gaussian splats directly in 3D space from input point sets via ray casting and Point-Image Transformer to reduce inter-view redundancy and improve novel-view quality for humans.
-
Monte Carlo Energy Aggregation for Mobile 3D Gaussian Splatting
Flux-GS is a mobile-optimized 3D Gaussian Splatting method that compresses specular energy via Monte Carlo aggregation, recovers details with attribute-conditioned SH offsets, and uses multi-view guidance for densific...
-
Splaxel: Efficient Distributed Training of 3D Gaussian Splatting for Large-scale Scene Reconstruction via Pixel-level Communication
Splaxel achieves up to 7.6x speedup in distributed 3DGS training on scenes with up to 120M Gaussians by using pixel-level communication and visibility prediction while preserving reconstruction quality.
-
EvoGS: Constructing Continuous-Layered Gaussian Splatting with Evolution Tree for Scalable 3D Streaming
EvoGS proposes the first continuous-layering 3D Gaussian Splatting representation via an Evolution Tree to reduce splat redundancy and transmission costs for scalable streaming.
-
Kinematics-Driven Gaussian Shape Deformation for Blurry Monocular Dynamic Scenes
Kinematics-GS reparameterizes Gaussian shapes along motion trajectories with a kinematic prior to reconstruct dynamic 3D scenes from blurry monocular videos by separating dynamic and static components and using coarse...
-
SatSurfGS: Generalizable 2D Gaussian Splatting for Sparse-View Satellite Surface Reconstruction
SatSurfGS improves sparse-view satellite surface reconstruction accuracy and generalization by adding confidence-aware monocular-multi-view fusion, cross-stage residual guidance, and bidirectional routing loss to 2D G...
-
Softmax-GS: Generalized Gaussians Learning When to Blend or Bound
Softmax-GS generalizes 3D Gaussians with learnable softmax competition in overlaps to enable a spectrum from blending to crisp edges while preserving order invariance and transmittance.
-
MesonGS++: Post-training Compression of 3D Gaussian Splatting with Hyperparameter Searching
MesonGS++ achieves over 34x compression of 3D Gaussian Splatting models with preserved or improved PSNR by using size-aware joint optimization of pruning and quantization hyperparameters via discrete sampling and 0-1 ...
-
You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenes
YOGO reformulates stochastic 3D Gaussian Splatting into a deterministic budget-aware system and supplies an ultra-dense dataset to enforce physical fidelity over viewpoint interpolation.
-
Unfolding 3D Gaussian Splatting via Iterative Gaussian Synopsis
Iterative Gaussian Synopsis creates compact multi-level LOD hierarchies for 3D Gaussian Splatting via top-down unfolding with adaptive pruning, preserving quality while cutting storage.
-
Visually-grounded Humanoid Agents
A coupled world-agent framework uses 3D Gaussian reconstruction and first-person RGB-D perception with iterative planning to enable goal-directed, collision-avoiding humanoid behavior in novel reconstructed scenes.
-
From Orbit to Ground: Generative City Photogrammetry from Extreme Off-Nadir Satellite Images
A technique reconstructs large urban areas from sparse extreme off-nadir satellite images by modeling geometry as a Z-monotonic 2.5D height map SDF and applying a generative network to restore plausible textures on th...
-
ACE-GS: Acing the Trade-off with Accurate, Compact and Efficient 3D Gaussian Splatting
ACE-GS adds momentum consistency densification, statistical sparsification, and residual frequency compensation to 3D Gaussian Splatting, claiming 3.7x faster training, 3-5 minute convergence, and up to 0.89 dB PSNR g...
-
QueryGaussian: Scalable and Training-Free Open-Vocabulary 3D Instance Retrieval
QueryGaussian decouples semantic understanding from 3D geometry via 2D model lifting and temporal fusion, matching prior accuracy while cutting memory over 70% and speeding inference 180x on city-scale Gaussian scenes.
-
KC-3DGS: Kurtosis-Constrained Gaussian Splatting for High-Fidelity View Synthesis
KC-3DGS adds multi-scale wavelet alignment, kurtosis concentration, and cross-band covariance losses to 3DGS training to reduce oversmoothing and improve perceptual quality in view synthesis.
-
MMGS: 10$\times$ Compressed 3DGS through Optimal Transport Aggregation based on Multi-view Ranking
MMGS compresses 3DGS models to 10% primitives with preserved rendering quality and 10x training speedup by combining multi-view geometric ranking with global OT aggregation and densification.
-
GaussianZoom: Progressive Zoom-in Generative 3D Gaussian Splatting with Geometric and Semantic Guidance
GaussianZoom enables high-fidelity extreme zoom-in 3D rendering from low-res inputs via an iterative framework combining geometry-consistent modeling, depth-based super-resolution, VLM detail synthesis, and an expanda...
-
MesonGS++: Post-training Compression of 3D Gaussian Splatting with Hyperparameter Searching
MesonGS++ achieves over 34x compression of 3D Gaussian Splatting models post-training while preserving or exceeding original rendering quality through size-aware hyperparameter optimization.
-
Long-LRM++: Preserving Fine Details in Feed-Forward Wide-Coverage Reconstruction
Long-LRM++ achieves real-time 14 FPS high-fidelity 360-degree scene reconstruction from 32-64 views by using semi-explicit Gaussians plus a light decoder, matching LaCT quality on DL3DV and improving depth prediction.
-
MetroGS: Efficient and Stable Reconstruction of Geometrically Accurate High-Fidelity Large-Scale Scenes
MetroGS combines distributed 2D Gaussian Splatting with structured dense enhancement, progressive hybrid optimization, and depth-guided appearance modeling to deliver higher geometric accuracy and stability in large-s...
-
Turbo-GS: Accelerating 3D Gaussian Fitting for High-Quality Radiance Fields
Turbo-GS accelerates 3D Gaussian Splatting training via dilated rendering of pixel subsets, convergence-aware Gaussian budget allocation, and combined positional-appearance error densification to enable faster 4K fitt...
-
LIVE-GS: LLM Powers Interactive VR Experience with Physics-Aware Gaussian Splatting
LIVE-GS uses an LLM to predict physical parameters from static Gaussian assets in 10 seconds for physics-aware VR interactions, validated by interviews, baseline comparisons, and user studies.
-
A Survey on 3D Gaussian Splatting
A survey compiling principles, applications, benchmarks, and challenges of 3D Gaussian Splatting for explicit 3D scene representation.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.