R²-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction
read the original abstract
3D Gaussian splatting (3DGS) has shown promising results in image rendering and surface reconstruction. However, its potential in volumetric reconstruction tasks, such as X-ray computed tomography, remains under-explored. This paper introduces R$^2$-Gaussian, the first 3DGS-based framework for sparse-view tomographic reconstruction. By carefully deriving X-ray rasterization functions, we discover a previously unknown integration bias in the standard 3DGS formulation, which hampers accurate volume retrieval. To address this issue, we propose a novel rectification technique via refactoring the projection from 3D to 2D Gaussians. Our new method presents three key innovations: (1) introducing tailored Gaussian kernels, (2) extending rasterization to X-ray imaging, and (3) developing a CUDA-based differentiable voxelizer. Experiments on synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art approaches in accuracy and efficiency. Crucially, it delivers high-quality results in 4 minutes, which is 12$\times$ faster than NeRF-based methods and on par with traditional algorithms. Code and models are available on the project page https://github.com/Ruyi-Zha/r2_gaussian.
This paper has not been read by Pith yet.
Forward citations
Cited by 4 Pith papers
-
Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography
Diagnoses PVFD optimization drift in sparse-view Gaussian tomography and introduces LADES controller using annealed dropout and population-based stopping to enhance volumetric fidelity.
-
3D Skew Gaussian Splatting with Any Camera Trajectory Visualization Engine
3D Skew Gaussian Splatting extends standard 3D Gaussian Splatting with skew primitives, enhanced opacity, depth-aware densification, and a re-derived CUDA pipeline for a free-camera visualization engine.
-
3D Gaussian Splatting for Annular Dark Field Scanning Transmission Electron Microscopy Tomography Reconstruction
DenZa-Gaussian adapts 3D Gaussian Splatting for ADF-STEM tomography by modeling scattering as a learnable scalar field, adding tilt-angle normalization, and using a Fourier amplitude loss to improve sparse-view 3D rec...
-
3DGR-CT: Sparse-View CT Reconstruction with a 3D Gaussian Representation
3DGR-CT adapts 3D Gaussian splatting with FBP-guided initialization and differentiable CT projection for sparse-view reconstruction, claiming better accuracy and speed than prior methods.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.