RaySplats: Ray Tracing based Gaussian Splatting
read the original abstract
3D Gaussian Splatting (3DGS) is a process that enables the direct creation of 3D objects from 2D images. This representation offers numerous advantages, including rapid training and rendering. However, a significant limitation of 3DGS is the challenge of incorporating light and shadow reflections, primarily due to the utilization of rasterization rather than ray tracing for rendering. This paper introduces RaySplats, a model that employs ray-tracing based Gaussian Splatting. Rather than utilizing the projection of Gaussians, our method employs a ray-tracing mechanism, operating directly on Gaussian primitives represented by confidence ellipses with RGB colors. In practice, we compute the intersection between ellipses and rays to construct ray-tracing algorithms, facilitating the incorporation of meshes with Gaussian Splatting models and the addition of lights, shadows, and other related effects.
This paper has not been read by Pith yet.
Forward citations
Cited by 6 Pith papers
-
RAGA: Real Time Ray Traced Gaussian Shadow Casting for 3DGS Avatar-Scene Interaction
Introduces ray-traced Gaussian shadow casting via exact opacity line integrals for 3DGS avatars, plus a proxy for temporal stability, achieving ~50 FPS with improved realism.
-
Directed Distance Fields for Constant-Time Ray Queries on Gaussian Splatting
A 52 MB neural Directed Distance Function is distilled from 3DGS to deliver constant-time ray distance and hit queries independent of the number of Gaussians.
-
Revisiting Photometric Ambiguity for Accurate Gaussian-Splatting Surface Reconstruction
AmbiSuR adds intrinsic photometric disambiguation and a self-indication module to Gaussian Splatting to resolve ambiguities and improve surface reconstruction accuracy.
-
Relightable Gaussian Splatting for Virtual Production Using Image-Based Illumination
A relightable Gaussian Splatting method for virtual production decomposes scenes into fixed appearance and variable lighting by parameterizing primitives to directly sample high-resolution background textures, enablin...
-
GRay: Ray Tracing 3D Gaussians Near the Speed of Splats
GRay is a ray tracer for 3D Gaussians that exploits dense small primitives for logarithmic scaling, rendering nearly 4x faster and optimizing nearly 10x faster than prior ray tracing while remaining competitive with s...
-
Editable Physically-based Reflections in Raytraced Gaussian Radiance Fields
Proof-of-concept for editable physically-based reflections in raytraced 3D Gaussian radiance fields via diffuse/specular buffer separation, path tracing, and specialized training.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.