GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting
read the original abstract
Gaussian Splatting (GS) is a novel, state-of-the-art technique for rendering points in a 3D scene by approximating their contribution to image pixels through Gaussian distributions, warranting fast training and real-time rendering. The main drawback of GS is the absence of a well-defined approach for its conditioning due to the necessity of conditioning several hundred thousand Gaussian components. To solve this, we introduce the Gaussian Mesh Splatting (GaMeS) model, which allows modification of Gaussian components in a similar way as meshes. We parameterize each Gaussian component by the vertices of the mesh face. Furthermore, our model needs mesh initialization on input or estimated mesh during training. We also define Gaussian splats solely based on their location on the mesh, allowing for automatic adjustments in position, scale, and rotation during animation. As a result, we obtain a real-time rendering of editable GS.
This paper has not been read by Pith yet.
Forward citations
Cited by 7 Pith papers
-
RigPAPR: Rig-Based Animation of Static Neural Point Clouds from a Fixed-Viewpoint Video
RigPAPR auto-rigs static PAPR point clouds and drives them via direct LBS from monocular fixed-view video, matching baselines at supervised views and exceeding them by 3+dB PSNR at novel views with cleaner joints.
-
LumiMotion: Improving Gaussian Relighting with Scene Dynamics
LumiMotion improves albedo estimation and scene relighting in dynamic scenes by leveraging motion to separate lighting effects from surface appearance in a dynamic 2D Gaussian Splatting representation.
-
DR-GS: Physically-Based Deformable and Relightable 2D Gaussians
DR-GS is a unified 2D Gaussian framework that integrates physically-based inverse rendering, relighting, and deformation by explicitly disentangling geometry, illumination, and material representations.
-
Transcoding a 3D Gaussian Splatting Model from a Plenoptic Point Cloud or Mesh without the Original Multi-view Images
An end-to-end transcoding pipeline creates 3D Gaussian splatting models from plenoptic point clouds or meshes without original multi-view images, using custom initialization and surface constraints for high-quality ou...
-
MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging
MedGS extends Gaussian Splatting with a relightable model tailored to endoscopic imaging where light and camera are co-located, achieving better novel-view synthesis and tissue editing than baselines.
-
Sat2City v2: Native 3D City Asset Generation from a Single Satellite Image
Sat2City v2 adapts a pretrained native 3D latent model to generate controllable textured 3D city assets from satellite images via geometry flow fine-tuning and anchored texturing on a collected real dataset.
-
Mesh2GS: White-Box 3DGS Construction via Plenoptic Sampling
Mesh2GS constructs 3DGS from meshes via plenoptic sampling for Nyquist-level global illumination rendering with albedo-shading decomposition and neural enhancement.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.