REVIEW 5 cited by
GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We propose a method that achieves state-of-the-art rendering quality and efficiency on monocular dynamic scene reconstruction using deformable 3D Gaussians. Implicit deformable representations commonly model motion with a canonical space and time-dependent backward-warping deformation field. Our method, GauFRe, uses a forward-warping deformation to explicitly model non-rigid transformations of scene geometry. Specifically, we propose a template set of 3D Gaussians residing in a canonical space, and a time-dependent forward-warping deformation field to model dynamic objects. Additionally, we tailor a 3D Gaussian-specific static component supported by an inductive bias-aware initialization approach which allows the deformation field to focus on moving scene regions, improving the rendering of complex real-world motion. The differentiable pipeline is optimized end-to-end with a self-supervised rendering loss. Experiments show our method achieves competitive results and higher efficiency than both previous state-of-the-art NeRF and Gaussian-based methods. For real-world scenes, GauFRe can train in ~20 mins and offer 96 FPS real-time rendering on an RTX 3090 GPU. Project website: https://lynl7130.github.io/gaufre/index.html
Forward citations
Cited by 5 Pith papers
-
Laplacian Analysis Meets Dynamics Modelling: Gaussian Splatting for 4D Reconstruction
A Laplacian-enhanced hybrid encoding method for 4D Gaussian Splatting that claims better reconstruction fidelity for dynamic scenes.
-
GSVR: 2D Gaussian-based Video Representation for 800+ FPS with Hybrid Deformation Field
A 2D Gaussian video representation with a tri-plane plus polynomial deformation field decodes at 800+ FPS on Bunny and trains in about 2 seconds per frame.
-
HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis
A deformable Gaussian splatting framework with hierarchical rigid, skeleton-driven, and flow-based warping reconstructs dynamic scenes from long video captures with fast training and rendering.
-
PIG: Physically-based Multi-Material Interaction with 3D Gaussians
PIG couples depth-based 3D object segmentation with MLS-MPM physics and adaptive eigen-clamping of Gaussian deformations to create multi-material interactions inside 3D Gaussian scenes.
-
FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstruction
A dynamic-scene representation where Gaussian primitives live freely in 4D space-time with linear motion and Gaussian time windows achieves state-of-the-art novel-view quality on complex-motion benchmarks.
Discussion (0). Sign in to comment.