REVIEW 6 cited by
VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality
read the original abstract
As consumer Virtual Reality (VR) and Mixed Reality (MR) technologies gain momentum, there's a growing focus on the development of engagements with 3D virtual content. Unfortunately, traditional techniques for content creation, editing, and interaction within these virtual spaces are fraught with difficulties. They tend to be not only engineering-intensive but also require extensive expertise, which adds to the frustration and inefficiency in virtual object manipulation. Our proposed VR-GS system represents a leap forward in human-centered 3D content interaction, offering a seamless and intuitive user experience. By developing a physical dynamics-aware interactive Gaussian Splatting in a Virtual Reality setting, and constructing a highly efficient two-level embedding strategy alongside deformable body simulations, VR-GS ensures real-time execution with highly realistic dynamic responses. The components of our Virtual Reality system are designed for high efficiency and effectiveness, starting from detailed scene reconstruction and object segmentation, advancing through multi-view image in-painting, and extending to interactive physics-based editing. The system also incorporates real-time deformation embedding and dynamic shadow casting, ensuring a comprehensive and engaging virtual experience.Our project page is available at: https://yingjiang96.github.io/VR-GS/.
Forward citations
Cited by 6 Pith papers
-
GSDeformer: Direct, Real-time and Extensible Cage-based Deformation for 3D Gaussian Splatting
GSDeformer enables direct, real-time cage-based deformation on 3D Gaussian Splatting via a proxy point-cloud representation and automated cage construction, without modifying the core 3DGS architecture.
-
UniTriSplat: A Unified 3D Gaussian Splatting Framework with Uniform Spherical Rasterization for Universal Cameras
UniTriSplat unifies 3D Gaussian Splatting across camera types by performing splatting and optimization on a HEALPix spherical grid with equal-area sampling.
-
FreeForm: Reduced-Order Deformable Simulation from Particle-Based Skinning Eigenmodes
FreeForm derives reduced-order skinning weights for particle-based hyperelastic simulation by solving a generalized eigensystem on the elastic energy Hessian, achieving faster training and lower error than neural fields.
-
Bundle Adjustment in the Eager Mode
Introduces an eager-mode PyTorch BA library with GPU-accelerated sparse ops claiming 18.5-23x speedups over GTSAM, g2o, and Ceres.
-
LIVE-GS: LLM Powers Interactive VR Experience with Physics-Aware Gaussian Splatting
LIVE-GS uses an LLM to predict physical parameters from static Gaussian assets in 10 seconds for physics-aware VR interactions, validated by interviews, baseline comparisons, and user studies.
-
A Survey on 3D Gaussian Splatting
A survey compiling principles, applications, benchmarks, and challenges of 3D Gaussian Splatting for explicit 3D scene representation.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.