pith. sign in

arxiv: 2407.04504 · v2 · pith:SLEDQP2Fnew · submitted 2024-07-05 · 💻 cs.CV

Segment Any 4D Gaussians

Shengxiang Ji , Guanjun Wu , Jiemin Fang , Jiazhong Cen , Taoran Yi , Wenyu Liu , Qi Tian , Xinggang Wang This is my paper
classification 💻 cs.CV
keywords gaussianssa4dsegmentsegmentationworldabilityanythinggaussian
0
0 comments X
read the original abstract

Modeling, understanding, and reconstructing the real world are crucial in XR/VR. Recently, 3D Gaussian Splatting (3D-GS) methods have shown remarkable success in modeling and understanding 3D scenes. Similarly, various 4D representations have demonstrated the ability to capture the dynamics of the 4D world. However, there is a dearth of research focusing on segmentation within 4D representations. In this paper, we propose Segment Any 4D Gaussians (SA4D), one of the first frameworks to segment anything in the 4D digital world based on 4D Gaussians. In SA4D, an efficient temporal identity feature field is introduced to handle Gaussian drifting, with the potential to learn precise identity features from noisy and sparse input. Additionally, a 4D segmentation refinement process is proposed to remove artifacts. Our SA4D achieves precise, high-quality segmentation within seconds in 4D Gaussians and shows the ability to remove, recolor, compose, and render high-quality anything masks. More demos are available at: https://jsxzs.github.io/sa4d/.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Intrinsic 4D Gaussian Segmentation from Scene Cues

    cs.CV 2026-06 unverdicted novelty 7.0

    Intrinsic-GS recovers object-level segmentation in 4D Gaussian scenes from intrinsic cues alone via affinity graph and Leiden partitioning, reaching 0.746 mIoU on Neu3D and 0.575 on HyperNeRF without mask supervision.

  2. Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction

    cs.CV 2026-05 unverdicted novelty 7.0

    C4G introduces compact timestamp-conditioned Gaussian query tokens that aggregate full temporal context to decode 3D Gaussians with timestamp-modulated positions for feed-forward 4D reconstruction from monocular video...

  3. PanopticQuery: Unified Query-Time Reasoning for 4D Scenes

    cs.CV 2026-04 unverdicted novelty 6.0

    PanopticQuery lifts 2D semantic predictions into globally consistent 4D groundings via neural field optimization and sets new state-of-the-art results on complex language queries for attributes, actions, and interactions.

  4. A Survey on 3D Gaussian Splatting

    cs.CV 2024-01 unverdicted novelty 2.0

    A survey compiling principles, applications, benchmarks, and challenges of 3D Gaussian Splatting for explicit 3D scene representation.