Pith. sign in

REVIEW 14 cited by

textit{S}³Gaussian: Self-Supervised Street Gaussians for Autonomous Driving

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.20323 v1 pith:FOASJ3EY submitted 2024-05-30 cs.CV cs.AI

textit{S}³Gaussian: Self-Supervised Street Gaussians for Autonomous Driving

classification cs.CV cs.AI
keywords gaussianstreetdecomposedrivingdynamicreconstructionscenesstatic
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Photorealistic 3D reconstruction of street scenes is a critical technique for developing real-world simulators for autonomous driving. Despite the efficacy of Neural Radiance Fields (NeRF) for driving scenes, 3D Gaussian Splatting (3DGS) emerges as a promising direction due to its faster speed and more explicit representation. However, most existing street 3DGS methods require tracked 3D vehicle bounding boxes to decompose the static and dynamic elements for effective reconstruction, limiting their applications for in-the-wild scenarios. To facilitate efficient 3D scene reconstruction without costly annotations, we propose a self-supervised street Gaussian ($\textit{S}^3$Gaussian) method to decompose dynamic and static elements from 4D consistency. We represent each scene with 3D Gaussians to preserve the explicitness and further accompany them with a spatial-temporal field network to compactly model the 4D dynamics. We conduct extensive experiments on the challenging Waymo-Open dataset to evaluate the effectiveness of our method. Our $\textit{S}^3$Gaussian demonstrates the ability to decompose static and dynamic scenes and achieves the best performance without using 3D annotations. Code is available at: https://github.com/nnanhuang/S3Gaussian/.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 14 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. PointForward: Feedforward Driving Reconstruction through Point-Aligned Representations

    cs.CV 2026-05 unverdicted novelty 7.0

    PointForward uses sparse world-space 3D queries and scene graphs to deliver consistent single-pass reconstruction of dynamic driving scenes via point-aligned representations.

  2. Ground4D: Spatially-Grounded Feedforward 4D Reconstruction for Unstructured Off-Road Scenes

    cs.CV 2026-05 unverdicted novelty 7.0

    Ground4D resolves temporal conflicts in feedforward 4D Gaussian reconstruction for off-road scenes via voxel-grounded temporal aggregation with intra-voxel softmax and surface normal regularization, outperforming prio...

  3. Appearance Decomposition Gaussian Splatting for Multi-Traversal Reconstruction

    cs.CV 2026-04 unverdicted novelty 7.0

    ADM-GS decomposes static background appearance into traversal-invariant material and traversal-dependent illumination via a frequency-separated neural light field, yielding +0.98 dB PSNR gains and better cross-travers...

  4. Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving

    cs.CV 2026-06 unverdicted novelty 6.0

    Envision4D presents a feed-forward 4D Gaussian Splatting framework with future pose prediction, temporal attention, and conditioned motion lifting for pose-free extrapolation in autonomous driving scenes.

  5. Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 6.0

    Sensor2Sensor uses 4D Gaussian Splatting to create synthetic training pairs and a diffusion model to convert monocular dashcam videos into high-fidelity multi-modal AV sensor data.

  6. Sensor2Sensor: Cross-Embodiment Sensor Conversion for Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 6.0

    Sensor2Sensor converts in-the-wild monocular dashcam videos into high-fidelity multi-modal AV sensor data using 4D Gaussian Splatting to synthesize training pairs and a diffusion model for the cross-embodiment translation.

  7. Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 6.0

    Xiaomi EV World Model integrates WorldRec for sparse-query 3D Gaussian reconstruction and WorldGen for fast causal video generation via bidirectional pretraining and causal fine-tuning to support autonomous driving si...

  8. CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 6.0

    CoWorld-VLA extracts semantic, geometric, dynamic, and trajectory expert tokens from multi-source supervision and feeds them into a diffusion-based hierarchical planner, achieving competitive collision avoidance and t...

  9. CoWorld-VLA: Thinking in a Multi-Expert World Model for Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 6.0

    CoWorld-VLA encodes world information into four expert tokens that condition a diffusion-based planner, yielding competitive collision avoidance and trajectory accuracy on the NAVSIM benchmark.

  10. Flux4D: Flow-based Unsupervised 4D Reconstruction

    cs.CV 2025-12 unverdicted novelty 6.0

    Flux4D reconstructs large-scale dynamic 4D scenes unsupervised by predicting moving 3D Gaussians from photometric losses and static regularization when trained across multiple scenes.

  11. GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priors

    cs.RO 2026-06 unverdicted novelty 5.0

    GraspFoM creates a shared 3D latent from SAM3D priors, adds an anchor-initialized diffuser for multimodal grasps, and uses reconstruction-aware scoring plus residual updates to jointly achieve SOTA reconstruction and ...

  12. Towards Physically Consistent 4D Scene Reconstruction for Closed-loop Autonomous Driving Simulation

    cs.CV 2026-05 unverdicted novelty 5.0

    Introduces Orthogonal Projected Gradient (OPG) and a smoothness-based temporal regularization to restore spatial identifiability and ensure physically consistent 4D scene reconstruction for closed-loop autonomous driv...

  13. Xiaomi Auto World Model: A Joint World Model Integrating Reconstruction and Generation for Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 5.0

    A unified system integrating sparse-query 3D Gaussian reconstruction with multi-stage causal video generation for autonomous driving world models.

  14. EvoDriveVLA: Evolving Driving VLA Models via Collaborative Perception-Planning Distillation

    cs.CV 2026-03 unverdicted novelty 5.0

    EvoDriveVLA uses collaborative perception-planning distillation with self-anchor and future-aware teachers to fix perception degradation and long-term instability in driving VLA models, reaching SOTA on nuScenes and NAVSIM.