SplatFlow jointly generates multi-view images, depths, and camera poses with a rectified flow model, then decodes them into editable 3D Gaussian Splatting scenes.
SteerX: Creating Any Camera-Free 3D and 4D Scenes with Geometric Steering
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Recent progress in 3D/4D scene generation emphasizes the importance of physical alignment throughout video generation and scene reconstruction. However, existing methods improve the alignment separately at each stage, making it difficult to manage subtle misalignments arising from another stage. Here, we present SteerX, a zero-shot inference-time steering method that unifies scene reconstruction into the generation process, tilting data distributions toward better geometric alignment. To this end, we introduce two geometric reward functions for 3D/4D scene generation by using pose-free feed-forward scene reconstruction models. Through extensive experiments, we demonstrate the effectiveness of SteerX in improving 3D/4D scene generation.
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
SplatFlow: Multi-View Rectified Flow Model for 3D Gaussian Splatting Synthesis
SplatFlow jointly generates multi-view images, depths, and camera poses with a rectified flow model, then decodes them into editable 3D Gaussian Splatting scenes.