M3Former fuses appearance and motion streams in a Mask2Former-style transformer and, when trained on a diverse mix that includes KITTI and DAVIS train splits, reaches state-of-the-art motion segmentation scores on those benchmarks.
Robust Dynamic Radiance Fields
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Dynamic radiance field reconstruction methods aim to model the time-varying structure and appearance of a dynamic scene. Existing methods, however, assume that accurate camera poses can be reliably estimated by Structure from Motion (SfM) algorithms. These methods, thus, are unreliable as SfM algorithms often fail or produce erroneous poses on challenging videos with highly dynamic objects, poorly textured surfaces, and rotating camera motion. We address this robustness issue by jointly estimating the static and dynamic radiance fields along with the camera parameters (poses and focal length). We demonstrate the robustness of our approach via extensive quantitative and qualitative experiments. Our results show favorable performance over the state-of-the-art dynamic view synthesis methods.
citation-role summary
citation-polarity summary
fields
cs.CV 1years
2024 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
On Moving Object Segmentation from Monocular Video with Transformers
M3Former fuses appearance and motion streams in a Mask2Former-style transformer and, when trained on a diverse mix that includes KITTI and DAVIS train splits, reaches state-of-the-art motion segmentation scores on those benchmarks.