REVIEW 4 cited by
ID-Pose: Sparse-view Camera Pose Estimation by Inverting Diffusion Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Given sparse views of a 3D object, estimating their camera poses is a long-standing and intractable problem. Toward this goal, we consider harnessing the pre-trained diffusion model of novel views conditioned on viewpoints (Zero-1-to-3). We present ID-Pose which inverses the denoising diffusion process to estimate the relative pose given two input images. ID-Pose adds a noise to one image, and predicts the noise conditioned on the other image and a hypothesis of the relative pose. The prediction error is used as the minimization objective to find the optimal pose with the gradient descent method. We extend ID-Pose to handle more than two images and estimate each pose with multiple image pairs from triangular relations. ID-Pose requires no training and generalizes to open-world images. We conduct extensive experiments using casually captured photos and rendered images with random viewpoints. The results demonstrate that ID-Pose significantly outperforms state-of-the-art methods.
Forward citations
Cited by 4 Pith papers
-
Sparse-view Pose Estimation and Reconstruction via Analysis by Generative Synthesis
SparseAGS jointly refines initial camera poses and reconstructs 3D from sparse views using multi-view SDS diffusion priors and explicit outlier removal.
-
Generalizable Single-view Object Pose Estimation by Two-side Generating and Matching
Two-side generation and matching of intermediate views with a score distillation loss improves single-reference object pose estimation under large viewpoint changes.
-
Pragmatist: Multiview Conditional Diffusion Models for High-Fidelity 3D Reconstruction from Unposed Sparse Views
Pragmatist turns sparse unposed photos of an object into a high-fidelity 3D mesh by generating consistent canonical views with a diffusion model, reconstructing a triplane mesh, then refining camera poses and texture ...
-
Sparse-View 3D Reconstruction: Recent Advances and Open Challenges
A comprehensive survey that organizes sparse-view 3D reconstruction methods into geometry-based, NeRF, 3DGS, and diffusion-based categories, with benchmarks and open challenges.
Discussion (0). Continue with ORCID to comment.