Pith. sign in

Articulat3D: Reconstructing Articulated Digital Twins From Monocular Videos with Geometric and Motion Constraints

2 Pith papers cite this work. Polarity classification is still indexing.

2 Pith papers citing it
abstract

Building high-fidelity digital twins of articulated objects from visual data remains a central challenge. Existing approaches depend on multi-view captures of the object in discrete, static states, which severely constrains their real-world scalability. In this paper, we introduce Articulat3D, a novel framework that constructs such digital twins from casually captured monocular videos by jointly enforcing explicit 3D geometric and motion constraints. We first propose Motion Prior-Driven Initialization, which leverages 3D point tracks to exploit the low-dimensional structure of articulated motion. By modeling scene dynamics with a compact set of motion bases, we facilitate soft decomposition of the scene into multiple rigidly moving groups. Building on this initialization, we introduce Geometric and Motion Constraints Refinement, which enforces physically plausible articulation through learnable kinematic primitives parameterized by a joint axis, a pivot point, and per-frame motion scalars, yielding reconstructions that are both geometrically accurate and temporally coherent. Extensive experiments demonstrate that Articulat3D achieves state-of-the-art performance on synthetic benchmarks and real-world casually captured monocular videos, significantly advancing the feasibility of digital twin creation under uncontrolled real-world conditions. Our project page is available at https://maxwell-zhao.github.io/Articulat3D/.

fields

cs.RO 2

years

2026 2

verdicts

CONDITIONAL 2

representative citing papers

RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation

cs.RO · 2026-07-07 · conditional · novelty 6.0

A tri-branch diffusion model co-generates RGB, depth, and optical flow from a single RGB-D image, and an inverse dynamics head on its internal latents achieves state-of-the-art bimanual manipulation success rates.

citing papers explorer

Showing 2 of 2 citing papers.

  • RynnWorld-4D: 4D Embodied World Models for Robotic Manipulation cs.RO · 2026-07-07 · conditional · none · ref 11 · internal anchor

    A tri-branch diffusion model co-generates RGB, depth, and optical flow from a single RGB-D image, and an inverse dynamics head on its internal latents achieves state-of-the-art bimanual manipulation success rates.

  • RynnWorld-Teleop: An Action-Conditioned World Model for Digital Teleoperation cs.RO · 2026-07-07 · conditional · none · ref 8 · internal anchor

    A real-time robot-centric video world model driven by depth-aware hand skeletons generates imitation-learning trajectories that support zero-shot real-robot transfer and improve policies when mixed with real data.