REVIEW 11 cited by
Visual Whole-Body Control for Legged Loco-Manipulation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We study the problem of mobile manipulation using legged robots equipped with an arm, namely legged loco-manipulation. The robot legs, while usually utilized for mobility, offer an opportunity to amplify the manipulation capabilities by conducting whole-body control. That is, the robot can control the legs and the arm at the same time to extend its workspace. We propose a framework that can conduct the whole-body control autonomously with visual observations. Our approach, namely Visual Whole-Body Control(VBC), is composed of a low-level policy using all degrees of freedom to track the body velocities along with the end-effector position, and a high-level policy proposing the velocities and end-effector position based on visual inputs. We train both levels of policies in simulation and perform Sim2Real transfer for real robot deployment. We perform extensive experiments and show significant improvements over baselines in picking up diverse objects in different configurations (heights, locations, orientations) and environments.
Forward citations
Cited by 11 Pith papers
-
Transformer Transformer: A Unified Model for Motion-Conditioned Robot Co-design
A single diffusion transformer trains on tokenized robot bodies and motions to generate and optimize robot designs for unseen rewards and trajectories, outpacing evolutionary search in speed and often in reward.
-
LocoTouch: Learning Dynamic Quadrupedal Transport with Tactile Sensing
LocoTouch trains a quadrupedal policy that uses a 221-taxel tactile back to balance and transport unsecured cylindrical objects, transferring zero-shot to a real Unitree Go1.
-
FACET: Force-Adaptive Control via Impedance Reference Tracking for Legged Robots
FACET trains legged robots to track a virtual mass-spring-damper reference, so the user can tune stiffness and virtual mass to control how the robot yields to or applies forces.
-
UMI-on-Air: Embodiment-Aware Guidance for Embodiment-Agnostic Visuomotor Policies
Embodiment-Aware Diffusion Policy steers a UMI-trained diffusion policy with controller tracking-cost gradients at inference time, improving aerial manipulation success in simulation and real flights.
-
TOP: Time Optimization Policy for Stable and Accurate Standing Manipulation with Humanoid Robots
A reinforcement-learned time optimization policy that adaptively slows upper-body motion clips improves stability and precision of humanoid standing manipulation at a modest time cost.
-
Versatile Loco-Manipulation through Flexible Interlimb Coordination
ReLIC lets a robot dog dynamically reassign its legs between walking and manipulating, achieving 78.9% average success across 12 real-world loco-manipulation tasks.
-
A Unified and General Humanoid Whole-Body Controller for Versatile Locomotion
A single RL policy controls walking, jumping, and standing gaits of a humanoid with tunable foot and posture parameters, plus a separate policy for hopping, and supports real-time upper-body intervention for loco-mani...
-
MobileH2R: Learning Generalizable Human to Mobile Robot Handover Exclusively from Scalable and Diverse Synthetic Data
A pipeline generates 100K+ synthetic human handover scenes and safe demonstrations to train a vision-based mobile robot handover policy that transfers to the real world.
-
Bimanual Grasp Synthesis for Dexterous Robot Hands
BimanGrasp produces a large-scale simulated dataset of bimanual dexterous grasps and a diffusion model that synthesizes them at quasi-real-time speeds.
-
Distilling Realizable Students from Unrealizable Teachers
A teacher-student distillation framework that queries the teacher only at critical states or resets RL from teacher recovery states improves performance on partially observable robot tasks.
-
Learning Whole-Body Loco-Manipulation for Omni-Directional Task Space Pose Tracking with a Wheeled-Quadrupedal-Manipulator
A reward fusion module that nonlinearly gates, sharpens, and schedules reward terms enables a wheeled quadrupedal manipulator to track 6D end-effector poses with under 5 cm and 0.1 rad error.
Discussion (0). Continue with ORCID to comment.