REVIEW 8 cited by
RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Humans excel in complex long-horizon soft body manipulation tasks via flexible tool use: bread baking requires a knife to slice the dough and a rolling pin to flatten it. Often regarded as a hallmark of human cognition, tool use in autonomous robots remains limited due to challenges in understanding tool-object interactions. Here we develop an intelligent robotic system, RoboCook, which perceives, models, and manipulates elasto-plastic objects with various tools. RoboCook uses point cloud scene representations, models tool-object interactions with Graph Neural Networks (GNNs), and combines tool classification with self-supervised policy learning to devise manipulation plans. We demonstrate that from just 20 minutes of real-world interaction data per tool, a general-purpose robot arm can learn complex long-horizon soft object manipulation tasks, such as making dumplings and alphabet letter cookies. Extensive evaluations show that RoboCook substantially outperforms state-of-the-art approaches, exhibits robustness against severe external disturbances, and demonstrates adaptability to different materials.
Forward citations
Cited by 8 Pith papers
-
Learning Physics-Guided Residual Dynamics for Deformable Object Simulation
Physics-guided residual dynamics, a spring-mass simulator plus a network that predicts velocity corrections, yields the most accurate deformable-object simulation in the paper's real-world tests.
-
Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?
Task-agnostic RL play pretraining on diverse objects yields a reusable dexterous prior that makes sparse-reward assembly learning ~33× more sample-efficient and enables zero-shot sim-to-real transfer on tight insertio...
-
VLMgineer: Vision Language Models as Robotic Toolsmiths
VLMgineer combines VLM-generated URDF tool designs with evolutionary search to co-design tools and action plans, outperforming human-specified and existing tools on a new simulated manipulation benchmark.
-
ParticleFormer: A 3D Point Cloud World Model for Multi-Object, Multi-Material Robotic Manipulation
ParticleFormer uses a Transformer over point-cloud particles and a hybrid Chamfer-Hausdorff loss to predict multi-material object dynamics, and it reports lower errors than GNN and image-based baselines in simulation ...
-
RobotSmith: Generative Robotic Tool Design for Acquisition of Complex Manipulation Skills
RobotSmith autonomously designs, 3D-prints, and uses task-specific tools for robotic manipulation, raising task success from 2.8% (no tool) to 50% in simulation.
-
Realizing Robotic Swimming with Unified Fluid-Robot Multiphysics
A differentiable, strongly coupled fluid-robot simulator, derived from a single least-action principle, produces swimming gaits that transfer to a physical eel robot.
-
Manipulating Elasto-Plastic Objects With 3D Occupancy and Learning-Based Predictive Control
3D occupancy representation with a learned 3D CNN-GNN dynamics model and MPC enables a robot to shape plasticine into letter goals in both simulation and the real world.
-
PinchBot: Long-Horizon Deformable Manipulation with Guided Diffusion Policy
A single goal-conditioned diffusion policy, combined with pre-trained point cloud embeddings and collision-constrained action projection, can create pottery bowls of 8, 10, and 12 centimeter diameters.
Discussion (0). Sign in to comment.