REVIEW 8 cited by
RAM: Retrieval-Based Affordance Transfer for Generalizable Zero-Shot Robotic Manipulation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This work proposes a retrieve-and-transfer framework for zero-shot robotic manipulation, dubbed RAM, featuring generalizability across various objects, environments, and embodiments. Unlike existing approaches that learn manipulation from expensive in-domain demonstrations, RAM capitalizes on a retrieval-based affordance transfer paradigm to acquire versatile manipulation capabilities from abundant out-of-domain data. First, RAM extracts unified affordance at scale from diverse sources of demonstrations including robotic data, human-object interaction (HOI) data, and custom data to construct a comprehensive affordance memory. Then given a language instruction, RAM hierarchically retrieves the most similar demonstration from the affordance memory and transfers such out-of-domain 2D affordance to in-domain 3D executable affordance in a zero-shot and embodiment-agnostic manner. Extensive simulation and real-world evaluations demonstrate that our RAM consistently outperforms existing works in diverse daily tasks. Additionally, RAM shows significant potential for downstream applications such as automatic and efficient data collection, one-shot visual imitation, and LLM/VLM-integrated long-horizon manipulation. For more details, please check our website at https://yxkryptonite.github.io/RAM/.
Forward citations
Cited by 8 Pith papers
-
Weakly-Supervised Learning of Dense Functional Correspondences
A weakly-supervised pipeline that distills VLM functional part knowledge and multi-view spatial structure into a model for dense cross-category functional correspondence, outperforming baselines on new synthetic and r...
-
AffordGen: Generating Diverse Demonstrations for Generalizable Object Manipulation with Afford Correspondence
AffordGen synthesizes large-scale affordance-aware manipulation trajectories via keypoint correspondence on 3D meshes, enabling zero-shot visuomotor policies for unseen objects from few source demos.
-
O$^3$Afford: One-Shot 3D Object-to-Object Affordance Grounding for Generalizable Robotic Manipulation
A one-shot training regime with DINOv2-enriched point clouds and joint cross-attention predicts 3D object-to-object affordance maps that guide optimization-based robotic manipulation.
-
GraspGen: A Diffusion-based Framework for 6-DOF Grasping with On-Generator Training
GraspGen shows that training a grasp-scoring discriminator on the generator's own simulated outputs, plus a large new multi-gripper dataset, improves 6-DOF grasping across simulation and a real robot.
-
SkillBlender: Towards Versatile Humanoid Whole-Body Loco-Manipulation via Skill Blending
SkillBlender pretrains reusable goal-conditioned skills and blends them with softmax per-joint weights to solve simulated humanoid loco-manipulation tasks with one or two reward terms.
-
RealDrive: Retrieval-Augmented Driving with Diffusion Models
A retrieval-augmented diffusion planner that interpolates retrieved expert demonstrations with current observations reduces collision rate by up to 40% on Waymo open-loop planning benchmarks.
-
Dynamics-Aware Meta-Imitation for Generalization to Unseen Robotic Manipulation
DAMI couples MAML with a 3D diffusion policy and a reference-demonstration conditioning module to improve few-shot adaptation on unseen robotic manipulation tasks.
-
Agentic Web: Weaving the Next Web with AI Agents
A position paper defines the Agentic Web as the next web era and proposes a three-dimensional conceptual framework for understanding and building it.
Discussion (0). Sign in to comment.