REVIEW 9 cited by
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations
read the original abstract
Grasp detection in clutter requires the robot to reason about the 3D scene from incomplete and noisy perception. In this work, we draw insight that 3D reconstruction and grasp learning are two intimately connected tasks, both of which require a fine-grained understanding of local geometry details. We thus propose to utilize the synergies between grasp affordance and 3D reconstruction through multi-task learning of a shared representation. Our model takes advantage of deep implicit functions, a continuous and memory-efficient representation, to enable differentiable training of both tasks. We train the model on self-supervised grasp trials data in simulation. Evaluation is conducted on a clutter removal task, where the robot clears cluttered objects by grasping them one at a time. The experimental results in simulation and on the real robot have demonstrated that the use of implicit neural representations and joint learning of grasp affordance and 3D reconstruction have led to state-of-the-art grasping results. Our method outperforms baselines by over 10% in terms of grasp success rate. Additional results and videos can be found at https://sites.google.com/view/rpl-giga2021
Forward citations
Cited by 9 Pith papers
-
Equivariant Volumetric Grasping
A novel tri-plane equivariant volumetric grasp model adapts GIGA and IGD planners with flow matching and deformable attention to achieve higher real-time performance than non-equivariant baselines.
-
Pix2Act: Image-Space Manipulation Policies with Equivariant Augmentation
Continuous multi-view image-space keypoint trajectories plus per-camera equivariant augmentation beat strong 3D and image baselines on MimicGen and real UR5 tasks.
-
Grasp-Oriented Non-Prehensile Manipulation via Learning a Graspability Field
A graspability field learned from synthesized grasps provides a dense reward signal for an RL policy that performs closed-loop non-prehensile manipulation leading to successful grasps.
-
Filling the Pareto-Optimal Front for Affordance Segmentation on Embedded Devices Using RGB-D Cameras
HW-NAS with an RGB-D search space and a cheap depth-to-RGB fine-tune layer yield mid-size networks that often sit on the accuracy–FLOPs/params Pareto front and run real-time on a Jetson Nano.
-
Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance
The viewpoint-agnostic grasp pipeline using VLM and partial observation handling achieves 90% success (9/10 trials) in cluttered tabletop scenarios on a real quadruped robot, outperforming a view-dependent baseline at...
-
Where to Touch, How to Contact: A Hierarchical RL-MPC Framework for Geometry-Aware Sim-to-Real Manipulation
A hierarchical RL-MPC framework with a 'contact intention' interface achieves data-efficient, robust non-prehensile manipulation that transfers zero-shot to a real robot.
-
Lightweight Neural Networks for Affordance Segmentation: Enhancement of the Decoder Module
Small decoder design choices (depthwise vs. standard convolutions, upsampling type, and an auxiliary object-segmentation head) yield modest accuracy gains over the authors' prior baseline on binary grasp affordance se...
-
AISPO: Enhancing Depth Reliability for Robotic Manipulation of Non-Lambertian Objects via Affine-Invariant Shape Prior
AISPO proposes a depth completion method using multi-scale RGB-D fusion and an affine-invariant shape prior to improve depth reliability and manipulation success for non-Lambertian objects.
-
Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance
Language-guided object-centric completion plus execution-aware grasp selection raised real Spot grasp success from 3/10 to 9/10 under partial observation in cluttered tabletop scenes.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.