REVIEW 5 cited by
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch
read the original abstract
Human hands are capable of in-hand manipulation in the presence of different hand motions. For a robot hand, harnessing rich tactile information to achieve this level of dexterity still remains a significant challenge. In this paper, we present AnyRotate, a system for gravity-invariant multi-axis in-hand object rotation using dense featured sim-to-real touch. We tackle this problem by training a dense tactile policy in simulation and present a sim-to-real method for rich tactile sensing to achieve zero-shot policy transfer. Our formulation allows the training of a unified policy to rotate unseen objects about arbitrary rotation axes in any hand direction. In our experiments, we highlight the benefit of capturing detailed contact information when handling objects of varying properties. Interestingly, we found rich multi-fingered tactile sensing can detect unstable grasps and provide a reactive behavior that improves the robustness of the policy. The project website can be found at https://maxyang27896.github.io/anyrotate/.
Forward citations
Cited by 5 Pith papers
-
NeuralTouch: Neural Descriptors for Precise Sim-to-Real Tactile Robot Control
A robot grasping system that uses neural descriptor fields to guide a tactile RL policy achieves sub-millimetre precision in simulation and zero-shot transfer to real peg-in-hole and bottle-lid-opening tasks.
-
Towards Artificial Nerves: Biomimetic Optical-Fiber Tactile Sensing for Robots
One-to-one pin-to-optical-fiber pairing lets a soft skin send touch images to a remote camera, where image moments localize contacts to 0.4 mm and classify basic shapes.
-
Blind Dexterous Grasping via Real2Sim2Real Tactile Policy Learning
Real2Sim tactile calibration, layout-aware encoder pretraining, and diffusion policy aggregation from object-specific RL experts enable 27% real-world success in blind grasping on a LEAP Hand for 10 seen and 10 unseen...
-
PTLD: Sim-to-real Privileged Tactile Latent Distillation for Dexterous Manipulation
PTLD distills real privileged tactile data into a state estimator to boost sim-to-real performance of proprioceptive dexterous manipulation policies, yielding 182% improvement on in-hand rotation and 57% on reorientat...
-
PTLD: Sim-to-real Privileged Tactile Latent Distillation for Dexterous Manipulation
A sim-to-real method that distills a privileged camera-based teacher policy into a tactile student policy, improving in-hand rotation and reorientation over proprioception-only policies.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.