REVIEW 6 cited by
VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
abstract
We introduce VIOLA, an object-centric imitation learning approach to learning closed-loop visuomotor policies for robot manipulation. Our approach constructs object-centric representations based on general object proposals from a pre-trained vision model. VIOLA uses a transformer-based policy to reason over these representations and attend to the task-relevant visual factors for action prediction. Such object-based structural priors improve deep imitation learning algorithm's robustness against object variations and environmental perturbations. We quantitatively evaluate VIOLA in simulation and on real robots. VIOLA outperforms the state-of-the-art imitation learning methods by $45.8\%$ in success rate. It has also been deployed successfully on a physical robot to solve challenging long-horizon tasks, such as dining table arrangement and coffee making. More videos and model details can be found in supplementary material and the project website: https://ut-austin-rpl.github.io/VIOLA .
Forward citations
Cited by 6 Pith papers
-
SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies
A full-stack speed-adaptation system lets imitation-learned robot policies execute up to 3-4x faster than human demonstrations while preserving task success rates.
-
Compositional Diffusion with Guided Search for Long-Horizon Planning
CDGS adds population-based search and likelihood-based pruning to compositional diffusion, enabling long-horizon planning from short-horizon models across robot manipulation, panoramas, and video.
-
RwoR: Generating Robot Demonstrations from Human Hand Collection for Policy Learning without Robot
A generative model and wrist camera turn human hand videos into robot gripper demonstrations that train manipulation policies at success rates close to those trained on real gripper data.
-
PSALM-V: Automating Symbolic Planning in Interactive Visual Environments with Large Language Models
PSALM-V autonomously learns PDDL action preconditions and effects by executing LLM-proposed plans, predicting error messages, and refining a tree-structured belief, raising ALFRED plan success from 37% to 74% and indu...
-
Efficient Sensorimotor Learning for Open-world Robot Manipulation
A PhD dissertation argues that object, spatial, and behavioral regularities, extracted with foundation models, enable data-efficient, generalizable robot manipulation, and presents seven systems and a benchmark built ...
-
UTTG_ A Universal Teleoperation Approach via Online Trajectory Generation
UTTG is a teleoperation framework that reads robot URDF files and applies smoothing-spline interpolation to convert low-rate human commands into high-frequency joint trajectories across three robot platforms.
Discussion (0). Continue with ORCID to comment.