Pith. sign in

REVIEW 4 major objections 7 minor 1 cited by

D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation

T0 review · 4 major / 7 minor · reviewed 2026-08-15 · deepseek-v4-flash

Pith's one-line read Diffusion-based offline augmentation improves bimanual wrist-camera policies by synthesizing coordinated views and feasible joint-space actions.

desk verdict A useful, honest extension of DMD to bimanual eye-in-hand augmentation, but the coordination mechanism is oversold and the central assumption is not validated. read the letter →

arxiv 2505.04860 v2 pith:QI7MSSOW submitted 2025-05-08 cs.RO cs.AIcs.CVcs.LG

classification cs.ROcs.AIcs.CVcs.LG
keywords bimanualmanipulationdataaugmentationeye-in-handimitationlearningdiffusionmodelsnovelviewsynthesiscontact-richconstrainedoptimizationactionlabeling
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that a diffusion model trained only on existing demonstrations can generate additional training data for two-arm robots by simultaneously synthesizing new left- and right-wrist images and new joint commands. The proposed method, D-CODA, is fully offline: it needs no simulator, no environment resets, and no extra teleoperation. Its key move is to treat contact-rich and contact-free states differently—random camera shifts in free space, identical constraint-optimized shifts during gripper-object contact—so the synthesized images and actions respect bimanual coordination. The authors report higher downstream task success than both baseline augmentations and simply adding more demonstrations across most simulated and all real-world tasks tested. If correct, this is a scalable route to better bimanual policies from small datasets.

What carries the argument

The central machinery is a paired latent diffusion denoiser that, conditioned on source wrist images $I^l_a, I^r_a$ and the relative camera transformations $\Delta p^l, \Delta p^r$, denoises the latents of both target wrist images in one pass, so the generated left and right views are coherent views of the same perturbed scene. The second mechanism is contact-aware camera perturbation sampling: a large video segmentation model tracks the grippers to split states into contactless and contact-rich; contactless states sample random translation and rotation perturbations, while contact-rich states solve a constrained optimization over translation $c_{\mathrm{trans}}$ that penalizes table collisions, end-effector proximity, and kinematically infeasible poses, applying the same perturbation to both arms. An inverse-kinematics solver converts the resulting camera-perturbed end-effector pose into a new joint-space action label, and augmented states replace original states every $k$ timesteps to address compounding errors.

What would settle it

Choose an asymmetric contact-rich task in which the left arm holds an object still while the right arm manipulates it; train D-CODA with the identical-perturbation rule, compare its rollout success against a variant that perturbs only the acting arm, and measure the inter-end-effector distance distribution in augmented contact states. If the identical-perturbation variant does not match or beat the alternative, the paper's coordination constraint fails.

Watch

Extended reading notes

Core claim

The paper claims that D-CODA, a diffusion-based offline augmentation method, extends a single-arm viewpoint-augmentation recipe to bimanual manipulation. It synthesizes both left and right wrist-camera images in a single conditioned diffusion pass from source images and relative camera transformations, then derives joint-space action labels by applying the same camera perturbation to both arms and solving inverse kinematics rather than reusing the original actions. Segmentation-based contact detection decides when to use random perturbations (contactless states) versus constrained, identical perturbations (contact-rich states). Trained with an action-chunking transformer policy, the augmented dataset outperforms no-augmentation, more-data, and prior viewpoint-augmentation baselines on 4 of 5 simulated tasks and all 3 real-world tasks, and it also boosts a vision-language-action policy on 2 of 3 real-world tasks.

Load-bearing premise

The load-bearing assumption is that applying the same camera perturbation to both arms during any gripper-object contact preserves the coordination encoded in the original demonstration; for tasks in which one arm stabilizes while the other acts, this symmetry may encode contradictory augmented states and the downstream policy could degrade.

Editorial extensions

If this is right

  • D-CODA produces an augmented bimanual dataset entirely offline, so any wrist-camera imitation learning pipeline can be supplemented without additional robot time, simulators, or environmental resets.
  • The contact-aware identical-perturbation constraint is essential: the ablation without constrained optimization drops simulation success on the ball-lifting task from 73.3 percent to 57.3 percent.
  • D-CODA also improves tasks that do not require symmetric simultaneous lifting, such as dual button pushing and rope straightening, suggesting the augmentation is not limited to coordinated lifts.
  • Removing the constrained perturbation sampling or swapping the pretrained image encoder degrades synthesized image quality and downstream success, indicating that both components carry the gains.
  • The method inherits a distributional caveat: it relies on novel camera poses being similar enough to training poses, so very different viewpoints would likely degrade performance.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial extension: the identical-perturbation rule is a symmetry assumption; for tasks with asymmetric act-stabilize roles, a more promising variant would perturb the acting arm and freeze or minimally move the stabilizing arm, and the paper's own segmentation pipeline could supply the role assignment.
  • Editorial extension: the paper's generalization experiment shows that the diffusion model can adapt to a new task with only 10 target demonstrations, suggesting D-CODA could be used as a cross-task augmentation engine trained once on several bimanual tasks and fine-tuned briefly on a new one.
  • Editorial extension: the real-world failure mode of large policy actions on augmented states suggests that pairing D-CODA with smoother action tokenization could close the gap seen with the vision-language-action policy.
  • Editorial extension: a testable possibility is iteratively augmenting the augmented dataset–adding synthesized states back into the diffusion model's training data–until the pose distribution drifts too far from valid scenes.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 7 minor

Summary. The paper proposes D-CODA, an offline data-augmentation method for eye-in-hand bimanual imitation learning. D-CODA trains a latent diffusion model to synthesize novel, viewpoint-consistent wrist-camera images for both arms, conditioned on camera pose perturbations, while generating corresponding joint-space action labels via a constrained optimization that is designed to preserve bimanual coordination during contact-rich states. The augmented dataset is used together with the original demonstrations to train downstream policies (ACT and π0-FAST). The method is evaluated on five simulated PerAct2 tasks and three real-world tasks, showing improvements over several baselines, with ablations and a generalization study reported in the appendices.

Significance. If the reported results hold, D-CODA offers a scalable and simulator-free data augmentation approach for bimanual manipulation, which is an important practical contribution given the high cost of collecting diverse demonstrations. The paper includes honest limitations, ablations (e.g., the constrained-optimization ablation in Table 3), and a generalization experiment (Appendix D), which strengthen the empirical narrative. However, the central coordination mechanism is misdescribed relative to the implementation, and the evaluation is limited to symmetric tasks, so the generality of the claimed coordination preservation is not established. The method's empirical promise is real, but the paper currently overstates the mechanism by which coordination is enforced.

major comments (4)
  1. [§4.2 and §4.3] The key insight stated in §4.2 is to 'apply identical perturbations to both arms during contact events, ensuring coordinated behavior,' but the implementation in §4.3, C·T·(C)^{-1}·E, does not apply identical world-frame perturbations. Since the left and right camera poses C_l and C_r differ, conjugating the same camera-frame T by C_l and C_r produces different world-frame displacements for the two end-effectors, and the relative pose between the end-effectors is not preserved. The augmented contact states may therefore encode coordination patterns that differ from the original demonstrations, contradicting the stated mechanism. The paper should either correct the description to 'identical camera-frame perturbation' and provide direct evidence (e.g., measuring distance and relative orientation between the end-effectors before and after augmentation) that coordination is approximately preserved, or modify the optimization to enforce a genuinely common world-frame translation. As written, the central coordination claim is not supported by the derivation.
  2. [§4.2 (contact detection)] The contact detection heuristic based on SAM2 masks, z-score filtering, depth thresholding, and SSIM is a key component of the pipeline because it determines when constrained optimization is applied, yet it is not validated in the paper. There is no evaluation of detection accuracy against ground truth (which is available in simulation) and no ablation showing how misclassification affects downstream performance. Given that random perturbations during contact-rich states are expected to degrade coordination (as the ablation in Table 3 suggests), errors in contact detection could be a significant source of failure. Please report detection accuracy, at least on the simulation tasks, or demonstrate robustness to detection thresholds.
  3. [§2 and §5] The paper claims in §2 that the approach is 'not task-specific,' but all five simulation tasks and all three real-world tasks are symmetric in the sense that both arms move simultaneously. The identical-perturbation assumption has not been tested for acting-stabilizing bimanual tasks (e.g., one arm holds an object while the other acts), where a common camera-frame displacement could break the required role asymmetry. Either test at least one asymmetric task or explicitly restrict the claim to symmetric coordination, which would require softening the statement in §2 and the abstract.
  4. [§5.3 and §5.4] The empirical claims are based on only three seeds per simulation task and 20 trials per real-world task-condition, and no confidence intervals or significance tests are reported. Several performance gaps are small (e.g., Lift Ball in Table 2: 17/20 vs 15/20), and it is unclear whether these differences are reliable. Reporting binomial confidence intervals or running multiple seeds with variance would substantially strengthen the claim that D-CODA 'outperforms baselines' across tasks.
minor comments (7)
  1. [§3] There is a typo in §3: 'we suppresst and instead use' should be 'we suppress t and instead use'.
  2. [Figure 4 caption] The caption states 'The first black column of images are the original states'; 'column ... are' should be 'column ... is'.
  3. [§4.1] The notation '∆p = aTb' for a pose transformation is introduced without a clear definition of the matrix product ordering; please clarify whether aTb denotes (T_a)^{-1} T_b or T_a^{-1} T_b, and relate it to the later use of C·T·(C)^{-1}·E.
  4. [§4.2] The constraint 'ctrans∈ [−1, 1]3 and ctrans≥mlb' is ambiguous because mlb is described as a 'magnitude' bound; state clearly whether the inequality is element-wise and whether mlb is a scalar or a vector.
  5. [§4.2] The contact-rich perturbation only uses an identity rotation matrix, while rotation bounds [rlb, rub] are introduced for contactless states. Clarify whether rotation perturbations are ever applied to contact-rich states, and if not, explain why zero rotation is appropriate.
  6. [§5.2] The paper states that ACT is trained on '100 episodes of training data along with their corresponding augmented data,' but does not specify how many augmented episodes are generated per original episode or the total augmented dataset size. This information is needed to assess the data scaling properties of the method.
  7. [Appendix E] The paper does not mention whether code is released; the project website is listed, but for reproducibility, please include a link to the code repository in the paper.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular reasoning detected; the augmentation pipeline is trained and evaluated on disjoint data, and no fitted parameter is renamed as a prediction.

full rationale

D-CODA does not derive its central claim from its inputs by construction. The diffusion model (Section 4.1) is trained on the original demonstration dataset D to map source wrist images and pose transformations to target wrist images; the same dataset is later augmented, but downstream policy performance is measured on held-out test episodes (Section 5.2: '25 unseen test data' in simulation; 20 rollouts per real-world task). No test data, validation data, or task success criterion enters the diffusion training objective (Eq. 1), the perturbation optimizer (Section 4.2), or the action-label update (Section 4.3, E' = C·T·C^{-1}·E). The claim that constrained optimization is important is checked by an explicit ablation ('D-CODA w/o Constrained Optim.' vs 'D-CODA', Appendix C), not asserted solely by construction. The method builds on DMD [9], which is cited as external prior work and is not authored by the current paper's authors; the self-citations ([19], [26]) appear only in related-work discussion and are not load-bearing for the augmentation mechanism. The paper's own Limitations section concedes scope limits (wrist-view-only augmentation, dependence on similar camera poses, residual failures), which is consistent with an honest empirical claim rather than a hidden circularity. The strongest skeptical issue, that Section 4.2's 'identical perturbations to both arms' may not be realized by Section 4.3's conjugated transform C·T·C^{-1}·E when left and right camera poses differ, is a correctness or validity concern about whether the implementation matches the prose, not a case of the result reducing to its inputs; the evaluation remains external and falsifiable. Therefore no circular step meets the evidentiary bar.

Assumptions & free parameters 5 free parameters · 4 assumptions · 0 invented entities

The method introduces no new physical entities. The central claim depends on three hand-set perturbation bounds, a replacement interval, unstated contact-detection thresholds, and per-task ACT chunk sizes, plus four domain assumptions about contact detection, coordination-preserving perturbations, IK-solved action validity, and diffusion view consistency.

free parameters (5)
  • Camera perturbation translation magnitude bounds [mlb, mub] = [0.01, 0.02] meters
    Hand-set bounds for contactless and contact-rich perturbation sampling; larger values would increase diversity but risk invalid states.
  • Camera perturbation rotation bounds [rlb, rub] = [-28.7, 28.7] degrees
    Hand-set rotation range for contactless states; impacts view diversity and realism of synthesized images.
  • Replacement interval k = 6 for most tasks, 9 for Coordinated Push Box Easy and Bimanual Straighten Rope
    Hand-chosen stride for replacing original states with augmented states; Figure 8 shows relative insensitivity but the value is still tuned.
  • Contact detection thresholds (depth z-score, depth threshold, SSIM threshold) = not specified
    Thresholds for deciding contact-rich versus contactless states; no values or validation are provided in the paper.
  • ACT action chunk size = 10, 15, 60, or 2 depending on task
    Tuned per task in the evaluation protocol; affects downstream policy performance independently of D-CODA.
assumptions (4)
  • domain assumption Gripper-to-object contact can be reliably inferred from SAM2 segmentation masks with depth z-score filtering, depth thresholding, and mask filling, or from SSIM when depth is unavailable.
    The entire constraint-enforced sampling is gated on this binary contact decomposition; no quantitative accuracy of the detector is reported.
  • domain assumption Identical camera pose perturbations applied to both arms during contact states preserve coordinated bimanual behavior.
    Load-bearing for the method's key contribution; only validated implicitly on symmetric coordinated tasks, not on asymmetric acting-stabilizing tasks.
  • domain assumption A kinematically valid IK solution for the perturbed end-effector pose yields a useful and feasible action label for the augmented state.
    Validity is checked by IK feasibility only; dynamic or task-level feasibility is not checked beyond discarding invalid configurations.
  • domain assumption A diffusion model trained on the original dataset can synthesize novel wrist-view images that are viewpoint-consistent across both arms.
    Inherited from DMD [9]; the paper does not directly measure image consistency or quality, only downstream task success.

how reviews work

0 comments
Cite this review

Pith. "Pith review of D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation." pith.science (2026). https://pith.science/paper/QI7MSSOW

@misc{pith2026250504860,
  author       = {Pith},
  title        = {Pith review of: D-CODA: Diffusion for Coordinated Dual-Arm Data Augmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/QI7MSSOW}},
  note         = {Machine review of arXiv:2505.04860}
}
read the original abstract

Learning bimanual manipulation is challenging due to its high dimensionality and tight coordination required between two arms. Eye-in-hand imitation learning, which uses wrist-mounted cameras, simplifies perception by focusing on task-relevant views. However, collecting diverse demonstrations remains costly, motivating the need for scalable data augmentation. While prior work has explored visual augmentation in single-arm settings, extending these approaches to bimanual manipulation requires generating viewpoint-consistent observations across both arms and producing corresponding action labels that are both valid and feasible. In this work, we propose Diffusion for COordinated Dual-arm Data Augmentation (D-CODA), a method for offline data augmentation tailored to eye-in-hand bimanual imitation learning that trains a diffusion model to synthesize novel, viewpoint-consistent wrist-camera images for both arms while simultaneously generating joint-space action labels. It employs constrained optimization to ensure that augmented states involving gripper-to-object contacts adhere to constraints suitable for bimanual coordination. We evaluate D-CODA on 5 simulated and 3 real-world tasks. Our results across 2250 simulation trials and 300 real-world trials demonstrate that it outperforms baselines and ablations, showing its potential for scalable data augmentation in eye-in-hand bimanual manipulation. Our project website is at: https://dcodaaug.github.io/D-CODA/.

Figures

Figures reproduced from arXiv: 2505.04860 by the authors.

Figure 1
Figure 1. Overview of D-CODA for a coordinated bimanual lifting task with two UR5 arms. D-CODA is a [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Overview of D-CODA. (i): The diffusion model is an iterative denoiser that learns to map source wrist-camera images I l a and I r a to target wrist-camera images I l b and I r b , conditioned on pose transformations ∆p l and ∆p r , using the original dataset (i.e., the dataset to be augmented). (ii): We use SAM2 [14] to de￾compose a bimanual manipulation task into contactless and contact-rich states. We uniformly sa… view at source ↗
Figure 3
Figure 3. Isometric view of original and aug￾mented camera positions for the real-world Lift Ball task. The augmented camera posi￾tions (maroon and yellow dots) provide broader coverage of state-space regions not occupied by the original camera positions (blue dots). Given the dataset D and its corresponding sampled camera perturbations, we use the trained diffusion model to synthesize novel wrist camera views for both arms. … view at source ↗
Figures from the paper (8 more)
Figure 4
Figure 4. Figure 4: Examples of the original and synthesized wrist-camera images using D-CODA on [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]
Figure 5
Figure 5. Figure 5: Simulation environments for our bimanual manipulation tasks, adapted from PerAct2 [ [PITH_FULL_IMAGE:figures/full_fig_p015_5.png]
Figure 6
Figure 6. Figure 6: Top: Real-world bimanual manipulation tasks. Bottom: Example successful rollouts ( [PITH_FULL_IMAGE:figures/full_fig_p015_6.png]
Figure 7
Figure 7. Figure 7: Real-world bimanual UR5 setup. C Ablations Ablations of D-CODA. In simulation, we test the following methods: • D-CODA with Replaced Encoders: uses a VQGAN encoder trained on the Open Images [81] dataset from Latent Diffusion [72] instead of the RealEstate10K [82] data…
Figure 8
Figure 8. Figure 8: Effects of k on downstream ACT performance on Coordinated Lift Tray Easy. For camera perturbation sampling, the translation magni￾tudes [mlb, mub] are set to 0.01 and 0.02 meters, respec￾tively, for contactless and contact-rich states. For con￾tactless states, the rota…
Figure 9
Figure 9. Figure 9: Visualization comparing constraint-enforced actions and random actions. [PITH_FULL_IMAGE:figures/full_fig_p018_9.png]
Figure 10
Figure 10. Figure 10: Examples of the original and synthesized wrist-camera images from both arms using D-CODA on [PITH_FULL_IMAGE:figures/full_fig_p019_10.png]
Figure 11
Figure 11. Figure 11: Examples of the original and synthesized wrist-camera images from both arms using D-CODA on [PITH_FULL_IMAGE:figures/full_fig_p020_11.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. BiNoMaP: Learning Category-Level Bimanual Non-Prehensile Manipulation Primitives

    cs.RO 2025-09 conditional novelty 6.0 of 10

    BiNoMaP learns category-level bimanual non-prehensile manipulation primitives from human videos without reinforcement learning, using trajectory extraction, geometry-aware optimization, and size-based parameterization.

Reference graph

Works this paper leans on

81 extracted references · 65 canonical work pages · cited by 1 Pith paper

  1. [1]

    Krebs and T

    F. Krebs and T. Asfour. A Bimanual Manipulation Taxonomy. In IEEE Robotics and Automa- tion Letters (RA-L), 2022

  2. [2]

    K. Hsu, M. J. Kim, R. Rafailov, J. Wu, and C. Finn. Vision-Based Manipulators Need to Also See from Their Hands. In International Conference on Learning Representations (ICLR), 2022

  3. [3]

    M. J. Kim, J. Wu, and C. Finn. Giving Robots a Hand: Learning Generalizable Manipulation with Eye-in-Hand Human Video Demonstrations. arXiv preprint arXiv:2307.05959, 2023

  4. [4]

    Young, D

    S. Young, D. Gandhi, S. Tulsiani, A. Gupta, P. Abbeel, and L. Pinto. Visual Imitation Made Easy. In Conference on Robot Learning (CoRL), 2020

  5. [5]

    P. Y . Simard, D. Steinkraus, and J. C. Platt. Best practices for convolutional neural networks applied to visual document analysis. In Proceedings of the Seventh International Conference on Document Analysis and Recognition (ICDAR), pages 958–963. IEEE, 2003

  6. [6]

    Krizhevsky, I

    A. Krizhevsky, I. Sutskever, and G. E. Hinton. Imagenet classification with deep convolutional neural networks. In Neural Information Processing Systems (NeurIPS), 2012

  7. [7]

    Laskin, K

    M. Laskin, K. Lee, A. Stooke, L. Pinto, P. Abbeel, and A. Srinivas. Reinforcement learning with augmented data. In Neural Information Processing Systems (NeurIPS), 2020

  8. [8]

    Kostrikov, D

    I. Kostrikov, D. Yarats, and R. Fergus. Image augmentation is all you need: Regularizing deep reinforcement learning from pixels. In International Conference on Learning Representations (ICLR), 2021

Show all 81 references
  1. [9]

    Zhang, M

    X. Zhang, M. Chang, P. Kumar, and S. Gupta. Diffusion Meets DAgger: Supercharging Eye- in-hand Imitation Learning. In Robotics: Science and Systems (RSS), 2024

  2. [10]

    A. Zhou, M. J. Kim, L. Wang, P. Florence, and C. Finn. NeRF in the Palm of Your Hand: Corrective Augmentation for Robotics via Novel-View Synthesis. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

  3. [11]

    L. Y . Chen, C. Xu, K. Dharmarajan, M. Z. Irshad, R. Cheng, K. Keutzer, M. Tomizuka, Q. Vuong, and K. Goldberg. RoVi-Aug: Robot and Viewpoint Augmentation for Cross- Embodiment Robot Learning. In Conference on Robot Learning (CoRL), 2024. 9

  4. [12]

    S. Tian, B. Wulfe, K. Sargent, K. Liu, S. Zakharov, V . Guizilini, and J. Wu. View-Invariant Pol- icy Learning via Zero-Shot Novel View Synthesis. In Conference on Robot Learning (CoRL), 2024

  5. [13]

    S. Ross, G. J. Gordon, and J. A. Bagnell. A Reduction of Imitation Learning and Structured Prediction to No-Regret Online Learning. InInternational Conference on Artificial Intelligence and Statistics (AISTATS), 2011

  6. [14]

    N. Ravi, V . Gabeur, Y .-T. Hu, R. Hu, C. Ryali, T. Ma, H. Khedr, R. Rädle, C. Rolland, L. Gustafson, et al. Sam 2: Segment anything in images and videos. arXiv preprint arXiv:2408.00714, 2024

  7. [15]

    Avigal, L

    Y . Avigal, L. Berscheid, T. Asfour, T. Kröger, and K. Goldberg. SpeedFolding: Learning Efficient Bimanual Folding of Garments. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022

  8. [16]

    Maitin-Shepard, M

    J. Maitin-Shepard, M. Cusumano-Towner, J. Lei, and P. Abbeel. Cloth Grasp Point Detection Based on Multiple-View Geometric Cues with Application to Robotic Towel Folding. InIEEE International Conference on Robotics and Automation (ICRA), 2010

  9. [17]

    Canberk, C

    A. Canberk, C. Chi, H. Ha, B. Burchfiel, E. Cousineau, S. Feng, and S. Song. Cloth funnels: Canonicalized-alignment for multi-purpose garment manipulation. InIEEE International Con- ference on Robotics and Automation (ICRA), 2022

  10. [18]

    Colomé and C

    A. Colomé and C. Torras. Dimensionality reduction for dynamic movement primitives and application to bimanual manipulation of clothes. In IEEE Transactions on Robotics, 2018

  11. [19]

    Salhotra, I.-C

    G. Salhotra, I.-C. A. Liu, and G. Sukhatme. Learning robot manipulation from cross- morphology demonstration. In Conference on Robot Learning (CoRL), 2023

  12. [20]

    T. Weng, S. Bajracharya, Y . Wang, K. Agrawal, and D. Held. Fabricflownet: Bimanual cloth manipulation with a flow-based policy. In Conference on Robot Learning (CoRL), 2021

  13. [21]

    L. Y . Chen, B. Shi, D. Seita, R. Cheng, T. Kollar, D. Held, K. Goldberg, K. Goldberg, K. Gold- berg, K. Goldberg, K. Goldberg, and K. Goldberg. AutoBag: Learning to Open Plastic Bags and Insert Objects. In IEEE International Conference on Robotics and Automation (ICRA) , 2023

  14. [22]

    L. Y . Chen, B. Shi, R. Lin, D. Seita, A. Ahmad, R. Cheng, T. Kollar, D. Held, and K. Gold- berg. Bagging by Learning to Singulate Layers Using Interactive Perception. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023

  15. [23]

    Bahety, S

    A. Bahety, S. Jain, H. Ha, N. Hager, B. Burchfiel, E. Cousineau, S. Feng, and S. Song. Bag All You Need: Learning a Generalizable Bagging Strategy for Heterogeneous Objects. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023

  16. [24]

    Grannen, Y

    J. Grannen, Y . Wu, S. Belkhale, and D. Sadigh. Learning Bimanual Scooping Policies for Food Acquisition. In Conference on Robot Learning (CoRL), 2022

  17. [25]

    Grannen, Y

    J. Grannen, Y . Wu, B. Vu, and D. Sadigh. Stabilize to act: Learning to coordinate for bimanual manipulation. In Conference on Robot Learning (CoRL), 2023

  18. [26]

    I.-C. A. Liu, S. He, D. Seita, and G. Sukhatme. V oxAct-B: V oxel-Based Acting and Stabilizing Policy for Bimanual Manipulation. In Conference on Robot Learning (CoRL), 2024

  19. [27]

    Batinica, B

    A. Batinica, B. Nemec, A. Ude, M. Rakovic, and A. Gams. Compliant movement primitives in a bimanual setting. In IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids). IEEE, 2017. 10

  20. [28]

    Ureche and A

    L. Ureche and A. Billard. Constraints extraction from asymmetrical bimanual tasks and their use in coordinated behavior. Robotics and Autonomous Systems, 103:222–235, 2018

  21. [29]

    Chitnis, S

    R. Chitnis, S. Tulsiani, S. Gupta, and A. Gupta. Efficient bimanual manipulation using learned task schemas. In IEEE International Conference on Robotics and Automation (ICRA), 2020

  22. [30]

    Y . Li, C. Pan, H. Xu, X. Wang, and Y . Wu. Efficient Bimanual Handover and Rearrangement via Symmetry-Aware Actor-Critic Learning. In IEEE International Conference on Robotics and Automation (ICRA), 2023

  23. [31]

    Y . Chen, Y . Yang, T. Wu, S. Wang, X. Feng, J. Jiang, S. M. McAleer, H. Dong, Z. Lu, and S.-C. Zhu. Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning. In Neural Information Processing Systems (NeurIPS), 2022

  24. [32]

    T. Lin, Y . Zhang, Q. Li, H. Qi, B. Yi, S. Levine, and J. Malik. Learning Visuotactile Skills with Two Multifingered Hands. In IEEE International Conference on Robotics and Automation (ICRA), 2025

  25. [33]

    Lin, Z.-H

    T. Lin, Z.-H. Yin, H. Qi, P. Abbeel, and J. Malik. Twisting Lids Off with Two Hands. In Conference on Robot Learning (CoRL), 2024

  26. [34]

    Zakka, P

    K. Zakka, P. Wu, L. Smith, N. Gileadi, T. Howell, X. B. Peng, S. Singh, Y . Tassa, P. Flo- rence, A. Zeng, and P. Abbeel. Robopianist: Dexterous piano playing with deep reinforcement learning. In Conference on Robot Learning (CoRL), 2023

  27. [35]

    Sferrazza, D.-M

    C. Sferrazza, D.-M. Huang, X. Lin, Y . Lee, and P. Abbeel. HumanoidBench: Simulated Hu- manoid Benchmark for Whole-Body Locomotion and Manipulation. In Robotics: Science and Systems (RSS), 2024

  28. [36]

    Chernyadev, N

    N. Chernyadev, N. Backshall, X. Ma, Y . Lu, Y . Seo, and S. James. BiGym: A Demo-Driven Mobile Bi-Manual Manipulation Benchmark. InConference on Robot Learning (CoRL), 2024

  29. [37]

    Franzese, L

    G. Franzese, L. d. S. Rosa, T. Verburg, L. Peternel, and J. Kober. Interactive imitation learning of bimanual movement primitives. IEEE/ASME Transactions on Mechatronics , 28(1):1–13, 2023

  30. [38]

    F. Xie, A. Chowdhury, M. C. De Paolis Kaluza, L. Zhao, L. L. Wong, and R. Yu. Deep Imitation Learning for Bimanual Robotic Manipulation. In Neural Information Processing Systems (NeurIPS), 2020

  31. [39]

    Bahety, P

    A. Bahety, P. Mandikal, B. Abbatematteo, and R. Martín-Martín. ScrewMimic: Bimanual Imitation from Human Videos with Screw Space Projection. InRobotics: Science and Systems (RSS), 2024

  32. [40]

    L. X. Shi, A. Sharma, T. Z. Zhao, and C. Finn. Waypoint-based imitation learning for robotic manipulation. In Conference on Robot Learning (CoRL), 2023

  33. [41]

    B. Zhou, H. Yuan, Y . Fu, and Z. Lu. Learning Diverse Bimanual Dexterous Manipulation Skills from Human Demonstrations. arXiv preprint arXiv:2410.02477, 2024

  34. [42]

    H. Zhou, R. Wang, Y . Tai, Y . Deng, G. Liu, and K. Jia. You Only Teach Once: Learn One-Shot Bimanual Robotic Manipulation from Video Demonstrations. arXiv preprint arXiv:2501.14208, 2025

  35. [43]

    G. Lu, T. Yu, H. Deng, S. S. Chen, Y . Tang, and Z. Wang. AnyBimanual: Transferring Uni- manual Policy for General Bimanual Manipulation. arXiv preprint arXiv:2412.06779, 2024

  36. [44]

    T. Z. Zhao, V . Kumar, S. Levine, and C. Finn. Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardware. In Robotics: Science and Systems (RSS), 2023. 11

  37. [45]

    S. Liu, L. Wu, B. Li, H. Tan, H. Chen, Z. Wang, K. Xu, H. Su, and J. Zhu. RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation. arXiv preprint arXiv:2410.07864, 2024

  38. [46]

    Black, N

    K. Black, N. Brown, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, L. Groom, K. Haus- man, B. Ichter, S. Jakubczak, T. Jones, L. Ke, S. Levine, A. Li-Bell, M. Mothukuri, S. Nair, K. Pertsch, L. X. Shi, J. Tanner, Q. Vuong, A. Walling, H. Wang, and U. Zhilin- sky. π0: A Visi...

  39. [48]

    A. . Team. Aloha 2: An enhanced low-cost hardware for bimanual teleoperation, 2024. URL https://aloha-2.github.io/

  40. [49]

    Z. Fu, T. Z. Zhao, and C. Finn. Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperation. In Conference on Robot Learning (CoRL), 2024

  41. [50]

    T. Z. Zhao, J. Tompson, D. Driess, P. Florence, K. Ghasemipour, C. Finn, and A. Wahid. ALOHA Unleashed: A Simple Recipe for Robot Dexterity. In Conference on Robot Learning (CoRL), 2024

  42. [51]

    C. Wang, H. Shi, W. Wang, R. Zhang, L. Fei-Fei, and C. K. Liu. DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulation. In Robotics: Science and Systems (RSS), 2024

  43. [52]

    R. Ding, Y . Qin, J. Zhu, C. Jia, S. Yang, R. Yang, X. Qi, and X. Wang. Bunny-visionpro: Real-time bimanual dexterous teleoperation for imitation learning. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2025

  44. [53]

    D. A. Pomerleau. Efficient Training of Artificial Neural Networks for Autonomous Navigation. Neural Computation, 3, 1991

  45. [54]

    L. Wang, Y . Ling, Z. Yuan, M. Shridhar, C. Bao, Y . Qin, B. Wang, H. Xu, and X. Wang. GenSim: Generating Robotic Simulation Tasks via Large Language Models. In International Conference on Learning Representations (ICLR), 2024

  46. [55]

    P. Hua, M. Liu, A. Macaluso, Y . Lin, W. Zhang, H. Xu, and L. Wang. GenSim2: Scaling Robot Data Generation with Multi-modal and Reasoning LLMs. In Conference on Robot Learning (CoRL), 2024

  47. [56]

    Katara, Z

    P. Katara, Z. Xian, and K. Fragkiadaki. Gen2Sim: Scaling up Robot Learning in Simula- tion with Generative Models. In IEEE International Conference on Robotics and Automation (ICRA), 2024

  48. [57]

    Y . Wang, Z. Xian, F. Chen, T.-H. Wang, Y . Wang, K. Fragkiadaki, Z. Erickson, D. Held, and C. Gan. RoboGen: Towards Unleashing Infinite Data for Automated Robot Learning via Generative Simulation. In International Conference on Machine Learning (ICML), 2024

  49. [58]

    Z. Chen, Z. Mandi, H. Bharadhwaj, M. Sharma, S. Song, A. Gupta, and V . Kumar. Semanti- cally Controllable Augmentations for Generalizable Robot Learning. In International Journal of Robotics Research (IJRR), 2024

  50. [59]

    C. Yuan, S. Joshi, S. Zhu, H. Su, H. Zhao, and Y . Gao. RoboEngine: Plug-and-Play Robot Data Augmentation with Semantic Robot Segmentation and Background Generation. arXiv preprint arXiv:2503.18738, 2025. 12

  51. [60]

    Bharadhwaj, J

    H. Bharadhwaj, J. Vakil, M. Sharma, A. Gupta, S. Tulsiani, and V . Kumar. RoboAgent: Gen- eralization and Efficiency in Robot Manipulation via Semantic Augmentations and Action Chunking. In IEEE International Conference on Robotics and Automation (ICRA), 2024

  52. [61]

    G. Tang, S. Rajkumar, Y . Zhou, H. R. Walke, S. Levine, and K. Fang. KALIE: Fine-Tuning Vision-Language Models for Open-World Manipulation without Robot Data. In IEEE Inter- national Conference on Robotics and Automation (ICRA), 2025

  53. [62]

    Y . Ye, X. Li, A. Gupta, S. D. Mello, S. Birchfield, J. Song, S. Tulsiani, and S. Liu. Affordance Diffusion: Synthesizing Hand-Object Interactions. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

  54. [63]

    Laskey, J

    M. Laskey, J. Lee, R. Fox, A. D. Dragan, and K. Goldberg. Dart: Noise injection for robust imitation learning. In Conference on Robot Learning (CoRL), 2017

  55. [64]

    Mandlekar, S

    A. Mandlekar, S. Nasiriany, B. Wen, I. Akinola, Y . Narang, L. Fan, Y . Zhu, and D. Fox. Mim- icGen: A Data Generation System for Scalable Robot Learning using Human Demonstrations. In Conference on Robot Learning (CoRL), 2023

  56. [65]

    Garrett, A

    C. Garrett, A. Mandlekar, B. Wen, and D. Fox. SkillMimicGen: Automated Demonstration Generation for Efficient Skill Learning and Deployment. In Conference on Robot Learning (CoRL), 2024

  57. [66]

    Jiang, Y

    Z. Jiang, Y . Xie, K. Lin, Z. Xu, W. Wan, A. Mandlekar, L. Fan, and Y . Zhu. DexMimicGen: Automated Data Generation for Bimanual Dexterous Manipulation via Imitation Learning. In IEEE International Conference on Robotics and Automation (ICRA), 2025

  58. [67]

    Mitrano and D

    P. Mitrano and D. Berenson. Data Augmentation for Manipulation. In Robotics: Science and Systems (RSS), 2022

  59. [68]

    L. Ke, Y . Zhang, A. Deshpande, S. Srinivasa, and A. Gupta. CCIL: Continuity-based Data Augmentation for Corrective Imitation Learning. In International Conference on Learning Representations (ICLR), 2024

  60. [69]

    Mildenhall, P

    B. Mildenhall, P. P. Srinivasan, M. Tancik, J. T. Barron, R. Ramamoorthi, and R. Ng. NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. In European Conference on Computer Vision (ECCV), 2020

  61. [70]

    J. J. Yu, F. Forghani, K. G. Derpanis, and M. A. Brubaker. Long-Term Photometric Consistent Novel View Synthesis with Diffusion Models. In IEEE/CVF International Conference on Computer Vision (ICCV), 2023

  62. [71]

    Esser, R

    P. Esser, R. Rombach, and B. Ommer. Taming transformers for high-resolution image synthe- sis. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

  63. [72]

    Rombach, A

    R. Rombach, A. Blattmann, D. Lorenz, P. Esser, and B. Ommer. High-resolution image syn- thesis with latent diffusion models. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

  64. [73]

    Ronneberger, P

    O. Ronneberger, P. Fischer, and T. Brox. U-net: Convolutional networks for biomedical im- age segmentation. In Medical image computing and computer-assisted intervention–MICCAI 2015: 18th international conference, Munich, Germany, October 5-9, 2015, proceedings, part III 18, p...

  65. [74]

    Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing , 13(4):600– 612, 2004. doi:10.1109/TIP.2003.819861. 13

  66. [75]

    Xiang, D

    Y . Xiang, D. Sun, W. Fan, and X. Gong. Generalized simulated annealing algorithm and its application to the thomson model. Physics Letters A, 233(3):216–220, 1997. ISSN 0375-9601. doi:https://doi.org/10.1016/S0375-9601(97)00474-X. URL https://www.sciencedirect. com/science/ar...

  67. [76]

    Grotz, M

    M. Grotz, M. Shridhar, T. Asfour, and D. Fox. PerAct2: Benchmarking and Learning for Robotic Bimanual Manipulation Tasks. arXiv preprint arXiv:2407.00278, 2024

  68. [77]

    James, Z

    S. James, Z. Ma, D. Rovick Arrojo, and A. J. Davison. Rlbench: The robot learning benchmark & learning environment. In IEEE Robotics and Automation Letters (RA-L), 2020

  69. [78]

    P. Wu, Y . Shentu, Z. Yi, X. Lin, and P. Abbeel. GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulators. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024

  70. [79]

    Sargent, Z

    K. Sargent, Z. Li, T. Shah, C. Herrmann, H.-X. Yu, Y . Zhang, E. R. Chan, D. Lagun, L. Fei-Fei, D. Sun, and J. Wu. ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024

  71. [80]

    Pertsch, K

    K. Pertsch, K. Stachowicz, B. Ichter, D. Driess, S. Nair, Q. Vuong, O. Mees, C. Finn, and S. Levine. Fast: Efficient action tokenization for vision-language-action models.arXiv preprint arXiv:2501.09747, 2025

  72. [81]

    Kuznetsova, H

    A. Kuznetsova, H. Rom, N. Alldrin, J. R. R. Uijlings, I. Krasin, J. Pont-Tuset, S. Kamali, S. Popov, M. Malloci, T. Duerig, and V . Ferrari. The open images dataset v4: Unified im- age classification, object detection, and visual relationship detection at scale. arXiv preprint...

  73. [82]

    T. Zhou, R. Tucker, J. Flynn, G. Fyffe, and N. Snavely. Stereo magnification: Learning view synthesis using multiplane images. In SIGGRAPH, 2018. 14 A Paper Changelog Version 1 on arXiv was the initial public release of the paper. Version 2 included minor writing and BibTeX ed...

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.