Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

A lightweight hybrid-attention adapter can lift frozen world-action robot policies from about one-in-four to nearly nine-in-ten success on real precision insertion and assembly tasks with under an hour of online practice per task.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · grok-4.5

2026-07-11 20:31 UTC pith:OWKGUHKV

load-bearing objection Solid WA-native adapter with real insertion gains in under an hour; the 19-point edge over RL-token is real enough to care about, but human intervention plus heavy BC/demo mixing means the architecture is not cleanly isolated. the 3 major comments →

arxiv 2607.04265 v1 pith:OWKGUHKV submitted 2026-07-05 cs.RO cs.AI

HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Models

Angen Ye , Weijie Ke , Xiaofeng Wang , Xinze Chen , Chaojun Ni , Guosheng Zhao , Boyuan Wang , Zheng Zhu
show 2 more authors
Junjie Xie Dapeng Zhang
This is my paper
classification cs.RO cs.AI
keywords World-Action ModelsOnline Reinforcement LearningPrecision ManipulationHybrid AttentionActor-Critic AdapterLatent GuidanceRobotic InsertionAction Chunks
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

World-action models can generate long motion chunks for robots from vision and task prompts, but on real hardware they often fail in the last few millimeters of alignment or insertion because of calibration, perception, and contact errors. This paper claims you need not retrain the large model: freeze it, keep its action prior and internal latent features, and train a small actor-critic adapter that refines short action chunks online. The adapter uses hybrid attention—self-attention to keep the chunk coherent over time, cross-attention to read task-relevant cues from the world-action latents—so it follows the prior when the prior is good and corrects when end-stage precision fails. On four real insertion and assembly tasks the method raises average success from 26.4% to 87.1% in 45–75 minutes of robot training per task, beating residual correction, pure interactive imitation, and compact-token reinforcement learning. Simulation tasks without human takeover show the same pattern of online improvement, supporting the claim that latent-guided adapters close the precision deployment gap efficiently.

Core claim

HALO-WA establishes that a frozen world-action backbone can be specialized for real precision manipulation by training only a lightweight hybrid-attention actor-critic adapter guided by the model’s reference action chunks and distributed latent features. Updated online with TD3 plus behavior-cloning regularization on real interactions—including human interventions—the adapter outputs refined action chunks that close end-stage alignment and insertion failures without full-parameter updates of the large backbone.

What carries the argument

The hybrid-attention latent-guided actor-critic adapter: robot state and world-action reference actions form query tokens that self-attend for chunk structure, then cross-attend into world-action visual latents as memory; the actor decodes a refined action chunk and twin critics score candidates for chunk-level TD3 with behavior-cloning regularization.

Load-bearing premise

The frozen world-action model must already supply usable action guesses and latent features that encode the geometry and contact cues the small adapter needs; if the base model is badly off, the adapter cannot fix the last millimeters.

What would settle it

On the same four real precision tasks with the same training budget, if hybrid-attention latent guidance fails to clearly beat residual correction and compact-token RL (or stays near the ~26% base success rate) when the frozen world-action model has only coarse competence, the claim that this adapter closes the precision gap would not hold.

Watch this falsifier — get emailed when new claim-graph text bears on it.

If this is right

  • Large offline world-action policies can be deployed on precision tasks without expensive full-backbone online fine-tuning.
  • Distributed world-action latents carry local spatial and contact cues that single compact tokens discard, so native latent access improves end-stage correction.
  • Sparse success rewards plus optional human takeover, in 45–75 minutes of real interaction per task, can specialize a frozen world-action prior.
  • Chunk-level TD3 with behavior-cloning regularization can keep the adapter near safe priors while still learning corrections that beat pure imitation.
  • The same adapter can raise success in simulation without human intervention, supporting autonomous online adaptation of frozen world-action models.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • If world-action latents systematically encode contact geometry, similar query-memory adapters may extend to force- or tactile-augmented precision tasks once those signals are added to the latent memory.
  • The gap between action residuals and latent-guided chunk refinement suggests other generative robot policies with rich internal latents—not only world-action models—may benefit more from memory-style adapters than from pure output residuals.
  • Because the method assumes a basically competent base prior, pretraining quality remains a hard gate: near-zero base success would likely leave the lightweight adapter underpowered.
  • A cloud-robot split that freezes heavy inference off-robot while updating only a small adapter implies practical online specialization without shipping large model updates to every robot.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. HALO-WA freezes a pretrained world-action (WA) backbone and trains a lightweight hybrid-attention actor-critic adapter that refines WA reference action chunks using distributed WA latent features and robot state. The adapter uses self-attention over state/reference-action tokens then cross-attention into WA visual latents, and is trained online with TD3 plus behavior-cloning regularization, human-gated interventions, and a 1:1 demo:replay mix. On four real dual-arm precision tasks (stick/Ethernet/plug insertion, block assembly), average success rises from 26.4% (WA-base) to 87.1% after 45–75 minutes of online training per task, beating residual, HG-DAgger, and RL-token-like baselines; ablations on Stick Insertion and two RoboTwin tasks without intervention support the design.

Significance. If the gains hold under cleaner controls, the paper supplies a practical WA-native online adaptation recipe for the precision deployment gap of long-horizon generative WA policies: freeze the backbone, keep chunk-level priors, and read distributed latents rather than compact tokens or pure residuals. Strengths include real-robot evaluation on four contact-rich tasks with intervention-rate curves, targeted ablations of hybrid attention and latent sources (Table 2), simulation results without human intervention (Table 3), released code, and sparse success/failure rewards without dense shaping. The contribution is engineering and empirical rather than theoretical, but it is timely for deploying large WA models on real precision manipulation.

major comments (3)
  1. [Table 1, §4.2, §7.9] Table 1 / Abstract / §4.2: the headline 19.2-point average SR edge over RL-token-like (87.1% vs 67.9%) is load-bearing for the claim that hybrid-attention + distributed Z^WA is the key WA-native contribution. Real-world training (§4.1, §7.1–7.2, §7.9) simultaneously uses human-gated overrides stored as executed actions, offline SFT warm-up of the actor on the same 100 demos used for WA-base, 1:1 demo:replay sampling, and λ_BC=50 that pulls π_θ toward a_ref (WA / success / human). HG-DAgger already reaches 62.9%. Without a matched-intervention-budget or no-intervention real-world control (or an ablation that equalizes intervention/demo/BC across HALO-WA and RL-token-like), the architectural attribution of the residual gap remains incompletely isolated. Simulation (Table 3) helps but is not a substitute for that control on the real tasks that drive the abstract claim.
  2. [Table 1, §4.1] Table 1 reports point success rates over 35 trials per task with no binomial confidence intervals, standard errors, or multi-seed variance. With n=35, several pairwise gaps (e.g., Ethernet 97.1% vs RL-token-like 82.9%; Block Assembly 71.4% vs 51.4%) are directionally large but not statistically characterized; the averaged 19.2-point claim should be accompanied by uncertainty so readers can judge robustness of the ranking.
  3. [Table 2, §4.3] Table 2 ablations that isolate hybrid attention and WA latent features are reported only on Stick Insertion. The largest absolute gains over the strongest baseline occur on Block Assembly and Power Plug Insertion (Table 1). At least one ablation (e.g., no-latent or compact-token vs hybrid) on a second, harder real task is needed to support the general claim that the hybrid-attention latent-guided design—not task-specific intervention patterns—explains the multi-task improvement.
minor comments (5)
  1. [§4.1, §7.1] Platform naming is inconsistent: §4.1 says “Songling ALOHA” while §7.1 says “AgileX ALOHA.” Please unify.
  2. [Fig. 1, Fig. 2] Figure 1 caption and body text use “Hybird-Attention” / “Cryaoss-Attention”; correct to Hybrid / Cross throughout figures and captions.
  3. [§3.1–3.2] Notation for the WA reference chunk (ã vs ã) and for C vs H is introduced in §3.1 but used with slight typographic inconsistency later; a short notation table would help.
  4. [§7.8, §3.2] §7.8 gives adapter dimensions (512, 12×14 chunks) that are useful; consider moving a compact architecture summary into the main Method section so the paper is self-contained without the appendix.
  5. [§2] Related work cites concurrent arXiv WA/VLA papers appropriately; ensure camera-ready versions update any still-preprint citations if journal versions exist by acceptance.

Circularity Check

0 steps flagged

No circularity: empirical online-RL method whose success rates are measured on held-out trials, not algebraic identities of fitted constants or self-definitional claims.

full rationale

HALO-WA is an engineering/empirical robotics paper. The central claim (Abstract, Table 1, §4.2) is an observed average success-rate lift from 26.4% (frozen WA-base) to 87.1% after 45–75 min of real-robot online training, plus ablations (Table 2) and RoboTwin simulation results (Table 3). The method freezes a pretrained WA backbone, extracts its reference action chunk and latent features Z^WA_t, and trains a lightweight hybrid-attention actor-critic adapter with TD3 + BC regularization (Eqs. 1–7, §3). The BC term and 1:1 demo/replay mixing (§3.3, §7.9) are explicit regularizers that bias π_θ toward a_ref; they do not make the reported evaluation SR equal to any fitted input by construction. Human interventions enter the replay buffer as executed actions (§3.1, §7.1), which is standard HIL-style data collection, not a self-definitional loop that forces the headline numbers. No uniqueness theorem is imported from overlapping authors to forbid alternatives; self-citations (e.g., GigaWorld-Policy) supply the base model, not a load-bearing derivation. No equation reduces a claimed prediction to a free parameter or renames a known identity. The skeptic concern about attribution of gains (intervention + BC vs. hybrid attention) is a validity/ablation issue, not circularity under the stated criteria. Derivation chain is therefore self-contained against external evaluation metrics.

Axiom & Free-Parameter Ledger

6 free parameters · 5 axioms · 2 invented entities

The central empirical claim rests on a standard TD3+BC online RL recipe, the premise that frozen WA latents and reference chunks are informative enough to refine, and several hand-set training knobs (BC weight, UTD, demo mix, per-task γ). No new physical entities; the invented pieces are architectural (hybrid-attention adapter, state packaging of WA latents).

free parameters (6)
  • BC regularization coefficient λ_BC = 50
    Set to 50 for all tasks (§7.9); strongly shapes how much the actor may leave the WA/demo action distribution and thus online improvement vs safety.
  • Update-to-data (UTD) ratio = 5
    Fixed at 5 gradient steps per new rollout batch; controls sample efficiency and overfitting risk under short real-robot budgets.
  • Demo:replay sampling ratio = 0.5
    Fixed 1:1 mix of offline demos and online replay (§7.2, §7.9); material to early stability and final policy.
  • Action chunk length C and action dim = 12×14
    Policy always outputs 12×14 chunks; C is a design choice that defines the RL transition grain.
  • Per-task discount γ and episode length = task-dependent (Tables 4–5)
    γ ∈ {0.92, 0.95, 0.98, 0.82} and horizons 192–480 chosen by task horizon (Tables 4–5); affect credit assignment for sparse rewards.
  • Actor/critic learning rates = 2.5e-5 / 3.0e-5
    2.5e-5 / 3.0e-5 fixed; standard free optimization hyperparameters for the reported runs.
axioms (5)
  • domain assumption TD3 with twin critics and delayed actor updates is a valid continuous-control learner for chunk-level robot actions under sparse success rewards.
    Training objective §3.3 cites TD3; no new convergence proof—standard RL practice assumed to transfer to real contact tasks.
  • domain assumption VAE/world-action latent features Z^WA_t from the frozen backbone encode spatial and action-generation cues useful for end-stage alignment and insertion.
    Core design of st and hybrid attention (§3.1–3.2); ablations support it on Stick Insertion but it is assumed for all tasks and for the method’s applicability.
  • domain assumption Human interventions and offline demos stored as executed actions provide reliable state-transition labels for the replay buffer.
    §3.3 and §7.1: interventions override actor outputs and are treated as ground-truth executed actions mixed with demos.
  • ad hoc to paper Sparse binary success/failure rewards (no dense shaping) suffice to train the adapter within 45–75 minutes of real interaction.
    Explicit experimental choice §7.9; success of the method under this reward is part of what is claimed, not a prior theorem.
  • ad hoc to paper Self-attention then cross-attention is an appropriate inductive bias for preserving action-chunk order while reading latent memory.
    Architectural postulate §3.2; justified empirically vs concat/CNN/self/cross ablations, not derived.
invented entities (2)
  • Hybrid-attention actor-critic adapter (HALO-WA) no independent evidence
    purpose: Lightweight online refinement module that consumes WA reference actions, robot state, and distributed WA latents to output refined action chunks without updating the WA backbone.
    Primary proposed object of the paper (§3, Fig. 2); evaluated only within this work’s tasks and baselines.
  • WA-native RL state st = (sr_t, reference action chunk, Z^WA_t) no independent evidence
    purpose: Packages proprioception, action prior, and latent memory as the adapter’s observation for chunk-level TD3.
    Defined in §3.1 Eq. (2); not a physical entity but a new interface construct relative to compact-token VLA adapters.

pith-pipeline@v1.1.0-grok45 · 20046 in / 3944 out tokens · 60120 ms · 2026-07-11T20:31:11.872006+00:00 · methodology

0 comments
read the original abstract

World-action (WA) models can generate long-horizon action chunks for general-purpose robotic manipulation, but they remain vulnerable to calibration, perception, and contact-dynamics errors in real-world precision tasks, often failing in the final few millimeters of alignment or insertion. We propose HALO-WA, a hybrid-attention latent-guided online reinforcement learning (RL) framework for WA models, which leverages latent features and action priors from the WA generation process through a lightweight actor-critic adapter to enable fast online adaptation to real deployment errors. HALO-WA introduces a hybrid-attention structure that preserves the temporal consistency of action chunks while reading task-relevant information from WA latents conditioned on visual context and end-stage correction requirements, thereby producing refined action chunks. We validate HALO-WA on four real-world precision manipulation tasks, where it improves the average success rate from 26.4\% for WA-base to 87.1\%, outperforming the strongest baseline by 19.2 percentage points while requiring only 45--75 minutes of online training per task. To facilitate reproducibility, we further conduct supplementary simulation experiments in RoboTwin and release the code at https://github.com/YeanRoot/HALO-WA.

Figures

Figures reproduced from arXiv: 2607.04265 by Angen Ye, Boyuan Wang, Chaojun Ni, Dapeng Zhang, Guosheng Zhao, Junjie Xie, Weijie Ke, Xiaofeng Wang, Xinze Chen, Zheng Zhu.

Figure 1
Figure 1. Figure 1: Overview of HALO-WA. The figure illustrates the cloud-robot online adaptation loop, in [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Figure 2: Hybrid-attention actor-critic adapter in HALO-WA. The figure shows how WA reference [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Figure 3: Representative rollouts of the evaluated tasks. Blue panels show four real-world precision [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figure 4
Figure 4. Figure 4: Intervention-rate curves during real-world online training. Lower intervention rates indi [PITH_FULL_IMAGE:figures/full_fig_p008_4.png] view at source ↗

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. GigaWorld-Policy-0.5: A Faster and Stronger WAM Empowered by AutoResearch

    cs.RO 2026-07 conditional novelty 4.0

    GigaWorld-Policy-0.5 uses a Mixture-of-Transformers action-expert split and mixed world-model pretraining to reach 85 ms action-only inference with claimed success-rate gains.

Reference graph

Works this paper leans on

31 extracted references · 17 linked inside Pith · cited by 1 Pith paper

  1. [1]

    S. Wang, J. Shi, Z. Fu, X. He, F. Liu, C. Yang, Y . Zhou, Z. Fei, J. Gong, J. Fu, et al. World action models: The next frontier in embodied ai.arXiv preprint arXiv:2605.12090, 2026

    Pith/arXiv arXiv 2026

  2. [2]

    B. Hou, G. Li, J. Jia, T. An, X. Guo, S. Leng, H. Geng, Y . Ze, T. Harada, P. Torr, et al. World model for robot learning: A comprehensive survey.arXiv preprint arXiv:2605.00080, 2026

    Pith/arXiv arXiv 2026

  3. [3]

    G. Team, A. Ye, B. Wang, C. Ni, G. Huang, G. Zhao, H. Li, J. Zhu, K. Li, M. Xu, et al. Gigaworld-0: World models as data engine to empower embodied ai.arXiv preprint arXiv:2511.19861, 2025

    arXiv 2025

  4. [4]

    M. J. Kim, Y . Gao, T.-Y . Lin, Y .-C. Lin, Y . Ge, G. Lam, P. Liang, S. Song, M.-Y . Liu, C. Finn, et al. Cosmos policy: Fine-tuning video models for visuomotor control and planning.arXiv preprint arXiv:2601.16163, 2026

    Pith/arXiv arXiv 2026

  5. [5]

    H. Bi, H. Tan, S. Xie, Z. Wang, S. Huang, H. Liu, R. Zhao, Y . Feng, C. Xiang, Y . Rong, et al. Motus: A unified latent action world model.arXiv preprint arXiv:2512.13030, 2025

    Pith/arXiv arXiv 2025

  6. [6]

    Luo et al

    J. Luo et al. Precise and dexterous robotic manipulation via human-in-the-loop reinforcement learning.Science Robotics, 10:eads5033, 2025. doi:10.1126/scirobotics.ads5033

    doi:10.1126/scirobotics.ads5033 2025

  7. [7]

    K. Lei, H. Li, D. Yu, Z. Wei, L. Guo, Z. Jiang, Z. Wang, S. Liang, and H. Xu. Rl- 100: Performant robotic manipulation with real-world reinforcement learning.arXiv preprint arXiv:2510.14830, 2025

    arXiv 2025

  8. [8]

    Z. Yuan, T. Wei, S. Cheng, G. Zhang, Y . Chen, and H. Xu. Learning to manipulate anywhere: A visual generalizable framework for reinforcement learning.arXiv preprint arXiv:2407.15815, 2024

    Pith/arXiv arXiv 2024

  9. [9]

    Y . Li, X. Ma, J. Xu, Y . Cui, Z. Cui, Z. Han, L. Huang, T. Kong, Y . Liu, H. Niu, et al. Gr-rl: Going dexterous and precise for long-horizon robotic manipulation.arXiv preprint arXiv:2512.01801, 2025

    arXiv 2025

  10. [10]

    C. Xu, J. T. Springenberg, M. Equi, A. Amin, A. Esmail, S. Levine, and L. Ke. Rl token: Bootstrapping online rl with vision-language-action models.arXiv preprint arXiv:2604.23073, 2026

    Pith/arXiv arXiv 2026

  11. [11]

    A. Ye, Z. Zhang, B. Wang, X. Wang, D. Zhang, and Z. Zhu. Vla-r1: Enhancing reasoning in vision-language-action models.arXiv preprint arXiv:2510.01623, 2025

    arXiv 2025

  12. [12]

    G. Lu, W. Guo, C. Zhang, Y . Zhou, H. Jiang, Z. Gao, Y . Tang, and Z. Wang. Vla-rl: To- wards masterful and general robotic manipulation with scalable reinforcement learning.arXiv preprint arXiv:2505.18719, 2025

    Pith/arXiv arXiv 2025

  13. [13]

    Black, N

    K. Black, N. Brown, D. Driess, A. Esmail, M. Equi, C. Finn, N. Fusai, L. Groom, K. Hausman, B. Ichter, et al. pi 0 : A vision-language-action flow model for general robot control.arXiv preprint arXiv:2410.24164, 2024

    Pith/arXiv arXiv 2024

  14. [14]

    G. Team, A. Ye, B. Wang, C. Ni, G. Huang, G. Zhao, H. Li, J. Li, J. Zhu, L. Feng, et al. Gigabrain-0: A world model-powered vision-language-action model.arXiv preprint arXiv:2510.19430, 2025

    arXiv 2025

  15. [15]

    S. Ye, Y . Ge, K. Zheng, S. Gao, S. Yu, G. Kurian, S. Indupuru, Y . L. Tan, C. Zhu, J. Xiang, et al. World action models are zero-shot policies.arXiv preprint arXiv:2602.15922, 2026

    Pith/arXiv arXiv 2026

  16. [16]

    T. Yuan, Z. Dong, Y . Liu, and H. Zhao. Fast-wam: Do world action models need test-time future imagination?arXiv preprint arXiv:2603.16666, 2026. 10

    Pith/arXiv arXiv 2026

  17. [17]

    Q. Feng, J. Yu, J. Liu, Y . Jia, Z. Wu, H. Chen, Z. Qian, S. Gu, P. Jia, S. Ma, et al. Harmowam: Harmonizing generalizable and precise manipulation via adaptive world action models.arXiv preprint arXiv:2605.10942, 2026

    Pith/arXiv arXiv 2026

  18. [18]

    Y . Liu, P. Sun, S. Li, Y . Xie, L. Zhang, X. Chao, S. Dong, F. Chen, X.-P. Zhang, and W. Ding. Oa-wam: Object-addressable world action model for robust robot manipulation.arXiv preprint arXiv:2605.06481, 2026

    Pith/arXiv arXiv 2026

  19. [19]

    S. Jha, A. Zholus, S. Chandar, et al. Reconstruction or semantics? what makes a latent space useful for robotic world models.arXiv preprint arXiv:2605.06388, 2026

    Pith/arXiv arXiv 2026

  20. [20]

    Vaswani, N

    A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polo- sukhin. Attention is all you need.Advances in neural information processing systems, 30, 2017

    2017

  21. [21]

    Bahdanau, K

    D. Bahdanau, K. Cho, and Y . Bengio. Neural machine translation by jointly learning to align and translate.arXiv preprint arXiv:1409.0473, 2014

    Pith/arXiv arXiv 2014

  22. [22]

    T. Chen, Z. Chen, B. Chen, Z. Cai, Y . Liu, Z. Li, Q. Liang, X. Lin, Y . Ge, Z. Gu, et al. Robotwin 2.0: A scalable data generator and benchmark with strong domain randomization for robust bimanual robotic manipulation.arXiv preprint arXiv:2506.18088, 2025

    Pith/arXiv arXiv 2025

  23. [23]

    A. Ye, B. Wang, C. Ni, G. Huang, G. Zhao, H. Li, H. Li, J. Li, J. Lv, J. Liu, et al. Gigaworld- policy: An efficient action-centered world–action model.arXiv preprint arXiv:2603.17240, 2026

    arXiv 2026

  24. [24]

    L. Li, Q. Zhang, Y . Luo, S. Yang, R. Wang, F. Han, M. Yu, Z. Gao, N. Xue, X. Zhu, et al. Causal world modeling for robot control.arXiv preprint arXiv:2601.21998, 2026

    Pith/arXiv arXiv 2026

  25. [25]

    B. Wang, X. Meng, X. Wang, Z. Zhu, A. Ye, Y . Wang, Z. Yang, C. Ni, G. Huang, and X. Wang. Embodiedreamer: Advancing real2sim2real transfer for policy training via embodied world modeling.arXiv preprint arXiv:2507.05198, 2025

    Pith/arXiv arXiv 2025

  26. [26]

    S. Ross, G. Gordon, and D. Bagnell. A reduction of imitation learning and structured prediction to no-regret online learning. InProceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, volume 15 ofProceedings of Machine Learning Research, pages 627–635, Fort Lauderdale, FL, USA, 2011. PMLR

    2011

  27. [27]

    Kelly, C

    M. Kelly, C. Sidrane, K. Driggs-Campbell, and M. J. Kochenderfer. Hg-dagger: Interactive imitation learning with human experts. In2019 International Conference on Robotics and Automation (ICRA), pages 8077–8083. IEEE, 2019

    2019

  28. [28]

    A. Ye, X. Wang, Y . Song, Y . Li, Z. Zhu, and D. Zhang. Fully automated insertion algorithm of flexible electrodes for invasive brain-machine interface.Pattern Recognition Letters, 2026

    2026

  29. [29]

    Fujimoto, H

    S. Fujimoto, H. Hoof, and D. Meger. Addressing function approximation error in actor-critic methods. InInternational conference on machine learning, pages 1587–1596. PMLR, 2018

    2018

  30. [30]

    W. Xiao, H. Lin, A. Peng, H. Xue, T. He, Y . Xie, F. Hu, J. Wu, Z. Luo, L. Fan, et al. Self- improving vision-language-action models with data generation via residual rl.arXiv preprint arXiv:2511.00091, 2025

    arXiv 2025

  31. [31]

    LeCun, L

    Y . LeCun, L. Bottou, Y . Bengio, and P. Haffner. Gradient-based learning applied to document recognition.Proceedings of the IEEE, 86(11):2278–2324, 1998. 11 7 Supplementary Material 7.1 Real-World Implementation Details The real-world experiments are conducted on an AgileX ALOHA dual-arm robot platform. The robot uses three RGB cameras as visual inputs, ...

    1998