Robotics · arXiv:2611.05155 v1 · submitted 3 Nov 2026 · 197 references
Asynchronous Robot Policies
The paper says
“Scaling vision-language foundation models has significantly advanced generalist robot manipulation, but the increased model scale introduces computational latency that degrades real-time physical reactivity.”
more of the abstract
Existing Vision-Language-Action (VLA) architectures execute high-level semantic reasoning and action ex- ecution sequentially within the primary control loop, creating a fundamental tension between semantic-reasoning capability and robot agility. To address this, we propose Asynchronous Robot Policy (ARP), an architectural framework that decouples semantic reasoning from low-level action generation using asynchronous processes operating at independent frequencies. In ARP, a high-capacity Vision-Language Model (VLM) asynchronously updates a semantic memory at low fre- quency, while a lightweight Vision-Action Expert, conditioned on this semantic memory, generates robot actions at a much higher control frequency. Such a formulation, enables having a fast perception-action loop without compromising on the semantic capability. To overcome asynchronous memory staleness, ARP trains the vision-action expert on the semantic staleness and execution delay, with temporally mismatched observation across processes. On Franka manipulation tasks, ARP achieves an 18% higher success rate and 20% less time need for execution in quasi-static setups, while 3-5 times baseline performance in dynamic simulation environments. Furthermore, ARP enables operating the VLM at 10 times lower than its nominal frequency with no significant performance loss making it much more efficient than the baseline. These results highlight the architectural advantages of modeling robot policies as asynchronous processes, enabling real-world reactive deployment without sacrificing the scale of foundation models.
from the abstract
Pith says
Machine review · deepseek-v4-flash · 4 Nov 2026 · what was read was not recorded · not checked by a person
It can be wrong. Challenge this review or reply to it.
Holds up, with conditions. A well-ablated, plausible async VLA architecture; the dynamic reactivity claim needs a synchronous-plus-staleness control and a cleaned-up headline before it is established. This line is wrong
2 major objections · 7 minor
How often objections from reviews like this one are right: not yet measured
Not checked: figures, code, what the 197 references say.
The paper says, at Sec. 4.3 (Tabs. 2-3), Sec. 3.4 (Eq. 3), Sec. 4.5
The review did not quote this passage.
Pith says: Objection 1 of 2 · major
The central attribution claim is confounded. Every dynamic comparison (ARP-1B vs pi0-1B at 51.5% vs 9.5% and 44.7% vs 12.7%) varies two factors at once: the asynchronous architecture and the training-time staleness/latency augmentation of Eq. (3), which the pi0 baseline does not receive.
more of objection 1
Tab. 4 establishes that the augmentation is necessary (the d_t=0 row collapses at 2.5-0.5 Hz), but no experiment runs the complementary cell: a synchronous pi0-style policy trained with the same staleness mixture and delay conditioning, i.e., the recipe of the cited Training-Time RTC (Black et al., 2025) and VLASH (Tang et al., 2025). The 'Vision-Gated VLA' ablation does not fill this gap because it drops the semantic memory rather than keeping the augmentation while removing asynchrony. If sync-plus-augmentation matches ARP's dynamic numbers, the gains are attributable to training-time latency compensation, which is prior art, and the claim that asynchronous decoupling itself 'breaks the reactivity-capability trade-off' (Sec. 1, Fig. 1b) would need to be substantially re-scoped. I recommend running this control, or directly benchmarking the cited TRTC/VLASH recipes, and reporting the outcome.
The paper says, at Abstract and Sec. 1 (b7, b33) vs. Tabs. 1, 6 and Fig. 3
The review did not quote this passage.
Pith says: Objection 2 of 2 · major
The headline '18% higher success rate and 20% less time need for execution in quasi-static setups' is not supported by any single comparison in the paper. In Tab. 1 the largest ARP-vs-pi0 relative gain on the average is roughly 8-11% (ARP-8B/14B vs pi0-1B-replicated); the closest cells to 18% are the Long-suite comparison (62.4 vs 51.8, +20.5% relative) and ARP-1B vs Diffusion Policy (+17.1%), neither of which is a clean 'conventional VLA baseline' average.
more of objection 2
The 20% time reduction appears only in the DROID/RoboLab evaluation (16.8 s vs 20.9 s, Fig. 3), where ARP's success is below pi0.5, and no execution-time table is provided for the LIBERO quasi-static experiments. The abstract's '3-5x' also overstates the p=0.5 cell of Tab. 2 (46.7 vs 20.0, i.e., 2.3x). These numbers should be reconciled with the tables or re-specified with their exact basis.
7 minor objections
The paper says, at Sec. 4.5
Pith says: minor objection 1 of 7
The 'ARP vs. Vision-Gated VLA' paragraph is ambiguous about what is ablated; it reads as if it refers to the d_t=0 row of Tab. 4, but that row retains the semantic-memory channel, so please state explicitly whether the memory is removed or merely trained at zero lag.
The paper says, at Tabs. 2-3 and Sec. D.2
Pith says: minor objection 2 of 7
Please report the number of evaluation episodes for the dynamic benchmarks and add standard errors, confidence intervals, or seed variance for the success rates; the real-robot protocols use only 10 trials per task, and the figure-only reporting there makes the margins hard to assess.
show 5 more
The paper says, at Sec. A.1
Pith says: minor objection 3 of 7
The latency list '64.0ms, 64.0ms, 90.5ms, 125.ms' lacks the model-size labels (presumably 1B, 2B, 8B, 14B) and contains a typo ('125.ms'); please also define the 'nominal' VLM frequency against which the 10x reduction is computed.
The paper says, at Sec. 3.2, Eq. (2)
Pith says: minor objection 4 of 7
Please specify the shape of KV_tau: the text says KV caches across L intermediate layers are tapped, but the projected memory is in R^{S x D}, so the layer index L does not appear in the memory dimension.
The paper says, at Fig. 7
Pith says: minor objection 5 of 7
The annotations '+1.8, +7.0, +10.0, +18.2' are unexplained, the axis is labeled 'Success rate (%)' while the annotated values appear to be deltas, and the relationship to the frequency columns of Tab. 4 should be stated explicitly.
The paper says, at Sec. 1 and Sec. 2.2
Pith says: minor objection 6 of 7
The claim that ARP is 'the first truly asynchronous robotic control framework' is too strong given that AsyncVLA and AR-VLA also place a local action expert outside the VLM path; please state the precise architectural criterion that distinguishes ARP from those systems.
The paper says, at Sec. 4.4 vs. Sec. A.2
Pith says: minor objection 7 of 7
The '10x lower frequency without performance loss' claim is an interpolation result, since 0.5 Hz refresh at a 20 Hz control rate produces staleness up to the d_max=40 training bound; the envelope caveat of Sec. A.2 (b255) should be echoed in the main text where the claim is made.
What would settle it
Train the same π0-1B architecture used in the replicated baseline with ARP's staleness/latency augmentation - sample d_t from U{1,...,40} (Eq. 3) and condition the flow-matching objective on staleness and execution delay in the style of Training-Time RTC (Black et al., 2025) or VLASH (Tang et al., 2025) - keeping data, seeds, and the Sec. B/C benchmark protocols identical. Evaluate on LIBERO-Perturb and Dynamic Bump exactly as in Tab. 2-3. If this synchronous augmented policy reaches within ~10 pp of ARP-1B (51.5% / 44.7%), the reactivity gains are attributable to training-time augmentation rather than to asynchronous decoupling, and the central claim requires revision; if it remains near the un-augmented π0-1B levels (9.5% / 12.7%), the decoupling is the operative mechanism.
from the skeptic's reading
How the review went
4 readings by deepseek-v4-flash · 4 Nov 2026
- Reader holds up, with conditions
- Skeptic partly agrees
- Editor wrote the verdict above
- Referee major revision: 2 major objections, 7 minor
Not run on this paper: the simulated authors' defence.
Pith did not check this review's objections against the paper.
The review in full
The review in brief, machine-written
ARP is worth a serious look. It decouples a slow VLM from a fast vision-action expert, and the genuinely new piece is end-to-end training of the fast expert on stale KV-cache memory plus explicit conditioning on staleness and execution delay. The strongest evidence is Tab. 4: training with no staleness collapses at low VLM refresh, while broad staleness sampling keeps success near 80% even at 0.5 Hz. That is a clean ablation, and it earns the paper its frequency-robustness claim. The citation pattern also looks fine; the relevant prior work on asynchronous VLAs and training-time latency compensation is cited.
The soft spots are real but not fatal. The dynamic-task result (ARP 44.7–51.5% vs π0 9.5–12.7%) varies two things at once: asynchrony and staleness-augmented training. The paper never runs a synchronous policy trained with the same staleness and delay conditioning—the recipe in Training-Time RTC and VLASH. The “Vision-Gated VLA” ablation drops the memory, so it does not fill that cell either. Until that control is run, the headline “asynchrony is what makes dynamic tasks work” is not isolated; the gains could be mostly training-time latency compensation, which is prior art. The method section is appropriately careful, but the introduction’s claim that ARP “breaks the reactivity-capability trade-off” goes further than the reported experiments support.
Two smaller issues. The abstract’s “18% higher success” in quasi-static setups does not match any ARP-vs-baseline comparison in Tab. 1; the largest gap is around 8%. And the replicated π0-1B baseline sits about 14 points below the published π0 result, so the capability side of the trade-off rests on a baseline the authors did not validate. These are fixable with a corrected abstract and baseline calibration. Also, no code or checkpoints are released, and the success numbers are single-point estimates without error bars; the real-robot evaluation is small.
Overall: the mechanism is plausible, the staleness ablation is honest and informative, and the dynamic gains are large enough to be worth independent replication. I would send it to review, asking for the missing synchronous-plus-augmentation control, variance reporting, baseline validation, and code before treating the reactivity claim as established. Revise, not reject.
The strongest objection
The headline reactivity evidence (Tab. 2-3: ARP-1B 51.5% vs π0-1B 9.5% on LIBERO-Perturb; 44.7% vs 12.7% on Dynamic Bump) is presented as proof that asynchronous decoupling breaks the reactivity-capability trade-off. But every one of these comparisons varies two factors at once: the asynchronous architecture (VLM moved off the action path) and training-time staleness/latency augmentation (Eq. 3, Sec. 3.4), which the π0-1B baseline does not receive. The paper establishes that staleness training is necessary - Tab. 4 shows the async interface alone (d_t ≡ 0) collapses at slow refresh - but it never runs the complementary cell: a synchronous policy trained with the same staleness distribution and delay conditioning, i.e., the recipe of the cited Training-Time RTC (Black et al., 2025) and VLASH (Tang et al., 2025). The 'Vision-Gated VLA' ablation in Sec. 4.5 does not fill this gap: it drops the semantic memory (removing the augmentation) rather than keeping augmentation while removing asynchrony. If a sync-plus-augmentation π0-1B matches ARP's 51.5%/44.7%, the dynamic gains are caused by training-time latency compensation, which is prior art, not by the decoupling the paper claims as the operative contribution; if it stays near 9.5%/12.7%, decoupling is confirmed. Secondary but relevant: the abstract's '18% higher success in quasi-static setups' (b7, b33) does not match any ARP-vs-baseline comparison in Tab. 1 (largest relative gain is roughly 8%), and the replicated π0 (80.2%) sits 14 pp below the published π0 (94.2%), so the capability half of the trade-off claim rests on an unvalidated baseline and an untraceable headline.
I take the central claim to be causal and architectural: removing the VLM from the perception-action loop (asynchronous decoupling) is what enables high-frequency reactive control, and this decoupling is what produces the 3-5x dynamic-task gains and the VLM-rate robustness. Three conditions must hold: (A) a fast expert conditioned on real-time vision plus a stale memory is competent; (B) scaling the VLM still buys capability; (C) the dynamic gains are causally due to decoupling rather than to a separable training component. (A) is supported: the Tab. 2-3 margins are large enough to survive sampling noise, and the task-identity-vs-position decomposition is coherent - the stale memory supplies instruction and object identity, which are stable across a perturbation, while real-time vision supplies the new pose. (B) is fragile: Tab. 1 shows only a few-pp gains from 1B to 8B concentrated on the Long suite, against a replicated π0 that is 14 pp below the published π0 (94.2% still beats every ARP variant), and the abstract's 18% headline (b7, b33) is not reproducible from any table; the capability half of the trade-off claim therefore rests on a weak, unvalidated baseline and an untraceable number. (C) is the least secure and is my primary concern: the dynamic comparisons confound decoupling with staleness training. Credit where due: Tab. 4 is a genuinely informative internal control and establishes necessity of staleness training (the d_t ≡ 0 row collapses at 0.5 Hz); the default-row result (81.8% at 0.5 Hz) is the paper's strongest evidence; the latency math is definitional since the VLM is off the fast path; and the authors honestly flag the open lower-frequency limit (b255) and the lexical-proxy caveat (b283), which are acknowledged scope limits rather than my objection. My objection is the missing 2x2 cell: sync architecture plus staleness augmentation, exactly the TRTC/VLASH recipe the authors cite as prior work. If that cell matches ARP's dynamic numbers, the decoupling story reduces to training-time latency compensation; if it does not, the central claim is confirmed. This is a runnable experiment the revision should include, alongside seed-level variance and the code release promised in the reproducibility statement. CONDITIONAL remains the right verdict; my read sharpens the conditions rather than changing the verdict.
The referee's report
ARP addresses a genuine deployment bottleneck: the latency of large VLMs inside the control loop. The design is clean, with the memory interface making the action-loop latency independent of backbone scale by construction (Sec. 3.1), and the paper has real strengths: a controlled LIBERO protocol, a careful staleness-distribution ablation with 500 episodes per cell (Tab. 4), deterministic seeding for bit-identical dynamic comparisons (App. C), two reusable dynamic benchmarks, DROID-scale training, and real-robot evaluation. The most solid finding is that the breadth of the training-time staleness band, rather than the cached-context interface alone, is what enables slow-refresh robustness (Tab. 4). The main weakness is attribution: the dynamic gains are presented as evidence for asynchronous decoupling, but no experiment isolates decoupling from training-time staleness augmentation, which the paper itself identifies as prior art. With one decisive control experiment and corrected headline numbers, the contribution is publishable.
Pith's reading of the paper (a machine's summary, not the authors')
Standard vision-language-action (VLA) robot policies run the large model and the action decoder sequentially inside the control loop, so every gain in semantic capability arrives with a latency penalty that degrades real-time reactivity. This paper proposes Asynchronous Robot Policies (ARP), which runs the VLM on its own slow clock and has it periodically write a compact semantic memory, while a lightweight vision-action expert generates motor commands at control frequency, conditioned on that memory, on fresh sensor input, and on how stale the memory is. The claim is that the perception-to-action latency then collapses to the expert's time alone, so reactivity stops growing with model size. On Franka manipulation tasks the paper reports an 18% success-rate gain with 20% shorter execution in quasi-static settings, 3-5 times baseline success under mid-episode perturbations, and stable performance when the VLM runs ten times slower than nominal. If true, this matters because generalist robot policies could scale their reasoning backbone without giving up physical agility or closed-loop robustness.
What carries the argument. The load-bearing object is the rate-decoupling semantic memory $M_\tau = \mathrm{LNLinear}(KV_\tau) + P + E_{\mathrm{stale}}(d_t)$: a learned linear projection of the VLM's layer-wise key-value cache, plus a positional embedding and a sine embedding of the memory's age, whose dimensions stay fixed no matter how large the VLM backbone grows. Because its width never depends on the backbone, this memory is the uniform interface that lets the fast Vision-Action Expert read high-level task context without ever invoking the VLM; the expert cross-attends to the memory in every Transformer layer, while per-token adaptive normalization conditions the flow-matching trajectory on both the noise timestep and the latency pair $(d_t, \ell_t)$ made of memory staleness and execution delay. The second essential mechanism is training-time staleness augmentation: sampling memory age from a mixture of a point mass at zero lag and a uniform band of stale horizons, which the paper's ablations show is required for the expert to act correctly on delayed semantics.
Core claim. The central claim is that a robot policy does not have to wait for its slow semantic model. ARP factors the policy into two asynchronous processes: a high-capacity VLM that periodically encodes the latest observation and instruction into a fixed-width memory matrix drawn from its key-value cache activations, and a Vision-Action Expert that, at every control step, cross-attends to the most recent memory while processing real-time images and proprioception. Because the fast loop's path contains no operation whose cost scales with the VLM backbone, the paper argues, the effective perception-to-action latency is reduced to the expert's inference time alone, independent of VLM parameter count. To make an outdated memory usable, the expert is trained on temporally mismatched observation-memory pairs, with staleness and execution delay supplied as explicit conditioning and with action-prefix conditioning for smooth replanning. Across LIBERO, LIBERO-Perturb, a dynamic-bump benchmark, and DROID-trained Franka evaluations, the paper reports that ARP outperforms $\pi_0$-style synchronous baselines in quasi-static success and execution time, by wide margins under perturbations, and stays accurate when the VLM is slowed tenfold.
The premise it rests on. The scheme stands or falls on whether the compressed memory written by the slow VLM preserves enough spatial and task semantics for the fast expert to act correctly for the whole interval until the next refresh; the dynamic benchmarks exercise that assumption over short horizons, but long episodes, repeated mid-interval changes, and very slow refresh rates, whose lower limit the paper leaves open, rest on it unverified.
If the paper is right (Pith's inferences, not the authors')
Because the fast loop's latency is the expert's time alone, backbone size can grow from 1B to 14B in these experiments, with rising LIBERO success, without lengthening the perception-to-action loop, so semantic capability and physical reactivity stop trading off against each other.
A single ARP policy keeps near-constant success while the VLM refresh frequency is cut from 5 Hz to 0.5 Hz, which implies the same robot can run its largest model at a tenth of the nominal inference frequency, saving deployment compute and energy.
Synchronous baselines collapse when the scene changes mid-episode, with 9.5% versus 51.5% success after a 5 cm target displacement and 12.7% versus 44.7% under physical bumps, so the paper identifies asynchronous execution, not better perception, as what restores closed-loop recovery.
Staleness-aware training is necessary for these gains: without it the policy falls to 2.0% success at a 0.5 Hz refresh, while a wide staleness band keeps 81.8-86.5%, and the same training also lifts fully synchronized performance.
Asynchronous action-prefix conditioning adds 5.6 percentage points of success, shortens episodes by 15.3%, and reduces jerk on DROID-trained evaluations, which the paper presents as what makes the architecture deployable on physical robots rather than only in simulation.
The two-clock pattern is a general design principle: any embodied agent pairing a slow semantic reasoner, such as an LLM, a world model, or a video predictor, with a fast controller could use a fixed-width memory interface to keep the reactive loop independent of the reasoner's cost; navigation, driving, and humanoid control are plausible targets beyond tabletop manipulation.
If the memory width stays fixed while the backbone scales, ARP's advantage should widen with scale because the marginal deployment cost of better semantics approaches zero; the paper's parameter-area plot points that way but does not measure the rate of improvement.
A testable explanation of the staleness-training bonus is that it pressures the VLM to write temporally invariant, anticipatory features; one could probe this by checking whether memory features taken from old frames predict future observations better than features from a synchronously trained VLM.
The open lower limit on refresh rate is probably set by the rate of goal-relevant scene change rather than by wall-clock time, which would argue for scheduling VLM refreshes from scene-change statistics instead of a fixed clock.
Check this review
Pith stored no record of this review's passes and took no fingerprint of it. Reviews made by code from 13 Nov 2026 on carry both.
How often reviews like this one are right
Reviews like this one: written by deepseek-v4-flash, where what was read was not recorded.
How often objections from reviews like this one are right: not yet measured
Reviews by people
This review was written by a machine. No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.
The paper
Abstract
Scaling vision-language foundation models has significantly advanced generalist robot manipulation, but the increased model scale introduces computational latency that degrades real-time physical reactivity. Existing Vision-Language-Action (VLA) architectures execute high-level semantic reasoning and action ex- ecution sequentially within the primary control loop, creating a fundamental tension between semantic-reasoning capability and robot agility. To address this, we propose Asynchronous Robot Policy (ARP), an architectural framework that decouples semantic reasoning from low-level action generation using asynchronous processes operating at independent frequencies. In ARP, a high-capacity Vision-Language Model (VLM) asynchronously updates a semantic memory at low fre- quency, while a lightweight Vision-Action Expert, conditioned on this semantic memory, generates robot actions at a much higher control frequency. Such a formulation, enables having a fast perception-action loop without compromising on the semantic capability. To overcome asynchronous memory staleness, ARP trains the vision-action expert on the semantic staleness and execution delay, with temporally mismatched observation across processes. On Franka manipulation tasks, ARP achieves an 18% higher success rate and 20% less time need for execution in quasi-static setups, while 3-5 times baseline performance in dynamic simulation environments. Furthermore, ARP enables operating the VLM at 10 times lower than its nominal frequency with no significant performance loss making it much more efficient than the baseline. These results highlight the architectural advantages of modeling robot policies as asynchronous processes, enabling real-world reactive deployment without sacrificing the scale of foundation models.
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.
abstract compiled · 2026-11-04
The authors' main claim, as the classifier picked it out 1.00
“These results highlight the architectural advantages of modeling robot policies as asynchronous processes, enabling real-world reactive deployment without sacrificing the scale of foundation models.”
How the main claim is stated: asserted 0.98
What the abstract itself states, as probabilities: claims first 0.07 · states limitation 0.26 · human participants 0.03 · controlled comparison 0.94 · randomized assignment 0.01 · states quantitative result 0.99 · compares with prior results 0.96 · mentions code or data availability 0.03
The abstract, sentence by sentence
This table labels the abstract only (arXiv listing abstract v1). The number is the probability the classifier gave the label.
| Sentence | Role | The authors' own work | States the main conclusion | Strength |
|---|---|---|---|---|
| Scaling vision-language foundation models has significantly advanced generalist robot manipulation, but the increased model scale introduces computational latency that degrades real-time physical reactivity. | background 0.99 | 0.07 | 0.03 | asserted 1.00 |
| Existing Vision-Language-Action (VLA) architectures execute high-level semantic reasoning and action ex- ecution sequentially within the primary control loop, creating a fundamental tension between semantic-reasoning capability and robot agility. | background 0.82 | 0.05 | 0.03 | asserted 1.00 |
| To address this, we propose Asynchronous Robot Policy (ARP), an architectural framework that decouples semantic reasoning from low-level action generation using asynchronous processes operating at independent frequencies. | contribution 0.91 | 0.68 | 0.11 | asserted 0.97 |
| In ARP, a high-capacity Vision-Language Model (VLM) asynchronously updates a semantic memory at low fre- quency, while a lightweight Vision-Action Expert, conditioned on this semantic memory, generates robot actions at a much higher control frequency. | method 0.96 | 0.63 | 0.08 | asserted 1.00 |
| Such a formulation, enables having a fast perception-action loop without compromising on the semantic capability. | interpretation 0.70 | 0.27 | 0.24 | asserted 0.74 |
| To overcome asynchronous memory staleness, ARP trains the vision-action expert on the semantic staleness and execution delay, with temporally mismatched observation across processes. | method 0.96 | 0.90 | 0.04 | asserted 1.00 |
| On Franka manipulation tasks, ARP achieves an 18% higher success rate and 20% less time need for execution in quasi-static setups, while 3-5 times baseline performance in dynamic simulation environments. | result 1.00 | 0.95 | 0.19 | asserted 1.00 |
| Furthermore, ARP enables operating the VLM at 10 times lower than its nominal frequency with no significant performance loss making it much more efficient than the baseline. | result 0.98 | 0.93 | 0.14 | asserted 1.00 |
| These results highlight the architectural advantages of modeling robot policies as asynchronous processes, enabling real-world reactive deployment without sacrificing the scale of foundation models. | interpretation 1.00 | 0.58 | 0.87 | asserted 0.98 |
What kind of paper the classifier reports this is: method or tool 1.00 · evidence from observation or experiment 0.88
What was examined, and what was not
Sources read
- arXiv listing abstract v1
Not examined
- full text
- figures and tables
- references and citing sentences
- relations to other papers
Levels run
- P abstract
Not run
- S sections
- T body sentences
- C citations
- R cross-paper relations
How the labels were made
Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-11-04: 1 request, 7,077 input tokens.
Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON
Figures (7)
Figures are the authors', reproduced from the paper.
References (197)
- [1] McGeer, Tad , title =. 1990 , doi =. http://ijr.sagepub.com/content/9/2/62.full.pdf+html , journal = on Pith
- [2] A new approach to linear filtering and prediction problems , author=. Journal of Basic Engineering , volume=. 1960 , publisher= on Pith
- [3] OpenVLA: An Open-Source Vision-Language-Action Model , author=. arXiv preprint arXiv:2406.09246 , year= on PithPith's reviewarXiv
- [4] DINOv2: Learning Robust Visual Features without Supervision , author=. 2024 , journal= on Pith
- [5] Sim-to-real transfer in deep reinforcement learning for robotics: a survey , author=. 2020 IEEE symposium series on computational intelligence (SSCI) , pages=. 2020 , organization= on Pith
- [6] Prismatic vlms: Investigating the design space of visually-conditioned language models , author=. arXiv preprint arXiv:2402.07865 , year= on PithPith's reviewarXiv
- [7] LLaMA: Open and Efficient Foundation Language Models , author= on Pith
- [8] Visual instruction tuning , author=. Advances in neural information processing systems , volume= on Pith
- [9] Evaluating Real-World Robot Manipulation Policies in Simulation , author=. arXiv preprint arXiv:2405.05941 , year= on PithPith's reviewarXiv
- [10] Maniskill: Generalizable manipulation skill benchmark with large-scale demonstrations , author=. arXiv preprint arXiv:2107.14483 , year= on PithPith's reviewarXiv
- [11] Git Re-Basin: Merging Models modulo Permutation Symmetries , author=. 2023 , journal= on Pith
- [12] Mitigating Catastrophic Forgetting in Language Transfer via Model Merging , author=. arXiv preprint arXiv:2407.08699 , year= on PithPith's reviewarXiv
- [13] Ensemble of averages: Improving model selection and boosting performance in domain generalization , author=. Advances in Neural Information Processing Systems , volume= on Pith
- [14] An empirical study of multimodal model merging , author=. arXiv preprint arXiv:2304.14933 , year= on PithPith's reviewarXiv
- [15] Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time , author=. International conference on machine learning , pages=. 2022 , organization= on Pith
- [16] M. S. Yee and L. Hanzo. Radial Basis Function Decision Feedback Equaliser Assisted Burst-by-burst Adaptive Modulation. Proc. IEEE Globecom '99. 1999 on Pith
- [17] Habitat 2.0: Training Home Assistants to Rearrange their Habitat , author =. Advances in Neural Information Processing Systems (NeurIPS) , year = on Pith
- [18] Xiang, Fanbo and Qin, Yuzhe and Mo, Kaichun and Xia, Yikuan and Zhu, Hao and Liu, Fangchen and Liu, Minghua and Jiang, Hanxiao and Yuan, Yifu and Wang, He and Yi, Li and Chang, Angel X. and Guibas, Leonidas J. and Su, Hao , title =. The IEEE Conference on Computer Vision and P... on Pith
- [19] Isaac gym: High performance gpu-based physics simulation for robot learning , author=. arXiv preprint arXiv:2108.10470 , year= on PithPith's reviewarXiv
- [20] Mohit Shridhar and Jesse Thomason and Daniel Gordon and Yonatan Bisk and Winson Han and Roozbeh Mottaghi and Luke Zettlemoyer and Dieter Fox , booktitle = on Pith
show 80 more
- [21] Graspnet-1billion: A large-scale benchmark for general object grasping , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages= on Pith
- [22] MotionBenchMaker: A tool to generate and benchmark motion planning datasets , author=. IEEE Robotics and Automation Letters , volume=. 2021 , publisher= on Pith
- [23] Open x-embodiment: Robotic learning datasets and rt-x models , author=. arXiv preprint arXiv:2310.08864 , year= on PithPith's reviewarXiv
- [24] RT-1: Robotics Transformer for Real-World Control at Scale , author=. arXiv preprint arXiv:2212.06817 , year= on PithPith's reviewarXiv
- [25] Octo: An Open-Source Generalist Robot Policy , author =. Proceedings of Robotics: Science and Systems , address = on Pith
- [26] Learning transferable visual models from natural language supervision , author=. International conference on machine learning , pages=. 2021 , organization= on Pith
- [27] Improved baselines with visual instruction tuning , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages= on Pith
- [28] RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robots , author=. Robotics: Science and Systems (RSS) , year= on Pith
- [29] Lucas Beyer and Andreas Steiner and André Susano Pinto and Alexander Kolesnikov and Xiao Wang and Daniel Salz and Maxim Neumann and Ibrahim Alabdulmohsin and Michael Tschannen and Emanuele Bugliarello and Thomas Unterthiner and Daniel Keysers and Skanda Koppula and Fangyu Liu ... on Pith
- [30] BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation , author=. 2022 , booktitle= on Pith
- [31] Vision Transformer with Quadrangle Attention , author=. arXiv preprint arXiv:2303.15105 , year= on PithPith's reviewarXiv
- [32] Flamingo: a Visual Language Model for Few-Shot Learning , author=. arXiv preprint arXiv:2204.14198 , year= on PithPith's reviewarXiv
- [33] Li, Junnan and Li, Dongxu and Savarese, Silvio and Hoi, Steven , title =. 2023 , booktitle = on Pith
- [34] Ren, Zhongwei and Huang, Zhicheng and Wei, Yunchao and Zhao, Yao and Fu, Dongmei and Feng, Jiashi and Jin, Xiaojie , title =. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , month =. 2024 , pages = on Pith
- [35] PaLI-X: On Scaling up a Multilingual Vision and Language Model , author=. arXiv preprint arXiv:2305.18565 , year= on PithPith's reviewarXiv
- [36] PaLM-E: An Embodied Multimodal Language Model , author=. arXiv preprint arXiv:2303.03378 , year= on PithPith's reviewarXiv
- [37] RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control , author =. Proceedings of The 7th Conference on Robot Learning , pages =. 2023 , editor = on Pith
- [38] Muratore, Fabio and Ramos, Fabio and Turk, Greg and Yu, Wenhao and Gienger, Michael and Peters, Jan , TITLE=. Frontiers in Robotics and AI , VOLUME= on Pith
- [39] Calli, Berk and Walsman, Aaron and Singh, Arjun and Srinivasa, Siddhartha and Abbeel, Pieter and Dollar, Aaron M. , journal=. Benchmarking in Manipulation Research: Using the Yale-CMU-Berkeley Object and Model Set , year= on Pith
- [40] Model merging in llms, mllms, and beyond: Methods, theories, applications and opportunities , author=. arXiv preprint arXiv:2408.07666 , year= on PithPith's reviewarXiv
- [41] Zhao, Wenshuai and Queralta, Jorge Peña and Westerlund, Tomi , booktitle=. Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Survey , year= on Pith
- [42] Chebotar, Yevgen and Handa, Ankur and Makoviychuk, Viktor and Macklin, Miles and Issac, Jan and Ratliff, Nathan and Fox, Dieter , booktitle=. Closing the Sim-to-Real Loop: Adapting Simulation Randomization with Real World Experience , year= on Pith
- [43] PaLI: A Jointly-Scaled Multilingual Language-Image Model ,author =. arXiv preprint arXiv:2209.06794 , year = on PithPith's reviewarXiv
- [44] Ren\'. Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfer , journal = on Pith
- [45] Sigmoid loss for language image pre-training , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages= on Pith
- [46] Llama 2: Open foundation and fine-tuned chat models , author=. arXiv preprint arXiv:2307.09288 , year= on PithPith's reviewarXiv
- [47] CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation , author=. arXiv preprint arXiv:2411.19650 , year= on PithPith's reviewarXiv
- [48] Gemma: Open models based on gemini research and technology , author=. arXiv preprint arXiv:2403.08295 , year= on PithPith's reviewarXiv
- [49] Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context , author=. arXiv preprint arXiv:2403.05530 , year= on PithPith's reviewarXiv
- [50] Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities , author=. arXiv preprint arXiv:2507.06261 , year= on PithPith's reviewarXiv
- [51] Depth Anything V2 , author=. The Thirty-eighth Annual Conference on Neural Information Processing Systems , year= on Pith
- [52] An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , author=. International Conference on Learning Representations , year= on Pith
- [53] Liu, Haotian and Li, Chunyuan and Wu, Qingyang and Lee, Yong Jae , booktitle =. Visual Instruction Tuning , url = on Pith
- [54] Andreas Ren. Learning with 3D rotations, a hitchhiker's guide to. Forty-first International Conference on Machine Learning , year= on Pith
- [55] Interactive language: Talking to robots in real time , author=. IEEE Robotics and Automation Letters , year= on Pith
- [56] Scalable diffusion models with transformers , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages= on Pith
- [57] The Ingredients for Robotic Diffusion Transformers , author=. arXiv preprint arXiv:2410.10088 , year= on PithPith's reviewarXiv
- [58] Nerf: Representing scenes as neural radiance fields for view synthesis , author=. Communications of the ACM , volume=. 2021 , publisher= on Pith
- [59] Roformer: Enhanced transformer with rotary position embedding , author=. Neurocomputing , volume=. 2024 , publisher= on Pith
- [60] Robotic Control via Embodied Chain-of-Thought Reasoning , author=. 8th Annual Conference on Robot Learning , year= on Pith
- [61] Spatialbot: Precise spatial understanding with vision language models , author=. arXiv preprint arXiv:2406.13642 , year= on PithPith's reviewarXiv
- [62] Revla: Reverting visual domain limitation of robotic foundation models , author=. arXiv preprint arXiv:2409.15250 , year= on PithPith's reviewarXiv
- [63] BridgeData V2: A Dataset for Robot Learning at Scale , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [64] Xuning Yang and Rishit Dagli and Alex Zook and Hugo Hadfield and Ankit Goyal and Stan Birchfield and Fabio Ramos and Jonathan Tremblay , title =. Proceedings of Robotics: Science and Systems , year = on Pith
- [65] Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasets , author=. Proceedings of Robotics: Science and Systems (RSS) , year = on Pith
- [66] DROID: A large-scale in-the-wild robot manipulation dataset , author=. Robotics: Science and Systems , year= on Pith
- [67] BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learning , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [68] Scalable deep reinforcement learning for vision-based robotic manipulation , author=. Conference on robot learning , pages=. 2018 , organization= on Pith
- [69] HYDRA: Hybrid Robot Actions for Imitation Learning , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [70] Interactive Language: Talking to Robots in Real Time , author=. IEEE Robotics and Automation Letters , year= on Pith
- [71] Latent Plans for Task-Agnostic Offline Reinforcement Learning , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [72] Grounding Language with Visual Affordances over Unstructured Data , author=. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) , year= on Pith
- [73] FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulation , author=. Proceedings of Robotics: Science and Systems (RSS) , year = on Pith
- [74] RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitation , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [75] MUTEX: Learning Unified Policies from Multimodal Task Specifications , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [76] Learning and Retrieval from Prior Data for Skill-based Imitation Learning , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [77] Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deployment , author=. Proceedings of Robotics: Science and Systems (RSS) , year = on Pith
- [78] On Bringing Robots Home , author=. arXiv preprint arXiv:2311.16098 , year= on PithPith's reviewarXiv
- [79] FMB: a Functional Manipulation Benchmark for Generalizable Robotic Learning , author=. The International Journal of Robotics Research , year= on Pith
- [80] Lawrence Yunliang Chen and Simeon Adebola and Ken Goldberg , howpublished =. Berkeley on Pith
- [81] Train Offline, Test Online: A Real Robot Learning Benchmark , author=. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) , year= on Pith
- [82] VIOLA: Imitation Learning for Vision-Based Manipulation with Object Proposal Priors , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [83] Multi-Resolution Sensing for Real-Time Control with Vision-Language Models , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [84] From Play to Policy: Conditional Behavior Generation from Uncurated Robot Data , author=. Proceedings of International Conference on Learning Representations (ICLR) , year= on Pith
- [85] Dass, Shivin and Yapeter, Jullian and Zhang, Jesse and Zhang, Jiahui and Pertsch, Karl and Nikolaidis, Stefanos and Lim, Joseph J. , title = on Pith
- [86] Multi-Stage Cable Routing through Hierarchical Imitation Learning , author=. IEEE Transactions on Robotics , volume= on Pith
- [87] Bottom-Up Skill Discovery from Unsegmented Demonstrations for Long-Horizon Robot Manipulation , author=. IEEE Robotics and Automation Letters , volume= on Pith
- [88] Fanuc Manipulation: A Dataset for Learning-based Manipulation with FANUC Mate 200iD Robot , author= on Pith
- [89] Structured World Models from Human Videos , author=. Proceedings of the Conference on Robot Learning (CoRL) , year= on Pith
- [90] Shared Control Templates for Assistive Robotics , author=. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) , year= on Pith
- [91] ucsd kitchens Dataset , author= on Pith
- [92] Moge: Unlocking accurate monocular geometry estimation for open-domain images with optimal training supervision , author=. arXiv preprint arXiv:2410.19115 , year= on PithPith's reviewarXiv
- [93] SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Model , author=. arXiv preprint arXiv:2501.15830 , year= on PithPith's reviewarXiv
- [94] Sam 2: Segment anything in images and videos , author=. arXiv preprint arXiv:2408.00714 , year= on PithPith's reviewarXiv
- [95] Grounded SAM: Assembling Open-World Models for Diverse Visual Tasks , author=. 2024 , eprint= on Pith
- [96] Ego-exo4d: Understanding skilled human activity from first-and third-person perspectives , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages= on Pith
- [97] Flow Matching for Generative Modeling , author=. The Eleventh International Conference on Learning Representations , year= on Pith
- [98] Rectified flow: A marginal preserving approach to optimal transport , author=. arXiv preprint arXiv:2209.14577 , year= on PithPith's reviewarXiv
- [99] Flow matching guide and code , author=. arXiv preprint arXiv:2412.06264 , year= on PithPith's reviewarXiv
- [100] A careful examination of large behavior models for multitask dexterous manipulation , author=. arXiv preprint arXiv:2507.05331 , year= on PithPith's reviewarXiv
The first 100 of 197 references are listed here. All of them are in this paper's citation record.
Challenges and discussion
Disagree with the review, or know something it missed? Leave a comment, or challenge this review formally: a challenge becomes a permanent entry in this paper's record, and its decision is published here.
Come back by email
A short list of the week's newly reviewed papers. Nothing is sent until you confirm from your inbox, and every email has a link that stops it. No account.
No comments yet.
Sign in to comment