Robotics · arXiv:2611.08373 v1 · submitted 5 Nov 2026 · 59 references
SLA: Scaling Spatial-Language-Action Model via Continual Pre-training
The paper says
“Reliable robotic manipulation requires both semantic understanding and precise control in three-dimensional space. However, vision-language-action (VLA) foundations largely inherit visual representations from 2D vision-language pre-training, while spatial supervision is often introduced only during task-specific adaptation.”
more of the abstract
Developing spatial understanding as a transferable foundation-model capability therefore calls for learning from broader robot experience. We present SLA, a Spatial-Language-Action Model that scales implicit spatial alignment to continual pre-training and maintains it during downstream post-training. Initialized from a pretrained pi05 policy, SLA jointly optimizes action prediction and alignment between intermediate visual embeddings and spatial representations from a frozen 3D perception model. We curate and unify heterogeneous robot datasets to support spatial learning across diverse embodiments, tasks, and scenes. To accommodate this diversity, we introduce feature-dependent gates that adaptively aggregate visual embeddings from multiple VLA layers for spatial supervision. The teacher further exploits partially available depth and camera calibration alongside RGB observations, enabling effective use of heterogeneous geometric annotations. Probabilistic state dropout encourages reliance on visual cues and mitigates overfitting to demonstration trajectories. All auxiliary components are used only during training, allowing direct reuse of pretrained VLA weights and preserving the original inference architecture.
from the abstract
Pith says
Machine review · deepseek-v4-flash · 6 Nov 2026 · what was read was not recorded · not checked by a person
It can be wrong. Challenge this review or reply to it.
Holds up, with conditions. A solid two-stage recipe for adding spatial supervision to pi0.5-class VLAs, with good ablations, but the spatial mechanism is not fully isolated and the RoboDojo-Real result carries a memory confound. This line is wrong
3 major objections · 5 minor
How often objections from reviews like this one are right: not yet measured
Not checked: figures, code, what the 59 references say.
The paper says, at Section 3.2.1–3.2.2, Eqs. (3)–(5)
The review did not quote this passage.
Pith says: Objection 1 of 3 · major
The causal attribution of the gains to spatially meaningful supervision is not established, because no control replaces the OmniVGGT target with a non-geometric or spatially meaningless target. Table 10 shows that some target improves over no alignment (31.8% to 42.8% average) and that calibration adds about 3.2 points, but every variant still uses geometric features; a frozen non-geometric image-encoder target …
more of objection 1
… or shuffled OmniVGGT features under the same pipeline would test whether the loss acts as a generic regularizer rather than as spatial supervision. The positional term E in Eq. (3) is part of the same concern: E is never defined or measured, and if it dominates f3D(I)+E, the model may align to token position codes rather than to geometric content. Please add these negative controls, report the relative norm of E, and provide a quantitative probing metric for the teacher features; the qualitative depth display in Figure 2 probes VLA embeddings after alignment and therefore does not validate the teacher target itself.
The paper says, at Section 4.3.4, Table 5, Appendix B
The review did not quote this passage.
Pith says: Objection 2 of 3 · major
The RoboDojo-Real result is confounded by the memory mechanism introduced in Appendix B. SLA is post-trained with nine historical main-camera frames (Eq. (11)) and keeps these inputs at inference, whereas the compared policies in Table 5 do not use this mechanism.
more of objection 2
RoboDojo-Sim results in Table 15 show that memory support is itself a major factor on this benchmark (SimpleMemVLA Memory SR 33.2% vs π0.5 at 7.0%), so the 21.1-point success-rate gain over π0.5 cannot be attributed to spatial alignment. A control with π0.5, or with SLA without alignment, given the same memory inputs is necessary. Without it, the RoboDojo-Real claim is not isolated, and the abstract's statement that auxiliary components are used only during training is qualified by the fact that memory frames are required at deployment for this benchmark.
The paper says, at Section 4.4.1, Tables 2, 4, 6, and 11
The review did not quote this passage.
Pith says: Objection 3 of 3 · major
Most headline comparisons are single-seed point estimates with no variance or confidence intervals, and several decisive margins are small. LIBERO-Plus (Table 2) separates SLA from Qwen-RobotManip by 0.3 points; RoboCasa-Panda (Table 4) separates SLA from Cosmos Policy by 1.3 points; and real-world condition E (Table 11) separates SLA from Spatial Forcing by two object instances out of 50.
more of objection 3
In Table 6, the no-alignment curve moves from 46.5% at 25% data to 46.1% at 50% data, a difference likely within noise. Reporting multiple seeds, or at least binomial confidence intervals for the 50-instance real-world evaluations, would materially strengthen the ranking claims and the data-scaling argument.
5 minor objections
The paper says, at Throughout
Pith says: minor objection 1 of 5
The manuscript contains numerous grammatical and typographical slips, including 'enbow', 'concentrate on post-training', 'stengthen', 'methods has the powerful static-to-dynamic fitness', and 'successs rates'; a thorough proofread is needed.
The paper says, at Eq. (3)
Pith says: minor objection 2 of 5
The positional embedding E is used in Eq. (3) but never defined; please specify its construction (sinusoidal, learned, or otherwise), its dimension, and whether it is added before or after bilinear resampling.
show 3 more
The paper says, at Section 3.3.2 and Table 9
Pith says: minor objection 3 of 5
The motivation for rotation vectors appeals to wrap-induced outliers from direct Euler-angle subtraction, but Table 9 only compares representations that all use SO(3) composition; a direct-subtraction Euler baseline would directly test the stated motivation.
The paper says, at References
Pith says: minor objection 4 of 5
The reference list contains duplicate entries for RoboTwin 2.0 (Chen et al., 2025a and 2025b) and for Qwen-RobotManip (Yuan et al., 2026a and 2026b), and some leaderboard values are cited to arXiv preprints without page or version identifiers; the authors should consolidate and verify these entries.
The paper says, at Figure 2
Pith says: minor objection 5 of 5
The depth-probing figure is qualitative; since it is used to motivate the entire alignment approach, reporting a quantitative readout such as relative or absolute depth error would make the motivation more convincing.
What would settle it
Using the Table 10 protocol (same continually pre-trained checkpoint, RoboTwin post-training), retrain with three alternative targets in place of OmniVGGT: (i) OmniVGGT features with tokens spatially shuffled within each image, destroying geometric correspondence while preserving feature statistics; (ii) frozen SigLIP or DINOv2 features at matched token resolution; (iii) the same OmniVGGT target with the positional embedding term E removed from Equation (3). If Clean2Random success for (i) or (iii) approaches the 37.3-46.0% range reported for OmniVGGT, the spatial correspondence of the target is not the active ingredient. In addition, report quantitative depth-probing metrics (for example AbsRel and delta1 from a DPT probe) of OmniVGGT final-layer features at VLA token locations to validate that the resampled target itself carries usable geometry.
from the skeptic's reading
How the review went
4 readings by deepseek-v4-flash · 6 Nov 2026
- Reader holds up, with conditions
- Skeptic agrees
- Editor wrote the verdict above
- Referee major revision: 3 major objections, 5 minor
Not run on this paper: the simulated authors' defence.
Pith did not check this review's objections against the paper.
The review in full
The review in brief, machine-written
Take: this is a real engineering contribution. It takes the alignment loss from the authors' prior Spatial Forcing paper and scales it into continual pre-training on a 1.7M-episode corpus, adds adaptive layer gating and probabilistic state dropout, and keeps alignment during post-training. The two-stage recipe performs well on public benchmarks, and the private real-world gains are large. The central claim, that alignment during both stages beats either stage alone, is supported by the data-scaling ablation in Table 6: at every tested data proportion the both-stages configuration wins, and it gains 23.1 points from 5% to 100% data while no-alignment gains only 4.4. Tables 7 and 8 give clean evidence for adaptive layers and 25% state dropout. Credit is also due for excluding downstream benchmark data from the pre-training corpus, reporting per-task breakdowns, and comparing against their own post-training-only method. The related-work coverage is current, and the dependence on their own Spatial Forcing is transparent.
Soft spots, in proportion. First, the active ingredient is not isolated. Table 10 shows that some teacher target helps over no alignment and calibration adds about 3 points, but there is no control with a non-geometric surrogate, such as random features, a shuffled target, or a frozen 2D encoder. Without that, the gain could come from the loss acting as a generic auxiliary regularizer rather than from spatial content. The depth probing in Figure 2 is qualitative and probes VLA embeddings, not the teacher targets, so it does not close that gap. This does not sink the recipe, but it leaves the spatial explanation underdetermined.
Second, the RoboDojo-Real numbers include a memory mechanism described in Section B, and there is no ablation separating memory from alignment. Since Table 15 shows memory alone contributes heavily on RoboDojo-Sim, the 33.9% versus 12.8% cannot be attributed to SLA training. The authors should state this more carefully.
Third, no error bars anywhere. In the real-world table, 94 versus 84 is four or five object instances out of 50; without variance those margins are fragile. Fourth, several hyperparameters, including alignment weight, dropout rate, and per-source retention rates, are tuned on the same benchmark families used for headline numbers. That is common in this area, but it limits the strength of the claims. Fifth, the code link is a placeholder; for a recipe built on public datasets, shipping the data-processing and alignment pipeline is part of the contribution.
On the stress-test concern: the non-geometric control is legitimate and cheap, and I would ask for it. The positional-embedding worry is minor; if E dominated, the target would carry almost no image dependence and the calibration effect in Table 10 would be hard to explain.
Who this is for: groups fine-tuning pi0.5-class VLAs who want a concrete, working recipe for robustness and data efficiency. It deserves a serious referee; the main asks are the control experiment, an isolated RoboDojo ablation, and error bars.
The strongest objection
The central claim depends on Equations (3)-(5): final-layer OmniVGGT features, augmented with positional embeddings and bilinearly resampled to VLA token resolution, are treated as spatial supervision targets, and cosine alignment is assumed to inject transferable geometry into the policy. Section 3.2.2 asserts that OmniVGGT backbone features are 'sufficiently rich' by architectural argument, but the depth probing in Figure 2 is performed on VLA embeddings, not on the teacher targets, and no quantitative probing metric is reported. Table 10 does show that some teacher target improves over no alignment and that calibration adds roughly 3 points, which is partial evidence for spatial content; however, no experiment compares against a spatially meaningless target. If a shuffled OmniVGGT target or a frozen non-geometric image-encoder target produces comparable Clean2Random gains, the alignment loss would be acting as a generic regularizer rather than as spatial supervision, and the paper's causal explanation for the continual-pre-training gains would not be supported. A related hidden variable is the unquantified magnitude of the positional embedding term E in Equation (3): if E dominates the cosine target, the model may align to token position codes rather than to geometric content. This is the least secure link in the chain from the proposed loss to the reported benchmark gains.
The reader's weakest assumption correctly identifies the least secure step: the paper assumes, rather than demonstrates, that OmniVGGT final-layer features resampled to token resolution provide a valid spatial supervision signal, and that cosine similarity to those features is what drives the reported gains. The internal ablations in Table 6 show that two-stage alignment beats either single-stage alternative, and Table 10 shows that some teacher target beats no alignment and that calibration helps; these results make the proposed mechanism plausible. What is missing is a control that isolates spatial content from generic feature-matching. The reader's other concerns, including missing code and absent error bars, are legitimate but secondary relative to this mechanism-level gap. I would keep the CONDITIONAL verdict: the central claim is coherent and well supported in parts, but it should not be taken as established until the spatial specificity of the teacher target is tested directly. No adjustment to the reader's verdict is needed.
The referee's report
If the reported results hold, SLA provides a scalable way to inject spatial supervision into a VLA foundation model without changing its deployment architecture or requiring depth or calibration at inference. The paper has several genuine strengths: downstream benchmark data are explicitly excluded from the pre-training corpus; the data-scaling experiment in Table 6 varies data proportion and compares both single-stage and two-stage alignment; Table 7 compares adaptive layer fusion against fixed layers; Table 8 studies state dropout; and Table 10 separates the teacher contribution from the calibration contribution. The central comparisons are external-benchmark or no-alignment comparisons rather than circular fits to the alignment target. However, the causal claim that the gains are due to spatial content, rather than to generic feature regularization, is not yet isolated, and the RoboDojo-Real comparison is confounded by the memory mechanism introduced in Appendix B. Both issues are fixable with additional experiments, which is why I recommend major revision rather than rejection.
Pith's reading of the paper (a machine's summary, not the authors')
This paper argues that a vision-language-action (VLA) robot policy can learn genuinely three-dimensional spatial competence without changing its architecture, sensors, or deployment inputs, addressing the gap left by VLA foundations whose visual representations come from 2D image-text pre-training. The recipe is to keep training the policy on a large, heterogeneous corpus of robot demonstrations while simultaneously pushing its intermediate visual representations toward the features of a frozen 3D perception model, and to keep doing that alignment during downstream task adaptation. On the pretrained pi0.5 policy, SLA reports gains on every tested benchmark, including 87.4% on LIBERO-Plus and 79.2% average on RoboTwin 2.0, and lifts the average success rate over eight real-world conditions from 59.8% to 83.8%. The claim that matters most is that spatial alignment in both training stages beats either stage alone at every tested data scale, so spatial understanding behaves like a capability that can be built once and carried across tasks and embodiments.
What carries the argument. The active ingredient is the alignment objective $$L_{\text{align}} = \frac{1}{N}\sum_{i=1}^{N}\left[1 - S(z_i, y_i)\right],$$ where $z_i$ is a gated, layer-aggregated projection of the VLA's visual tokens ($z = \sum_{\ell=1}^{L} g^{(\ell)} \odot \mathrm{MLP}(\mathrm{LN}(x_V^{(\ell)}))$) and $y_i$ is the frozen teacher's feature at the same image location ($y = R(f_{\mathrm{3D}}(I) + E)$, with bilinear resampling $R$ to VLA token resolution). Cosine similarity here does the work of pulling geometric structure into the exact representations the action head conditions on, so action tokens generated autoregressively inherit 3D cues without ever seeing depth during inference. Supporting machinery includes OmniVGGT's GeoAdapter, which folds whatever depth and calibration annotations exist into the teacher's features; token- and channel-wise sigmoid gates that let heterogeneous data draw spatial supervision from different VLA layers; probabilistic state dropout; and the unified action space that expresses end-effector deltas as rotation vectors via SO(3) composition ($\Delta r_t = \mathrm{Log}(R_t R_0^{\top})^{\vee}$) so that angular wrapping does not corrupt training targets.
Core claim. SLA's central claim is that implicit spatial alignment is not merely a post-training trick but a scalable pre-training objective. Starting from the pretrained pi0.5 policy, SLA jointly optimizes action prediction and a cosine-similarity alignment loss between the VLA's intermediate visual embeddings and the final-layer spatial features of the frozen OmniVGGT teacher, bilinearly resampled to VLA token resolution; the teacher may consume partially available depth and camera calibration, and feature-dependent gates adaptively blend multiple VLA layers per token and channel. A probabilistic state dropout omits state tokens during training to force reliance on visual evidence, and the whole pipeline runs both during continual pre-training on roughly 1.7 million episodes from six datasets and again during post-training. The authors report that this two-stage recipe outperforms either single-stage alternative at every data proportion tested (Clean2Random success rising from 49.2% to 72.3% as pre-training data grows), matches or beats published baselines on LIBERO-Plus, RoboTwin 2.0, RoboCasa-Panda with only 50 demonstrations per task, and RoboDojo-Real, and raises real-world object-level success by an average of 24.0 percentage points over pi0.5 across eight deployment conditions. All auxiliary components are discarded at deployment, so the policy that runs is the original pi0.5 architecture with no added latency or sensor requirements.
The premise it rests on. The load-bearing premise is that the frozen OmniVGGT teacher's final-layer features, bilinearly resampled to the VLA's token grid, really do carry the spatial geometry a controller needs, and that cosine similarity at those token locations transfers that geometry into the policy; the paper asserts the features are sufficiently rich but gives no quantitative check of the teacher's own spatial quality beyond a depth-probing figure without reported metrics.
If the paper is right (Pith's inferences, not the authors')
If the two-stage recipe holds up, spatial competence becomes a reusable foundation-model property: downstream users can keep the alignment objective during adaptation rather than re-learning geometry per task.
Because the teacher, projector, and gates vanish at deployment, any existing pi0.5-style pipeline can adopt the recipe with no change to inference latency, memory, or sensors.
The data-scaling curves imply that larger, more diverse pre-training corpora will keep converting into downstream robustness, and that spatial alignment is what makes the extra data count.
The few-shot cross-embodiment result (78% success with only 10 Franka demonstrations) points to spatial pre-training lowering the data barrier for deploying on new robot hardware.
Gains concentrated in perturbed and randomized settings suggest the alignment teaches policies to lean on scene geometry rather than memorized trajectories, which is the failure mode state dropout targets.
A stress test the paper does not run: swap the OmniVGGT teacher for a different frozen geometric feature extractor, or for spatially shuffled fixed targets, under identical training; if gains persist, the active ingredient is generic feature alignment rather than OmniVGGT's specific spatial latent.
The RoboDojo-Real results entangle spatial alignment with a memory mechanism introduced during post-training; isolating the two on long-horizon tasks would sharpen the attribution of the 21.1-point success-rate gain over pi0.5.
If spatial knowledge really lives in the aligned representations, compression experiments (pruning, quantization, or token reduction of the VLA) could reveal whether spatial competence survives more or less gracefully than action competence, a testable proxy for how deeply the geometry was internalized.
The two-stage superiority at every data scale suggests a possible scaling law for spatial pre-training: the marginal value of alignment appears largest where data is scarcest, so spatial supervision may be the lever that makes small downstream budgets viable across new embodiments.
Check this review
Pith stored no record of this review's passes and took no fingerprint of it. Reviews made by code from 13 Nov 2026 on carry both.
How often reviews like this one are right
Reviews like this one: written by deepseek-v4-flash, where what was read was not recorded.
How often objections from reviews like this one are right: not yet measured
Reviews by people
This review was written by a machine. No person has reviewed this paper on Pith yet. A scientist listed on Pith can review it for a fee, and their review is published here whatever it concludes.
The paper
Abstract
Reliable robotic manipulation requires both semantic understanding and precise control in three-dimensional space. However, vision-language-action (VLA) foundations largely inherit visual representations from 2D vision-language pre-training, while spatial supervision is often introduced only during task-specific adaptation. Developing spatial understanding as a transferable foundation-model capability therefore calls for learning from broader robot experience. We present SLA, a Spatial-Language-Action Model that scales implicit spatial alignment to continual pre-training and maintains it during downstream post-training. Initialized from a pretrained pi05 policy, SLA jointly optimizes action prediction and alignment between intermediate visual embeddings and spatial representations from a frozen 3D perception model. We curate and unify heterogeneous robot datasets to support spatial learning across diverse embodiments, tasks, and scenes. To accommodate this diversity, we introduce feature-dependent gates that adaptively aggregate visual embeddings from multiple VLA layers for spatial supervision. The teacher further exploits partially available depth and camera calibration alongside RGB observations, enabling effective use of heterogeneous geometric annotations. Probabilistic state dropout encourages reliance on visual cues and mitigates overfitting to demonstration trajectories. All auxiliary components are used only during training, allowing direct reuse of pretrained VLA weights and preserving the original inference architecture.
The paper's own sentences, arranged, kept beside the review and separate from it. Each label is drawn from a closed vocabulary; the number beside it is the probability the classifier gave that label. No sentence in this record was written by a model.
abstract compiled · 2026-11-06
The authors' main claim, as the classifier picked it out 0.98
“We present SLA, a Spatial-Language-Action Model that scales implicit spatial alignment to continual pre-training and maintains it during downstream post-training.”
How the main claim is stated: asserted 1.00
What the abstract itself states, as probabilities: claims first 0.06 · states limitation 0.40 · human participants 0.03 · controlled comparison 0.06 · randomized assignment 0.01 · states quantitative result 0.03 · compares with prior results 0.09 · mentions code or data availability 0.04
The abstract, sentence by sentence
This table labels the abstract only (arXiv listing abstract v1). The number is the probability the classifier gave the label.
| Sentence | Role | The authors' own work | States the main conclusion | Strength |
|---|---|---|---|---|
| Reliable robotic manipulation requires both semantic understanding and precise control in three-dimensional space. | background 1.00 | 0.05 | 0.03 | asserted 1.00 |
| However, vision-language-action (VLA) foundations largely inherit visual representations from 2D vision-language pre-training, while spatial supervision is often introduced only during task-specific adaptation. | gap 0.88 | 0.06 | 0.03 | asserted 0.97 |
| Developing spatial understanding as a transferable foundation-model capability therefore calls for learning from broader robot experience. | background 0.58 | 0.07 | 0.06 | asserted 0.88 |
| We present SLA, a Spatial-Language-Action Model that scales implicit spatial alignment to continual pre-training and maintains it during downstream post-training. | contribution 0.99 | 0.92 | 0.32 | asserted 1.00 |
| Initialized from a pretrained pi05 policy, SLA jointly optimizes action prediction and alignment between intermediate visual embeddings and spatial representations from a frozen 3D perception model. | method 0.99 | 0.88 | 0.07 | asserted 1.00 |
| We curate and unify heterogeneous robot datasets to support spatial learning across diverse embodiments, tasks, and scenes. | method 0.90 | 0.95 | 0.04 | asserted 0.98 |
| To accommodate this diversity, we introduce feature-dependent gates that adaptively aggregate visual embeddings from multiple VLA layers for spatial supervision. | method 0.91 | 0.93 | 0.03 | asserted 1.00 |
| The teacher further exploits partially available depth and camera calibration alongside RGB observations, enabling effective use of heterogeneous geometric annotations. | method 0.98 | 0.82 | 0.03 | asserted 0.98 |
| Probabilistic state dropout encourages reliance on visual cues and mitigates overfitting to demonstration trajectories. | method 0.97 | 0.78 | 0.03 | asserted 1.00 |
| All auxiliary components are used only during training, allowing direct reuse of pretrained VLA weights and preserving the original inference architecture. | method 0.87 | 0.85 | 0.09 | asserted 1.00 |
What kind of paper the classifier reports this is: method or tool 1.00 · evidence from observation or experiment 0.71
What was examined, and what was not
Sources read
- arXiv listing abstract v1
Not examined
- full text
- figures and tables
- references and citing sentences
- relations to other papers
Levels run
- P abstract
Not run
- S sections
- T body sentences
- C citations
- R cross-paper relations
How the labels were made
Compiled by classifier-1.13.0 via TypeSafe API, question bank abstract-p1-20260923, 2026-11-06: 1 request, 7,428 input tokens.
Every quoted sentence on this record is the authors'. Every label is from Pith's closed vocabulary, with the probability shown beside it. This record as JSON
Figures (6)
Figures are the authors', reproduced from the paper.
References (59)
- [1] AgiBot-World-Contributors, Qingwen Bu, Jisong Cai, Li Chen, Xiuqi Cui, Yan Ding, et al. AgiBot World Colosseo: A large-scale manipulation platform for scalable and intelligent embodied systems.arXiv preprint arXiv:2503.06669, on PithPith's reviewarXiv
- [4] Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, Marco Dos Santos, Stephen McAleer, Qiaochu Jiang, Jia Deng, Stella R Biderman, and Sean Welleck. Llemma: An open language model for mathematics. InInternational Conference on Learning Representations, volume 2024, pages 40622–40649, on Pith
- [6] Lucas Beyer, Andreas Steiner, André Susano Pinto, Alexander Kolesnikov, Xiao Wang, Daniel Salz, Maxim Neumann, Ibrahim Alabdulmohsin, Michael Tschannen, Emanuele Bugliarello, et al. Paligemma: A versatile 3b vlm for transfer. arXiv preprint arXiv:2407.07726, on PithPith's reviewarXiv
- [7] Johan Bjorck, Fernando Castañeda, Nikita Cherniadev, Xingye Da, Runyu Ding, Linxi Fan, Yu Fang, Dieter Fox, Fengyuan Hu, Spencer Huang, et al. Gr00t n1: An open foundation model for generalist humanoid robots.arXiv preprint arXiv:2503.14734, on PithPith's reviewarXiv
- [8] Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Joseph Dabis, Chelsea Finn, Keerthana Gopalakr- ishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, et al. Rt-1: Robotics transformer for real-world control at scale. arXiv preprint arXiv:2212.06817, on PithPith's reviewarXiv
- [11] 20 Junhao Cai, Zetao Cai, Jiafei Cao, Yilun Chen, Zeyu He, Lei Jiang, Hang Li, Hengjie Li, Yang Li, Yufei Liu, et al. Internvla-a1: Unifying understanding, generation and action for robotic manipulation.arXiv preprint arXiv:2601.02456, 2026a. Rui Cai, Jun Guo, Xinze He, Piaopi... on PitharXiv
- [13] Jiayi Chen, Wenxuan Song, Jingbo Wang, Shuai Zhou, Xicheng Gong, Zehua Fan, Ziyang Zhou, Haodong Yan, Fuhao Li, Qize Yu, et al. Uniwam: Unified world-action model.arXiv preprint arXiv:2610.02054, 2026a. Tianxing Chen, Zanxin Chen, Baijun Chen, Zijian Cai, Yibin Liu, Zixuan Li,... on PithPith's reviewarXiv
- [14] StarVLA Community. Starvla: A lego-like codebase for vision-language-action model developing.arXiv preprint arXiv:2604.05014, on PithPith's reviewarXiv
- [16] Haoquan Fang, Jiafei Duan, Donovan Clay, Sam Wang, Shuo Liu, Weikai Huang, Xiang Fan, Wei-Chuan Tsai, Shirui Chen, Yi Ru Wang, et al. Molmoact2: Action reasoning models for real-world deployment.arXiv preprint arXiv:2605.02881, on PithPith's reviewarXiv
- [17] Senyu Fei, Siyin Wang, Junhao Shi, Zihao Dai, Jikun Cai, Pengfang Qian, Li Ji, Xinzhe He, Shiduo Zhang, Zhaoye Fei, et al. Libero-plus: In-depth robustness analysis of vision-language-action models.arXiv preprint arXiv:2510.13626, on PithPith's reviewarXiv
- [18] Shukai Gong, Xuanran Zhai, Yintianrun Zhang, Ruopeng Cui, Ye Huang, Yiyang Fu, Dexuan Lyu, Chaojie Li, Xinyi Song, Peiwen Lin, et al. Rethinking world-action model for compositional and in-context robotic manipulation. arXiv preprint arXiv:2610.02368, on PithPith's reviewarXiv
- [19] Jun Guo, Qiwei Li, Peiyan Li, Zilong Chen, Nan Sun, Yifei Su, Heyun Wang, Yuan Zhang, Xinghang Li, and Huaping Liu. Unified 4d world action modeling from video priors with asynchronous denoising.arXiv preprint arXiv:2604.26694, 2026a. 21 Yanjiang Guo, Haodong Yan, Zhide Zhong,... on PithPith's reviewarXiv
- [20] ByungOk Han, Jaehong Kim, and Jinhyeok Jang. A dual process vla: Efficient robotic manipulation leveraging vlm. arXiv preprint arXiv:2410.15549, on PithPith's reviewarXiv
- [21] Joel Jang, Seonghyeon Ye, Zongyu Lin, Jiannan Xiang, Johan Bjorck, Yu Fang, Fengyuan Hu, Spencer Huang, Kaushil Kundalia, Yen-Chen Lin, et al. Dreamgen: Unlocking generalization in robot learning through video world models. arXiv preprint arXiv:2505.12705, on PithPith's reviewarXiv
- [22] Alexander Khazatsky, Karl Pertsch, Suraj Nair, Ashwin Balakrishna, Sudeep Dasari, Siddharth Karamcheti, et al. DROID: A large-scale in-the-wild robot manipulation dataset.arXiv preprint arXiv:2403.12945, on PithPith's reviewarXiv
- [23] Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, et al. Openvla: An open-source vision-language-action model.arXiv preprint arXiv:2406.09246, on PithPith's reviewarXiv
- [24] Moo Jin Kim, Chelsea Finn, and Percy Liang. Fine-tuning vision-language-action models: Optimizing speed and success.arXiv preprint arXiv:2502.19645, on PithPith's reviewarXiv
- [25] Moo Jin Kim, Yihuai Gao, Tsung-Yi Lin, Yen-Chen Lin, Yunhao Ge, Grace Lam, Percy Liang, Shuran Song, Ming-Yu Liu, Chelsea Finn, et al. Cosmos policy: Fine-tuning video models for visuomotor control and planning.arXiv preprint arXiv:2601.16163, on PithPith's reviewarXiv
- [26] Myungkyu Koo, Daewon Choi, Taeyoung Kim, Kyungmin Lee, Changyeon Kim, Younggyo Seo, and Jinwoo Shin. Hamlet: Switch your vision-language-action model into a history-aware policy. InInternational Conference on Learning Representations, volume 2026, pages 101537–101558, on Pith
- [27] Chengmeng Li and Yaxin Peng. Embodiment transfer learning for vision-language-action models.arXiv preprint arXiv:2511.01224, on PitharXiv
show 39 more
- [28] Chengmeng Li, Junjie Wen, Yaxin Peng, Yan Peng, and Yichen Zhu. Pointvla: Injecting the 3d world into vision- language-action models.IEEE Robotics and Automation Letters, 11(3):2506–2513, 2026a. Fuhao Li, Wenxuan Song, Han Zhao, Jingbo Wang, Pengxiang Ding, Donglin Wang, Long ... on PitharXiv
- [29] Haitao Lin, Hanyang Yu, Jingshun Huang, He Zhang, Yonggen Ling, Ping Tan, Xiangyang Xue, and Yanwei Fu. Posevla: Universal pose pretraining for generalizable vision-language-action policies.arXiv preprint arXiv:2602.19710, on PithPith's reviewarXiv
- [30] Yaron Lipman, Ricky TQ Chen, Heli Ben-Hamu, Maximilian Nickel, and Matt Le. Flow matching for generative modeling.arXiv preprint arXiv:2210.02747, on PithPith's reviewarXiv
- [31] Songming Liu, Lingxuan Wu, Bangguo Li, Hengkai Tan, Huayu Chen, Zhengyi Wang, Ke Xu, Hang Su, and Jun Zhu. Rdt-1b: a diffusion foundation model for bimanual manipulation.arXiv preprint arXiv:2410.07864, on PithPith's reviewarXiv
- [32] Songming Liu, Bangguo Li, Kai Ma, Lingxuan Wu, Hengkai Tan, Xiao Ouyang, Hang Su, and Jun Zhu. Rdt2: Exploring the scaling limit of umi data towards zero-shot cross-embodiment generalization.arXiv preprint arXiv:2602.03310, 2026a. Yicheng Liu, Zibin Dong, Baijun Ye, Tianyuan Y... on PitharXiv
- [33] Hao Luo, Wanpeng Zhang, Yicheng Feng, Sipeng Zheng, Haiweng Xu, Chaoyi Xu, Ziheng Xi, Yuhui Fu, and Zongqing Lu. Being-h0. 7: A latent world-action model from egocentric videos.arXiv preprint arXiv:2605.00078, on PithPith's reviewarXiv
- [34] Juncheng Ma, Jianxin Bi, Yufan Deng, Xuanran Zhai, Kewei Zhang, Ye Huang, Bo Liang, Shukai Gong, Jiankai Tu, Xiaotian Tang, et al. Humanscale: Egocentric human video can outperform real-robot data for embodied pretraining. arXiv preprint arXiv:2606.20521, on PithPith's reviewarXiv
- [35] Xingyu Miao, Zizun Li, Baole Fang, Kaiwen Song, Tenghui Wang, Hanxue Zhang, Yating Wang, Xudong Li, Yuping He, Xueyuan Wei, et al. InternW0-∆: A world action model bridging predictive dynamics and actions with 20k+ hours of open data.arXiv preprint arXiv:2609.31394, on PithPith's reviewarXiv
- [36] Soroush Nasiriany, Abhiram Maddukuri, Lance Zhang, Adeet Parikh, Aaron Lo, Abhishek Joshi, Ajay Mandlekar, and Yuke Zhu. Robocasa: Large-scale simulation of everyday tasks for generalist robots.arXiv preprint arXiv:2406.02523, on PithPith's reviewarXiv
- [37] Soroush Nasiriany, Sepehr Nasiriany, Abhiram Maddukuri, and Yuke Zhu. RoboCasa365: A large-scale simulation framework for training and benchmarking generalist robots.arXiv preprint arXiv:2603.04356, on PitharXiv
- [38] NVIDIA. GR00T N1.5: An improved open foundation model for generalist humanoid robots, 2025.https://research. nvidia.com/labs/gear/gr00t-n1_5/. Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Ma... on PithPith's reviewarXiv
- [39] Haosong Peng, Hao Li, Yalun Dai, Yushi Lan, Yihang Luo, Tianyu Qi, Zhengshen Zhang, Yufeng Zhan, Junfei Zhang, Wenchao Xu, and Ziwei Liu. OmniVGGT: Omni-modality driven visual geometry grounded transformer.arXiv preprint arXiv:2511.10560, on PitharXiv
- [40] Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, and Junyang Lin. Gated attention for large language models: Non-linearity, sparsity, and attention-sink-free.arXiv preprint arXiv:2505.06708, on PithPith's reviewarXiv
- [42] Ajay Sridhar, Jennifer Pan, Satvik Sharma, and Chelsea Finn. Memer: Scaling up memory for robot control via experience retrieval.arXiv preprint arXiv:2510.20328, on PitharXiv
- [43] Haisheng Su, Zongdai Liu, Xin Jin, Haoxuan Dou, Chengming Hu, Baorun Li, Zhanwang Liu, Ruiyan Xu, Jianjie Fang, Xin Zhang, et al. Worldscape policy 2.0: Empowering steerable world action modeling with reasoning-augmented memory.arXiv preprint arXiv:2607.18840, 2026a. Liangcai ... on PithPith's reviewarXiv
- [44] Lin Sun, Bin Xie, Yingfei Liu, Hao Shi, Tiancai Wang, and Jiale Cao. Geovla: Empowering 3d representations in vision-language-action models.arXiv preprint arXiv:2508.09071, on PithPith's reviewarXiv
- [45] GigaBrain Team, Angen Ye, Axiang Sun, Can Jin, Chenxi Cheng, Chong Shi, Dengke Shang, Dingqian Zhang, Guan Huang, Guangqiang Wang, et al. Gigabrain-0.7: Scaling embodied foundation models to emergent capabilities with a three-system architecture.arXiv preprint arXiv:2608.15875... on PithPith's reviewarXiv
- [46] https://www.spirit-ai.com/en/blog/spirit-v1-5. Xiaomi Robotics Team, Jun Guo, Piaopiao Jin, Jason Li, Peiyan Li, Yingyan Li, Futeng Liu, Wanli Peng, Optimus Qin, Yifei Su, et al. Xiaomi-robotics-1: Scaling vision-language-action models with over 100k hours of real-world trajec... on PithPith's reviewarXiv
- [47] Hao Wang, Xiaobao Wei, Jingyang He, Chengyu Bai, Chun-Kai Fan, Jiajun Cao, Jintao Chen, Ying Li, Shanyu Rong, Ming Lu, et al. Vega: Visual encoder grounding alignment for spatially-aware vision-language-action models.arXiv preprint arXiv:2605.10485, 2026a. Hao Wang, Jiajun Wen... on PithPith's reviewarXiv
- [48] Jingbo Wang, Wenxuan Song, Wenhao Yu, Han Zhao, Xi Wang, Jiayi Chen, Donglin Wang, Yan Wang, and Haoang Li. Discrete forcing: Infusing discrete guidance into continuous denoising for few-step action experts.arXiv preprint arXiv:2609.39526, 2026c. 24 Sen Wang, Liu Liu, Xinjiang... on PithPith's reviewarXiv
- [49] Haoyu Wu, Diankun Wu, Tianyu He, Junliang Guo, Yang Ye, Yueqi Duan, and Jiang Bian. Geometry forcing: Marrying video diffusion and 3d representation for consistent world modeling.arXiv preprint arXiv:2507.07982, 2025a. Kun Wu, Chengkai Hou, Jiaming Liu, Zhengping Che, Xiaozhu ... on PithPith's reviewarXiv
- [50] Shihan Wu, Xuecheng Liu, Shaoxuan Xie, Pengwei Wang, Xinghang Li, Bowen Yang, et al. RoboCOIN: An open-sourced bimanual robotic data collection for integrated manipulation.arXiv preprint arXiv:2511.17441, 2025b. Lishan Yang, Wenxuan Song, Xi Wang, Pingyue Sheng, Zheng Fang, Zi... on PithPith's reviewarXiv
- [51] Cheng Yin, Wang Xu, Junpeng Yang, Sikyuen Tam, Hanyu Liu, Yuan Yao, Xiangrui Zeng, Junbo Cui, Yequan Wang, Zhouping Yin, et al. Simplememvla: A simple but effective native-video memory for vision-language-action models. arXiv preprint arXiv:2609.05533, on PithPith's reviewarXiv
- [52] Qize Yu, Lianrui Fan, Boyu Chen, Jiaqi Liang, Xini Ding, Yue Chen, Zetian Song, Yuran Wang, Yi Zou, Kaixuan Wang, et al. Groundingpi: A grounding foundation model towards physical intelligence with visual primitives.arXiv preprint arXiv:2609.39601, on PithPith's reviewarXiv
- [53] Haoqi Yuan, Zhixuan Liang, Anzhe Chen, Ye Wang, Haoyang Li, Pei Lin, Yiyang Huang, Zixing Lei, Tong Zhang, Jiazhao Zhang, et al. Qwen-robotmanip technical report: Alignment unlocks scale for robotic manipulation foundation models.arXiv preprint arXiv:2606.17846, 2026a. Haoqi Y... on PithPith's reviewarXiv
- [54] Renshan Zhang, Rui Shao, Gongwei Chen, Miao Zhang, Kaiwen Zhou, Weili Guan, and Liqiang Nie. Falcon: Resolving visual redundancy and fragmentation in high-resolution multimodal large language models via visual registers.arXiv preprint arXiv:2501.16297, on PithPith's reviewarXiv
- [55] Xuancheng Zhang, Xuetao Liu, Qianying Tang, Jizhe Wang, Runsheng Wang, Zhijing Cheng, Bochen Lin, Haoran Wen, Ming Li, Kun Zhan, et al. Me-dex 1.0: Bringing heterogeneous tactile sensing into world action modeling. arXiv preprint arXiv:2609.21449, on PithPith's reviewarXiv
- [56] 25 Juntu Zhao, Wenbo Lu, Di Zhang, Yufeng Liu, Yushen Liang, Tianluo Zhang, Yifeng Cao, Junyuan Xie, Yingdong Hu, Shengjie Wang, et al. Do you need proprioceptive states in visuomotor policies?arXiv preprint arXiv:2509.18644, on PitharXiv
- [57] Mengfei Zhao, Dihong Huang, Yikai Tang, Peihao Li, Mingxuan Yan, Ruiqi Zhuang, Yanjia Huang, Jie Wang, Hai Zhai, Tony Zhou, et al. Axis: A growable community-driven data engine for scalable robot manipulation.arXiv preprint arXiv:2607.21588, on PithPith's reviewarXiv
- [58] Jinliang Zheng, Jianxiong Li, Zhihao Wang, Dongxiu Liu, Xirui Kang, Yuchun Feng, Yinan Zheng, Jiayin Zou, Yilun Chen, Jia Zeng, et al. X-vla: Soft-prompted transformer as scalable cross-embodiment vision-language-action model. arXiv preprint arXiv:2510.10274, 2025a. Ruijie Zhe... on PithPith's reviewarXiv
- [59] 6.4 4.0 7.4 2.9 14.6 5.533.7 33.20.9 0.8 12.6 9.3 KinRT (Yang et al., 2026b) 14.0 8.6 15.7 9.9 26.4 18.1 4.8 3.64.2 3.813.0 8.8 CogWAM (Wang et al., 2026d) 12.8 9.3 20.5 14.627.4 18.28.2 7.0 2.9 2.7 14.3 10.3 EWAM (Wang et al., 2026b) 15.1 9.7 22.212.3 30.218.1 7.4 6.0 1.1 0.8... on Pith
- [2019] Dogu Araci. Finbert: Financial sentiment analysis with pre-trained language models.arXiv preprint arXiv:1908.10063, on PithPith's reviewarXiv
- [2020] Chi-Lam Cheang, Guangzeng Chen, Ya Jing, Tao Kong, Hang Li, Yifeng Li, Yuxiao Liu, Hongtao Wu, Jiafeng Xu, Yichu Yang, et al. Gr-2: A generative video-language-action model with web-scale knowledge for robot manipulation. arXiv preprint arXiv:2410.06158, on PithPith's reviewarXiv
- [2021] Hao Shi, Weiye Li, Bin Xie, Yulin Wang, Renping Zhou, Tiancai Wang, Xiangyu Zhang, Ping Luo, and Gao Huang. Memoryvla++: Temporal modeling via memory and imagination in vision-language-action models.arXiv preprint arXiv:2606.09827, 2026a. Hao Shi, Bin Xie, Yingfei Liu, Lin Sun... on PithPith's reviewarXiv
- [2022] Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, et al. Rt-2: Vision-language-action models transfer web knowledge to robotic control.arXiv preprint arXiv:2307.15818, on PithPith's reviewarXiv
- [2023] Qingwen Bu, Yanting Yang, Jisong Cai, Shenyuan Gao, Guanghui Ren, Maoqing Yao, Ping Luo, and Hongyang Li. Learning to act anywhere with task-centric latent actions.arXiv preprint arXiv:2502.14420, on PithPith's reviewarXiv
- [2024] Suneel Belkhale, Tianli Ding, Ted Xiao, Pierre Sermanet, Quon Vuong, Jonathan Tompson, Yevgen Chebotar, Debidatta Dwibedi, and Dorsa Sadigh. Rt-h: Action hierarchies using language.arXiv preprint arXiv:2403.01823, on PithPith's reviewarXiv
- [2025] Arthur Allshire, Himanshu Gaurav Singh, Ritvik Singh, Adam Rashid, Hongsuk Choi, David McAllister, Justin Yu, Yiyuan Chen, Huang Huang, Pieter Abbeel, et al. Scalable behavior cloning with open data, training, and evaluation. arXiv preprint arXiv:2606.27375, on PithPith's reviewarXiv
- [2026] Xingyu Ding, Yuzhong Zhao, Yang Wu, Chunhai Zhao, Chaoyang Zhao, Yifan Zhang, and Jian Cheng. Mind- vla: Instruction-aware spatial representation alignment for vision-language-action models.arXiv preprint arXiv:2608.04633, on PithPith's reviewarXiv
Challenges and discussion
Disagree with the review, or know something it missed? Leave a comment, or challenge this review formally: a challenge becomes a permanent entry in this paper's record, and its decision is published here.
Come back by email
A short list of the week's newly reviewed papers. Nothing is sent until you confirm from your inbox, and every email has a link that stops it. No account.
No comments yet.
Sign in to comment