{"record_type":"pith_number_record","schema_url":"https://pith.science/schemas/pith-number/v1.json","pith_number":"pith:2025:ABUITWGJPFUECEEDS6XA226RDY","short_pith_number":"pith:ABUITWGJ","schema_version":"1.0","canonical_sha256":"006889d8c9796841108397ae0d6bd11e09207c2fd66e155720ba682bbbdc6b27","source":{"kind":"arxiv","id":"2509.09674","version":1},"attestation_state":"computed","paper":{"title":"SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning","license":"http://creativecommons.org/licenses/by-nc-sa/4.0/","headline":"Reinforcement learning scales vision-language-action model training beyond supervised fine-tuning","cross_cats":["cs.AI","cs.CL","cs.LG"],"primary_cat":"cs.RO","authors_text":"Bowen Zhou, Dehui Wang, Dingxiang Luo, Ganqu Cui, Haozhan Li, Jiale Yu, Jiangmiao Pang, Jia Zeng, Kaiyan Zhang, Ning Ding, Shanghang Zhang, Tianxing Chen, Xuekai Zhu, Yao Mu, Youbang Sun, Yuchen Fan, Yuchen Zhang, Yuhao Zhang, Yu Wang, Yuxin Zuo, Zhaohui Yang","submitted_at":"2025-09-11T17:59:17Z","abstract_excerpt":"Vision-Language-Action (VLA) models have recently emerged as a powerful paradigm for robotic manipulation. Despite substantial progress enabled by large-scale pretraining and supervised fine-tuning (SFT), these models face two fundamental challenges: (i) the scarcity and high cost of large-scale human-operated robotic trajectories required for SFT scaling, and (ii) limited generalization to tasks involving distribution shift. Recent breakthroughs in Large Reasoning Models (LRMs) demonstrate that reinforcement learning (RL) can dramatically enhance step-by-step reasoning capabilities, raising a"},"verification_status":{"content_addressed":true,"pith_receipt":true,"author_attested":false,"weak_author_claims":0,"strong_author_claims":0,"externally_anchored":false,"storage_verified":false,"citation_signatures":0,"replication_records":0,"graph_snapshot":true,"references_resolved":true,"formal_links_present":true},"canonical_record":{"source":{"id":"2509.09674","kind":"arxiv","version":1},"metadata":{"license":"http://creativecommons.org/licenses/by-nc-sa/4.0/","primary_cat":"cs.RO","submitted_at":"2025-09-11T17:59:17Z","cross_cats_sorted":["cs.AI","cs.CL","cs.LG"],"title_canon_sha256":"705bc96580cb34c4cd93cf4d2b6f80daaae6ea990a9552a70416de12a645416b","abstract_canon_sha256":"eb6febe5fd595ea05910a580fc224467f6772dcd2bd2f7323867fe71e413ff2e"},"schema_version":"1.0"},"receipt":{"kind":"pith_receipt","key_id":"pith-v1-2026-05","algorithm":"ed25519","signed_at":"2026-05-17T23:38:53.075143Z","signature_b64":"O0VELzntt2uj9TpAYAbhH80wuq0bNlb1xMAQBNuWgWQKdtTQwIcDs59Mp5m5Hng9ataZ7zb6RGqw8WehnTp2Ag==","signed_message":"canonical_sha256_bytes","builder_version":"pith-number-builder-2026-05-17-v1","receipt_version":"0.3","canonical_sha256":"006889d8c9796841108397ae0d6bd11e09207c2fd66e155720ba682bbbdc6b27","last_reissued_at":"2026-05-17T23:38:53.074646Z","signature_status":"signed_v1","first_computed_at":"2026-05-17T23:38:53.074646Z","public_key_fingerprint":"8d4b5ee74e4693bcd1df2446408b0d54"},"graph_snapshot":{"paper":{"title":"SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning","license":"http://creativecommons.org/licenses/by-nc-sa/4.0/","headline":"Reinforcement learning scales vision-language-action model training beyond supervised fine-tuning","cross_cats":["cs.AI","cs.CL","cs.LG"],"primary_cat":"cs.RO","authors_text":"Bowen Zhou, Dehui Wang, Dingxiang Luo, Ganqu Cui, Haozhan Li, Jiale Yu, Jiangmiao Pang, Jia Zeng, Kaiyan Zhang, Ning Ding, Shanghang Zhang, Tianxing Chen, Xuekai Zhu, Yao Mu, Youbang Sun, Yuchen Fan, Yuchen Zhang, Yuhao Zhang, Yu Wang, Yuxin Zuo, Zhaohui Yang","submitted_at":"2025-09-11T17:59:17Z","abstract_excerpt":"Vision-Language-Action (VLA) models have recently emerged as a powerful paradigm for robotic manipulation. Despite substantial progress enabled by large-scale pretraining and supervised fine-tuning (SFT), these models face two fundamental challenges: (i) the scarcity and high cost of large-scale human-operated robotic trajectories required for SFT scaling, and (ii) limited generalization to tasks involving distribution shift. Recent breakthroughs in Large Reasoning Models (LRMs) demonstrate that reinforcement learning (RL) can dramatically enhance step-by-step reasoning capabilities, raising a"},"claims":{"count":4,"items":[{"kind":"strongest_claim","text":"When applied to OpenVLA-OFT, SimpleVLA-RL achieves SoTA performance on LIBERO and even outperforms π₀ on RoboTwin 1.0&2.0 with the exploration-enhancing strategies we introduce. SimpleVLA-RL not only reduces dependence on large-scale data and enables robust generalization, but also remarkably surpasses SFT in real-world tasks.","source":"verdict.strongest_claim","status":"machine_extracted","claim_id":"C1","attestation":"unclaimed"},{"kind":"weakest_assumption","text":"That the introduced VLA-specific trajectory sampling, multi-environment rendering, and exploration-enhancing strategies remain stable and effective across different base VLA models and real-world distribution shifts without extensive additional tuning or hidden failure modes.","source":"verdict.weakest_assumption","status":"machine_extracted","claim_id":"C2","attestation":"unclaimed"},{"kind":"one_line_summary","text":"SimpleVLA-RL applies tailored reinforcement learning to VLA models, reaching SoTA on LIBERO, outperforming π₀ on RoboTwin, and surpassing SFT in real-world tasks while reducing data needs and identifying a 'pushcut' phenomenon.","source":"verdict.one_line_summary","status":"machine_extracted","claim_id":"C3","attestation":"unclaimed"},{"kind":"headline","text":"Reinforcement learning scales vision-language-action model training beyond supervised fine-tuning","source":"verdict.pith_extraction.headline","status":"machine_extracted","claim_id":"C4","attestation":"unclaimed"}],"snapshot_sha256":"735af64748f3db26f279dfa5878804d25a54e38ef71705dcc1acd0db9e266d18"},"source":{"id":"2509.09674","kind":"arxiv","version":1},"verdict":{"id":"45b2e080-c87d-4ae2-a567-88007d9dc30f","model_set":{"reader":"grok-4.3"},"created_at":"2026-05-15T07:55:51.457256Z","strongest_claim":"When applied to OpenVLA-OFT, SimpleVLA-RL achieves SoTA performance on LIBERO and even outperforms π₀ on RoboTwin 1.0&2.0 with the exploration-enhancing strategies we introduce. SimpleVLA-RL not only reduces dependence on large-scale data and enables robust generalization, but also remarkably surpasses SFT in real-world tasks.","one_line_summary":"SimpleVLA-RL applies tailored reinforcement learning to VLA models, reaching SoTA on LIBERO, outperforming π₀ on RoboTwin, and surpassing SFT in real-world tasks while reducing data needs and identifying a 'pushcut' phenomenon.","pipeline_version":"pith-pipeline@v0.9.0","weakest_assumption":"That the introduced VLA-specific trajectory sampling, multi-environment rendering, and exploration-enhancing strategies remain stable and effective across different base VLA models and real-world distribution shifts without extensive additional tuning or hidden failure modes.","pith_extraction_headline":"Reinforcement learning scales vision-language-action model training beyond supervised fine-tuning"},"references":{"count":44,"sample":[{"doi":"","year":null,"title":"OpenVLA: An Open-Source Vision-Language-Action Model","work_id":"3e7e65c5-5aed-4fe9-8414-2092bcb31cc7","ref_index":1,"cited_arxiv_id":"2406.09246","is_internal_anchor":true},{"doi":"","year":null,"title":"A Survey on Vision-Language-Action Models: An Action Tokenization Perspective","work_id":"c1359daa-6e63-4d55-9d22-1575acbd787c","ref_index":2,"cited_arxiv_id":"2507.01925","is_internal_anchor":true},{"doi":"","year":null,"title":"Roumelio- tis, and Manoj Karkee","work_id":"5f0bf2cc-1901-4ad0-940b-1e742cc6d7e7","ref_index":3,"cited_arxiv_id":"","is_internal_anchor":false},{"doi":"","year":null,"title":"What Matters in Learning from Offline Human Demonstrations for Robot Manipulation","work_id":"6a4c95c5-540e-4854-946d-c7c8a6c540ba","ref_index":4,"cited_arxiv_id":"2108.03298","is_internal_anchor":true},{"doi":"","year":null,"title":"AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems","work_id":"f797e9ec-510f-43a7-8a0c-18009ce332e5","ref_index":5,"cited_arxiv_id":"2503.06669","is_internal_anchor":true}],"resolved_work":44,"snapshot_sha256":"d56d9d3851f4830c21737e9f637276066818a01373f7943de31e3b3af4e26396","internal_anchors":30},"formal_canon":{"evidence_count":2,"snapshot_sha256":"9612d031635a20bc73681899721228d84ce248567d78be55424283623196c2de"},"author_claims":{"count":0,"strong_count":0,"snapshot_sha256":"258153158e38e3291e3d48162225fcdb2d5a3ed65a07baac614ab91432fd4f57"},"builder_version":"pith-number-builder-2026-05-17-v1"},"aliases":[{"alias_kind":"arxiv","alias_value":"2509.09674","created_at":"2026-05-17T23:38:53.074722+00:00"},{"alias_kind":"arxiv_version","alias_value":"2509.09674v1","created_at":"2026-05-17T23:38:53.074722+00:00"},{"alias_kind":"doi","alias_value":"10.48550/arxiv.2509.09674","created_at":"2026-05-17T23:38:53.074722+00:00"},{"alias_kind":"pith_short_12","alias_value":"ABUITWGJPFUE","created_at":"2026-05-18T12:33:37.589309+00:00"},{"alias_kind":"pith_short_16","alias_value":"ABUITWGJPFUECEED","created_at":"2026-05-18T12:33:37.589309+00:00"},{"alias_kind":"pith_short_8","alias_value":"ABUITWGJ","created_at":"2026-05-18T12:33:37.589309+00:00"}],"events":[],"event_summary":{},"paper_claims":[],"inbound_citations":{"count":38,"internal_anchor_count":38,"sample":[{"citing_arxiv_id":"2602.07399","citing_title":"VGAS: Value-Guided Action-Chunk Selection for Few-Shot Vision-Language-Action Adaptation","ref_index":24,"is_internal_anchor":true},{"citing_arxiv_id":"2605.22896","citing_title":"Agentic-VLA: Efficient Online Adaptation for Vision-Language-Action Models","ref_index":8,"is_internal_anchor":true},{"citing_arxiv_id":"2602.10503","citing_title":"Towards Long-Lived Robots: Continual Learning VLA Models via Reinforcement Fine-Tuning","ref_index":34,"is_internal_anchor":true},{"citing_arxiv_id":"2602.09023","citing_title":"TwinRL: Digital Twin-Driven Reinforcement Learning for Real-World Robotic Manipulation","ref_index":28,"is_internal_anchor":true},{"citing_arxiv_id":"2605.11151","citing_title":"RankQ: Offline-to-Online Reinforcement Learning via Self-Supervised Action Ranking","ref_index":5,"is_internal_anchor":true},{"citing_arxiv_id":"2605.12334","citing_title":"Reinforcing VLAs in Task-Agnostic World Models","ref_index":17,"is_internal_anchor":true},{"citing_arxiv_id":"2605.16154","citing_title":"Learn Where Outcomes Diverge: Efficient VLA RL via Probabilistic Chunk Masking","ref_index":15,"is_internal_anchor":true},{"citing_arxiv_id":"2605.17486","citing_title":"DyGRO-VLA: Cross-Task Scaling of Vision-Language-Action Models via Dynamic Grouped Residual Optimization","ref_index":177,"is_internal_anchor":true},{"citing_arxiv_id":"2605.19580","citing_title":"PAPO-VLA: Planning-Aware Policy Optimization for Vision-Language-Action Models","ref_index":13,"is_internal_anchor":true},{"citing_arxiv_id":"2605.19678","citing_title":"RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models","ref_index":38,"is_internal_anchor":true},{"citing_arxiv_id":"2511.15669","citing_title":"DeepThinkVLA: Enhancing Reasoning Capability of Vision-Language-Action Models","ref_index":21,"is_internal_anchor":true},{"citing_arxiv_id":"2509.08827","citing_title":"A Survey of Reinforcement Learning for Large Reasoning Models","ref_index":272,"is_internal_anchor":true},{"citing_arxiv_id":"2511.14148","citing_title":"AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Models","ref_index":35,"is_internal_anchor":true},{"citing_arxiv_id":"2511.18082","citing_title":"ActDistill: General Action-Guided Self-Derived Distillation for Efficient Vision-Language-Action Models","ref_index":11,"is_internal_anchor":true},{"citing_arxiv_id":"2602.05765","citing_title":"RL-VLA$^3$: A Flexible and Asynchronous Reinforcement Learning Framework for VLA Training","ref_index":11,"is_internal_anchor":true},{"citing_arxiv_id":"2602.11075","citing_title":"RISE: Self-Improving Robot Policy with Compositional World Model","ref_index":56,"is_internal_anchor":true},{"citing_arxiv_id":"2603.13842","citing_title":"Fine-tuning is Not Enough: A Parallel Framework for Collaborative Imitation and Reinforcement Learning in End-to-end Autonomous Driving","ref_index":29,"is_internal_anchor":true},{"citing_arxiv_id":"2605.13276","citing_title":"D-VLA: A High-Concurrency Distributed Asynchronous Reinforcement Learning Framework for Vision-Language-Action Models","ref_index":17,"is_internal_anchor":true},{"citing_arxiv_id":"2605.13080","citing_title":"Learning to See What You Need: Gaze Attention for Multimodal Large Language Models","ref_index":57,"is_internal_anchor":true},{"citing_arxiv_id":"2605.13276","citing_title":"D-VLA: A High-Concurrency Distributed Asynchronous Reinforcement Learning Framework for Vision-Language-Action Models","ref_index":17,"is_internal_anchor":true},{"citing_arxiv_id":"2605.12334","citing_title":"Reinforcing VLAs in Task-Agnostic World Models","ref_index":17,"is_internal_anchor":true},{"citing_arxiv_id":"2605.11151","citing_title":"RankQ: Offline-to-Online Reinforcement Learning via Self-Supervised Action Ranking","ref_index":5,"is_internal_anchor":true},{"citing_arxiv_id":"2601.21998","citing_title":"Causal World Modeling for Robot Control","ref_index":38,"is_internal_anchor":true},{"citing_arxiv_id":"2511.14759","citing_title":"$\\pi^{*}_{0.6}$: a VLA That Learns From Experience","ref_index":35,"is_internal_anchor":true},{"citing_arxiv_id":"2604.28192","citing_title":"LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning","ref_index":24,"is_internal_anchor":true}]},"formal_canon":{"evidence_count":2,"sample":[],"anchors":[]},"links":{"html":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY","json":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY.json","graph_json":"https://pith.science/api/pith-number/ABUITWGJPFUECEEDS6XA226RDY/graph.json","events_json":"https://pith.science/api/pith-number/ABUITWGJPFUECEEDS6XA226RDY/events.json","paper":"https://pith.science/paper/ABUITWGJ"},"agent_actions":{"view_html":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY","download_json":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY.json","view_paper":"https://pith.science/paper/ABUITWGJ","resolve_alias":"https://pith.science/api/pith-number/resolve?arxiv=2509.09674&json=true","fetch_graph":"https://pith.science/api/pith-number/ABUITWGJPFUECEEDS6XA226RDY/graph.json","fetch_events":"https://pith.science/api/pith-number/ABUITWGJPFUECEEDS6XA226RDY/events.json","actions":{"anchor_timestamp":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY/action/timestamp_anchor","attest_storage":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY/action/storage_attestation","attest_author":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY/action/author_attestation","sign_citation":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY/action/citation_signature","submit_replication":"https://pith.science/pith/ABUITWGJPFUECEEDS6XA226RDY/action/replication_record"}},"created_at":"2026-05-17T23:38:53.074722+00:00","updated_at":"2026-05-17T23:38:53.074722+00:00"}