{"arxiv_id":"2512.20276","title":"ActionFlow: A Pipelined Action Acceleration for Vision Language Models on Edge","abstract":"Vision-Language-Action (VLA) models have emerged as a unified paradigm for robotic perception and control, enabling emergent generalization and long-horizon task execution. However, their deployment in dynamic, real-world environments is severely hindered by high inference latency. While smooth robotic interaction requires control frequencies of 20-30 Hz, current VLA models typically operate at only 3-5 Hz on edge devices due to the memory-bound nature of autoregressive decoding. Existing optimizations often require extensive retraining or compromise model accuracy. To bridge this gap, we introduce ActionFlow, a system-level inference framework tailored for resource-constrained edge platforms. At the core of ActionFlow is a Cross-Request Pipelining strategy, a novel scheduler that redefines VLA inference as a macro-pipeline of micro-requests. The strategy intelligently batches memory-bound Decode phases with compute-bound Prefill phases across continuous time steps to maximize hardware utilization. Furthermore, to support this scheduling, we propose a Cross-Request State Packed Forward operator and a Unified KV Ring Buffer, which fuse fragmented memory operations into efficient dense computations. Experimental results demonstrate that ActionFlow achieves a 2.55x improvement in FPS on the OpenVLA-7B model without retraining, enabling real-time dynamic manipulation on edge hardware. Our work is available at https://github.com/Frankd35/Action-Flow.","primary_cat":"cs.AI","cross_cats":["cs.RO"],"submitted_at":"2025-12-23T11:29:03+00:00","latest_version":2,"source":"arxiv","source_label":"arXiv","source_url":null,"has_pdf":false,"has_source":false,"verdict":null,"confidence":null,"one_line_summary":null,"novelty_score":null,"correctness_risk":null,"formal_verification":null,"upvotes":0,"downvotes":0,"pith_score":0,"inbound_count":7,"_links":{"html":"https://pith.science/paper/2512.20276","verdict":"/api/v1/verdicts/2512.20276"}}