ExToken conditions VLA policies on discrete behavioral tokens from demos so RL explores more modes and converges faster under tight interaction budgets.

Summary. The manuscript investigates exploration stagnation in Vision-Language-Action (VLA) reinforcement fine-tuning and reports that trajectory diversity is more important for sample efficiency than the sheer quantity of rollouts. Motivated by this, it proposes ExToken: discrete behavioral priors (tokens) derived from offline demonstrations are used to condition the VLA policy during rollout collection so that different tokens induce different behavioral modes and improve state-action coverage. A state-conditioned token selector is then introduced to map states to effective tokens at deployment, bridging structured exploration in training with deterministic inference. The abstract claims consistent faster convergence, better task performance, and robustness under highly constrained interaction budgets on simulated and real robotic manipulation tasks.

Significance. If the investigation finding and the empirical results hold under standard experimental scrutiny, ExToken would address a genuine practical bottleneck—interaction cost—in RL fine-tuning of VLA policies for manipulation. A simple conditioning mechanism that improves coverage without large budgets, plus an explicit train–deploy bridge via a state-conditioned selector, would be of clear interest to robotics and embodied AI. The abstract also frames the work as a general framework rather than a narrow architecture tweak, which would increase impact if the free parameters (token definition, selector design) are shown to be robust. Significance cannot be confirmed from the abstract alone, because the load-bearing diversity finding, mode extraction, selector validation, and all quantitative results are not present in the available text.