Pith. sign in

REVIEW 45 cited by

Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillation

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.07503 v2 pith:JW23WX3T submitted 2024-05-13 cs.RO cs.AI

Consistency Policy: Accelerated Visuomotor Policies via Consistency Distillation

classification cs.RO cs.AI
keywords policyconsistencydiffusioninferencepretrainedtasksvisuomotoralternative
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

Many robotic systems, such as mobile manipulators or quadrotors, cannot be equipped with high-end GPUs due to space, weight, and power constraints. These constraints prevent these systems from leveraging recent developments in visuomotor policy architectures that require high-end GPUs to achieve fast policy inference. In this paper, we propose Consistency Policy, a faster and similarly powerful alternative to Diffusion Policy for learning visuomotor robot control. By virtue of its fast inference speed, Consistency Policy can enable low latency decision making in resource-constrained robotic setups. A Consistency Policy is distilled from a pretrained Diffusion Policy by enforcing self-consistency along the Diffusion Policy's learned trajectories. We compare Consistency Policy with Diffusion Policy and other related speed-up methods across 6 simulation tasks as well as three real-world tasks where we demonstrate inference on a laptop GPU. For all these tasks, Consistency Policy speeds up inference by an order of magnitude compared to the fastest alternative method and maintains competitive success rates. We also show that the Conistency Policy training procedure is robust to the pretrained Diffusion Policy's quality, a useful result that helps practioners avoid extensive testing of the pretrained model. Key design decisions that enabled this performance are the choice of consistency objective, reduced initial sample variance, and the choice of preset chaining steps.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 45 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Test-time Adversarial Takeover: A Real-time Hijacking Interface against Robotic Diffusion Policies

    cs.RO 2026-06 unverdicted novelty 8.0

    TAKO demonstrates real-time adversarial takeover of robotic diffusion policies via reusable universal patches on visual inputs, achieving 100% success in steering attacker-chosen trajectories across multiple tasks, en...

  2. The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks

    cs.RO 2026-06 unverdicted novelty 7.0

    TISED framework reveals paradoxical effects where inference optimizations can lengthen task completion time on static tasks or raise success rates on dynamic tasks in embodied AI.

  3. Action-Prior Denoising for Smooth Real-Time Chunking

    cs.RO 2026-05 unverdicted novelty 7.0

    Soft RTC uses partially denoised states for overlap tokens and token-wise blending to reduce action delta and jerk by ~9% versus hard RTC while matching solve rates on Kinetix levels.

  4. EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control

    cs.RO 2026-05 conditional novelty 7.0

    EvoScene-VLA maintains an action-updated scene prior across control chunks in VLA policies, raising success rates on RoboTwin tasks from 87.2% to 89.1% fixed and 86.1% to 88.5% randomized while outperforming baselines...

  5. DSSP: Diffusion State Space Policy with Full-History Encoding

    cs.RO 2026-05 conditional novelty 7.0

    DSSP is a history-conditioned diffusion state space policy that uses SSMs to encode full observation streams with an auxiliary dynamics objective and hierarchical fusion, achieving SOTA results with reduced model size...

  6. Test-time Sparsity for Extreme Fast Action Diffusion

    cs.CV 2026-05 unverdicted novelty 7.0

    Test-time sparsity with a parallel pipeline and omnidirectional feature reuse accelerates action diffusion by 5x to 47.5 Hz while cutting FLOPs 92% with no performance loss.

  7. Muninn: Your Trajectory Diffusion Model But Faster

    cs.RO 2026-05 unverdicted novelty 7.0

    Muninn accelerates diffusion trajectory planners up to 4.6x by spending an uncertainty budget to decide when to cache denoiser outputs, preserving performance and certifying bounded deviation from full computation.

  8. Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control

    cs.RO 2026-05 unverdicted novelty 7.0

    HDP3 is a pocket-scale 3D diffusion policy with a Diffusion Mixer decoder that achieves state-of-the-art visuomotor control using two-step DDIM inference and under 1% of the parameters of prior 3D diffusion policies.

  9. Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control

    cs.RO 2026-05 conditional novelty 7.0

    Frequency analysis of smooth robot actions bounds denoising error to low-frequency modes, enabling a sub-1% parameter 3D diffusion policy with two-step inference that reaches SOTA on manipulation benchmarks.

  10. MISTY: High-Throughput Motion Planning via Mixer-based Single-step Drifting

    cs.RO 2026-04 unverdicted novelty 7.0

    MISTY delivers state-of-the-art closed-loop scores on nuPlan Test14-hard (80.32 non-reactive, 82.21 reactive) at 10.1 ms latency via single-step MLP-Mixer inference and a latent drifting loss that encourages proactive...

  11. You've Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector

    cs.RO 2026-03 conditional novelty 7.0

    Optimizing a single constant initial noise vector for frozen generative robot policies improves success rates on 38 of 43 tasks by up to 58% relative improvement.

  12. Information Filtering via Variational Regularization for Robot Manipulation

    cs.RO 2026-01 unverdicted novelty 7.0

    Variational Regularization imposes an adaptive information bottleneck on noisy intermediate features in DP3-UNet and DP3-DiT policies, consistently raising task success rates on RoboTwin2.0, Adroit, and MetaWorld whil...

  13. Spatial Attention: Adapting Execution Horizons for Diffusion Policies via Observation Sensitivity

    cs.RO 2026-07 conditional novelty 6.5

    Under a fixed sampling budget, execution horizons that minimize disturbance-induced likelihood drop should shorten as Spatial Attention rises; forecasting it yields higher success rates than fixed horizons.

  14. FA-RDP: A Frequency-Adaptive Reactive Diffusion Policy for Contact-Rich Manipulation

    cs.RO 2026-07 conditional novelty 6.0

    A shared visual-force diffusion policy with a multimodality indicator and manifold consistency distillation raises contact-rich task success to 81.7% while keeping diverse pre-contact modes.

  15. SegDiff: Segmented Trajectory Diffusion for Consistent and Adaptive Robot Manipulation

    cs.RO 2026-07 conditional novelty 6.0

    SegDiff predicts continuous trajectories anchored to the next keypose and uses DDIM inversion for dynamic temporal ensembling, outperforming continuous and keypose baselines on RLBench, RoboMimic, and five real tasks.

  16. High-Fidelity One-Step Generative Visuomotor Policy via Recursive Correction, Frequency Consistency, and Contrastive Flow Matching

    cs.RO 2026-07 conditional novelty 6.0

    One-step flow-matching visuomotor policy with recursive correction, dual-timestep spectral consistency, and contrastive mode separation matches or exceeds 10-step baselines at 1 NFE.

  17. Chronos: A Physics-Informed Full-History Framework for Non-Markovian Long-Horizon Manipulation

    cs.RO 2026-06 unverdicted novelty 6.0

    Chronos elevates full observation history to the policy's latent state via selective SSM tokens and a Schrödinger-inspired acceleration bridge, achieving large gains on memory-dependent robot tasks with fewer parameters.

  18. The Speedup Paradox: Rethinking Inference Speed-Quality Trade-off in Embodied Tasks

    cs.RO 2026-06 unverdicted novelty 6.0

    TISED decomposes inference optimization effects on embodied tasks and identifies paradoxical outcomes where faster per-step inference can increase task completion time on static tasks or raise success rates on dynamic tasks.

  19. ARP: Enhancing Quantized Skill Abstractions via Visual Alignment and Iterative Refinement for Robotic Manipulation

    cs.RO 2026-06 unverdicted novelty 6.0

    ARP enhances quantized skill abstractions in imitation learning by coupling visual grounding via contrastive alignment with execution refinement via IRH, reporting SOTA results on LIBERO, Meta-World, and real-robot tasks.

  20. CoRDE: Concept-Prior Routed Diffusion Experts for Structural Generalization in Robot Manipulation

    cs.RO 2026-06 unverdicted novelty 6.0

    CoRDE uses concept-prior variational distillation and LoRA-based expert pools to route diffusion models for structurally generalizable robot manipulation policies.

  21. Implicit Drifting Policy: One-Step Action Generation via Conditional Expert Geometry

    cs.RO 2026-05 unverdicted novelty 6.0

    IDP generates one-step robot actions by adaptively weighting a scalar potential objective using conditional expert geometry derived from local variations of observation-similar expert actions, combined with expert-pro...

  22. Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control

    cs.RO 2026-05 unverdicted novelty 6.0

    Hydra-DP3 is a lightweight 3D diffusion policy that uses frequency analysis of smooth action trajectories to enable two-step DDIM inference and achieves state-of-the-art results with under 1% of prior parameters.

  23. Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control

    cs.RO 2026-05 unverdicted novelty 6.0

    Hydra-DP3 achieves SOTA visuomotor performance with under 1% of prior 3D diffusion policy parameters by using frequency analysis to justify a lightweight decoder and two-step DDIM inference.

  24. VADF: Vision-Adaptive Diffusion Policy Framework for Efficient Robotic Manipulation

    cs.RO 2026-04 unverdicted novelty 6.0

    VADF adds an Adaptive Loss Network for hard-negative training sampling and a Hierarchical Vision Task Segmenter for adaptive noise scheduling during inference to speed convergence and reduce timeouts in diffusion robo...

  25. SnapFlow: One-Step Action Generation for Flow-Matching VLAs via Progressive Self-Distillation

    cs.CV 2026-04 unverdicted novelty 6.0

    SnapFlow compresses multi-step denoising in flow-matching VLAs into one step via progressive self-distillation using two-step Euler shortcuts from marginal velocities, matching 10-step teacher success rates with 9.6x ...

  26. You've Got a Golden Ticket: Improving Generative Robot Policies With A Single Noise Vector

    cs.RO 2026-03 unverdicted novelty 6.0

    A single constant initial noise vector found by Monte-Carlo search improves frozen diffusion and flow-matching robot policies on 46 of 51 tasks, by up to 55% absolute success rate.

  27. SeedPolicy: Horizon Scaling via Self-Evolving Diffusion Policy for Robot Manipulation

    cs.RO 2026-03 conditional novelty 6.0

    Adding a recurrent, gated cross-attention memory to Diffusion Policy improves long-horizon robot manipulation success by keeping a compact evolving state instead of stacking more observation frames.

  28. SeedPolicy: Horizon Scaling via Self-Evolving Diffusion Policy for Robot Manipulation

    cs.RO 2026-03 conditional novelty 6.0

    SeedPolicy introduces self-evolving gated attention to extend the temporal horizon of diffusion policies, yielding 36.8% and 169% relative gains over standard DP on clean and randomized RoboTwin 2.0 tasks.

  29. TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Control

    cs.RO 2026-01 conditional novelty 6.0

    TIDAL raises VLA control feedback from ~2.4 Hz to ~9 Hz by caching semantic intent and interleaving one-step flow generation with execution, doubling dynamic interception success in simulation.

  30. DASIP: Dynamic Test-Time Compute Scaling for Robot Control with Stochastic Interpolant Policies

    cs.RO 2025-11 reject novelty 6.0

    A difficulty classifier adaptively selects step count, solver, and ODE/SDE mode for stochastic-interpolant robot policies, reporting 2.6–4.4x compute savings with roughly unchanged success rates.

  31. R2RGEN: Real-to-Real 3D Data Generation for Spatially Generalized Manipulation

    cs.RO 2025-10 unverdicted novelty 6.0

    R2RGen introduces a simulator-free three-stage pipeline that parses, augments, and post-processes real pointcloud observation-action pairs to improve spatial generalization in robotic manipulation policies.

  32. Real-Time Execution of Action Chunking Flow Policies

    cs.RO 2025-06 unverdicted novelty 6.0

    Real-time chunking (RTC) allows diffusion- and flow-based action chunking policies to execute smoothly and asynchronously, maintaining high success rates on dynamic tasks even with significant inference latency.

  33. HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model

    cs.CV 2025-03 unverdicted novelty 6.0

    HybridVLA unifies diffusion and autoregression in a single VLA model via collaborative training and ensemble to raise robot manipulation success rates by 14% in simulation and 19% in real-world tasks.

  34. DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control

    cs.RO 2025-02 unverdicted novelty 6.0

    DexVLA combines a scaled diffusion action expert with embodiment curriculum learning to achieve better generalization and performance than prior VLA models on diverse robot hardware and long-horizon tasks.

  35. RoamFlow: Reinforcement-Aligned One-Step Action MeanFlow Policy for Image-Goal Navigation

    cs.RO 2026-06 unverdicted novelty 5.0

    RoamFlow applies MeanFlow to predict average velocity fields for one-step action policies in image-goal navigation, trained via expert imitation followed by RL refinement.

  36. MirrorDuo: Reflection-Consistent Visuomotor Learning from Mirrored Demonstration Pairs

    cs.RO 2026-06 unverdicted novelty 5.0

    MirrorDuo augments demonstration data via reflection to improve behavior cloning and diffusion policies, enabling better performance or cross-side transfer with limited demos.

  37. Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination

    cs.RO 2026-06 unverdicted novelty 5.0

    Efficient-WAM delivers 30x lower latency than prior WAMs at 100 ms per chunk while keeping competitive manipulation performance by treating coarse future video as guidance rather than high-fidelity output.

  38. BORA: Bridging Offline Reinforcement Learning and Online Residual Adaptation for Real-World Dexterous VLA Models

    cs.RO 2026-05 unverdicted novelty 5.0

    BORA combines offline RL critic training with online chunk-wise residual adaptation to raise average success rates of real-world dexterous VLA policies by 33% and up to 43% on unseen objects across five tasks.

  39. FocalPolicy: Frequency-Optimized Chunking and Locally Anchored Flow Matching for Coherent Visuomotor Policy

    cs.RO 2026-05 unverdicted novelty 5.0

    FocalPolicy introduces frequency-optimized chunking and locally anchored flow matching with a foresight composite objective to reduce inter-chunk discontinuities in visuomotor policies.

  40. FocalPolicy: Frequency-Optimized Chunking and Locally Anchored Flow Matching for Coherent Visuomotor Policy

    cs.RO 2026-05 unverdicted novelty 5.0

    FocalPolicy introduces frequency-optimized chunking and locally anchored flow matching with a foresight composite objective to improve inter-chunk coherence in visuomotor policies for manipulation tasks.

  41. Sparse ActionGen: Accelerating Diffusion Policy with Real-time Pruning

    cs.RO 2026-01 unverdicted novelty 5.0

    Sparse ActionGen accelerates diffusion policies up to 4x for robot control via rollout-adaptive pruning and zig-zag activation reuse without performance loss.

  42. SeFA-Policy: Fast and Accurate Visuomotor Policy Learning with Selective Flow Alignment

    cs.RO 2025-11 conditional novelty 5.0

    Selective Flow Alignment replaces reflow-generated actions with nearby expert actions during training, yielding a one-step flow policy that beats diffusion baselines on 66 simulated and 7 real tasks.

  43. ConsistencyPlanner: Real-time Planning with Fast-Sampling Consistency Models

    cs.RO 2026-06 unverdicted novelty 4.0

    ConsistencyPlanner applies fast-sampling consistency models for efficient multimodal trajectory generation and attention-based heterogeneous feature fusion to achieve superior safety in Waymax driving simulations.

  44. OmniVLA-RL: A Vision-Language-Action Model with Spatial Understanding and Online RL

    cs.RO 2026-04 unverdicted novelty 4.0

    OmniVLA-RL uses a mix-of-transformers architecture and flow-matching reformulated as SDE with group segmented policy optimization to surpass prior VLA models on LIBERO benchmarks.

  45. Cosmos World Foundation Model Platform for Physical AI

    cs.CV 2025-01 unverdicted novelty 3.0

    The Cosmos platform supplies open-source pre-trained world models and supporting tools for building fine-tunable digital world simulations to train Physical AI.