Pith. sign in

REVIEW 14 cited by

Centaur: Robust End-to-End Autonomous Driving with Test-Time Training

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2503.11650 v1 pith:F23C3YXQ submitted 2025-03-14 cs.RO cs.AIcs.CVcs.LG

Centaur: Robust End-to-End Autonomous Driving with Test-Time Training

classification cs.RO cs.AIcs.CVcs.LG
keywords test-timetrainingcentaurclustercostentropyplanneruncertainty
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

How can we rely on an end-to-end autonomous vehicle's complex decision-making system during deployment? One common solution is to have a ``fallback layer'' that checks the planned trajectory for rule violations and replaces it with a pre-defined safe action if necessary. Another approach involves adjusting the planner's decisions to minimize a pre-defined ``cost function'' using additional system predictions such as road layouts and detected obstacles. However, these pre-programmed rules or cost functions cannot learn and improve with new training data, often resulting in overly conservative behaviors. In this work, we propose Centaur (Cluster Entropy for Test-time trAining using Uncertainty) which updates a planner's behavior via test-time training, without relying on hand-engineered rules or cost functions. Instead, we measure and minimize the uncertainty in the planner's decisions. For this, we develop a novel uncertainty measure, called Cluster Entropy, which is simple, interpretable, and compatible with state-of-the-art planning algorithms. Using data collected at prior test-time time-steps, we perform an update to the model's parameters using a gradient that minimizes the Cluster Entropy. With only this sole gradient update prior to inference, Centaur exhibits significant improvements, ranking first on the navtest leaderboard with notable gains in safety-critical metrics such as time to collision. To provide detailed insights on a per-scenario basis, we also introduce navsafe, a challenging new benchmark, which highlights previously undiscovered failure modes of driving models.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 14 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. Test-Time Coverage: Test-Conditioned Data Curation for Deployment-Aware Learning

    cs.AI 2026-07 conditional novelty 6.0

    TTCov curates training data for deployment by building an LLM-generated atomic-proposition atlas of the test distribution and greedily selecting clips that match it.

  2. Test-Time Trajectory Optimization for Autonomous Driving

    cs.RO 2026-06 unverdicted novelty 6.0

    TOAD applies test-time Cross-Entropy Method optimization to refine trajectories using the planner's scorer as a reward function, improving end-to-end autonomous driving performance without retraining.

  3. ChainFlow-VLA: Causal Flow Planning with Vision-Language Models

    cs.CV 2026-05 unverdicted novelty 6.0

    ChainFlow-VLA unifies autoregressive causal trajectory modes with VLM-conditioned diffusion refinement to reach 94.85 on NAVSIM v1, matching human performance.

  4. CLOVER: Closed-Loop Value Estimation and Ranking for End-to-End Autonomous Driving Planning

    cs.RO 2026-05 conditional novelty 6.0

    CLOVER is a closed-loop generator-scorer framework that expands proposal coverage with pseudo-expert trajectories and performs conservative self-distillation to achieve state-of-the-art planning scores on NAVSIM and nuScenes.

  5. GSDrive: Reinforcing Driving Policies by Multi-mode Future Trajectory Probing with 3D Gaussian Splatting Environment

    cs.RO 2026-04 unverdicted novelty 6.0

    GSDrive improves end-to-end driving policies through 3D Gaussian Splatting simulation and multi-mode trajectory probing that supplies dense, differentiable rewards for reinforcement learning.

  6. GSDrive: Reinforcing Driving Policies by Multi-mode Future Trajectory Probing with 3D Gaussian Splatting Environment

    cs.RO 2026-04 unverdicted novelty 6.0

    GSDrive combines IL priors with RL feedback by probing multi-mode futures inside a 3D Gaussian Splatting simulator to supply dense rewards for closed-loop driving policy improvement on nuScenes.

  7. ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving

    cs.CV 2026-04 unverdicted novelty 6.0

    ExploreVLA augments VLA driving models with future RGB and depth prediction for dense supervision and uses prediction uncertainty as a safety-gated intrinsic reward for RL-based exploration, reaching SOTA PDMS 93.7 on NAVSIM.

  8. Zero-Human Demonstration End-to-end Autonomous Driving with Trajectory Scorer

    cs.RO 2025-10 conditional novelty 6.0

    A reward-only offline RL method for trajectory planning in end-to-end autonomous driving achieves state-of-the-art on Navhard and competitive closed-loop HUGSIM performance without imitation learning.

  9. AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning

    cs.CV 2025-06 unverdicted novelty 6.0

    AutoVLA unifies semantic reasoning and trajectory planning in one autoregressive VLA model for end-to-end autonomous driving by tokenizing trajectories into discrete actions and using GRPO reinforcement fine-tuning to...

  10. HAD: Combining Hierarchical Diffusion with Metric-Decoupled RL for End-to-End Driving

    cs.RO 2026-04 conditional novelty 5.5

    Hierarchical diffusion plus polar structure-preserving expansion and metric-decoupled RL yields SOTA open- and closed-loop planning scores on NAVSIM and HUGSIM.

  11. CADET: Physics-Grounded Causal Auditing and Training-Free Deconfounding of End-to-End Driving Planners

    cs.RO 2026-06 unverdicted novelty 5.0

    CADET is a training-free framework for auditing, benchmarking, and repairing spurious correlations in pretrained end-to-end autonomous driving planners using physics-grounded causal methods.

  12. SparseWorld: Enhancing End-to-End Autonomous Driving via World Models with Sparse Scene Representation

    cs.CV 2026-05 unverdicted novelty 5.0

    SparseWorld is a sparse world model with a Sparse Dreamer module that performs autoregressive rollout of future instances to refine motion prediction and planning, reporting 0.05% collision rate on nuScenes open-loop metrics.

  13. ExploreVLA: Dense World Modeling and Exploration for End-to-End Autonomous Driving

    cs.CV 2026-04 unverdicted novelty 5.0

    Dense future RGB/depth world modeling both supervises a VLA planner and supplies safety-gated uncertainty rewards that, optimized with GRPO, reach 93.7 PDMS on NAVSIM.

  14. DeepSight: Long-Horizon World Modeling via Latent States Prediction for End-to-End Autonomous Driving

    cs.CV 2026-05 unverdicted novelty 4.0

    DeepSight uses parallel latent feature prediction in BEV for long-horizon world modeling and adaptive text reasoning to reach state-of-the-art closed-loop performance on the Bench2drive benchmark.