Pith. sign in

REVIEW 10 cited by

Vision Language Models in Autonomous Driving: A Survey and Outlook

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2310.14414 v2 pith:U6JNUKXX submitted 2023-10-22 cs.CV cs.AI

Xingcheng Zhou , Mingyu Liu , Ekim Yurtsever , Bare Luka Zagar , Walter Zimmer , Hu Cao , Alois C. Knoll This is my paper · ORCID
classification cs.CVcs.AI
keywords drivingautonomouslanguagemodelsapplicationscurrentdatasurvey
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD) have attracted widespread attention due to their outstanding performance and the ability to leverage Large Language Models (LLMs). By incorporating language data, driving systems can gain a better understanding of real-world environments, thereby enhancing driving safety and efficiency. In this work, we present a comprehensive and systematic survey of the advances in vision language models in this domain, encompassing perception and understanding, navigation and planning, decision-making and control, end-to-end autonomous driving, and data generation. We introduce the mainstream VLM tasks in AD and the commonly utilized metrics. Additionally, we review current studies and applications in various areas and summarize the existing language-enhanced autonomous driving datasets thoroughly. Lastly, we discuss the benefits and challenges of VLMs in AD and provide researchers with the current research gaps and future trends.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 10 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Sparse Neuron Ablation Triggers Catastrophic Collapse of the Language Core in Large Vision-Language Models

    cs.AI 2025-11 conditional novelty 5.0 of 10

    Ablating just four neurons in LLaVA-1.5-7b's language-model down-projection layer triggers complete output collapse, with critical neurons concentrated in the language backbone.

  2. BlueGlass: A Framework for Composite AI Safety

    cs.AI 2025-07 conditional novelty 5.0 of 10

    BlueGlass provides composite AI safety infrastructure; its case studies on object-detection VLMs reveal dataset trade-offs, a decoder-layer phase transition in probe accuracy, and SAE-discovered concepts including spu...

  3. H-MBA: Hierarchical MamBa Adaptation for Multi-Modal Video Understanding in Autonomous Driving

    cs.CV 2025-01 conditional novelty 5.0 of 10

    A hierarchical Mamba adapter (C-Mamba and Q-Mamba) improves multimodal LLM video understanding in autonomous driving, achieving SOTA 66.9% mIoU on DRAMA risk localization.

  4. Large Language Models (LLMs) as Traffic Control Systems at Urban Intersections: A New Paradigm

    cs.CL 2024-11 conditional novelty 5.0 of 10

    A fine-tuned GPT-4o-mini detects conflicts in synthetic four-leg intersection scenarios with 83% accuracy and produces traffic-management text with high ROUGE-L scores against the simulator's templated references.

  5. IKIWISI: An Interactive Visual Pattern Generator for Evaluating the Reliability of Vision-Language Models Without Ground Truth

    cs.CV 2025-05 conditional novelty 4.0 of 10

    A visual heatmap tool lets people rate vision-language model reliability in video by inspecting patterns of green and red cells, with user ratings tracking objective F1 scores when those exist.

  6. Gaussian Splatting Under Attack: Investigating Adversarial Noise in 3D Objects

    cs.CV 2024-12 conditional novelty 4.0 of 10

    M-IFGSM, a masked iterative FGSM attack on CLIP, reduces top-1 accuracy to 12.5% on training renders and 35.4% on test renders of 3D Gaussian Splatting models.

  7. Image Segmentation with Large Language Models: A Survey with Perspectives for Intelligent Transportation Systems

    cs.CV 2025-06 reject novelty 3.0 of 10

    A survey that organizes vision-language segmentation methods for intelligent transportation, but its synthesis is undermined by fabricated references and unverifiable benchmarks.

  8. Visual Large Language Models for Generalized and Specialized Applications

    cs.CV 2025-01 conditional novelty 3.0 of 10

    This paper reviews and taxonomizes VLLM applications into vision-to-text, vision-to-action, and text-to-vision, adding ethics and future-work discussion.

  9. Vision-Language Models for Edge Networks: A Comprehensive Survey

    cs.CV 2025-02 reject novelty 2.0 of 10

    A survey of lightweight vision-language models for edge deployment, marred by citation errors, self-citation, and a lack of selection methodology.

  10. Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions

    eess.SY 2025-01 conditional novelty 2.0 of 10

    The paper surveys recent work, models, applications, and challenges of using LLMs in intelligent transportation systems, without presenting new experimental results.

Pith tools