Pith. sign in

REVIEW 9 cited by

Chain of Thought Prompt Tuning in Vision Language Models

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2304.07919 v2 pith:PXCPNLVF submitted 2023-04-16 cs.CV cs.AI

Jiaxin Ge , Hongyin Luo , Siyuan Qian , Yulu Gan , Jie Fu , Shanghang Zhang This is my paper · ORCID
classification cs.CVcs.AI
keywords chainreasoningtasksthoughtvisuallanguageprompttuning
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

Language-Image Pre-training has demonstrated promising results on zero-shot and few-shot downstream tasks by prompting visual models with natural language prompts. However, most recent studies only use a single prompt for tuning, neglecting the inherent step-to-step cognitive reasoning process that humans conduct in complex task settings, for example, when processing images from unfamiliar domains. Chain of Thought is a simple and effective approximation to human reasoning process and has been proven useful for natural language processing (NLP) tasks. Based on this cognitive intuition, we believe that conducting effective reasoning is also an important problem in visual tasks, and a chain of thought could be a solution to this problem. In this work, we propose a novel chain of thought prompt tuning for vision-language modeling. Extensive experiments show that our method not only generalizes better in image classification tasks, has greater transferability beyond a single dataset, and has stronger domain generalization performance, but also performs much better in imagetext retrieval and visual question answering, which require more reasoning capabilities. We are the first to successfully adapt chain-of-thought prompting that combines visual and textual embeddings. We will release our codes

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 9 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Can Vision-Language Models Assess Proxemic Risk from Egocentric Robot Images?

    cs.CV 2026-08 conditional novelty 5.0 of 10

    Vision-language models classify proxemic danger in egocentric robot images only slightly better than random, except Qwen-VL which detects high-danger scenes with high recall that is not tied to accurate person localization.

  2. AVA-VLM: Adaptive Visual Attention-Vision Language Model for In-the-Wild Construction Site Monitoring

    cs.CV 2026-07 conditional novelty 5.0 of 10

    AVA-VLM reduces visual-token usage by 69% while improving PPE-violation F1 by 13 points over direct-QA baselines by training a VLM to adaptively crop high-resolution local regions from a downsampled global image.

  3. Salience Adjustment for Context-Based Emotion Recognition

    cs.CV 2025-07 conditional novelty 5.0 of 10

    A salience-weighted Bayesian cue integration formula improves automated emotion recognition on the Split-Steal corpus, but the weighting is fit to the evaluation set and no held-out validation is provided.

  4. Argus: Vision-Centric Reasoning with Grounded Chain-of-Thought

    cs.CV 2025-05 conditional novelty 5.0 of 10

    Argus adds explicit language-guided visual attention to multimodal LLMs by grounding questions to bounding boxes and re-engaging those regions, improving vision-centric reasoning and grounding accuracy.

  5. Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models

    cs.CV 2025-05 conditional novelty 4.0 of 10

    A survey organizes multimodal reasoning research into a staged roadmap and proposes native large multimodal reasoning models that unify perception, generation, and agentic planning.

  6. XiHeFusion: Harnessing Large Language Models for Science Communication in Nuclear Fusion

    cs.CV 2025-02 reject novelty 4.0 of 10

    XiHeFusion is a Qwen2.5-14B model fine-tuned on 1.2 million fusion knowledge pairs to answer nuclear fusion questions for science communication.

  7. Explainability for Vision Foundation Models: A Survey

    cs.CV 2025-01 conditional novelty 4.0 of 10

    A structured review of 122 papers on explainability for vision foundation models, with a taxonomy and the finding that quantitative evaluation is rare (36%).

  8. A Review of Multimodal Explainable Artificial Intelligence: Past, Present and Future

    cs.CV 2024-12 conditional novelty 4.0 of 10

    A historical review that organizes multimodal explainability methods into four chronological eras and three explainability types, extending coverage to generative LLMs.

  9. Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey

    cs.CL 2024-12 conditional novelty 4.0 of 10

    A survey maps the field of MLLM explainability and interpretability into data, model, and training and inference perspectives.

Pith tools