REVIEW 4 cited by
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Vision-Language Models for Medical Report Generation and Visual Question Answering: A Review
read the original abstract
Medical vision-language models (VLMs) combine computer vision (CV) and natural language processing (NLP) to analyze visual and textual medical data. Our paper reviews recent advancements in developing VLMs specialized for healthcare, focusing on models designed for medical report generation and visual question answering (VQA). We provide background on NLP and CV, explaining how techniques from both fields are integrated into VLMs to enable learning from multimodal data. Key areas we address include the exploration of medical vision-language datasets, in-depth analyses of architectures and pre-training strategies employed in recent noteworthy medical VLMs, and comprehensive discussion on evaluation metrics for assessing VLMs' performance in medical report generation and VQA. We also highlight current challenges and propose future directions, including enhancing clinical validity and addressing patient privacy concerns. Overall, our review summarizes recent progress in developing VLMs to harness multimodal medical data for improved healthcare applications.
Forward citations
Cited by 4 Pith papers
-
DentiAsk: A VQA Benchmark for Multimodal Reasoning in Panoramic Dental Radiographs
A 1,000-image, 10,000-QA dental VQA benchmark shows current VLMs handle descriptive recognition far better than spatial localization or numerical counting on panoramic radiographs.
-
Medical Report Generation: A Hierarchical Task Structure-Based Cross-Modal Causal Intervention Framework
HTSC-CIF applies hierarchical task decomposition and cross-modal causal intervention to generate medical reports from images while addressing domain knowledge, alignment, and bias challenges.
-
DobicVLM: Aligning Chest X-Ray Report Generation with Clinically-Grounded Programmatic Rewards via Group Relative Policy Optimization
A GRPO-tuned medical VLM using rule-based rewards reaches 27.2% expert acceptance for diagnostic impression accuracy on 69 CXR cases, barely beating its base model and clearly beating a generalist Gemini baseline.
-
Analysis of Blood Report Images Using General Purpose Vision-Language Models
Comparative evaluation of Qwen-VL-Max, Gemini 2.5 Pro, and Llama 4 Maverick on 100 blood report images using Sentence-BERT similarity indicates general-purpose VLMs show promise for preliminary patient-facing analysis.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.