REVIEW 12 cited by
Improving Medical Large Vision-Language Models with Abnormal-Aware Feedback
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Existing Medical Large Vision-Language Models (Med-LVLMs), encapsulating extensive medical knowledge, demonstrate excellent capabilities in understanding medical images. However, there remain challenges in visual localization in medical images, which is crucial for abnormality detection and interpretation. To address these issues, we propose a novel UMed-LVLM designed to unveil medical abnormalities. Specifically, we collect a Medical Abnormalities Unveiling (MAU) dataset and propose a two-stage training method for UMed-LVLM training. To collect MAU dataset, we propose a prompt method utilizing the GPT-4V to generate diagnoses based on identified abnormal areas in medical images. Moreover, the two-stage training method includes Abnormal-Aware Instruction Tuning and Abnormal-Aware Rewarding, comprising Relevance Reward, Abnormal Localization Reward and Vision Relevance Reward. Experimental results demonstrate that our UMed-LVLM significantly outperforms existing Med-LVLMs in identifying and understanding medical abnormalities, achieving a 58% improvement over the baseline. In addition, this work shows that enhancing the abnormality detection capabilities of Med-LVLMs significantly improves their understanding of medical images and generalization capability.
Forward citations
Cited by 12 Pith papers
-
VT-LVLM-AR: A Video-Temporal Large Vision-Language Model Adapter for Fine-Grained Action Recognition in Long-Term Videos
VT-LVLM-AR converts video into quantized 'visual event sentences' and classifies actions with a frozen LLaVA-1.5 using prompt tuning, claiming 94.1% on NTU RGB+D X-Sub.
-
Context-Adaptive Synthesis and Compression for Enhanced Retrieval-Augmented Generation in Complex Domains
CASC uses a fine-tuned Llama-2-7B to extract, de-conflict, and structure retrieved contexts, reporting higher F1 and lower hallucination than RAG baselines on the new SciDocs-QA benchmark.
-
Multi-Level LVLM Guidance for Untrimmed Video Action Recognition
The paper proposes ECVT, a transformer that uses LVLM-generated text prompts to guide action localization, and reports state-of-the-art results that it itself describes as fabricated.
-
DocRefine: An Intelligent Framework for Scientific Document Understanding and Content Optimization based on Multimodal Large Model Agents
A multi-agent GPT-4o framework for editing scientific PDFs reports higher semantic consistency, layout fidelity, and instruction adherence than three baselines on DocEditBench.
-
LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generation
An LVLM-driven iterative text-to-image framework whose claimed performance scores are explicitly labeled fictitious, so no empirical result is established.
-
CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs
CIMR, an iterative reasoning wrapper around LLaVA-1.5-7B, reports 91.5% task completion on a newly constructed but unreleased synthetic MAP dataset, above GPT-4V at 89.2%.
-
LVLM-Composer's Explicit Planning for Image Generation
An image generation model that explicitly plans objects, attributes, locations, and relations before synthesizing the image, with reported gains on LongBench-T2I that cannot be verified from the paper.
-
Enhancing Factual Accuracy and Citation Generation in LLMs via Multi-Stage Self-Verification
The paper proposes a four-stage self-verification prompting method but explicitly labels its experimental results as fabricated, so it cannot support its claimed gains.
-
Leveraging Vision-Language Large Models for Interpretable Video Action Recognition with Semantic Tokenization
LVLM-VAR transforms video into 'semantic action tokens' and uses a LoRA-tuned vision-language model to classify actions and generate explanations, reporting 94.1% on NTU RGB+D X-Sub.
-
Context-Aware Multi-Turn Visual-Textual Reasoning in LVLMs via Dynamic Memory and Adaptive Visual Guidance
The proposed CAMVR framework is not supported by verifiable evidence, and the manuscript itself labels its experimental results as fabricated.
-
Unlocking Compositional Control: Self-Supervision for LVLM-Based Image Generation
Hi-SSLVLM combines hierarchical self-captioning, internal sub-prompt planning, and a CLIP-based consistency loss, and reports judged compositional fidelity gains of roughly 0.04 to 0.09 points that no significance tes...
-
Large Language Models for Zero-Shot Multicultural Name Recognition
A prompt-tuned LLM with data augmentation and cultural context prompts reportedly recognizes multicultural names at 93.1% accuracy and unseen names at 89.5%, but the evidence is not reproducible.
Discussion (0). Sign in to comment.