REVIEW 7 cited by
ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical licensing exam. However, LLMs currently have difficulty processing images, making it challenging to interpret information from medical images, which are rich in information that supports clinical decisions. On the other hand, computer-aided diagnosis (CAD) networks for medical images have seen significant success in the medical field by using advanced deep-learning algorithms to support clinical decision-making. This paper presents a method for integrating LLMs into medical-image CAD networks. The proposed framework uses LLMs to enhance the output of multiple CAD networks, such as diagnosis networks, lesion segmentation networks, and report generation networks, by summarizing and reorganizing the information presented in natural language text format. The goal is to merge the strengths of LLMs' medical domain knowledge and logical reasoning with the vision understanding capability of existing medical-image CAD models to create a more user-friendly and understandable system for patients compared to conventional CAD systems. In the future, LLM's medical knowledge can be also used to improve the performance of vision-based medical-image CAD models.
Forward citations
Cited by 7 Pith papers
-
Enhancing Visual Reliance in Text Generation: A Bayesian Perspective on Mitigating Hallucination in Large Vision-Language Models
EVRB is a three-part inference-time method that prunes ambiguous visual tokens, divides the model's output distribution by a text-only prior, and triggers early stopping to reduce hallucination in LVLMs.
-
Grounding Chest X-Ray Visual Question Answering with Generated Radiology Reports
Feeding a model-generated radiology report as additional context improves chest X-ray visual question answering, setting a new state of the art on the Medical-Diff-VQA benchmark.
-
Extracting Visual Facts from Intermediate Layers for Mitigating Hallucinations in Multimodal Large Language Models
Selecting the intermediate layer where image-conditioned and text-only predictions diverge most, and adding that layer's contrastive visual signal back to the final logits, reduces object hallucinations in four large ...
-
TokenShapley: Token Level Context Attribution with Shapley Value
TokenShapley computes token-level Shapley attributions from context to response by treating context tokens as (prefix, token) data points in a KNN datastore.
-
BcQLM: Efficient Vision-Language Understanding with Distilled Q-Gated Cross-Modal Fusion
A roughly 1.2B-parameter VQA model with a distilled 31M CLIP encoder and Q-gated cross-attention reports accuracies comparable to 7B-13B baselines on GQA, VQAv2, and VizWiz.
-
MedGellan: LLM-Generated Medical Guidance to Support Physicians
LLM-generated, temporally ordered clinical guidance improves simulated physicians' recall and F1 on discharge diagnosis prediction, at the cost of precision.
-
Balancing Knowledge Delivery and Emotional Comfort in Healthcare Conversational Systems
Fine-tuning a 1B medical chatbot on LLM-rewritten emotional dialogues improves its emotion scores with only small changes in n-gram overlap with the original medical responses.
Discussion (0). Sign in to comment.