CoLT replaces text chain-of-thought in multimodal LLMs with three supervised latent vectors, improving average accuracy from 75.7 to 79.1 across eight benchmarks while cutting text-decoding time 22.6x.
MedSynapse-V: Bridging Visual Perception and Clinical Intuition via Latent Memory Evolution
3 Pith papers cite this work. Polarity classification is still indexing.
abstract
High-precision medical diagnosis relies not only on static imaging features but also on the implicit diagnostic memory experts instantly invoke during image interpretation. We pinpoint a fundamental cognitive misalignment in medical VLMs caused by discrete tokenization, leading to quantization loss, long-range information dissipation, and missing case-adaptive expertise. To bridge this gap, we propose ours, a framework for latent diagnostic memory evolution that simulates the experiential invocation of clinicians by dynamically synthesizing implicit diagnostic memories within the model's hidden stream. Specifically, it begins with a Meta Query for Prior Memorization mechanism, where learnable probes retrieve structured priors from an anatomical prior encoder to generate condensed implicit memories. To ensure clinical fidelity, we introduce Causal Counterfactual Refinement (CCR), which leverages reinforcement learning and counterfactual rewards derived from region-level feature masking to quantify the causal contribution of each memory, thereby pruning redundancies and aligning latent representations with diagnostic logic. This evolutionary process culminates in Intrinsic Memory Transition (IMT), a privileged-autonomous dual-branch paradigm that internalizes teacher-branch diagnostic patterns into the student-branch via full-vocabulary divergence alignment. Comprehensive empirical evaluations across multiple datasets demonstrate that ours, by transferring external expertise into endogenous parameters, significantly outperforms existing state-of-the-art methods, particularly chain-of-thought paradigms, in diagnostic accuracy. The code is available at https://github.com/zhcz328/MedSynapse-V.
fields
cs.CV 3years
2026 3representative citing papers
Proposes TopoAgent, an LLM agent framework that automatically selects and configures topological descriptors from persistent homology for medical image analysis without task-specific training.
Deformba introduces context-adaptive state fusion to vision SSMs for better spatial augmentation and cross-stream interactions, showing strong results on 2D classification/detection/segmentation and 3D BEV perception benchmarks.
citing papers explorer
-
CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts
CoLT replaces text chain-of-thought in multimodal LLMs with three supervised latent vectors, improving average accuracy from 75.7 to 79.1 across eight benchmarks while cutting text-decoding time 22.6x.
-
TopoAgent: An Agentic Framework for Automated Topology Learning in Medical Imaging
Proposes TopoAgent, an LLM agent framework that automatically selects and configures topological descriptors from persistent homology for medical image analysis without task-specific training.
-
Deformba: Vision State Space Model with Adaptive State Fusion
Deformba introduces context-adaptive state fusion to vision SSMs for better spatial augmentation and cross-stream interactions, showing strong results on 2D classification/detection/segmentation and 3D BEV perception benchmarks.