REVIEW 17 cited by
A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
A Survey on Mechanistic Interpretability for Multi-Modal Foundation Models
read the original abstract
The rise of foundation models has transformed machine learning research, prompting efforts to uncover their inner workings and develop more efficient and reliable applications for better control. While significant progress has been made in interpreting Large Language Models (LLMs), multimodal foundation models (MMFMs) - such as contrastive vision-language models, generative vision-language models, and text-to-image models - pose unique interpretability challenges beyond unimodal frameworks. Despite initial studies, a substantial gap remains between the interpretability of LLMs and MMFMs. This survey explores two key aspects: (1) the adaptation of LLM interpretability methods to multimodal models and (2) understanding the mechanistic differences between unimodal language models and crossmodal systems. By systematically reviewing current MMFM analysis techniques, we propose a structured taxonomy of interpretability methods, compare insights across unimodal and multimodal architectures, and highlight critical research gaps.
Forward citations
Cited by 17 Pith papers
-
FairFlow: Demystifying and Mitigating Stereotype Bias in Text-to-Image Diffusion Transformers
Bias in MM-DiTs is mediated by sparse stage-wise semantic binding hubs, and sparse inference-time steering at those hubs mitigates gender, race, and intersectional stereotypes with low overhead.
-
Who Wins the Conflict? Mechanistic Interpretability of Text Bias in Audio LLMs
Mechanistic tracing shows text suppresses but does not erase audio representations in late layers of Audio LLMs; back-patching reduces text dominance.
-
The physics of AI weather models
AI weather models may simulate the atmosphere via particle positions in latent space whose updates follow gradient flow on a learned free energy functional rather than conventional physical equations.
-
V-SEAM: Visual Semantic Editing and Attention Modulating for Causal Interpretability of Vision-Language Models
V-SEAM combines concept-level visual semantic editing with attention head modulation to identify positive and negative contributors across object, attribute, and relationship levels, then uses this to improve VLM perf...
-
Through the LENS: Local Geometric Decomposition of Vision-Language Model Representations
Local low-rank Gaussian neighborhoods in VLM residual streams reveal model-specific fusion trajectories and serve as causal steering and retrieval units.
-
Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs
CMA uses diffusion-generated counterfactuals and two-player Shapley values to measure whether an image or the text drives a multimodal LLM's prediction, hitting 98% on synthetic biased benchmarks.
-
Which Modality Decides? Counterfactual Modality Attribution for Multimodal LLMs
CMA uses diffusion-based counterfactuals and Shapley values to quantify how much of a multimodal LLM's prediction is driven by the image versus the text.
-
How Do VLMs Fail? Vision-Operation Misalignment in Compositional VQA
The paper proposes four operation-level VLM failure modes and a pathway dissociation, but the dissociation is not supported by the paper's own intervention statistics.
-
Unsupervised Features Mining via Activation Geometry
Prefix-induced activation shifts (MAG) yield model-relative reasoning directions that predict verdicts, support matched-format steering, and select transfer datasets at 94.7% Top-1 accuracy.
-
Beyond Text-Dominance: Understanding Modality Preference of Omni-modal Large Language Models
Omni-modal LLMs exhibit visual preference that emerges in mid-to-late layers, enabling hallucination detection without task-specific training.
-
Characterize Then Distill: Mechanistic Reasoning in Large Output Spaces
Reasoning in large output spaces proceeds via shortlisting then fine-grained reasoning; this characterization enables a mechanistic distillation strategy that outperforms standard distillation.
-
Do Factual Recall Mechanisms Carry over from Text to Speech in Multimodal Language Models?
Causal mediation analysis on SpiritLM reveals discrepancies in factual recall between text-to-text and speech-to-text paths, indicating only partial carry-over of mechanisms from text to speech modality.
-
SimReg: Achieving Higher Performance in the Pretraining via Embedding Similarity Regularization
SimReg regularization accelerates LLM pretraining convergence by over 30% and raises average zero-shot performance by over 1% across benchmarks.
-
From Heads to Neurons: Causal Attribution and Steering in Multi-Task Vision-Language Models
HONES ranks feed-forward neurons by their causal contributions from task-relevant attention heads and uses lightweight scaling to steer performance on multiple vision-language tasks.
-
Wearable AI in the Era of Large Sensor Models
Large Sensor Models trained on large-scale multimodal wearable data can provide a scalable, general framework for wearable AI by learning transferable representations across modalities and tasks.
-
Locate, Steer, and Improve: A Practical Survey of Actionable Mechanistic Interpretability in Large Language Models
The survey organizes mechanistic interpretability techniques into a Locate-Steer-Improve framework to enable actionable improvements in LLM alignment, capability, and efficiency.
-
LLM-Powered AI Agent Systems and Their Applications in Industry
A survey categorizing LLM-powered agent systems into software-based, physical, and hybrid types, covering industrial applications and challenges such as latency and security.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.