Pith. sign in

REVIEW 5 cited by

The LLM Language Network: A Neuroscientific Approach for Identifying Causally Task-Relevant Units

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2411.02280 v2 pith:TPP7ZCJA submitted 2024-11-04 cs.CL cs.LG

Badr AlKhamissi , Greta Tuckute , Antoine Bosselut , Martin Schrimpf This is my paper · ORCID
classification cs.CLcs.LG
keywords languageunitsllmsbrainlanguage-selectivemodelstasksapproach
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Large language models (LLMs) exhibit remarkable capabilities on not just language tasks, but also various tasks that are not linguistic in nature, such as logical reasoning and social inference. In the human brain, neuroscience has identified a core language system that selectively and causally supports language processing. We here ask whether similar specialization for language emerges in LLMs. We identify language-selective units within 18 popular LLMs, using the same localization approach that is used in neuroscience. We then establish the causal role of these units by demonstrating that ablating LLM language-selective units -- but not random units -- leads to drastic deficits in language tasks. Correspondingly, language-selective LLM units are more aligned to brain recordings from the human language system than random units. Finally, we investigate whether our localization method extends to other cognitive domains: while we find specialized networks in some LLMs for reasoning and social capabilities, there are substantial differences among models. These findings provide functional and causal evidence for specialization in large language models, and highlight parallels with the functional organization in the brain.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Reward Valuation in Vision Language Models: Causal Mechanisms Underlying Anhedonia

    cs.LG 2026-07 conditional novelty 6.5 of 10

    Targeted perturbation of reward-anticipatory units in VLMs induces anhedonia-like effort avoidance and clinical-scale score drops without impairing baseline task competence.

  2. Disjoint Processing Mechanisms of Hierarchical and Linear Grammars in Large Language Models

    cs.CL 2025-01 conditional novelty 6.0 of 10

    Pretrained LLMs use largely disjoint neuron sets for hierarchical versus linear grammaticality judgments, and hierarchical-selective neurons transfer to nonsense-word grammars.

  3. Sparse Neuron Ablation Triggers Catastrophic Collapse of the Language Core in Large Vision-Language Models

    cs.AI 2025-11 conditional novelty 5.0 of 10

    Ablating just four neurons in LLaVA-1.5-7b's language-model down-projection layer triggers complete output collapse, with critical neurons concentrated in the language backbone.

  4. Enhancing Chain-of-Thought Reasoning with Critical Representation Fine-tuning

    cs.CL 2025-07 conditional novelty 5.0 of 10

    CRFT selects critical internal representations via attention and saliency scores and fine-tunes only them, improving GSM8K accuracy over ReFT from 29.0% to 32.8% on LLaMA-2-7B.

  5. The Predictive Brain: Neural Correlates of Word Expectancy Align with Large Language Model Prediction Probabilities

    q-bio.NC 2025-06 conditional novelty 4.0 of 10

    EEG and MEG responses during audiobook listening scale with BERT's word predictability: more predictable nouns evoke smaller N400-like responses and altered pre-onset activity.

Pith tools