Pith. sign in

REVIEW 2 cited by

Model-based analysis of brain activity reveals the hierarchy of language in 305 subjects

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2110.06078 v1 pith:Q47JOGSF submitted 2021-10-12 q-bio.NC cs.AIcs.CLcs.LG

classification q-bio.NCcs.AIcs.CLcs.LG
keywords brainlanguageapproachmodel-basedregularscrambledstimulisubjects
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

A popular approach to decompose the neural bases of language consists in correlating, across individuals, the brain responses to different stimuli (e.g. regular speech versus scrambled words, sentences, or paragraphs). Although successful, this `model-free' approach necessitates the acquisition of a large and costly set of neuroimaging data. Here, we show that a model-based approach can reach equivalent results within subjects exposed to natural stimuli. We capitalize on the recently-discovered similarities between deep language models and the human brain to compute the mapping between i) the brain responses to regular speech and ii) the activations of deep language models elicited by modified stimuli (e.g. scrambled words, sentences, or paragraphs). Our model-based approach successfully replicates the seminal study of Lerner et al. (2011), which revealed the hierarchy of language areas by comparing the functional-magnetic resonance imaging (fMRI) of seven subjects listening to 7min of both regular and scrambled narratives. We further extend and precise these results to the brain signals of 305 individuals listening to 4.1 hours of narrated stories. Overall, this study paves the way for efficient and flexible analyses of the brain bases of language.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SIM: Surface-based fMRI Analysis for Inter-Subject Multimodal Decoding from Movie-Watching Experiments

    cs.LG 2025-01 conditional novelty 6.0 of 10

    A surface-transformer and tri-modal CLIP model decodes which 3-second movie clip a person watched from 3 seconds of fMRI, generalizing to new people and new clips.

  2. Decoding individual words from non-invasive brain recordings across 723 participants

    eess.SP 2024-12 conditional novelty 6.0 of 10

    A transformer-based model decodes individual words from non-invasive EEG and MEG signals above chance across 723 participants, with limited but real generalization to unseen words.

Pith tools