Pith. sign in

REVIEW 8 cited by

Are EEG-to-Text Models Working?

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2405.06459 v4 pith:GFCQSJ7F submitted 2024-05-10 cs.CL cs.AI

classification cs.CLcs.AI
keywords eeg-to-textdatamodelmodelsnoiseperformanceevaluationinputs
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This work critically analyzes existing models for open-vocabulary EEG-to-Text translation. We identify a crucial limitation: previous studies often employed implicit teacher-forcing during evaluation, artificially inflating performance metrics. Additionally, they lacked a critical benchmark - comparing model performance on pure noise inputs. We propose a methodology to differentiate between models that truly learn from EEG signals and those that simply memorize training data. Our analysis reveals that model performance on noise data can be comparable to that on EEG data. These findings highlight the need for stricter evaluation practices in EEG-to-Text research, emphasizing transparent reporting and rigorous benchmarking with noise inputs. This approach will lead to more reliable assessments of model capabilities and pave the way for robust EEG-to-Text communication systems. Code is available at https://github.com/NeuSpeech/EEG-To-Text

Discussion (0). Sign in to comment.

Forward citations

Cited by 8 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. A foundation model of vision, audition, and language for in-silico neuroscience

    q-bio.NC 2026-05 unverdicted novelty 7.0 of 10

    TRIBE v2 is a multimodal AI model that predicts human brain activity more accurately than linear encoding models and recovers established neuroscientific findings through in-silico testing.

  2. CogEEGAgent: Toward Autonomous Cognitive EEG Analysis with Grounded Execution and Selection-Aware Verification

    cs.AI 2026-07 conditional novelty 6.0 of 10

    An MNE-grounded EEG agent separates LLM semantic routing from deterministic commitment, participant-disjoint confirmation, and evidence-bound release, outperforming a matched lexical router and blocking adaptive-searc...

  3. MindVoice: Reconstructing Intelligible Speech from Non-invasive Neural Signals with Pretrained Priors

    cs.SD 2026-05 unverdicted novelty 6.0 of 10

    MindVoice disentangles neural-to-speech reconstruction into semantic and acoustic pathways using pretrained priors, then fuses them with speech generation models to produce intelligible output from non-invasive recordings.

  4. Meta-learning In-Context Enables Training-Free Cross Subject Brain Decoding

    cs.LG 2026-04 unverdicted novelty 6.0 of 10

    A meta-optimized in-context learning approach enables training-free cross-subject semantic visual decoding from fMRI by inferring individual neural encoding patterns via hierarchical inference on a few examples.

  5. Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding

    cs.CL 2026-02 conditional novelty 6.0 of 10

    SemKey predicts four semantic attributes from EEG and conditions a frozen LLM on them, beating prior decoders on new semantic-alignment metrics while leaving true word-level accuracy low (2.7% content recall).

  6. Escaping the BLEU Trap: A Signal-Grounded Framework with Decoupled Semantic Guidance for EEG-to-Text Decoding

    cs.CL 2026-02 unverdicted novelty 6.0 of 10

    SemKey decouples semantic objectives to ground EEG-to-text generation in neural signals, eliminating hallucinations on noise and improving results on retrieval accuracy and Fréchet distance metrics.

  7. WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception

    cs.CV 2025-08 unverdicted novelty 5.0 of 10

    WorldWeaver reduces temporal drift in long-horizon video generation by jointly modeling RGB and depth perceptual conditions with segmented noise scheduling.

  8. Foundation Models for Cross-Domain EEG Analysis Application: A Survey

    cs.HC 2025-08 conditional novelty 4.0 of 10

    A survey that organizes EEG foundation-model research into five output-modality categories: native EEG, text, vision, audio, and multimodal fusion, with a claim to be the first such comprehensive taxonomy.

Pith tools