Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies

Dongrui Wu; Hongbin Wang; Siyang Li; Xiaoqing Chen

REVIEW 3 major objections 4 minor 2 cited by

Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies

T0 review · 3 major / 4 minor · reviewed 2026-08-09 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read A review of AI-powered multimodal brain-computer interfaces argues that the entire field reduces to three algorithmic task types, and organizes visual, speech, and affective decoding around them.

desk verdict Useful, current review whose central taxonomy is oversold: the three task types are not a clean partition, but the dataset tables and temporal-leakage section are worth a reader's time. read the letter →

arxiv 2502.02830 v1 pith:2XQGKBBH submitted 2025-02-05 cs.HC cs.LGq-bio.NC

Siyang Li , Hongbin Wang , Xiaoqing Chen , Dongrui Wu This is my paper · ORCID

classification cs.HCcs.LGq-bio.NC

keywords brain-computerinterfacemultimodaldecodingcross-modalitymappingsequentialtranslationfusionvisualspeechaffective

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This review paper claims that multimodal brain-computer interface (BCI) decoding can be organized into three distinct algorithmic task types: instance-wise cross-modality mapping, sequential cross-modality translation, and multi-modality fusion. It maps these onto the classic reactive, active, and passive BCI categories, and then surveys the literature on visual, speech, and affective decoding through that lens. If the taxonomy holds, it gives researchers a common language for choosing and comparing decoding architectures across otherwise disparate applications, and it clarifies which AI techniques are appropriate for which BCI paradigm.

What carries the argument

The central object is the three-way algorithmic taxonomy of Section II-B, formalized as three function types: $f_{\mathrm{mapping}}$, $f_{\mathrm{translation}}$, and $f_{\mathrm{fusion}}$. The taxonomy organizes which algorithm families apply to which BCI paradigm, and the paper uses it as the skeleton for its literature review, including the distinction between target-centric sequential modeling and end-to-end sequence-to-sequence modeling for translation, and the token-, hierarchical-, and cross-attention variants for Transformer-based fusion.

What would settle it

Take a representative sample of multimodal BCI systems published in the last three years and determine whether each system's decoding algorithm fits exactly one of the three equations; if a substantial fraction combine two task types (for instance, a system that fuses EEG and eye tracking while also generating a sequence), then the taxonomy is not a partition and would need revision.

Watch

Extended reading notes

Core claim

The central claim is that the algorithmic structure of multimodal BCIs is not a single fusion problem but three problems with different input-output shapes: mapping one instance to another (e.g., brain signal to image), translating a sequence (e.g., neural recordings to sentences), and fusing multiple modalities into a label (e.g., EEG plus eye movement to emotion). The paper formalizes these as $x^B = f_{\mathrm{mapping}}(x^A)$, $(x^B_1,\dots,x^B_T) = f_{\mathrm{translation}}(x^A_1,\dots,x^A_T)$, and $y = f_{\mathrm{fusion}}(x^A, x^B)$ in Eqs. (1)-(4), and aligns them with reactive, active, and passive BCIs. It then reviews the dominant AI techniques for each type, showing that contrastive and generative models carry the mapping tasks, RNN- and Transformer-based sequence models carry translation, and feature-, decision-, and Transformer-based fusion carry the fusion tasks.

Load-bearing premise

The three task types form a genuine partition of multimodal BCI problems, with no overlap and no missing cases, and the mapping of reactive/active/passive BCIs onto mapping/translation/fusion is valid.

Editorial extensions

If this is right

Researchers can classify any new multimodal BCI system by its algorithmic input-output shape and immediately identify the relevant family of AI methods.
Publicly available datasets can be categorized by which of the three task types they support, making it easier to compare methods and to spot missing dataset types.
The review shows that speech decoding has largely moved from instance-wise classification to sequence-to-sequence translation, while affect decoding remains dominated by fusion, pointing to where cross-application transfer of methods may be fruitful.
The paper's cautions about temporal leakage in block-designed experiments apply across all three task types, so reported accuracies in older studies that used flawed splits should be treated with suspicion.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The taxonomy may need a fourth category for systems that combine mapping and fusion, such as generative reconstruction of a stimulus from multiple input modalities at once; the paper's partition is asserted rather than proven exhaustive.
A testable check would be to survey recent multimodal BCI papers and code each system into exactly one of the three equations; if many systems combine two task types, the partition should be revised.
The common-errors section implies that some high-profile earlier results in visual and affective decoding may be partly artifacts of temporal leakage, which would shrink the empirical performance gap between simple and sophisticated models.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The paper is a readable survey of AI decoding methods for multimodal BCIs, and the useful part is not the central taxonomy. It does a decent job assembling current visual, speech, and affective decoding work, with accurate standard equations (InfoNCE, VAE objectives, Viterbi, n-gram, seq2seq all correctly stated) and unusually current dataset tables that people will actually use. The strongest genuine asset is Section V: the block-design and temporal-normalization leakage discussion is concrete, well-illustrated, and worth handing to anyone training classifiers on EEG.

The novel three-way categorization (mapping/translation/fusion aligned with reactive/active/passive) is the weak load-bearing piece. The paper's own definitions make translation a composition of mapping plus sequential modeling (Eqs. 9-10 assume a prebuilt fmapping), so it is not a third task type. The surveyed systems also straddle the categories: the speech systems in IV-B mix mapping and n-gram/Viterbi, Défossez's InfoNCE retrieval is classified as mapping though it is an active speech BCI, and the EEG video decoder under reactive mapping uses a sequence-to-sequence Transformer. No criterion is given to assign a pipeline to exactly one category, so the claimed 'comprehensive understanding' rests on an unverified partition. The authors should either explicitly present the three types as overlapping analytical lenses or show the partition.

Other soft spots are more standard. The affect section delegates dataset details to the authors' own prior review, the 'comprehensive' claim is not backed by a systematic literature-search protocol, and several load-bearing transfer-learning references (Sections V-B and V-C) are the authors' own unpublished or in-press manuscripts. That pattern weakens an otherwise fair citation set. These are fixable in revision.

Who is this for? Researchers entering BCI from AI, or AI folks wanting a current map of visual and speech BCIs, will get value from the tables, the algorithm summaries, and Section V. It deserves a serious referee, but the referee should request that the taxonomy be reframed as a heuristic rather than a partition, that unpublished citations be either removed or replaced, and that the deflected affect-dataset content be either included or explicitly scoped out. I would not cite the taxonomy in its current form, but I would cite the review for its dataset tables and leakage warnings.

Referee Report

3 major / 4 minor

Summary. The paper is a review of AI-powered decoding methodologies for multimodal brain-computer interfaces (BCIs). It proposes an algorithmic categorization of multimodal BCIs into three task types: instance-wise cross-modality mapping, sequential cross-modality translation, and multi-modality fusion (Section II-B, Eqs. (1)-(4), Fig. 2), and then surveys visual, speech, and affective decoding applications through this lens (Section IV). It also covers decoding algorithms (contrastive learning, generative modeling, sequential modeling, multimodal Transformers), datasets, transfer learning, brain foundation models, common errors in EEG/fMRI experimental design, and security/privacy issues. The central claim is that this three-way taxonomy provides a 'comprehensive understanding' of AI-powered multimodal BCIs.

Significance. If the taxonomy and survey were sound, the paper would offer a useful organizing framework for a rapidly growing interdisciplinary field, and its compilation of datasets and algorithms would be a practical reference. The review correctly states many standard algorithmic objectives (InfoNCE, VAE, Viterbi, n-gram, seq2seq) and includes recent high-profile speech decoding systems (Willett 2023, Metzger 2023, Card 2024), which adds value. However, the organizing taxonomy is not a partition by the paper's own definitions, and the review's coverage of affective decoding is incomplete, so the central synthesis currently rests on an unsupported assumption. The paper also does not document a systematic literature selection method, which limits the verifiability of its 'comprehensive' claim.

major comments (3)

[Section II-B and Section III-C1]
[Section IV-C]
[Section I and Section IV]

minor comments (4)

[Section II-B]
[Section III-B] Stray spaces in the rendered text: 'V ariational' and 'T okenization' appear with an extra space in several headings (e.g., 'V ariational generative models', 'T okenization for Embedding'). These are likely LaTeX source issues that should be fixed in the final version.
[Section IV-C] The sentence 'For a comprehensive survey of these methods, Poria et al. provided a detailed review...' lacks a citation; the reference appears to be missing from the bibliography.
[Section V-B] References [196], [197], and [198] are listed as 'under review' manuscripts; citing unpublished work as evidence for the effectiveness of an approach is risky and should be flagged, ideally replaced with published versions or clearly labeled as preprints.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation: the review's taxonomy is an organizing proposal, not a result derived from fitted inputs or self-cited uniqueness theorems.

full rationale

This manuscript is a literature review; it makes no quantitative predictions and fits no parameters. Equations (1)-(4) are notation for the proposed task types, not derivations. Equations (9)-(10) describe a target-centric Viterbi/n-gram pipeline that assumes a prebuilt mapping function, but the paper also presents sequence-to-sequence translation as a unified framework where mapping and sequential modeling are integrated, so translation is not reduced to mapping by the paper's own definitions. The reactive/active/passive alignment in Fig. 2 is under-justified and applied inconsistently in Section IV (e.g., Liu et al. [63], placed under reactive visual decoding, uses a sequence-to-sequence Transformer; Défossez et al. [127], an active speech BCI, is classified as instance-wise mapping). These are threats to the taxonomy's correctness, exhaustiveness, and practical utility, but they are not circularity: the taxonomy is not claimed to be derived from a fitted parameter, from the cited systems, or from a self-cited uniqueness theorem. The paper's self-citations (e.g., [157], [180], [181], [196]-[198]) are numerous and include under-review manuscripts, but they serve as literature pointers or scope-setting definitions; no load-bearing argument in the central taxonomy reduces to the authors' own prior work as an incontestable premise. Because no specific step exhibits Eq. X = Eq. Y by construction, a fitted input renamed as a prediction, or a self-citation chain that forces the central claim, the honest finding is no significant circularity.

Assumptions & free parameters 0 free parameters · 4 assumptions · 0 invented entities

The review has no fitted parameters and introduces no new entities. It relies on standard ML formulations and on domain assumptions about the taxonomy and the validity of cited results. These are listed as axioms.

assumptions (4)

domain assumption The three-way algorithmic taxonomy (instance-wise mapping, sequential translation, fusion) is a partition of multimodal BCI decoding problems.
Section II-B introduces the taxonomy through Eqs. (1)-(4) and Fig. 2 without evidence that the categories are exhaustive or mutually exclusive.
domain assumption The performance and design claims about the surveyed systems are accurately attributed to the cited papers.
The review does not re-run experiments; every efficacy statement is taken from the cited literature.
domain assumption The block-design temporal leakage critique in Li et al. [219] applies broadly to EEG and fMRI decoding in the surveyed applications.
Section V-D generalizes the critique from one study to the field; the review assumes its validity and transferability.
standard math Standard machine learning background, including InfoNCE, VAE, GAN, diffusion, and Transformer formulations, is correct and applicable.
Section III relies on standard textbook equations without derivation; this is acceptable for a review but is an unproved background assumption.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies." pith.science (2026). https://pith.science/paper/2XQGKBBH

@misc{pith2026250202830,
  author       = {Pith},
  title        = {Pith review of: Multimodal Brain-Computer Interfaces: AI-powered Decoding Methodologies},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/2XQGKBBH}},
  note         = {Machine review of arXiv:2502.02830}
}

read the original abstract

Brain-computer interfaces (BCIs) enable direct communication between the brain and external devices. This review highlights the core decoding algorithms that enable multimodal BCIs, including a dissection of the elements, a unified view of diversified approaches, and a comprehensive analysis of the present state of the field. We emphasize algorithmic advancements in cross-modality mapping, sequential modeling, besides classic multi-modality fusion, illustrating how these novel AI approaches enhance decoding of brain data. The current literature of BCI applications on visual, speech, and affective decoding are comprehensively explored. Looking forward, we draw attention on the impact of emerging architectures like multimodal Transformers, and discuss challenges such as brain data heterogeneity and common errors. This review also serves as a bridge in this interdisciplinary field for experts with neuroscience background and experts that study AI, aiming to provide a comprehensive understanding for AI-powered multimodal BCIs.

Figures

Figures reproduced from arXiv: 2502.02830 by the authors.

**Figure 1.** The outline of this review. functional outputs, bridging human cognition and external devices. Input Elicitation Stimuli are used to elicit specific neural responses from the user. These stimuli can be visual, auditory, or sensory, designed to provoke brain activity that the BCI system can detect and interpret. Stimulus design must prioritize specificity to reduce user confusion, ensure user comfort and safety by a… view at source ↗

**Figure 2.** Three types of multimodal BCIs and their representat [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗

**Figure 3.** Zero-shot classification under cross-modality contr [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗

Figures from the paper (6 more)

**Figure 4.** Figure 4: Two types of cross-modality generative modeling, us [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]

**Figure 5.** Figure 5: Three pipelines for decoding brain recordings into s [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]

**Figure 6.** Figure 6: Variants of multimodal Transformers mechanisms tha [PITH_FULL_IMAGE:figures/full_fig_p009_6.png]

**Figure 7.** Figure 7: Available types of auxiliary data that could benefit t [PITH_FULL_IMAGE:figures/full_fig_p017_7.png]

**Figure 8.** Figure 8: Common error of block design on brain signal classific [PITH_FULL_IMAGE:figures/full_fig_p019_8.png]

**Figure 9.** Figure 9: Common error of normalization on block-based brain s [PITH_FULL_IMAGE:figures/full_fig_p019_9.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

SACM: SEEG-Audio Contrastive Matching for Chinese Speech Decoding
cs.HC 2025-05 conditional novelty 6.0 of 10

A new SEEG-audio contrastive learning framework decodes Mandarin words from brain signals with top-5 accuracy around 17% versus 10% chance.
EEG-Based Imagined Speech Decoding Using a Hybrid CNN-SNN Architecture
cs.SD 2026-07 conditional novelty 5.5 of 10

A CNN feature extractor plus LIF spiking classifier reaches 80.13% accuracy on five-class imagined-speech EEG from the 2020 BCI Competition III, exceeding prior reported methods under the same split.

Reference graph

Works this paper leans on

249 extracted references · 66 canonical work pages · cited by 2 Pith papers

[1]

D. L. Schacter, D. T. Gilbert, and D. M. Wegner, Psychology. Macmil- lan, 2009

2009
[2]

Multimo dal machine learning: A survey and taxonomy,

T. Baltruˇ saitis, C. Ahuja, and L.-P . Morency, “Multimo dal machine learning: A survey and taxonomy,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 41, no. 2, pp. 423–443, 2019

2019
[3]

Brain–computer interfaces for multimodal interaction: a survey and principles,

H. G¨ urk¨ ok and A. Nijholt, “Brain–computer interfaces for multimodal interaction: a survey and principles,” Int’l Journal of Human-Computer Interaction, vol. 28, no. 5, pp. 292–307, 2012

2012
[4]

R. P . Rao, Brain-Computer Interfacing: an Introduction . Cambridge University Press, 2013

2013
[5]

Utiliz ing sec- ondary input from passive brain-computer interfaces for en hancing human-machine interaction,

T. O. Zander, C. Kothe, S. Welke, and M. R¨ otting, “Utiliz ing sec- ondary input from passive brain-computer interfaces for en hancing human-machine interaction,” in Proc. Int’l Conf. F oundations of Aug- mented Cognition. Neuroergonomics and Operational Neuros cience, San Diego, CA, Jul. 2009, pp. 759–771

2009
[6]

A brain-computer interface using electrocorticog raphic signals in humans,

E. C. Leuthardt, G. Schalk, J. R. Wolpaw, J. G. Ojemann, an d D. W. Moran, “A brain-computer interface using electrocorticog raphic signals in humans,” Journal of Neural Engineering , vol. 1, no. 2, pp. 63–71, 2004

2004
[7]

Lesion, “irritative

J. Talairach and J. Bancaud, “Lesion, “irritative” zone and epileptogenic focus,” Conﬁnia Neurologica , vol. 27, no. 1, pp. 91–94, 1966

1966
[8]

Cortical neural prosthetics,

A. B. Schwartz, “Cortical neural prosthetics,” Annual Review of Neu- roscience, vol. 27, pp. 487–507, 2004

2004

Show all 249 references

[9]

An integrated brain-machine int erface plat- form with thousands of channels,

E. Musk and Neuralink, “An integrated brain-machine int erface plat- form with thousands of channels,” Journal of Medical Internet Re- search, vol. 21, no. 10, p. e16194, 2019

2019
[10]

Topological supramolecular network enabled high-conductivity, stretchable organic b ioelectronics,

Y . Jiang, Z. Zhang, Y .-X. Wang, D. Li, C.-T. Coen, E. Hwau n, G. Chen, H.-C. Wu, D. Zhong, S. Niu et al. , “Topological supramolecular network enabled high-conductivity, stretchable organic b ioelectronics,” Science, vol. 375, no. 6587, pp. 1411–1417, 2022

2022
[11]

Flexible bra in–computer interfaces,

X. Tang, H. Shen, S. Zhao, N. Li, and J. Liu, “Flexible bra in–computer interfaces,” Nature Electronics, vol. 6, no. 2, pp. 109–118, 2023

2023
[12]

Flexible electrodes for brain–computer interfa ce system,

J. Wang, T. Wang, H. Liu, K. Wang, K. Moses, Z. Feng, P . Li, and W. Huang, “Flexible electrodes for brain–computer interfa ce system,” Advanced Materials , vol. 35, no. 47, p. 2211012, 2023

2023
[13]

Tracking neural activity from the same cells during the entire adult life of mice,

S. Zhao, X. Tang, W. Tian, S. Partarrieu, R. Liu, H. Shen, J. Lee, S. Guo, Z. Lin, and J. Liu, “Tracking neural activity from the same cells during the entire adult life of mice,” Nature Neuroscience, vol. 26, no. 4, pp. 696–710, 2023

2023
[14]

Ultraﬂexible endovascular probes for brain recor ding through micrometer-scale vasculature,

A. Zhang, E. T. Mandeville, L. Xu, C. M. Stary, E. H. Lo, an d C. M. Lieber, “Ultraﬂexible endovascular probes for brain recor ding through micrometer-scale vasculature,” Science, vol. 381, no. 6655, pp. 306– 312, 2023

2023
[15]

Electrochemi- cally actuated microelectrodes for minimally invasive per ipheral nerve interfaces,

C. Dong, A. Carnicer-Lombarte, F. Bonafe, B. Huang, S. M iddya, A. Jin, X. Tao, S. Han, M. Bance, D. G. Barone et al. , “Electrochemi- cally actuated microelectrodes for minimally invasive per ipheral nerve interfaces,” Nature Materials, vol. 23, pp. 969–976, 2024

2024
[16]

3D spatiotemporally scalable in vivo neural probes based on ﬂuorinated elastome rs,

P . Le Floch, S. Zhao, R. Liu, N. Molinari, E. Medina, H. Sh en, Z. Wang, J. Kim, H. Sheng, S. Partarrieu et al. , “3D spatiotemporally scalable in vivo neural probes based on ﬂuorinated elastome rs,” Nature Nanotechnology, vol. 19, no. 3, pp. 319–329, 2024

2024
[17]

Scalable thousand channel penetrating microneedle arrays on ﬂex for multimodal and large area coverage brainmachine interfaces,

S. H. Lee, M. Thunemann, K. Lee, D. R. Cleary, K. J. Tonsfe ldt, H. Oh, F. Azzazy, Y . Tchoe, A. M. Bourhis, L. Hossain et al., “Scalable thousand channel penetrating microneedle arrays on ﬂex for multimodal and large area coverage brainmachine interfaces,” Advanced Functional...

2022
[18]

Promises and limitations of human intracra- nial electroencephalography,

J. Parvizi and S. Kastner, “Promises and limitations of human intracra- nial electroencephalography,” Nature Neuroscience, vol. 21, no. 4, pp. 474–483, 2018

2018
[19]

Non-invasive brain-computer interface s: State of the art and trends,

B. J. Edelman, S. Zhang, G. Schalk, P . Brunner, G. M¨ ulle r-Putz, C. Guan, and B. He, “Non-invasive brain-computer interface s: State of the art and trends,” IEEE Reviews in Biomedical Engineering , pp. 1–25, early access, 2024

2024
[20]

Deep learning-based electroencephalography analysis: a systematic review,

Y . Roy, H. Banville, I. Albuquerque, A. Gramfort, T. H. F alk, and J. Faubert, “Deep learning-based electroencephalography analysis: a systematic review,” Journal of Neural Engineering , vol. 16, no. 5, p. 051001, 2019

2019
[21]

EEG-based brain-computer interfaces (BCIs): A surve y of recent studies on signal sensing technologies and computational i ntelligence approaches and their applications,

X. Gu, Z. Cao, A. Jolfaei, P . Xu, D. Wu, T.-P . Jung, and C.- T. Lin, “EEG-based brain-computer interfaces (BCIs): A surve y of recent studies on signal sensing technologies and computational i ntelligence approaches and their applications,” IEEE/ACM Trans. Computational Biol...

2021
[22]

Brain computer interfaces, a review,

L. F. Nicolas-Alonso and J. Gomez-Gil, “Brain computer interfaces, a review,” Sensors, vol. 12, no. 2, pp. 1211–1279, 2012

2012
[23]

Magnetoencephalography: detection of the b rain’s electrical activity with a superconducting magnetometer,

D. Cohen, “Magnetoencephalography: detection of the b rain’s electrical activity with a superconducting magnetometer,” Science, vol. 175, no. 4022, pp. 664–666, 1972

1972
[24]

fMRI brain-computer interfaces,

R. Sitaram, N. Weiskopf, A. Caria, R. V eit, M. Erb, and N. Birbaumer, “fMRI brain-computer interfaces,” IEEE Signal Processing Magazine , vol. 25, no. 1, pp. 95–106, 2008

2008
[25]

fMRI brain decodin g and its applications in brain–computer interface: A survey,

B. Du, X. Cheng, Y . Duan, and H. Ning, “fMRI brain decodin g and its applications in brain–computer interface: A survey,” Brain Sciences, vol. 12, no. 2, p. 228, 2022

2022
[26]

Noninvasive, infrared monitoring of ce rebral and myocar- dial oxygen sufﬁciency and circulatory parameters,

F. F. J¨ obsis, “Noninvasive, infrared monitoring of ce rebral and myocar- dial oxygen sufﬁciency and circulatory parameters,” Science, vol. 198, no. 4323, pp. 1264–1267, 1977

1977
[27]

Representati on learning: A review and new perspectives,

Y . Bengio, A. Courville, and P . Vincent, “Representati on learning: A review and new perspectives,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 35, no. 8, pp. 1798–1828, 2013

2013
[28]

Representation lea rning with contrastive predictive coding,

A. v. d. Oord, Y . Li, and O. Vinyals, “Representation lea rning with contrastive predictive coding,” arXiv preprint arXiv:1807.03748 , 2018

2018 arXiv
[29]

Learning transferable visual models from natural language supervision,

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Ag arwal, G. Sastry, A. Askell, P . Mishkin, J. Clark et al., “Learning transferable visual models from natural language supervision,” in Proc. Int’l Conf. Machine Learning , Vienna, Austria, Jul. 2021, pp. 8748–8763

2021
[30]

Understanding the behaviour of cont rastive loss,

F. Wang and H. Liu, “Understanding the behaviour of cont rastive loss,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recogniti on, Nashville, TN, Jun. 2021, pp. 2495–2504

2021
[31]

Learning to detect unseen object classes by between-class attribute transfer ,

C. H. Lampert, H. Nickisch, and S. Harmeling, “Learning to detect unseen object classes by between-class attribute transfer ,” in IEEE Conf. Computer Vision and Pattern Recognition, Miami, FL, Jun. 2009, pp. 951–958

2009
[32]

Zero-sho t learning through cross-modal transfer,

R. Socher, M. Ganjoo, C. D. Manning, and A. Ng, “Zero-sho t learning through cross-modal transfer,” in Proc. Advances in Neural Information Processing Systems, Lake Tahoe, NV , Dec. 2013

2013
[33]

Uniﬁed contrastive learning in image-text-label space,

J. Y ang, C. Li, P . Zhang, B. Xiao, C. Liu, L. Y uan, and J. Ga o, “Uniﬁed contrastive learning in image-text-label space,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition , New Orleans, LA, Jun. 2022, pp. 19 163–19 173

2022
[34]

Supervised contrast ive learning,

P . Khosla, P . Teterwak, C. Wang, A. Sarna, Y . Tian, P . Iso la, A. Maschinot, C. Liu, and D. Krishnan, “Supervised contrast ive learning,” in Proc. Advances in Neural Information Processing Systems , V ancouver, Canada, Dec. 2020, pp. 18 661–18 673

2020
[35]

Hybrid contrastive learning of tri-modal representation for multimodal sentiment anal ysis,

S. Mai, Y . Zeng, S. Zheng, and H. Hu, “Hybrid contrastive learning of tri-modal representation for multimodal sentiment anal ysis,” IEEE Trans. Affective Computing , vol. 14, no. 3, pp. 2276–2289, 2022. UNDER REVIEW A T IEEE REVIEWS IN BIOMEDICAL ENGINEERING 21

2022
[36]

Multimodal contrastive learning via u ni-modal coding and cross-modal prediction for multimodal sentimen t analysis,

R. Lin and H. Hu, “Multimodal contrastive learning via u ni-modal coding and cross-modal prediction for multimodal sentimen t analysis,” in Findings of the Association for Computational Linguistics : EMNLP , 2022, pp. 511–523

2022
[37]

Coarse-to-ﬁne vision-language pre-training with fusion in the backbone,

Z.-Y . Dou, A. Kamath, Z. Gan, P . Zhang, J. Wang, L. Li, Z. L iu, C. Liu, Y . LeCun, N. Peng et al. , “Coarse-to-ﬁne vision-language pre-training with fusion in the backbone,” in Proc. Advances in Neural Information Processing Systems, New Orleans, LA, Nov. 2022, pp. 32 942–32 956

2022
[38]

VLMO: Uniﬁed vision-langua ge pre-training with mixture-of-modality-experts,

H. Bao, W. Wang, L. Dong, Q. Liu, O. K. Mohammed, K. Aggar- wal, S. Som, S. Piao, and F. Wei, “VLMO: Uniﬁed vision-langua ge pre-training with mixture-of-modality-experts,” in Proc. Advances in Neural Information Processing Systems , New Orleans, LA, Nov. 2022, pp. 32 897–32 912

2022
[39]

Auto-encoding variational bayes,

D. P . Kingma, “Auto-encoding variational bayes,” arXiv preprint arXiv:1312.6114, 2013

2013 arXiv
[40]

Generative adversar ial nets,

I. Goodfellow, J. Pouget-Abadie, M. Mirza, B. Xu, D. War de-Farley, S. Ozair, A. Courville, and Y . Bengio, “Generative adversar ial nets,” in Proc. Advances in Neural Information Processing Systems , Montreal, Canada, Dec. 2014

2014
[41]

Denoising diffusion prob abilistic models,

J. Ho, A. Jain, and P . Abbeel, “Denoising diffusion prob abilistic models,” in Proc. Advances in Neural Information Processing Systems , V ancouver, Canada, Dec. 2020, pp. 6840–6851

2020
[42]

Sequence to sequ ence learning with neural networks,

I. Sutskever, O. Vinyals, and Q. V . Le, “Sequence to sequ ence learning with neural networks,” in Proc. Advances in Neural Information Processing Systems, Montreal, Canada, Dec. 2014

2014
[43]

Connec- tionist temporal classiﬁcation: labelling unsegmented se quence data with recurrent neural networks,

A. Graves, S. Fern´ andez, F. Gomez, and J. Schmidhuber, “Connec- tionist temporal classiﬁcation: labelling unsegmented se quence data with recurrent neural networks,” in Proc. Int’l Conf. Machine learning , Pittsburgh, PA, Jun. 2006, pp. 369–376

2006
[44]

Attention is all you need,

A. V aswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jone s, A. N. Gomez, L. u. Kaiser, and I. Polosukhin, “Attention is all you need,” in Proc. Advances in Neural Information Processing Systems , Long Beach, CA, Dec. 2017

2017
[45]

Multimodal learning wi th transform- ers: A survey,

P . Xu, X. Zhu, and D. A. Clifton, “Multimodal learning wi th transform- ers: A survey,” IEEE Trans. Pattern Analysis and Machine Intelligence , vol. 45, no. 10, pp. 12 113–12 132, 2023

2023
[46]

Speed of processing i n the human visual system,

S. Thorpe, D. Fize, and C. Marlot, “Speed of processing i n the human visual system,” Nature, vol. 381, no. 6582, pp. 520–522, 1996

1996
[47]

Decoding the visual and subjec tive contents of the human brain,

Y . Kamitani and F. Tong, “Decoding the visual and subjec tive contents of the human brain,” Nature Neuroscience, vol. 8, no. 5, pp. 679–685, 2005

2005
[48]

Evoked-pot ential corre- lates of stimulus uncertainty,

S. Sutton, M. Braren, J. Zubin, and E. John, “Evoked-pot ential corre- lates of stimulus uncertainty,” Science, vol. 150, no. 3700, pp. 1187– 1188, 1965

1965
[49]

Multiple channe l detection of steady-state visual evoked potentials for brain-comput er interfaces,

O. Friman, I. V olosyak, and A. Graser, “Multiple channe l detection of steady-state visual evoked potentials for brain-comput er interfaces,” IEEE Trans. Biomedical Engineering , vol. 54, no. 4, pp. 742–750, 2007

2007
[50]

Distributed and overlapping representation s of faces and objects in ventral temporal cortex,

J. V . Haxby, M. I. Gobbini, M. L. Furey, A. Ishai, J. L. Sch outen, and P . Pietrini, “Distributed and overlapping representation s of faces and objects in ventral temporal cortex,” Science, vol. 293, no. 5539, pp. 2425–2430, 2001

2001
[51]

Neura l decoding of visual information across different neural recording mo dalities and approaches,

Y .-J. Zhang, Z.-F. Y u, J. K. Liu, and T.-J. Huang, “Neura l decoding of visual information across different neural recording mo dalities and approaches,” Machine Intelligence Research , vol. 19, no. 5, pp. 350– 365, 2022

2022
[52]

Fea- sibility of decoding visual information from EEG,

H. Wilson, X. Chen, M. Golbabaee, M. J. Proulx, and E. O’N eill, “Fea- sibility of decoding visual information from EEG,” Brain-Computer Interfaces, vol. 11, no. 1-2, pp. 33–60, 2024

2024
[53]

A representational similarity analysis of the d ynamics of object processing using single-trial EEG classiﬁcation,

B. Kaneshiro, M. Perreau Guimaraes, H.-S. Kim, A. M. Nor cia, and P . Suppes, “A representational similarity analysis of the d ynamics of object processing using single-trial EEG classiﬁcation,” PLOS One , vol. 10, no. 8, p. e0135697, 2015

2015
[54]

Generic decoding of seen a nd imagined objects using hierarchical visual features,

T. Horikawa and Y . Kamitani, “Generic decoding of seen a nd imagined objects using hierarchical visual features,” Nature Communications , vol. 8, no. 1, p. 15037, 2017

2017
[55]

Neu ral encoding and decoding with deep learning for dynamic natura l vision,

H. Wen, J. Shi, Y . Zhang, K.-H. Lu, J. Cao, and Z. Liu, “Neu ral encoding and decoding with deep learning for dynamic natura l vision,” Cerebral Cortex, vol. 28, no. 12, pp. 4136–4160, 2018

2018
[56]

Deep i mage re- construction from human brain activity,

G. Shen, T. Horikawa, K. Majima, and Y . Kamitani, “Deep i mage re- construction from human brain activity,” PLOS Computational Biology, vol. 15, no. 1, p. e1006633, 2019

2019
[57]

BOLD5000, a public fMRI dataset while viewing 500 0 visual images,

N. Chang, J. A. Pyles, A. Marcus, A. Gupta, M. J. Tarr, and E. M. Aminoff, “BOLD5000, a public fMRI dataset while viewing 500 0 visual images,” Scientiﬁc Data , vol. 6, no. 1, p. 49, 2019

2019
[58]

The represen- tational dynamics of visual objects in rapid serial visual p rocessing streams,

T. Grootswagers, A. K. Robinson, and T. A. Carlson, “The represen- tational dynamics of visual objects in rapid serial visual p rocessing streams,” NeuroImage, vol. 188, pp. 668–679, 2019

2019
[59]

A massive 7T fMRI dataset to bridge cognitive neuroscience and artiﬁc ial intelli- gence,

E. J. Allen, G. St-Yves, Y . Wu, J. L. Breedlove, J. S. Prin ce, L. T. Dowdle, M. Nau, B. Caron, F. Pestilli, I. Charest et al. , “A massive 7T fMRI dataset to bridge cognitive neuroscience and artiﬁc ial intelli- gence,” Nature Neuroscience, vol. 25, no. 1, pp. 116–126, 2022

2022
[60]

Human EEG recordings for 1,854 concepts presente d in rapid serial visual presentation streams,

T. Grootswagers, I. Zhou, A. K. Robinson, M. N. Hebart, a nd T. A. Carlson, “Human EEG recordings for 1,854 concepts presente d in rapid serial visual presentation streams,” Scientiﬁc Data , vol. 9, no. 1, p. 3, 2022

2022
[61]

A lar ge and rich EEG dataset for modeling human visual object recogn ition,

A. T. Gifford, K. Dwivedi, G. Roig, and R. M. Cichy, “A lar ge and rich EEG dataset for modeling human visual object recogn ition,” NeuroImage, vol. 264, p. 119754, 2022

2022
[62]

THINGS-data, a multimodal collection of large-scale data sets for investigating object representations in human brain and be havior,

M. N. Hebart, O. Contier, L. Teichmann, A. H. Rockter, C. Y . Zheng, A. Kidder, A. Corriveau, M. V aziri-Pashkam, and C. I. Baker, “THINGS-data, a multimodal collection of large-scale data sets for investigating object representations in human brain and be havior,” eLife, vol....

2023
[63]

EEG2Video: Towards decoding dynamic v isual perception from EEG signals,

X. Liu, Y .-K. Liu, Y . Wang, K. Ren, H. Shi, Z. Wang, D. Li, B .-l. Lu, and W.-L. Zheng, “EEG2Video: Towards decoding dynamic v isual perception from EEG signals,” in Proc. Advances in Neural Information Processing Systems, V ancouver, Canada, Dec. 2024

2024
[64]

MinD- 3D: Reconstruct high-quality 3D objects in human brain,

J. Gao, Y . Fu, Y . Wang, X. Qian, J. Feng, and Y . Fu, “MinD- 3D: Reconstruct high-quality 3D objects in human brain,” in Proc. European Conf. Computer Vision , Milan, Italy, Sep. 2024, pp. 312– 329

2024
[65]

Functional magnetic resonanc e imaging (fMRI) “brain reading

D. D. Cox and R. L. Savoy, “Functional magnetic resonanc e imaging (fMRI) “brain reading”: detecting and classifying distrib uted patterns of fMRI activity in human visual cortex,” Neuroimage, vol. 19, no. 2, pp. 261–270, 2003

2003
[66]

Resolving human object recognition in space and time,

R. M. Cichy, D. Pantazis, and A. Oliva, “Resolving human object recognition in space and time,” Nature Neuroscience, vol. 17, no. 3, pp. 455–462, 2014

2014
[67]

EEG-ConvTransformer for s ingle-trial EEG-based visual stimulus classiﬁcation,

S. Bagchi and D. R. Bathula, “EEG-ConvTransformer for s ingle-trial EEG-based visual stimulus classiﬁcation,” Pattern Recognition , vol. 129, p. 108757, 2022

2022
[68]

A d ual- branch spatio-temporal-spectral transformer feature fus ion network for EEG-based visual recognition,

J. Luo, W. Cui, S. Xu, L. Wang, X. Li, X. Liao, and Y . Li, “A d ual- branch spatio-temporal-spectral transformer feature fus ion network for EEG-based visual recognition,” IEEE Trans. Industrial Informatics , vol. 20, no. 2, pp. 1721–1731, 2024

2024
[69]

Predicting the orientation o f invisible stim- uli from activity in human primary visual cortex,

J.-D. Haynes and G. Rees, “Predicting the orientation o f invisible stim- uli from activity in human primary visual cortex,” Nature Neuroscience, vol. 8, no. 5, pp. 686–691, 2005

2005
[70]

Mind artist: Creatin g artistic snapshots with human thought,

J. Chen, Y . Qi, Y . Wang, and G. Pan, “Mind artist: Creatin g artistic snapshots with human thought,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition , Seattle, W A, Jun. 2024, pp. 27 207– 27 217

2024
[71]

Decodi ng natural images from EEG for object recognition,

Y . Song, B. Liu, X. Li, N. Shi, Y . Wang, and X. Gao, “Decodi ng natural images from EEG for object recognition,” in Int’l Conf. Learning Representations, Vienna, Austria, May. 2024

2024
[72]

Lite-Mind: Towards efﬁcient and robust brain repr esentation learning,

Z. Gong, Q. Zhang, G. Bao, L. Zhu, Y . Zhang, K. Liu, L. Hu, a nd D. Miao, “Lite-Mind: Towards efﬁcient and robust brain repr esentation learning,” in Proc. ACM Int’l Conf. Multimedia , Melbourne, Australia, Oct. 2024

2024
[73]

CLIP-MUSED: CLIP-gui ded multi-subject visual neural information semantic decodin g,

Q. Zhou, C. Du, S. Wang, and H. He, “CLIP-MUSED: CLIP-gui ded multi-subject visual neural information semantic decodin g,” in Int’l Conf. Learning Representations , Vienna, Austria, May. 2024

2024
[74]

Sharing deep generative represe ntation for perceived image reconstruction from human brain activity,

C. Du, C. Du, and H. He, “Sharing deep generative represe ntation for perceived image reconstruction from human brain activity, ” in Proc. Int’l Joint Conf. Neural Networks , Anchorage, AK, May. 2017, pp. 1049–1056

2017
[75]

Reconstructing percei ved images from human brain activities with bayesian deep multiview le arning,

C. Du, C. Du, L. Huang, and H. He, “Reconstructing percei ved images from human brain activities with bayesian deep multiview le arning,” IEEE Trans. Neural Networks and Learning Systems , vol. 30, no. 8, pp. 2310–2323, 2019

2019
[76]

V ariational autoencoder: An unsupervised model for encod ing and decoding fMRI activity in visual cortex,

K. Han, H. Wen, J. Shi, K.-H. Lu, Y . Zhang, D. Fu, and Z. Liu , “V ariational autoencoder: An unsupervised model for encod ing and decoding fMRI activity in visual cortex,” NeuroImage, vol. 198, pp. 125–136, 2019

2019
[77]

Reconstructing visu al illusory experiences from human brain activity,

F. L. Cheng, T. Horikawa, K. Majima, M. Tanaka, M. Abdelh ack, S. C. Aoki, J. Hirano, and Y . Kamitani, “Reconstructing visu al illusory experiences from human brain activity,” Science Advances , vol. 9, no. 46, p. eadj3906, 2023

2023
[78]

LEA: Learnin g latent embedding alignment model for fMRI decoding and encoding,

X. Qian, Y . Wang, X. Sun, Y . Fu, and J. Feng, “LEA: Learnin g latent embedding alignment model for fMRI decoding and encoding,” Trans. on Machine Learning Research , 2024. UNDER REVIEW A T IEEE REVIEWS IN BIOMEDICAL ENGINEERING 22

2024
[79]

Masked autoencoders are scalable vision learners,

K. He, X. Chen, S. Xie, Y . Li, P . Doll´ ar, and R. Girshick, “Masked autoencoders are scalable vision learners,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition , New Orleans, LA, Jun. 2022, pp. 16 000–16 009

2022
[80]

Controllable mind visual diffusion model,

B. Zeng, S. Li, X. Liu, S. Gao, X. Jiang, X. Tang, Y . Hu, J. L iu, and B. Zhang, “Controllable mind visual diffusion model,” in Proc. AAAI Conf. Artiﬁcial Intelligence , vol. 38, no. 7, V ancouver, Canada, Feb. 2024, pp. 6935–6943

2024
[81]

N euroDM: Decoding and visualizing human brain activity with EEG-gui ded diffusion model,

D. Qian, H. Zeng, W. Cheng, Y . Liu, T. Bikki, and J. Pan, “N euroDM: Decoding and visualizing human brain activity with EEG-gui ded diffusion model,” Computer Methods and Programs in Biomedicine , vol. 251, p. 108213, 2024

2024
[82]

Recon- structing the mind’s eye: fMRI-to-image with contrastive l earning and diffusion priors,

P . Scotti, A. Banerjee, J. Goode, S. Shabalin, A. Nguyen , A. Dempster, N. V erlinde, E. Y undler, D. Weisberg, K. Norman et al. , “Recon- structing the mind’s eye: fMRI-to-image with contrastive l earning and diffusion priors,” in Proc. Advances in Neural Information Process...

2023
[83]

Mix up: Beyond empirical risk minimization,

H. Zhang, M. Cisse, Y . N. Dauphin, and D. Lopez-Paz, “Mix up: Beyond empirical risk minimization,” in Int’l Conf. Learning Repre- sentations, V ancouver, Canada, Apr. 2018

2018
[84]

Brain deco ding: toward real-time reconstruction of visual perception,

Y . Benchetrit, H. Banville, and J.-R. King, “Brain deco ding: toward real-time reconstruction of visual perception,” in Int’l Conf. Learning Representations, Vienna, Austria, May. 2024

2024
[85]

Visual dec oding and reconstruction via EEG embeddings with guided diffusio n,

D. Li, C. Wei, S. Li, J. Zou, H. Qin, and Q. Liu, “Visual dec oding and reconstruction via EEG embeddings with guided diffusio n,” arXiv preprint arXiv:2403.07721, 2024

2024 arXiv
[86]

Seei ng beyond the brain: Conditional diffusion model with sparse masked m odeling for vision decoding,

Z. Chen, J. Qing, T. Xiang, W. L. Y ue, and J. H. Zhou, “Seei ng beyond the brain: Conditional diffusion model with sparse masked m odeling for vision decoding,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, V ancouver, Canada, Jun. 2023, pp. 22 710–22 720

2023
[87]

Vision-language m odels for vision tasks: A survey,

J. Zhang, J. Huang, S. Jin, and S. Lu, “Vision-language m odels for vision tasks: A survey,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 46, no. 8, pp. 5625–5644, 2024

2024
[88]

Decoding visual neural rep resentations by multimodal learning of brain-visual-linguistic featur es,

C. Du, K. Fu, J. Li, and H. He, “Decoding visual neural rep resentations by multimodal learning of brain-visual-linguistic featur es,” IEEE Trans. Pattern Analysis and Machine Intelligence , vol. 45, no. 9, pp. 10 760– 10 777, 2023

2023
[89]

BrainCLIP: Bridging brain and visual-linguistic representation via C LIP for generic natural visual stimulus decoding from fMRI,

Y . Liu, Y . Ma, W. Zhou, G. Zhu, and N. Zheng, “BrainCLIP: Bridging brain and visual-linguistic representation via C LIP for generic natural visual stimulus decoding from fMRI,” arXiv preprint arXiv:2302.12971, 2023

2023 arXiv
[90]

Brain RAM: Cross-modality retrieval-augmented image reconstructio n from human brain activity,

D. Xie, P . Zhao, J. Zhang, K. Wei, X. Ni, and J. Xia, “Brain RAM: Cross-modality retrieval-augmented image reconstructio n from human brain activity,” in Proc. ACM Int’l Conf. Multimedia , New Y ork, NY , Oct. 2024, p. 3994–4003

2024
[91]

DREA M: Visual decoding from reversing human visual system,

W. Xia, R. de Charette, C. Oztireli, and J.-H. Xue, “DREA M: Visual decoding from reversing human visual system,” in Proc. IEEE/CVF Winter Conf. Applications of Computer Vision, Waikoloa, HI, Jan. 2024, pp. 8226–8235

2024
[92]

High-resolution image rec onstruction with latent diffusion models from human brain activity,

Y . Takagi and S. Nishimoto, “High-resolution image rec onstruction with latent diffusion models from human brain activity,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, V ancouver, Canada, Jun. 2023, pp. 14 453–14 463

2023
[93]

BrainBERT: Self-supervised representation learning for intracranial recordings,

C. Wang, V . Subramaniam, A. U. Y aari, G. Kreiman, B. Katz , I. Cases, and A. Barbu, “BrainBERT: Self-supervised representation learning for intracranial recordings,” in Int’l Conf. Learning Representations , Kigali, Rwanda, May 2023

2023
[94]

Enhancing cross-subject fMRI-to-Video decoding with glo bal-local functional alignment,

C. Li, X. Qian, Y . Wang, J. Huo, X. Xue, Y . Fu, and J. Feng, “Enhancing cross-subject fMRI-to-Video decoding with glo bal-local functional alignment,” in Proc. European Conf. Computer Vision , Milan, Italy, Sep. 2024, pp. 353–369

2024
[95]

Animate your thoughts: Decoupled reconstruction of dynamic natural vis ion from slow brain activity,

Y . Lu, C. Du, C. Wang, X. Zhu, L. Jiang, and H. He, “Animate your thoughts: Decoupled reconstruction of dynamic natural vis ion from slow brain activity,” arXiv preprint arXiv:2405.03280 , 2024

2024 arXiv
[96]

BLIP: Bootstrapping l anguage- image pre-training for uniﬁed vision-language understand ing and gen- eration,

J. Li, D. Li, C. Xiong, and S. Hoi, “BLIP: Bootstrapping l anguage- image pre-training for uniﬁed vision-language understand ing and gen- eration,” in Proc. Int’l Conf. Machine Learning , Baltimore, MD, Jul. 2022, pp. 12 888–12 900

2022
[97]

fMRI-3 D: A comprehensive dataset for enhancing fMRI-based 3D reconst ruction,

J. Gao, Y . Fu, Y . Wang, X. Qian, J. Feng, and Y . Fu, “fMRI-3 D: A comprehensive dataset for enhancing fMRI-based 3D reconst ruction,” arXiv preprint arXiv:2409.11315 , 2024

2024 arXiv
[98]

Neuro-3D: Towards 3D visual decoding from EEG signals,

Z. Guo, J. Wu, Y . Song, W. Mai, Q. Zheng, W. Ouyang, and C. S ong, “Neuro-3D: Towards 3D visual decoding from EEG signals,” arXiv preprint arXiv:2411.12248, 2024

2024 arXiv
[99]

D ynamic stimulation of visual cortex produces form vision in sighte d and blind humans,

M. S. Beauchamp, D. Oswalt, P . Sun, B. L. Foster, J. F. Mag notti, S. Niketeghad, N. Pouratian, W. H. Bosking, and D. Y oshor, “D ynamic stimulation of visual cortex produces form vision in sighte d and blind humans,” Cell, vol. 181, no. 4, pp. 774–783, 2020

2020
[100]

D ecoding visual brain representations from electroencephalography throu gh knowledge distillation and latent diffusion models,

M. Ferrante, T. Boccato, S. Bargione, and N. Toschi, “D ecoding visual brain representations from electroencephalography throu gh knowledge distillation and latent diffusion models,” Computers in Biology and Medicine, p. 108701, 2024

2024
[101]

Brain–computer interfaces for restorin g communication,

E. F. Chang, “Brain–computer interfaces for restorin g communication,” New England Journal of Medicine , vol. 391, no. 7, pp. 654–657, 2024

2024
[102]

The speech neuroprosthesis,

A. B. Silva, K. T. Littlejohn, J. R. Liu, D. A. Moses, and E. F. Chang, “The speech neuroprosthesis,” Nature Reviews Neuroscience , vol. 25, p. 473–492, 2024

2024
[103]

Decoding the brain: From neural representations to mechan istic mod- els,

M. W. Mathis, A. P . Rotondo, E. F. Chang, A. S. Tolias, an d A. Mathis, “Decoding the brain: From neural representations to mechan istic mod- els,” Cell, vol. 187, no. 21, pp. 5814–5832, 2024

2024
[104]

ZuCo, a simultaneous EEG and eye-tracking resou rce for natural sentence reading,

N. Hollenstein, J. Rotsztejn, M. Troendle, A. Pedroni , C. Zhang, and N. Langer, “ZuCo, a simultaneous EEG and eye-tracking resou rce for natural sentence reading,” Scientiﬁc Data , vol. 5, no. 1, pp. 1–13, 2018

2018
[105]

Electrophysiological correlates of semantic dissimilarity reﬂect the comprehension of natural, narrative speech,

M. P . Broderick, A. J. Anderson, G. M. Di Liberto, M. J. C rosse, and E. C. Lalor, “Electrophysiological correlates of semantic dissimilarity reﬂect the comprehension of natural, narrative speech,” Current Biol- ogy, vol. 28, no. 5, pp. 803–809, 2018

2018
[106]

Hierarchical structure g uides rapid linguistic predictions during naturalistic listening,

J. R. Brennan and J. T. Hale, “Hierarchical structure g uides rapid linguistic predictions during naturalistic listening,” PLOS One, vol. 14, no. 1, p. e0207741, 2019

2019
[107]

A 204-subject multimodal neuroimaging datase t to study language processing,

J.-M. Schoffelen, R. Oostenveld, N. H. Lam, J. Udd´ en, A. Hult´ en, and P . Hagoort, “A 204-subject multimodal neuroimaging datase t to study language processing,” Scientiﬁc Data , vol. 6, no. 1, p. 17, 2019

2019
[108]

ZuCo 2.0: A dataset of physiological recordings during natural readi ng and annotation,

N. Hollenstein, M. Troendle, C. Zhang, and N. Langer, “ ZuCo 2.0: A dataset of physiological recordings during natural readi ng and annotation,” in Proc. Conf. Language Resources and Evaluation , 2020, pp. 138–146

2020
[109]

Datas et of speech production in intracranial electroencephalogra phy,

M. V erwoert, M. C. Ottenhoff, S. Goulis, A. J. Colon, L. Wagner, S. Tousseyn, J. P . V an Dijk, P . L. Kubben, and C. Herff, “Datas et of speech production in intracranial electroencephalogra phy,” Scientiﬁc Data, vol. 9, no. 1, p. 434, 2022

2022
[110]

Introducing MEG-MASC a high-quality magne to- encephalography dataset for evaluating natural speech pro cessing,

L. Gwilliams, G. Flick, A. Marantz, L. Pylkk¨ anen, D. P oeppel, and J.-R. King, “Introducing MEG-MASC a high-quality magne to- encephalography dataset for evaluating natural speech pro cessing,” Scientiﬁc Data , vol. 10, no. 1, p. 862, 2023

2023
[111]

A high-performance speech neuroprosthesis,

F. R. Willett, E. M. Kunz, C. Fan, D. T. Avansino, G. H. Wi lson, E. Y . Choi, F. Kamdar, M. F. Glasser, L. R. Hochberg, S. Druckmann et al. , “A high-performance speech neuroprosthesis,” Nature, vol. 620, no. 7976, pp. 1031–1036, 2023

2023
[112]

A high-performance neuroprosthesis for speech decoding a nd avatar control,

S. L. Metzger, K. T. Littlejohn, A. B. Silva, D. A. Moses , M. P . Seaton, R. Wang, M. E. Dougherty, J. R. Liu, P . Wu, M. A. Berger et al. , “A high-performance neuroprosthesis for speech decoding a nd avatar control,” Nature, vol. 620, no. 7976, pp. 1037–1046, 2023

2023
[113]

Chisco: An EEG-based BCI dataset for decoding of imagined s peech,

Z. Zhang, X. Ding, Y . Bao, Y . Zhao, X. Liang, B. Qin, and T . Liu, “Chisco: An EEG-based BCI dataset for decoding of imagined s peech,” Scientiﬁc Data , vol. 11, no. 1, p. 1265, 2024

2024
[114]

ChineseEEG: A Chinese linguistic corpora EEG dataset for semantic alignment and neural decoding,

X. Mou, C. He, L. Tan, J. Y u, H. Liang, J. Zhang, Y . Tian, Y .-F. Y ang, T. Xu, Q. Wang et al. , “ChineseEEG: A Chinese linguistic corpora EEG dataset for semantic alignment and neural decoding,” Scientiﬁc Data, vol. 11, no. 1, p. 550, 2024

2024
[115]

Du-IN: Discrete units -guided mask modeling for decoding speech from intracranial neural signals,

H. Zheng, H.-T. Wang, W.-B. Jiang, Z.-T. Chen, L. He, P . -Y . Lin, P .-H. Wei, G.-G. Zhao, and Y .-Z. Liu, “Du-IN: Discrete units -guided mask modeling for decoding speech from intracranial neural signals,” in Proc. Advances in Neural Information Processing Systems , V ancouv...

2024
[116]

Func- tional organization of human sensorimotor cortex for speec h articula- tion,

K. E. Bouchard, N. Mesgarani, K. Johnson, and E. F. Chan g, “Func- tional organization of human sensorimotor cortex for speec h articula- tion,” Nature, vol. 495, no. 7441, pp. 327–332, 2013

2013
[117]

Encoding of articulatory kinematic trajectories in human speech sensorimotor cortex,

J. Chartier, G. K. Anumanchipalli, K. Johnson, and E. F . Chang, “Encoding of articulatory kinematic trajectories in human speech sensorimotor cortex,” Neuron, vol. 98, no. 5, pp. 1042–1054, 2018

2018
[118]

The control of vocal pitch in human laryngeal motor cortex,

B. K. Dichter, J. D. Breshears, M. K. Leonard, and E. F. C hang, “The control of vocal pitch in human laryngeal motor cortex,” Cell, vol. 174, no. 1, pp. 21–31, 2018

2018
[119]

Large-scale single-neuron speech sound encoding a cross the depth of human cortex,

M. K. Leonard, L. Gwilliams, K. K. Sellers, J. E. Chung, D. Xu, G. Mischler, N. Mesgarani, M. Welkenhuysen, B. Dutta, and E. F. Chang, “Large-scale single-neuron speech sound encoding a cross the depth of human cortex,” Nature, vol. 626, no. 7999, pp. 593–602, 2024

2024
[120]

Real- time detection of spoken speech from unlabeled ECoG signals : A pilot study with an ALS participant,

M. Angrick, S. Luo, Q. Rabbani, S. Joshi, D. N. Candrea, G. W. Milsap, C. R. Gordon, K. Rosenblatt, L. Clawson, N. Maragakis et al. , “Real- time detection of spoken speech from unlabeled ECoG signals : A pilot study with an ALS participant,” medRxiv, 2024. UNDER REVIEW A T IE...

2024
[121]

D i- rect classiﬁcation of all American English phonemes using s ignals from functional speech motor cortex,

E. M. Mugler, J. L. Patton, R. D. Flint, Z. A. Wright, S. U . Schuele, J. Rosenow, J. J. Shih, D. J. Krusienski, and M. W. Slutzky, “D i- rect classiﬁcation of all American English phonemes using s ignals from functional speech motor cortex,” Journal of Neural Engineering , vo...

2014
[122]

Neural decoding of im agined speech and visual imagery as intuitive paradigms for BCI com muni- cation,

S.-H. Lee, M. Lee, and S.-W. Lee, “Neural decoding of im agined speech and visual imagery as intuitive paradigms for BCI com muni- cation,” IEEE Trans. Neural Systems and Rehabilitation Engineering , vol. 28, no. 12, pp. 2647–2659, 2020

2020
[123]

Stable decoding from a speech BCI enables control for an individual with ALS without recalibration for 3 months,

S. Luo, M. Angrick, C. Coogan, D. N. Candrea, K. Wyse-So okoo, S. Shah, Q. Rabbani, G. W. Milsap, A. R. Weiss, W. S. Anderson et al. , “Stable decoding from a speech BCI enables control for an individual with ALS without recalibration for 3 months,” Advanced Science, vol. 10, ...

2023
[124]

Representation of internal speech by single neu rons in human supramarginal gyrus,

S. K. Wandelt, D. A. Bj˚ anes, K. Pejsa, B. Lee, C. Liu, an d R. A. Andersen, “Representation of internal speech by single neu rons in human supramarginal gyrus,” Nature Human Behaviour , vol. 8, pp. 1136–1149, 2024

2024
[125]

Eff ec- tive phoneme decoding with hyperbolic neural networks for h igh- performance speech BCIs,

X. Tan, Q. Lian, J. Zhu, J. Zhang, Y . Wang, and Y . Qi, “Eff ec- tive phoneme decoding with hyperbolic neural networks for h igh- performance speech BCIs,” IEEE Trans. Neural Systems and Reha- bilitation Engineering , vol. 32, pp. 3432–3441, 2024

2024
[126]

Decoding and synthesizing to nal language speech from brain activity,

Y . Liu, Z. Zhao, M. Xu, H. Y u, Y . Zhu, J. Zhang, L. Bu, X. Zh ang, J. Lu, Y . Li, D. Ming, and J. Wu, “Decoding and synthesizing to nal language speech from brain activity,” Science Advances, vol. 9, no. 23, p. eadh0478, 2023

2023
[127]

Decoding speech perception from non-invasive brain recor dings,

A. D´ efossez, C. Caucheteux, J. Rapin, O. Kabeli, and J .-R. King, “Decoding speech perception from non-invasive brain recor dings,” Nature Machine Intelligence , vol. 5, no. 10, pp. 1097–1107, 2023

2023
[128]

De Wave: discrete EEG waves encoding for brain dynamics to text trans lation,

Y . Duan, J. Zhou, Z. Wang, Y .-K. Wang, and C.-T. Lin, “De Wave: discrete EEG waves encoding for brain dynamics to text trans lation,” in Proc. Advances in Neural Information Processing Systems , New Orleans, LA, Dec. 2023

2023
[129]

Fully end-to-end EEG to speech translation using m ulti-scale optimized dual generative adversarial network with cycle- consistency loss,

C. Ma, Y . Zhang, Y . Guo, X. Liu, H. Shangguan, J. Wang, an d L. Zhao, “Fully end-to-end EEG to speech translation using m ulti-scale optimized dual generative adversarial network with cycle- consistency loss,” Neurocomputing, vol. 616, p. 128916, 2025

2025
[130]

Brain-to-text: decoding spoken phrases fr om phone representations in the brain,

C. Herff, D. Heger, A. De Pesters, D. Telaar, P . Brunner , G. Schalk, and T. Schultz, “Brain-to-text: decoding spoken phrases fr om phone representations in the brain,” Frontiers in Neuroscience, vol. 9, p. 217, 2015

2015
[131]

Brain2C har: a deep architecture for decoding text from brain recordings,

P . Sun, G. K. Anumanchipalli, and E. F. Chang, “Brain2C har: a deep architecture for decoding text from brain recordings,” Journal of Neural Engineering, vol. 17, no. 6, p. 066015, 2020

2020
[132]

Neuroprosthesis for decoding speech in a paralyzed person with anarthria,

D. A. Moses, S. L. Metzger, J. R. Liu, G. K. Anumanchipal li, J. G. Makin, P . F. Sun, J. Chartier, M. E. Dougherty, P . M. Liu, G. M. Abrams et al. , “Neuroprosthesis for decoding speech in a paralyzed person with anarthria,” New England Journal of Medicine , vol. 385, no. 3,...

2021
[133]

A brain-to-text frame work for decoding natural tonal sentences,

D. Zhang, Z. Wang, Y . Qian, Z. Zhao, Y . Liu, X. Hao, W. Li, S. Lu, H. Zhu, L. Chen, K. Xu, Y . Li, and J. Lu, “A brain-to-text frame work for decoding natural tonal sentences,” Cell Reports , vol. 43, no. 11, p. 114924, 2024

2024
[134]

Language models are few-shot l earners,

T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P . Dhari- wal, A. Neelakantan, P . Shyam, G. Sastry, A. Askell, S. Agarw al, A. Herbert-V oss, G. Krueger, T. Henighan, R. Child, A. Rames h, D. Ziegler, J. Wu, C. Winter, C. Hesse, M. Chen, E. Sigler, M. L itwin, S. Gray...

2020
[135]

A survey of large language models,

W. X. Zhao, K. Zhou, J. Li, T. Tang, X. Wang, Y . Hou, Y . Min , B. Zhang, J. Zhang, Z. Dong et al. , “A survey of large language models,” arXiv preprint arXiv:2303.18223 , 2023

2023 arXiv
[136]

Con- textual feature extraction hierarchies converge in large l anguage models and the brain,

G. Mischler, Y . A. Li, S. Bickel, A. D. Mehta, and N. Mesg arani, “Con- textual feature extraction hierarchies converge in large l anguage models and the brain,” Nature Machine Intelligence , vol. 6, p. 1467–1477, 2024

2024
[137]

Semantic rec onstruction of continuous language from non-invasive brain recordings ,

J. Tang, A. LeBel, S. Jain, and A. G. Huth, “Semantic rec onstruction of continuous language from non-invasive brain recordings ,” Nature Neuroscience, vol. 26, no. 5, pp. 858–866, 2023

2023
[138]

Wearable intelligent throat enables nat- ural speech in stroke patients with dysarthria,

C. Tang, S. Gao, C. Li, W. Yi, Y . Jin, X. Zhai, S. Lei, H. Me ng, Z. Zhang, M. Xu et al. , “Wearable intelligent throat enables nat- ural speech in stroke patients with dysarthria,” arXiv preprint arXiv:2411.18266, 2024

2024 arXiv
[139]

A bilingual speech neuroprosthesis driven by cortical articulatory representations shared between lan guages,

A. B. Silva, J. R. Liu, S. L. Metzger, I. Bhaya-Grossman , M. E. Dougherty, M. P . Seaton, K. T. Littlejohn, A. Tu-Chan, K. Gan guly, D. A. Moses et al. , “A bilingual speech neuroprosthesis driven by cortical articulatory representations shared between lan guages,” Nature Bio...

2024
[140]

Machine trans lation of cortical activity to text with an encoder–decoder framewor k,

J. G. Makin, D. A. Moses, and E. F. Chang, “Machine trans lation of cortical activity to text with an encoder–decoder framewor k,” Nature Neuroscience, vol. 23, no. 4, pp. 575–582, 2020

2020
[141]

High-resolution neural recordings improve the accuracy of speech decoding,

S. Duraivel, S. Rahimpour, C.-H. Chiang, M. Trumpis, C . Wang, K. Barth, S. C. Harward, S. P . Lad, A. H. Friedman, D. G. Southw ell et al. , “High-resolution neural recordings improve the accuracy of speech decoding,” Nature Communications , vol. 14, no. 1, p. 6938, 2023

2023
[142]

An accurate and rapidly calibrating speech neuroprosthesis,

N. S. Card, M. Wairagkar, C. Iacobacci, X. Hou, T. Singe r-Clark, F. R. Willett, E. M. Kunz, C. Fan, M. V ahdati Nia, D. R. Deo et al. , “An accurate and rapidly calibrating speech neuroprosthesis, ” New England Journal of Medicine , vol. 391, no. 7, pp. 609–618, 2024

2024
[143]

WaveNet: A generative model for raw audio,

A. V an Den Oord, S. Dieleman, H. Zen, K. Simonyan, O. Vin yals, A. Graves, N. Kalchbrenner, A. Senior, K. Kavukcuoglu et al. , “WaveNet: A generative model for raw audio,” arXiv preprint arXiv:1609.03499

arXiv
[144]

Speech synthesis from ECoG usi ng densely connected 3D convolutional neural networks,

M. Angrick, C. Herff, E. Mugler, M. C. Tate, M. W. Slutzk y, D. J. Krusienski, and T. Schultz, “Speech synthesis from ECoG usi ng densely connected 3D convolutional neural networks,” Journal of Neural Engineering , vol. 16, no. 3, p. 036019, 2019

2019
[145]

Densely connected convolutional networks,

G. Huang, Z. Liu, L. V an Der Maaten, and K. Q. Weinberger , “Densely connected convolutional networks,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition , Honolulu, HI, Jul. 2017, pp. 4700– 4708

2017
[146]

Natural TTS synthesis by conditioning Wav enet on Mel spectrogram predictions,

J. Shen, R. Pang, R. J. Weiss, M. Schuster, N. Jaitly, Z. Y ang, Z. Chen, Y . Zhang, Y . Wang, R. Skerrv-Ryan, R. A. Saurous, Y . Agiomvrg ian- nakis, and Y . Wu, “Natural TTS synthesis by conditioning Wav enet on Mel spectrogram predictions,” in IEEE Int’l Conf. Acoustics, Sp...

2018
[147]

Sp eech synthesis from neural decoding of spoken sentences,

G. K. Anumanchipalli, J. Chartier, and E. F. Chang, “Sp eech synthesis from neural decoding of spoken sentences,” Nature, vol. 568, no. 7753, pp. 493–498, 2019

2019
[148]

Direct speech-to-speech translation with discrete units,

A. Lee, P .-J. Chen, C. Wang, J. Gu, S. Popuri, X. Ma, A. Po lyak, Y . Adi, Q. He, Y . Tanget al., “Direct speech-to-speech translation with discrete units,” in Proc. Annual Meeting Association for Computational Linguistics, Dublin, Ireland, May 2022, pp. 3327–3339

2022
[149]

Online speech synthesis using a chronically implanted bra in–computer interface in an individual with ALS,

M. Angrick, S. Luo, Q. Rabbani, D. N. Candrea, S. Shah, G . W. Milsap, W. S. Anderson, C. R. Gordon, K. R. Rosenblatt, L. Clawson et al. , “Online speech synthesis using a chronically implanted bra in–computer interface in an individual with ALS,” Scientiﬁc Reports , vol. 14, ...

2024
[150]

LPCNet: Improving neura l speech synthesis through linear prediction,

J.-M. V alin and J. Skoglund, “LPCNet: Improving neura l speech synthesis through linear prediction,” in IEEE Int’l Conf. Acoustics, Speech and Signal Processing , Brighton, United Kingdom, May 2019, pp. 5891–5895

2019
[151]

An instantane ous voice synthesis neuroprosthesis,

M. Wairagkar, N. S. Card, T. Singer-Clark, X. Hou, C. Ia cobacci, L. R. Hochberg, D. M. Brandman, and S. D. Stavisky, “An instantane ous voice synthesis neuroprosthesis,” bioRxiv, 2024

2024
[152]

Visual neural decod - ing via improved visual-EEG semantic consistency,

H. Chen, L. He, Y . Liu, and L. Y ang, “Visual neural decod - ing via improved visual-EEG semantic consistency,” arXiv preprint arXiv:2408.06788, 2024

2024
[153]

Universal adversarial perturbations for CNN classiﬁers in EEG-based BCIs,

Z. Liu, L. Meng, X. Zhang, W. Fang, and D. Wu, “Universal adversarial perturbations for CNN classiﬁers in EEG-based BCIs,” Journal of Neural Engineering , vol. 18, no. 4, p. 0460a4, 2021

2021
[154]

Longevity of a brain–computer interface for amyotrophic lateral sclerosis,

M. J. V ansteensel, S. Leinders, M. P . Branco, N. E. Cron e, T. Denison, Z. V . Freudenburg, S. H. Geukes, P . H. Gosselaar, M. Raemaeke rs, A. Schippers et al. , “Longevity of a brain–computer interface for amyotrophic lateral sclerosis,” New England Journal of Medicine , vo...

2024
[155]

Emo tion and decision making,

J. S. Lerner, Y . Li, P . V aldesolo, and K. S. Kassam, “Emo tion and decision making,” Annual Review of Psychology , vol. 66, no. 1, pp. 799–823, 2015

2015
[156]

Minsky, Society of Mind

M. Minsky, Society of Mind . Simon and Schuster, 1988

1988
[157]

Affective brain-co mputer interfaces (aBCIs): A tutorial,

D. Wu, B.-L. Lu, B. Hu, and Z. Zeng, “Affective brain-co mputer interfaces (aBCIs): A tutorial,” Proc. of the IEEE , vol. 11, no. 10, pp. 1314–1332, 2023

2023
[158]

Optimal arousal identiﬁcation and clas- siﬁcation for affective computing using physiological sig nals: Virtual reality stroop task,

D. Wu, C. G. Courtney, B. J. Lance, S. S. Narayanan, M. E. Dawson, K. S. Oie, and T. D. Parsons, “Optimal arousal identiﬁcation and clas- siﬁcation for affective computing using physiological sig nals: Virtual reality stroop task,” IEEE Trans. Affective Computing , vol. 1, no....

2010
[159]

A multimodal approach to est imating vig- ilance using EEG and forehead EOG,

W.-L. Zheng and B.-L. Lu, “A multimodal approach to est imating vig- ilance using EEG and forehead EOG,” Journal of Neural Engineering , vol. 14, no. 2, p. 026017, 2017. UNDER REVIEW A T IEEE REVIEWS IN BIOMEDICAL ENGINEERING 24

2017
[160]

Multimodal emoti on recognition in response to videos,

M. Soleymani, M. Pantic, and T. Pun, “Multimodal emoti on recognition in response to videos,” IEEE Trans. Affective Computing , vol. 3, no. 2, pp. 211–223, 2012

2012
[161]

Joint blind source separation for neurophysiological data analysis: Multiset and multim odal meth- ods,

X. Chen, Z. J. Wang, and M. McKeown, “Joint blind source separation for neurophysiological data analysis: Multiset and multim odal meth- ods,” IEEE Signal Processing Magazine , vol. 33, no. 3, pp. 86–107, 2016

2016
[162]

CiABL: Compl eteness- induced adaptative broad learning for cross-subject emoti on recognition with EEG and eye movement signals,

X. Gong, C. L. P . Chen, B. Hu, and T. Zhang, “CiABL: Compl eteness- induced adaptative broad learning for cross-subject emoti on recognition with EEG and eye movement signals,” IEEE Trans. Affective Comput- ing, vol. 15, no. 4, pp. 1970–1984, 2024

1970
[163]

Arousal recogni tion using audio-visual features and fMRI-based brain response,

J. Han, X. Ji, X. Hu, L. Guo, and T. Liu, “Arousal recogni tion using audio-visual features and fMRI-based brain response,” IEEE Trans. Affective Computing , vol. 6, no. 4, pp. 337–347, 2015

2015
[164]

Semi-supervised deep generative modelling of incomplete multi- modality emotional data,

C. Du, C. Du, H. Wang, J. Li, W.-L. Zheng, B.-L. Lu, and H. He, “Semi-supervised deep generative modelling of incomplete multi- modality emotional data,” in Proc. ACM Int’l Conf. Multimedia , Seoul, South Korea, Oct. 2018, pp. 108–116

2018
[165]

E motion- Meter: A multimodal framework for recognizing human emotio ns,

W.-L. Zheng, W. Liu, Y . Lu, B.-L. Lu, and A. Cichocki, “E motion- Meter: A multimodal framework for recognizing human emotio ns,” IEEE Trans. Cybernetics , vol. 49, no. 3, pp. 1110–1122, 2019

2019
[166]

Simplifying multimo dal emotion recognition with single eye movement modality,

X. Y an, L.-M. Zhao, and B.-L. Lu, “Simplifying multimo dal emotion recognition with single eye movement modality,” in Proc. ACM Int’l Conf. Multimedia, Virtual, Oct. 2021, pp. 1057–1063

2021
[167]

Mul timodal adaptive emotion transformer with ﬂexible modality inputs on a novel dataset with continuous labels,

W.-B. Jiang, X.-H. Liu, W.-L. Zheng, and B.-L. Lu, “Mul timodal adaptive emotion transformer with ﬂexible modality inputs on a novel dataset with continuous labels,” in Proc. ACM Int’l Conf. Multimedia , Ottawa, Canada, Oct. 2023, pp. 5975–5984

2023
[168]

MBCFNet: A multimodal brain–computer fusion network for human inten tion recognition,

Z. Li, G. Zhang, S. Okada, L. Wang, B. Zhao, and J. Dang, “ MBCFNet: A multimodal brain–computer fusion network for human inten tion recognition,” Knowledge-Based Systems , vol. 296, p. 111826, 2024

2024
[169]

R esearch on multimodal emotion recognition based on fusion of electr oen- cephalogram and electrooculography,

J. Yin, M. Wu, Y . Y ang, P . Li, F. Li, W. Liang, and Z. Lv, “R esearch on multimodal emotion recognition based on fusion of electr oen- cephalogram and electrooculography,” IEEE Trans. Instrumentation and Measurement, vol. 73, pp. 1–12, 2024

2024
[170]

Dynam ic conﬁdence-aware multi-modal emotion recognition,

Q. Zhu, C. Zheng, Z. Zhang, W. Shao, and D. Zhang, “Dynam ic conﬁdence-aware multi-modal emotion recognition,” IEEE Trans. Af- fective Computing , vol. 15, no. 3, pp. 1358–1370, 2024

2024
[171]

Dynamic alignment and fusion of multimodal physiolo gical patterns for stress recognition,

X. Zhang, X. Wei, Z. Zhou, Q. Zhao, S. Zhang, Y . Y ang, R. L i, and B. Hu, “Dynamic alignment and fusion of multimodal physiolo gical patterns for stress recognition,” IEEE Trans. Affective Computing , vol. 15, no. 2, pp. 685–696, 2024

2024
[172]

Multimodal neurophysiological transformer for emotion recognition,

S. Koorathota, Z. Khan, P . Lapborisuth, and P . Sajda, “ Multimodal neurophysiological transformer for emotion recognition, ” in Proc. Int’l Conf. IEEE Engineering Medicine Biology Society , Glasgow, United Kingdom, Jul. 2022, pp. 3563–3567

2022
[173]

Cross-modal credibility modelling for EEG-based multimo dal emo- tion recognition,

Y . Zhang, H. Liu, D. Wang, D. Zhang, T. Lou, Q. Zheng, and C. Quek, “Cross-modal credibility modelling for EEG-based multimo dal emo- tion recognition,” Journal of Neural Engineering , vol. 21, no. 2, p. 026040, 2024

2024
[174]

MTNet: Mul timodal transformer network for mild depression detection through fusion of EEG and eye tracking,

F. Zhu, J. Zhang, R. Dang, B. Hu, and Q. Wang, “MTNet: Mul timodal transformer network for mild depression detection through fusion of EEG and eye tracking,” Biomedical Signal Processing and Control , vol. 100, p. 106996, 2025

2025
[175]

The human connectome project: a data acquisition perspect ive,

D. C. V an Essen, K. Ugurbil, E. Auerbach, D. Barch, T. E. Behrens, R. Bucholz, A. Chang, L. Chen, M. Corbetta, S. W. Curtiss et al. , “The human connectome project: a data acquisition perspect ive,” Neuroimage, vol. 62, no. 4, pp. 2222–2231, 2012

2012
[176]

The minimal preprocessing pipelines for the human connec tome project,

M. F. Glasser, S. N. Sotiropoulos, J. A. Wilson, T. S. Co alson, B. Fischl, J. L. Andersson, J. Xu, S. Jbabdi, M. Webster, J. R. Polimeni et al., “The minimal preprocessing pipelines for the human connec tome project,” Neuroimage, vol. 80, pp. 105–124, 2013

2013
[177]

Scaling law in neural data: Non-invasive speech d ecoding with 175 hours of EEG data,

M. Sato, K. Tomeoka, I. Horiguchi, K. Arulkumaran, R. K anai, and S. Sasai, “Scaling law in neural data: Non-invasive speech d ecoding with 175 hours of EEG data,” arXiv preprint arXiv:2407.07595 , 2024

2024 arXiv
[178]

A survey on transfer learning,

S. J. Pan and Q. Y ang, “A survey on transfer learning,” IEEE Trans. Knowledge and Data Engineering , vol. 22, no. 10, pp. 1345–1359, 2010

2010
[179]

A comprehensive survey on transfer learning,

F. Zhuang, Z. Qi, K. Duan, D. Xi, Y . Zhu, H. Zhu, H. Xiong, and Q. He, “A comprehensive survey on transfer learning,” Proc. of the IEEE, vol. 109, no. 1, pp. 43–76, 2021

2021
[180]

Transfer learning for EEG-b ased brain–computer interfaces: A review of progress made since 2016,

D. Wu, Y . Xu, and B.-L. Lu, “Transfer learning for EEG-b ased brain–computer interfaces: A review of progress made since 2016,” IEEE Trans. Cognitive and Developmental Systems , vol. 14, no. 1, pp. 4–19, 2022

2016
[181]

Transfer learning for mot or imagery based brain-computer interfaces: A tutorial,

D. Wu, X. Jiang, and R. Peng, “Transfer learning for mot or imagery based brain-computer interfaces: A tutorial,” Neural Networks , vol. 153, pp. 235–253, 2022

2022
[182]

A survey on negat ive transfer,

W. Zhang, L. Deng, L. Zhang, and D. Wu, “A survey on negat ive transfer,” IEEE/CAA Journal of Automatica Sinica , vol. 10, no. 2, pp. 305–329, 2023

2023
[183]

On the effects of data normalization for domain adaptation on EEG data,

A. Apicella, F. Isgr` o, A. Pollastro, and R. Prevete, “ On the effects of data normalization for domain adaptation on EEG data,” Engineering Applications of Artiﬁcial Intelligence , vol. 123, p. 106205, 2023

2023
[184]

Trans- fer learning: A Riemannian geometry framework with applica tions to brain–computer interfaces,

P . Zanini, M. Congedo, C. Jutten, S. Said, and Y . Bertho umieu, “Trans- fer learning: A Riemannian geometry framework with applica tions to brain–computer interfaces,” IEEE Trans. Biomedical Engineering , vol. 65, no. 5, pp. 1107–1116, 2018

2018
[185]

Transfer learning for brain-computer interfaces: A Euclidean space data alignment approach,

H. He and D. Wu, “Transfer learning for brain-computer interfaces: A Euclidean space data alignment approach,” IEEE Trans. Biomedical Engineering, vol. 67, no. 2, pp. 399–410, 2020

2020
[186]

Inter- and intra-subject tra nsfer reduces calibration effort for high-speed SSVEP-based BCI s,

C. M. Wong, Z. Wang, B. Wang, K. F. Lao, A. Rosa, P . Xu, T.- P . Jung, C. L. P . Chen, and F. Wan, “Inter- and intra-subject tra nsfer reduces calibration effort for high-speed SSVEP-based BCI s,” IEEE Trans. Neural Systems and Rehabilitation Engineering , vol. 28, no. 10, pp...

2020
[187]

Manifold embedded knowledge trans fer for brain-computer interfaces,

W. Zhang and D. Wu, “Manifold embedded knowledge trans fer for brain-computer interfaces,” IEEE Trans. Neural Systems and Rehabil- itation Engineering , vol. 28, no. 5, pp. 1117–1127, 2020

2020
[188]

T-TIME: Test- time information maximization ensemble for plug-and-play BCIs ,

S. Li, Z. Wang, H. Luo, L. Ding, and D. Wu, “T-TIME: Test- time information maximization ensemble for plug-and-play BCIs ,” IEEE Trans. Biomedical Engineering , vol. 71, no. 2, pp. 423–432, 2024

2024
[189]

Multi- modal domain adaptation variational autoencoder for EEG-based e motion recognition,

Y . Wang, S. Qiu, D. Li, C. Du, B.-L. Lu, and H. He, “Multi- modal domain adaptation variational autoencoder for EEG-based e motion recognition,” IEEE/CAA Journal of Automatica Sinica , vol. 9, no. 9, pp. 1612–1626, 2022

2022
[190]

Domain adaptati on for EEG emotion recognition based on latent representation sim ilarity,

J. Li, S. Qiu, C. Du, Y . Wang, and H. He, “Domain adaptati on for EEG emotion recognition based on latent representation sim ilarity,” IEEE Trans. Cognitive and Developmental Systems , vol. 12, no. 2, pp. 344–353, 2020

2020
[191]

Unsupervis ed domain adaptation for cross-patient seizure classiﬁcation,

Z. Wang, W. Zhang, S. Li, X. Chen, and D. Wu, “Unsupervis ed domain adaptation for cross-patient seizure classiﬁcation,” Journal of Neural Engineering, vol. 20, no. 6, p. 066002, 2023

2023
[192]

Cross-dat aset variability problem in EEG decoding with deep learning,

L. Xu, M. Xu, Y . Ke, X. An, S. Liu, and D. Ming, “Cross-dat aset variability problem in EEG decoding with deep learning,” Frontiers in Human Neuroscience, vol. 14, p. 103, 2020

2020
[193]

Cross-dataset transfer learning for motor ima gery signal classiﬁcation via multi-task learning and pre-trai ning,

Y . Xie, K. Wang, J. Meng, J. Y ue, L. Meng, W. Yi, T.-P . Jun g, M. Xu, and D. Ming, “Cross-dataset transfer learning for motor ima gery signal classiﬁcation via multi-task learning and pre-trai ning,” Journal of Neural Engineering , vol. 20, no. 5, p. 056037, 2023

2023
[194]

Fa- cilitating calibration in high-speed BCI spellers via leve raging cross- device shared latent responses,

M. Nakanishi, Y .-T. Wang, C.-S. Wei, K.-J. Chiang, and T.-P . Jung, “Fa- cilitating calibration in high-speed BCI spellers via leve raging cross- device shared latent responses,” IEEE Trans. Biomedical Engineering , vol. 67, no. 4, pp. 1105–1113, 2020

2020
[195]

Aggre gating intrinsic information to enhance BCI performance through f ederated learning,

R. Liu, Y . Chen, A. Li, Y . Ding, H. Y u, and C. Guan, “Aggre gating intrinsic information to enhance BCI performance through f ederated learning,” Neural Networks, vol. 172, p. 106100, 2024

2024
[196]

Heterogeneous supe rvised domain adaptation (HSDA) for cross-device EEG classiﬁcati on,

S. Li, Z. Wang, S. Zheng, and D. Wu, “Heterogeneous supe rvised domain adaptation (HSDA) for cross-device EEG classiﬁcati on,” IEEE Trans. Pattern Analysis and Machine Intelligence , under review. 2025

2025
[197]

Spatial distill ation based distribution alignment (SDDA) for cross-headset EEG class iﬁcation,

D. Liu, S. Li, Z. Wang, W. Li, and D. Wu, “Spatial distill ation based distribution alignment (SDDA) for cross-headset EEG class iﬁcation,” IEEE Trans. Neural Systems and Rehabilitation Engineering , under review. 2025

2025
[198]

Cross-species and cross-mod ality framework for epileptic seizure detection via multi-space alignment,

Z. Wang, S. Li, and D. Wu, “Cross-species and cross-mod ality framework for epileptic seizure detection via multi-space alignment,” National Science Review , under review. 2025

2025
[199]

Different set domain adaptation for br ain-computer interfaces: A label alignment approach,

H. He and D. Wu, “Different set domain adaptation for br ain-computer interfaces: A label alignment approach,” IEEE Trans. Neural Systems and Rehabilitation Engineering , vol. 28, no. 5, pp. 1091–1108, 2020

2020
[200]

Label alignment improves EEG-based machine learning-bas ed classi- ﬁcation of traumatic brain injury,

M. Vishwanath, N. Dutt, A. M. Rahmani, M. M. Lim, and H. C ao, “Label alignment improves EEG-based machine learning-bas ed classi- ﬁcation of traumatic brain injury,” in Int’l Conf. IEEE Engineering in Medicine & Biology Society , Glasgow, United Kingdom, Jul. 2022, pp. 3546–3549

2022
[201]

Dee p time series models: A comprehensive survey and benchmark,

Y . Wang, H. Wu, J. Dong, Y . Liu, M. Long, and J. Wang, “Dee p time series models: A comprehensive survey and benchmark,” arXiv preprint arXiv:2407.13278, 2024

2024 arXiv
[202]

Deep learning with convolutional neural networks for EEG d ecoding UNDER REVIEW A T IEEE REVIEWS IN BIOMEDICAL ENGINEERING 25 and visualization,

R. T. Schirrmeister, J. T. Springenberg, L. D. J. Fiede rer, M. Glasstetter, K. Eggensperger, M. Tangermann, F. Hutter, W. Burgard, and T . Ball, “Deep learning with convolutional neural networks for EEG d ecoding UNDER REVIEW A T IEEE REVIEWS IN BIOMEDICAL ENGINEERING 25 and ...

2017
[203]

EEGNet: A compact convolutional neur al network for EEG-based brain-computer interfaces,

V . J. Lawhern, A. J. Solon, N. R. Waytowich, S. M. Gordon , C. P . Hung, and B. J. Lance, “EEGNet: A compact convolutional neur al network for EEG-based brain-computer interfaces,” Journal of Neural Engineering, vol. 15, no. 5, p. 056013, 2018

2018
[204]

Learning temporal inf ormation for brain-computer interface using convolutional neural netw orks,

S. Sakhavi, C. Guan, and S. Y an, “Learning temporal inf ormation for brain-computer interface using convolutional neural netw orks,” IEEE Trans. Neural Networks and Learning Systems , vol. 29, no. 11, pp. 5619–5629, 2018

2018
[205]

EEG emotion reco gnition using dynamical graph convolutional neural networks,

T. Song, W. Zheng, P . Song, and Z. Cui, “EEG emotion reco gnition using dynamical graph convolutional neural networks,” IEEE Trans. Affective Computing , vol. 11, no. 3, pp. 532–541, 2020

2020
[206]

TS ception: Capturing temporal dynamics and spatial asymmetry from EEG for emotion recognition,

Y . Ding, N. Robinson, S. Zhang, Q. Zeng, and C. Guan, “TS ception: Capturing temporal dynamics and spatial asymmetry from EEG for emotion recognition,” IEEE Trans. Affective Computing , vol. 14, no. 3, pp. 2238–2250, 2023

2023
[207]

EEG-Deformer: A dense convolutional transformer for brai n-computer interfaces,

Y . Ding, Y . Li, H. Sun, R. Liu, C. Tong, C. Liu, X. Zhou, an d C. Guan, “EEG-Deformer: A dense convolutional transformer for brai n-computer interfaces,” IEEE Journal of Biomedical and Health Informatics , pp. 1–10, early access, 2024

2024
[208]

LGG Net: Learning from local-global-graph representations for bra in–computer interface,

Y . Ding, N. Robinson, C. Tong, Q. Zeng, and C. Guan, “LGG Net: Learning from local-global-graph representations for bra in–computer interface,” IEEE Trans. Neural Networks and Learning Systems , vol. 35, no. 7, pp. 9773–9786, 2024

2024
[209]

Self-supervised learning: Generative or contrastive,

X. Liu, F. Zhang, Z. Hou, L. Mian, Z. Wang, J. Zhang, and J . Tang, “Self-supervised learning: Generative or contrastive,” IEEE Trans. Knowledge and Data Engineering , vol. 35, no. 1, pp. 857–876, 2023

2023
[210]

Se lf-supervised contrastive pre-training for time series via time-frequen cy consistency,

X. Zhang, Z. Zhao, T. Tsiligkaridis, and M. Zitnik, “Se lf-supervised contrastive pre-training for time series via time-frequen cy consistency,” in Proc. Advances in Neural Information Processing Systems , New Orleans, LA, Nov. 2022, pp. 3988–4003

2022
[211]

BIOT: Biosignal tran sformer for cross-data learning in the wild,

C. Y ang, M. Westover, and J. Sun, “BIOT: Biosignal tran sformer for cross-data learning in the wild,” in Proc. Advances in Neural Information Processing Systems , New Orleans, LA, Dec. 2023

2023
[212]

B rant: Foundation model for intracranial neural signal,

D. Zhang, Z. Y uan, Y . Y ang, J. Chen, J. Wang, and Y . Li, “B rant: Foundation model for intracranial neural signal,” in Proc. Advances in Neural Information Processing Systems , New Orleans, LA, Dec. 2023

2023
[213]

EEGPT: Pre trained transformer for universal and reliable representation of E EG signals,

G. Wang, W. Liu, Y . He, C. Xu, L. Ma, and H. Li, “EEGPT: Pre trained transformer for universal and reliable representation of E EG signals,” in Proc. Advances in Neural Information Processing Systems , V ancouver, Canada, Dec. 2024

2024
[214]

Large brain model for l earning generic representations with tremendous EEG data in BCI,

W. Jiang, L. Zhao, and B.-L. Lu, “Large brain model for l earning generic representations with tremendous EEG data in BCI,” i n Int’l Conf. Learning Representations , Vienna, Austria, May. 2024

2024
[215]

Brain-conditi onal mul- timodal synthesis: A survey and taxonomy,

W. Mai, J. Zhang, P . Fang, and Z. Zhang, “Brain-conditi onal mul- timodal synthesis: A survey and taxonomy,” IEEE Trans. Artiﬁcial Intelligence, pp. 1–20, early access. 2024

2024
[216]

UMB RAE: Uniﬁed multimodal brain decoding,

W. Xia, R. de Charette, C. Oztireli, and J.-H. Xue, “UMB RAE: Uniﬁed multimodal brain decoding,” in Proc. European Conf. Computer Vision, Milan, Italy, Sep. 2024, pp. 242–259

2024
[217]

Long-range temporal correlations and scaling be havior in human brain oscillations,

K. Linkenkaer-Hansen, V . V . Nikouline, J. M. Palva, an d R. J. Il- moniemi, “Long-range temporal correlations and scaling be havior in human brain oscillations,” Journal of Neuroscience , vol. 21, no. 4, pp. 1370–1377, 2001

2001
[218]

Colored noise and computat ional inference in neurophysiological (fMRI) time series analys is: resampling methods in time and wavelet domains,

E. Bullmore, C. Long, J. Suckling, J. Fadili, G. Calver t, F. Zelaya, T. A. Carpenter, and M. Brammer, “Colored noise and computat ional inference in neurophysiological (fMRI) time series analys is: resampling methods in time and wavelet domains,” Human Brain Mapping, vol. 12,...

2001
[219]

The perils and pitfalls of blo ck design for EEG classiﬁcation experiments,

R. Li, J. S. Johansen, H. Ahmed, T. V . Ilyevsky, R. B. Wil bur, H. M. Bharadwaj, and J. M. Siskind, “The perils and pitfalls of blo ck design for EEG classiﬁcation experiments,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 43, no. 1, pp. 316–333, 2021

2021
[220]

Deep learning human mind for automated visual clas siﬁca- tion,

C. Spampinato, S. Palazzo, I. Kavasidis, D. Giordano, N. Souly, and M. Shah, “Deep learning human mind for automated visual clas siﬁca- tion,” in Proc. IEEE Conf. Computer Vision and Pattern Recognition , Honolulu, HI, Jul. 2017, pp. 6809–6817

2017
[221]

Generative adversarial networks conditioned by brain sig nals,

S. Palazzo, C. Spampinato, I. Kavasidis, D. Giordano, and M. Shah, “Generative adversarial networks conditioned by brain sig nals,” in Proc. IEEE Int’l Conf. Computer Vision , V enice, Italy, Oct. 2017, pp. 3410–3418

2017
[222]

Brain2Image: Converting brain signals into images,

I. Kavasidis, S. Palazzo, C. Spampinato, D. Giordano, and M. Shah, “Brain2Image: Converting brain signals into images,” in Proc. ACM Int’l Conf. Multimedia , Mountain View, CA, Oct. 2017, pp. 1809–1817

2017
[223]

Multi-view a dversari- ally learned inference for cross-domain joint distributio n matching,

C. Du, C. Du, X. Xie, C. Zhang, and H. Wang, “Multi-view a dversari- ally learned inference for cross-domain joint distributio n matching,” in Proc. ACM SIGKDD Int’l Conf. Knowledge Discovery & Data Mini ng, London, United Kingdom, Aug. 2018, pp. 1348–1357

2018
[224]

Envisioned speech recognition using EEG sensors,

P . Kumar, R. Saini, P . P . Roy, P . K. Sahu, and D. P . Dogra,“Envisioned speech recognition using EEG sensors,” Personal and Ubiquitous Computing, vol. 22, pp. 185–199, 2018

2018
[225]

ThoughtViz: Visualizing human thoughts using generative adversarial n etwork,

P . Tirupattur, Y . S. Rawat, C. Spampinato, and M. Shah, “ThoughtViz: Visualizing human thoughts using generative adversarial n etwork,” in Proc. ACM Int’l Conf. Multimedia , Seoul, South Korea, Oct. 2018, pp. 950–958

2018
[226]

Decoding brain representations by multimodal lea rning of neural activity and visual features,

S. Palazzo, C. Spampinato, I. Kavasidis, D. Giordano, J. Schmidt, and M. Shah, “Decoding brain representations by multimodal lea rning of neural activity and visual features,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 43, no. 11, pp. 3833–3849, 2021

2021
[227]

Long-term wireless streaming of neural recordings for ci rcuit discovery and adaptive stimulation in individuals with Par kinson’s disease,

R. Gilron, S. Little, R. Perrone, R. Wilt, C. de Hemptin ne, M. S. Y aroshinsky, C. A. Racine, S. S. Wang, J. L. Ostrem, P . S. Lars on et al. , “Long-term wireless streaming of neural recordings for ci rcuit discovery and adaptive stimulation in individuals with Par kinson’s ...

2021
[228]

Investigating critical fre quency bands and channels for EEG-based emotion recognition with deep ne ural networks,

W.-L. Zheng and B.-L. Lu, “Investigating critical fre quency bands and channels for EEG-based emotion recognition with deep ne ural networks,” IEEE Trans. Autonomous Mental Development, vol. 7, no. 3, pp. 162–175, 2015

2015
[229]

Off-line and on-line vigilanc e estimation based on linear dynamical system and manifold learning,

L.-C. Shi and B.-L. Lu, “Off-line and on-line vigilanc e estimation based on linear dynamical system and manifold learning,” in Int’l Conf. IEEE Engineering in Medicine and Biology , Buenos Aires, Argentina, Aug. 2010, pp. 6587–6590

2010
[230]

Leakage and the reproduci bility crisis in machine-learning-based science,

S. Kapoor and A. Narayanan, “Leakage and the reproduci bility crisis in machine-learning-based science,” Patterns, vol. 4, no. 9, 2023

2023
[231]

Brain leaks and consumer neurotechnology,

M. Ienca, P . Haselager, and E. J. Emanuel, “Brain leaks and consumer neurotechnology,” Nature Biotechnology, vol. 36, no. 9, pp. 805–810, 2018

2018
[232]

Em otion recogni- tion of playing musicians from EEG, ECG, and acoustic signal s,

L. Turchet, B. O’Sullivan, R. Ortner, and C. Guger, “Em otion recogni- tion of playing musicians from EEG, ECG, and acoustic signal s,” IEEE Trans. Human-Machine Systems , vol. 54, no. 5, pp. 619–629, 2024

2024
[233]

Beyond neural dat a: Cognitive biometrics and mental privacy,

P . Magee, M. Ienca, and N. Farahany, “Beyond neural dat a: Cognitive biometrics and mental privacy,” Neuron, vol. 112, no. 18, pp. 3017– 3028, 2024

2024
[234]

Tiny noise, big mistakes: Adversarial per turbations induce errors in brain-computer interface spellers,

X. Zhang, D. Wu, L. Ding, H. Luo, C.-T. Lin, T.-P . Jung, a nd R. Chavarriaga, “Tiny noise, big mistakes: Adversarial per turbations induce errors in brain-computer interface spellers,” National Science Review, vol. 8, no. 4, p. nwaa233, 2021

2021
[235]

On the vulnerability of CNN classiﬁ ers in EEG-based BCIs,

X. Zhang and D. Wu, “On the vulnerability of CNN classiﬁ ers in EEG-based BCIs,” IEEE Trans. Neural Systems and Rehabilitation Engineering, vol. 27, no. 5, pp. 814–825, 2019

2019
[236]

Generative pertu rbation network for universal adversarial attacks on brain-comput er interfaces,

J. Jung, H. Moon, G. Y u, and H. Hwang, “Generative pertu rbation network for universal adversarial attacks on brain-comput er interfaces,” IEEE Journal of Biomedical and Health Informatics , vol. 27, no. 11, pp. 5622–5633, 2023

2023
[237]

Physically-constrained adversarial attacks on brain-ma chine inter- faces,

X. Wang, R. O. S. Quintanilla, M. Hersche, L. Benini, an d G. Singh, “Physically-constrained adversarial attacks on brain-ma chine inter- faces,” in Proc. Advances in Neural Information Processing Systems W orkshop on Trustworthy and Socially Responsible Machine L earning, New...

2022
[238]

Single-sensor sparse adversarial perturbation attacks against behavioural biometrics,

R. Gunawardena, S. Jayawardena, S. Seneviratne, R. Ma sood, and S. S. Kanhere, “Single-sensor sparse adversarial perturbation attacks against behavioural biometrics,” IEEE Internet of Things Journal , vol. 11, no. 16, pp. 27 303–27 321, 2024

2024
[239]

BadCLIP: Dual-embedding guided backdoor attack on multimodal contr astive learning,

S. Liang, M. Zhu, A. Liu, B. Wu, X. Cao, and E.-C. Chang, “ BadCLIP: Dual-embedding guided backdoor attack on multimodal contr astive learning,” in Proc. IEEE/CVF Conf. Computer Vision and Pattern Recognition, Seattle, W A, Jun. 2024, pp. 24 645–24 654

2024
[240]

Alignment-based adversar ial training (ABA T) for improving the robustness and accuracy of EEG-bas ed BCIs,

X. Chen, Z. Wang, and D. Wu, “Alignment-based adversar ial training (ABA T) for improving the robustness and accuracy of EEG-bas ed BCIs,” IEEE Trans. Neural Systems and Rehabilitation Engineering , vol. 32, pp. 1703–1714, 2024

2024
[241]

RobustBench: a st andard- ized adversarial robustness benchmark,

F. Croce, M. Andriushchenko, V . Sehwag, E. Debenedett i, N. Flam- marion, M. Chiang, P . Mittal, and M. Hein, “RobustBench: a st andard- ized adversarial robustness benchmark,” in Proc. Neural Information Processing Systems Track on Datasets and Benchmarks , Virtual, Dec. 2021

2021
[242]

Adversarial robustness b enchmark for EEG-based brain–computer interfaces,

L. Meng, X. Jiang, and D. Wu, “Adversarial robustness b enchmark for EEG-based brain–computer interfaces,” Future Generation Computer Systems, vol. 143, pp. 231–247, 2023

2023
[243]

Privacy-preserving brain-com puter interfaces: A systematic review,

K. Xia, W. Duch, Y . Sun, K. Xu, W. Fang, H. Luo, Y . Zhang, D . Sang, X. Xu, F.-Y . Wang, and D. Wu, “Privacy-preserving brain-com puter interfaces: A systematic review,” IEEE Trans. Computational Social Systems, vol. 10, no. 5, pp. 2312–2324, 2023. UNDER REVIEW A T IEEE REVI...

2023
[244]

On the feasibility of side-channel attacks with brain-comput er interfaces,

I. Martinovic, D. Davies, M. Frank, D. Perito, T. Ros, a nd D. Song, “On the feasibility of side-channel attacks with brain-comput er interfaces,” in Proc. 21st USENIX Security Symposium , Bellevue, W A, Aug. 2012, pp. 143–158

2012
[245]

Mind you r privacy: Privacy leakage through BCI applications using machine lea rning methods,

O. Landau, A. Cohen, S. Gordon, and N. Nissim, “Mind you r privacy: Privacy leakage through BCI applications using machine lea rning methods,” Knowledge-Based Systems , vol. 198, p. 105932, 2020

2020
[246]

User-wise pert urbations for user identity protection in EEG-based BCIs,

X. Chen, S. Li, Y . Tu, Z. Wang, and D. Wu, “User-wise pert urbations for user identity protection in EEG-based BCIs,” Journal of Neural Engineering, 2024, in press

2024
[247]

Federated moto r imagery classiﬁcation for privacy-preserving brain-computer int erfaces,

T. Jia, L. Meng, S. Li, J. Liu, and D. Wu, “Federated moto r imagery classiﬁcation for privacy-preserving brain-computer int erfaces,” IEEE Trans. Neural Systems and Rehabilitation Engineering , vol. 32, pp. 3442–3451, 2024

2024
[248]

Mu-ming poo: China brain project and the futu re of chinese neuroscience,

L. Wang, “Mu-ming poo: China brain project and the futu re of chinese neuroscience,” National Science Review , vol. 4, no. 2, pp. 258–263, 2017

2017
[249]

The BRAI N Initiative: a pioneering program on the precipice,

C. T. Miller, X. Chen, Z. R. Donaldson, B. J. Marlin, D. Y . Tsao, Z. M. Williams, M. Zelikowsky, H. Zeng, and W. Hong, “The BRAI N Initiative: a pioneering program on the precipice,” Nature Neuroscience, vol. 27, p. 2264–2266, 2024

2024

Pith tools

Reviewed August 9, 2026 · model on record in the stance chip above.

[1] [1]

D. L. Schacter, D. T. Gilbert, and D. M. Wegner, Psychology. Macmil- lan, 2009

2009

[2] [2]

Multimo dal machine learning: A survey and taxonomy,

T. Baltruˇ saitis, C. Ahuja, and L.-P . Morency, “Multimo dal machine learning: A survey and taxonomy,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 41, no. 2, pp. 423–443, 2019

2019

[3] [3]

Brain–computer interfaces for multimodal interaction: a survey and principles,

H. G¨ urk¨ ok and A. Nijholt, “Brain–computer interfaces for multimodal interaction: a survey and principles,” Int’l Journal of Human-Computer Interaction, vol. 28, no. 5, pp. 292–307, 2012

2012

[4] [4]

R. P . Rao, Brain-Computer Interfacing: an Introduction . Cambridge University Press, 2013

2013

[5] [5]

Utiliz ing sec- ondary input from passive brain-computer interfaces for en hancing human-machine interaction,

T. O. Zander, C. Kothe, S. Welke, and M. R¨ otting, “Utiliz ing sec- ondary input from passive brain-computer interfaces for en hancing human-machine interaction,” in Proc. Int’l Conf. F oundations of Aug- mented Cognition. Neuroergonomics and Operational Neuros cience, San Diego, CA, Jul. 2009, pp. 759–771

2009

[6] [6]

A brain-computer interface using electrocorticog raphic signals in humans,

E. C. Leuthardt, G. Schalk, J. R. Wolpaw, J. G. Ojemann, an d D. W. Moran, “A brain-computer interface using electrocorticog raphic signals in humans,” Journal of Neural Engineering , vol. 1, no. 2, pp. 63–71, 2004

2004

[7] [7]

Lesion, “irritative

J. Talairach and J. Bancaud, “Lesion, “irritative” zone and epileptogenic focus,” Conﬁnia Neurologica , vol. 27, no. 1, pp. 91–94, 1966

1966

[8] [8]

Cortical neural prosthetics,

A. B. Schwartz, “Cortical neural prosthetics,” Annual Review of Neu- roscience, vol. 27, pp. 487–507, 2004

2004