A survey of generative AI in multimodal user interfaces, recommending hybrid interface designs and lightweight on-device frameworks.
Mental-Gen: A Brain-Computer Interface-Based Interactive Method for Interior Space Generative Design
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Interior space design significantly influences residents' daily lives. However, the process often presents high barriers and complex reasoning for users, leading to semantic losses in articulating comprehensive requirements and communicating them to designers. This study proposes the Mental-Gen design method, which focuses on interpreting users' spatial design intentions at neural level and expressing them through generative AI models. We employed unsupervised learning methods to detect similarities in users' brainwave responses to different spatial features, assess the feasibility of BCI commands. We trained and refined generative AI models for each valuable design command. The command prediction process adopted the motor imagery paradigm from BCI research. We trained Support Vector Machine (SVM) models to predict design commands for different spatial features based on EEG features. The results indicate that the Mental-Gen method can effectively interpret design intentions through brainwave signals, assisting users in achieving satisfactory interior space designs using imagined commands.
fields
cs.HC 1years
2024 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Generative AI in Multimodal User Interfaces: Trends, Challenges, and Cross-Platform Adaptability
A survey of generative AI in multimodal user interfaces, recommending hybrid interface designs and lightweight on-device frameworks.