<p>Brain-computer interfaces (BCIs) are evolving from research prototypes into clinical, assistive, and performance enhancement technologies. Despite the rapid rise and promise of implantable technologies, there is a need for better and more capable wearable and non-invasive approaches whilst also minimising hardware requirements. We present a non-invasive BCI for iterative selection-based mind-drawing that infers a subject’s internal visual intent through iterative selection of adaptive visual probes presented on a screen encoded at different flicker-frequencies and analyses the steady-state visual evoked potentials (SSVEPs). Gabor-inspired or machine-learned policies dynamically update the spatial placement of the visual probes on the screen to explore the image space and reconstruct simple imagined shapes within approximately two minutes or less using just single-channel EEG data. Additionally, by leveraging stable diffusion models, reconstructed mental images can be transformed into realistic and detailed visual representations. Whilst we expect that similar results might be achievable with e.g. eye-tracking techniques, our work shows that symbiotic human-AI interaction can increase BCI bit-rates by more than a factor 5x, providing a platform for future development of AI-augmented BCI.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Symbiotic brain-machine drawing via visual brain-computer interfaces

  • Gao Wang,
  • Yingying Huang,
  • Lars Muckli,
  • Daniele Faccio

摘要

Brain-computer interfaces (BCIs) are evolving from research prototypes into clinical, assistive, and performance enhancement technologies. Despite the rapid rise and promise of implantable technologies, there is a need for better and more capable wearable and non-invasive approaches whilst also minimising hardware requirements. We present a non-invasive BCI for iterative selection-based mind-drawing that infers a subject’s internal visual intent through iterative selection of adaptive visual probes presented on a screen encoded at different flicker-frequencies and analyses the steady-state visual evoked potentials (SSVEPs). Gabor-inspired or machine-learned policies dynamically update the spatial placement of the visual probes on the screen to explore the image space and reconstruct simple imagined shapes within approximately two minutes or less using just single-channel EEG data. Additionally, by leveraging stable diffusion models, reconstructed mental images can be transformed into realistic and detailed visual representations. Whilst we expect that similar results might be achievable with e.g. eye-tracking techniques, our work shows that symbiotic human-AI interaction can increase BCI bit-rates by more than a factor 5x, providing a platform for future development of AI-augmented BCI.