Scholarlink

<p>Allen Coin &amp; Veljko Dubljević discuss the potential implications of a brain-computer interface (BCI) that sends input signals to a calculator which would then “…transmit the result of the calculation to the subject in such a way that the subject could immediately mentally note, verbalize, or record the result” [1]. In other words, the system sends an output, presumably via deep brain stimulation (DBS), which induces thought-like experiences. They characterize this system as being able to enhance cognition and restore the mathematical capacity and self-esteem of those with dyscalculia. However, many reports suggest that DBS and BCI technology can have negative unintended psychological consequences. I introduce a related conceptual model of a “BCI-LLM system” to better illustrate the possible negative unintended psychological consequences of <i>contentful</i> DBS, or neural stimulations that produce meaningful sensations, regardless of whether true cognitive enhancement occurs. It is possible, for example, that a subject can be <i>fooled</i> into thinking that the output of the device is one’s own thought. I call this the <i>Illusion of Directed Production</i> (IDP). I model the phenomenality of contentful DBS experiences alongside <i>auditory verbal hallucinations</i> (AVHs) and <i>thought insertions</i> (TIs) to show the potential for delusion formation and metacognitive and self-narrating disturbances&#xa0;[2–4] when using such systems. I argue that psychological risks and worries are present in such systems regardless of whether they truly enhance cognition or extend the mind.</p>

错误：搜索内容不能为空，请输入英文关键词
错误：关键词超出字数限制，请精简
高级检索

The Psychological Risks of BCI-LLM Cognitive “Enhancement”

  • 期刊论文

  • 发表日期：

    2025年11月22日

查看全文
  • John Tuskey

摘要

Allen Coin & Veljko Dubljević discuss the potential implications of a brain-computer interface (BCI) that sends input signals to a calculator which would then “…transmit the result of the calculation to the subject in such a way that the subject could immediately mentally note, verbalize, or record the result” [1]. In other words, the system sends an output, presumably via deep brain stimulation (DBS), which induces thought-like experiences. They characterize this system as being able to enhance cognition and restore the mathematical capacity and self-esteem of those with dyscalculia. However, many reports suggest that DBS and BCI technology can have negative unintended psychological consequences. I introduce a related conceptual model of a “BCI-LLM system” to better illustrate the possible negative unintended psychological consequences of contentful DBS, or neural stimulations that produce meaningful sensations, regardless of whether true cognitive enhancement occurs. It is possible, for example, that a subject can be fooled into thinking that the output of the device is one’s own thought. I call this the Illusion of Directed Production (IDP). I model the phenomenality of contentful DBS experiences alongside auditory verbal hallucinations (AVHs) and thought insertions (TIs) to show the potential for delusion formation and metacognitive and self-narrating disturbances [2–4] when using such systems. I argue that psychological risks and worries are present in such systems regardless of whether they truly enhance cognition or extend the mind.