Functional magnetic resonance imaging (fMRI) enables the visualization and analysis of brain activity, offering insights into neural processes underlying various cognitive functions and emotional responses. Decoding models, particularly those based on deep learning, have emerged as powerful tools for predicting cognitive states from fMRI data. However, the complex architectures of deep learning models often pose challenges in understanding their decision-making processes. This study proposes a novel approach combining the fMRINet decoding model with the DeepLIFT interpretability technique to unveil hidden neuronal processes involved in distinguishing high and low emotional arousal states. Our results demonstrate robust classification performance of the fMRINet, exceeding chance levels in both typically developing and Autism Spectrum Disorder populations. Importantly, our interpretability analysis identifies statistically relevant regions of interest (ROIs) important for emotional processing, shedding light on both known and novel neural mechanisms underlying emotional arousal. These findings hold promise for the application of explainable models in clinical settings, facilitating the identification of abnormal patterns without relying on predefined assumptions. While our study lays the groundwork for future investigations into the significance of identified ROIs and their broader applicability across diverse populations, addressing limitations such as temporal information and negative contributions remains crucial for model refinement. Overall, our work contributes to advancements in understanding and interpreting neural data, with implications for personalized medicine and enhanced diagnostic capabilities in fMRI research and its clinical applications.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Explainability of fMRI Decoding Models Can Unveil Insights into Neural Mechanisms Related to Emotions

  • Daniel Agostinho,
  • Davide Borra,
  • Miguel Castelo-Branco,
  • Marco Simões

摘要

Functional magnetic resonance imaging (fMRI) enables the visualization and analysis of brain activity, offering insights into neural processes underlying various cognitive functions and emotional responses. Decoding models, particularly those based on deep learning, have emerged as powerful tools for predicting cognitive states from fMRI data. However, the complex architectures of deep learning models often pose challenges in understanding their decision-making processes. This study proposes a novel approach combining the fMRINet decoding model with the DeepLIFT interpretability technique to unveil hidden neuronal processes involved in distinguishing high and low emotional arousal states. Our results demonstrate robust classification performance of the fMRINet, exceeding chance levels in both typically developing and Autism Spectrum Disorder populations. Importantly, our interpretability analysis identifies statistically relevant regions of interest (ROIs) important for emotional processing, shedding light on both known and novel neural mechanisms underlying emotional arousal. These findings hold promise for the application of explainable models in clinical settings, facilitating the identification of abnormal patterns without relying on predefined assumptions. While our study lays the groundwork for future investigations into the significance of identified ROIs and their broader applicability across diverse populations, addressing limitations such as temporal information and negative contributions remains crucial for model refinement. Overall, our work contributes to advancements in understanding and interpreting neural data, with implications for personalized medicine and enhanced diagnostic capabilities in fMRI research and its clinical applications.