A Convolutional Neural Network with Feature Selection for Generating Explainable 1D Image Information for Brain Disease Diagnosis
摘要
An explainable and efficient convolutional neural network (CNN) consists of convolutional layers, a new feature selection (FS) layer, a classifier, and a novel “patch row-column ranking map” (PRCRM). patchpatchTop-ranked common features selected by different FS methods are used to generate the feature accumulation matrix. The feature accumulation matrix is used to rank patch rows and patch columns in the PRCRM to explain the relationship among an input image, top-ranked features, top-ranked feature maps, and decisions of the CNN. Simulation results using the Alzheimer’s disease (AD) MRI preprocessed images for 4-class image classification with 6, 400 \(128\times 128\) images indicate that patch rows 6 and 11 (12.5% of 16 patch rows) and patch columns 7 and 8 (12.5% of 16 patch columns) are related to 27 distinct brain areas (48.2% of the 56 brain areas associated with AD), and 13 brain areas (28.9% of the 45 brain areas likely associated with AD). In addition, they are not associated with any brain areas not likely associated with AD. The fine-tuned ResNet50-FS model using a small number of selected features is more accurate and more memory-efficient than the traditional ResNet50 model using all features. Thus, the new patch row-column ranking method can generate useful 1D image-row-column information to interpret decisions of a CNN model. The hybrid 1D-2D-3D information in important brain areas associated with the top patches, top patch rows, and top patch columns will be used to make a robust, rational and explainable brain disease diagnosis.