Explainable medicinal plant identification using a hybrid CNN-vision transformer framework
摘要
Image processing has already expanded to substantial importance in today’s world due to its extensive range of applications across several domains, including science, healthcare, and business. One of the ongoing challenges in computer vision is the accurate recognition of plant species, particularly medicinal plants. Traditional methods are error-prone, time-consuming, and reliant on knowledge experts, so there is a need for automation approaches. In this study, we propose an EfficientViT-Net, a hybrid deep learning architecture combining the strengths of vision transformer (ViT) and ResNet50 to enhance feature extraction and classify the medicinal plants accurately and efficiently. The model is designed to overcome the deficiencies of traditional methods by tapping both global contextual information encoded by transformers and local structural information learned using convolutional networks. The suggested model was tested with a benchmark dataset on Indian medicinal plants, including with augmentation methods for enhanced robustness and diversity. Experimental results indicate that EfficientViT-Net obtains 94.7% accuracy, surpassing solely transformer-based architecture models. Furthermore, explainable AI (XAI) techniques, including Grad-CAM, Grad-CAM++, and Eigen-CAM, were employed to provide visual interpretations of the model’s decision-making process by highlighting the most influential regions in the input images. The results show the potential of hybrid approaches to not only accomplish high results but also improve transparency and interpretability in automated medicinal plant species recognition systems.