Multi-modal fusion of acoustic and microwave signals for early detection of Red Palm Weevil infestation
摘要
Fusion of heterogeneous sensor signals offers a promising solution to early Red Palm Weevil (RPW) infestation detection in palm trees. In this work, we present a multimodal detection system that combines acoustic signals from larval activity with microwave backscatter signals to detect the presence of Red Palm Weevil inside a palm tree. The acoustic data is processed using a spectral feature extraction technique, while microwave signals are analyzed using a frequency domain feature extraction to detect shifts that indicate the presence of RPW. Each model undergoes independent feature extraction and classification using lightweight, efficient deep learning models, including an attention-guided fusion classifier and a sensor-guided transformer. To enhance decision reliability, a late fusion approach based on adaptive sequential Kalman filtering is used to fuse the outputs of the individual classifiers. Experimental tests on real-world datasets achieve 96.2% accuracy, demonstrating significant improvement in sensitivity and robustness compared with unimodal systems. The proposed system offers a non-invasive, field-deployable solution for precision pest monitoring and timely intervention in palm plants.