Fine-Tuning Arabic BERT Models with Hybrid CNN–BiLSTM Architecture for Disinformative Tweet Detection
摘要
The phenomenon of disinformative tweet propagation on social networks poses a significant challenge for researchers in the field of natural language processing (NLP) due to its real-world impact on various aspects of society, including health, economics, and politics. This paper addresses the automated identification of disinformative tweets within the context of social networks, specifically focusing on Arabic tweets published during the COVID-19 pandemic. A hybrid deep learning model combining convolutional neural networks (CNN) and bidirectional long short-term memory (BiLSTM) was tested on the ArAIEval dataset. Arabic BERT variants, including AraBERT, MARBERT, and CaMelBERT, were fine-tuned and used as embedding layers. To address the issue of data imbalance, three data augmentation techniques were implemented: (1) synonym replacement, (2) random deletion, and (3) contextualized embedding-based replacement. The hybrid CNN–BiLSTM architecture, including the AraBERT embedding layer, achieved a micro-F1 score of 91.00% with the utilization of a BERT-based data augmentation strategy on the minority class.