Propaganda is a form of persuasion that has been used throughout history with the intention goal of influencing people’s opinions through rhetorical and psychological persuasion techniques for determined ends. Although Arabic ranked as the fourth most-used language on the internet, resources for propaganda detection in languages other than English, especially Arabic, remain extremely limited. To address this gap, the first Arabic dataset for Multi-label Propaganda, Sentiment, and Emotion (MultiProSE) has been introduced. MultiProSE is an open-source extension of the existing Arabic propaganda dataset, ArPro, with the addition of sentiment and emotion annotations for each text. This dataset comprises 8,000 annotated news articles, which is the largest propaganda dataset to date. For each task, several baselines have been developed using large language models (LLMs), such as GPT-4o-mini, and pre-trained language models (PLMs), including three BERT-based models. The best model achieves a macro-F1 score of 75.6% for the propaganda detection task using AraBERT. Additionally, GPT-4o-Mini attains a macro-F1 score of 82.5% for sentiment analysis and 70.7% for emotion detection, respectively. The dataset, annotation guidelines, and source code are all publicly released to facilitate future research and development in Arabic language models and contribute to a deeper understanding of how various opinion dimensions interact in news media ( https://github.com/LubnaAlhenaki/MultiProSE ).

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

MultiProSE: A Multi-label Arabic Dataset for Propaganda, Sentiment, and Emotion Detection

  • Lubna Al-Henaki,
  • Hend Al-Khalifa,
  • Abdulmalik Al-Salman,
  • Hajar Alqubayshi,
  • Hind Al-Twailay,
  • Gheeda Alghamdi,
  • Hawra Aljasim

摘要

Propaganda is a form of persuasion that has been used throughout history with the intention goal of influencing people’s opinions through rhetorical and psychological persuasion techniques for determined ends. Although Arabic ranked as the fourth most-used language on the internet, resources for propaganda detection in languages other than English, especially Arabic, remain extremely limited. To address this gap, the first Arabic dataset for Multi-label Propaganda, Sentiment, and Emotion (MultiProSE) has been introduced. MultiProSE is an open-source extension of the existing Arabic propaganda dataset, ArPro, with the addition of sentiment and emotion annotations for each text. This dataset comprises 8,000 annotated news articles, which is the largest propaganda dataset to date. For each task, several baselines have been developed using large language models (LLMs), such as GPT-4o-mini, and pre-trained language models (PLMs), including three BERT-based models. The best model achieves a macro-F1 score of 75.6% for the propaganda detection task using AraBERT. Additionally, GPT-4o-Mini attains a macro-F1 score of 82.5% for sentiment analysis and 70.7% for emotion detection, respectively. The dataset, annotation guidelines, and source code are all publicly released to facilitate future research and development in Arabic language models and contribute to a deeper understanding of how various opinion dimensions interact in news media ( https://github.com/LubnaAlhenaki/MultiProSE ).