Detecting hate and offensive spans in Vietnamese content presents unique challenges due to the complex linguistic structure of the language. This study introduces VHateX, an ensemble-based framework developed to detect hate and offensive spans in Vietnamese text using the PhoBERT model. The primary contribution of this work is the integration of PhoBERT with ensemble learning techniques to significantly improve the model’s performance in the problem of Vietnamese hate and offensive spans detection within the ViHOS dataset. To enhance model robustness and diversity, the training set of the ViHOS dataset is divided into three bootstrap subsets, each of which is randomly drawn from 80% of the original training data. This study trained three independent classification models (PhoBERT) on three different bootstrap subsets of the ViHOS dataset and combined their predictions using soft voting. The results indicate that VHateX outperforms existing methods, achieving higher Precision (8.1% increase), Recall (8.1% and 10.2% increase), and F1 Score (10.9% and 12.2% increase) on both syllable-based and word-based models. These results demonstrate the effectiveness of VHateX in real-world applications for Vietnamese hate and offensive span detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An Ensemble-Based Approach with PhoBERT for Vietnamese Hate and Offensive Spans Detection

  • Dinh-Hong Vu,
  • Ky Pham,
  • Tuong Le

摘要

Detecting hate and offensive spans in Vietnamese content presents unique challenges due to the complex linguistic structure of the language. This study introduces VHateX, an ensemble-based framework developed to detect hate and offensive spans in Vietnamese text using the PhoBERT model. The primary contribution of this work is the integration of PhoBERT with ensemble learning techniques to significantly improve the model’s performance in the problem of Vietnamese hate and offensive spans detection within the ViHOS dataset. To enhance model robustness and diversity, the training set of the ViHOS dataset is divided into three bootstrap subsets, each of which is randomly drawn from 80% of the original training data. This study trained three independent classification models (PhoBERT) on three different bootstrap subsets of the ViHOS dataset and combined their predictions using soft voting. The results indicate that VHateX outperforms existing methods, achieving higher Precision (8.1% increase), Recall (8.1% and 10.2% increase), and F1 Score (10.9% and 12.2% increase) on both syllable-based and word-based models. These results demonstrate the effectiveness of VHateX in real-world applications for Vietnamese hate and offensive span detection.