This study proposes a regression-based framework for modeling the severity of online hate speech, addressing the limitations of traditional classification approaches that overlook the nuanced and continuous nature of harmful language. Leveraging a compiled dataset of over 3.1 million English-language social media posts from Reddit, Twitter, and Wikipedia, we fine-tune both general-purpose and hate speech-specific transformer models to predict real-valued severity scores. Our findings show that domain-specific models, particularly HateBERT, outperform general-purpose alternatives in capturing subtle gradients of hatefulness. The proposed approach enables more context-aware and proportionate content moderation, while also highlighting challenges related to annotation subjectivity, lack of conversational context, and cross-platform generalization. This work advances the field by demonstrating the feasibility and utility of severity estimation as a scalable alternative to categorical hate speech detection.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Combining Large-Scale and Domain-Specific Datasets for Hate Speech Severity Modeling: A Regression-Based Approach

  • Andrew Asante,
  • Petr Hajek

摘要

This study proposes a regression-based framework for modeling the severity of online hate speech, addressing the limitations of traditional classification approaches that overlook the nuanced and continuous nature of harmful language. Leveraging a compiled dataset of over 3.1 million English-language social media posts from Reddit, Twitter, and Wikipedia, we fine-tune both general-purpose and hate speech-specific transformer models to predict real-valued severity scores. Our findings show that domain-specific models, particularly HateBERT, outperform general-purpose alternatives in capturing subtle gradients of hatefulness. The proposed approach enables more context-aware and proportionate content moderation, while also highlighting challenges related to annotation subjectivity, lack of conversational context, and cross-platform generalization. This work advances the field by demonstrating the feasibility and utility of severity estimation as a scalable alternative to categorical hate speech detection.