Code-mixed offensive content categorization using multi-channel CNN with N-gram fusion and XGB
摘要
In recent years, the exchange of offensive content through social media has increased. Social media users represent their thoughts in regional language. Such comments contain mixing of more than one language. There is no standard tool or script for effectively identifying and detecting these code-mixed comments. In general social media comments may be lengthy and the long term dependency need to be captured. The proportion of offensive comments posted in social media is very less, there by creating an imbalanced data distribution. To address these limitations, Multi Channel CNN is proposed that extracts n-gram features, which are later concatenated by early fusion method. The obtained semantically rich features are balanced in the feature space by applying SOUP based sampling technique. These features are fed to XGB classifier for classifying the YouTube comments as Offensive or not. To prove the effectiveness of the proposed model, we have conducted extensive experiments namely Unidirectional, Bidirectional, Hybrid, Multi-Channel Models and Transfer learning based Multi-Channel models on YouTube Offensive Comments in two different languages, Malayalam and Kannada. The proposed Transfer learning based Multichannel CNN model outperformed other methods by achieving an F1 score of 97.7%, 72.24% on Malayalam and Kannada languages. The proposed approach demonstrates notable performance gain by 3% in Malayalam and 11% in Kannada over existing state-of-the-art methods.