A Clustering Ensemble Approach to Improving Text Classification Adding Anti-dictionary
摘要
In order to enhance the classification models, this research presents a unique method of pre-processing the data that includes text clustering. The dataset used in this study consists of news articles that have been labelled as “real” or “fake”. The two primary elements of the method under discussion are text data pre-processing and data modelling. Initially, a sparse matrix is created by applying term frequency-inverse document frequency (TF-IDF) vectorization to the text data from the news articles. A piece of news in vectorized form is represented by each row in the matrix. Agglomerative clustering is applied based on these vectors, and as an extra feature, the data is divided into two new clusters. The model is trained using both the modified and the basic datasets alternately in the second stage, and the accuracy scores are compared. With accuracy, precision, and an F1 score of 98%, the multinomial classifier utilizing TF-IDF after stemming produces the best results according to the experiments.