Exploring the reliability of clustering models: a case study on interpretation and overlapping issues
摘要
Clustering analysis (CA) plays a key role in many industrial machine learning (IML) tasks by discovering and interpreting hidden patterns among data. The growing IML data may yield overlapped data—“similar in characteristics but different in category”. This impacts the CA performance and demands the need to redefine features, distance matrices, centroids, and other hyperparameters at every overlap appearance. These issues raise doubt on the reliability of the recent CA solutions in terms of interpretation and feasibility unsupervisedly. This study showcases an in-depth investigation by exploring the complex relationships among the given settings and issues, aiming to highlight the main challenges associated with CAs that impact prediction, partitioning, and false confidence in outcomes of CA models. We propose a novel experimental framework that has been able to produce over 271 million possible settings of the Iris dataset based on various models, equations, and procedures. Findings indicate that achieving reliable solutions is questionable and doubt the use of supervised information upfront, which is against the CA concept. Thereby, we designed an open issue that challenges the CA models. Experiment code, results, and open issues are released at https://github.com/MustafaRaadKadhim/CaseStudy.