This paper proposes a hybrid system for feature selection, allowing the degree of importance of different features to be determined. Different feature selection techniques, specifically the following four: Univariate feature ranking for classification using chi-square tests, Rank features for classification using minimum redundancy maximum relevance, Relief-based feature selection and Constrained greedy k-means with silhouette value ranking method are employed on the three well-known datasets from UCI Machine Learning Repository: Iris, Wine, and Ionosphere. Subsequently, with the variables ordered from highest to lowest importance as a result of each of the four feature selection methods, an iterative clustering process is performed, agglomerating features that are used to calculate accuracy. This accuracy is employed to determine the most relevant features. The best accuracy value for Iris dataset is 96%, for Wine dataset is 80.33%, and the best accuracy for Ionosphere is 83.19%. Experimental results obtained with the general unsupervised hybrid clustering system proposed in this paper are absolutely comparable to other studies.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Novel General Hybrid System for Data Feature Selection

  • Dragan Simić,
  • Zorana Banković,
  • José R. Villar,
  • José Luis Calvo-Rolle,
  • Svetislav D. Simić,
  • Svetlana Simić

摘要

This paper proposes a hybrid system for feature selection, allowing the degree of importance of different features to be determined. Different feature selection techniques, specifically the following four: Univariate feature ranking for classification using chi-square tests, Rank features for classification using minimum redundancy maximum relevance, Relief-based feature selection and Constrained greedy k-means with silhouette value ranking method are employed on the three well-known datasets from UCI Machine Learning Repository: Iris, Wine, and Ionosphere. Subsequently, with the variables ordered from highest to lowest importance as a result of each of the four feature selection methods, an iterative clustering process is performed, agglomerating features that are used to calculate accuracy. This accuracy is employed to determine the most relevant features. The best accuracy value for Iris dataset is 96%, for Wine dataset is 80.33%, and the best accuracy for Ionosphere is 83.19%. Experimental results obtained with the general unsupervised hybrid clustering system proposed in this paper are absolutely comparable to other studies.