GMM-PACO: Gaussian Mixture Models and Pareto-Based Ant Colony Optimization for Multi-objective Feature Selection
摘要
In this paper, we propose GMM-PACO, a novel Ant Colony Optimization (ACO) for multi-objective feature selection. This algorithm explicitly models each feature using Gaussian Mixture Models (GMMs) to capture distributional characteristics. Our heuristic function integrates mutual information with the Wasserstein distance between feature distributions to evaluate feature relevance and redundancy. GMM-PACO simultaneously optimizes classification accuracy, feature subset size, and redundancy using Pareto dominance. Extensive evaluations on multiple UCI datasets with k-nearest neighbors (KNN) classifier demonstrate improvements over existing methods in both subset compactness and classification accuracy.