<p>Support vector machines (SVMs) are powerful supervised learning methods widely used for classification and regression. However, theirs performance can significantly deteriorate in the presence of label noise and class imbalance, which are common in real-world applications. To address these issues, we propose a novel asymmetric bounded loss function within the general framework of robust loss functions for machine learning (RML). This loss function allows for class-dependent misclassification penalties while ensuring robustness to label noise. By incorporating this loss into the SVM framework, we develop a new model, referred to as asymmetric loss SVM (ALSVM), which is efficiently optimized via the stochastic variance reduced gradient method. We further provide a theoretical analysis by deriving generalization error bounds based on Rademacher complexity, and demonstrate the robustness by showing that its influence function is bounded. Extensive experiments on benchmark datasets, particularly those related to disease classification, demonstrate that the proposed method consistently improves performance across multiple evaluation metrics.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

An RML-Based Asymmetric Loss Support Vector Machine for Robust and Imbalanced Classification

  • Yu-Nuo Chen,
  • Kai Qi,
  • Li-Ping Tang

摘要

Support vector machines (SVMs) are powerful supervised learning methods widely used for classification and regression. However, theirs performance can significantly deteriorate in the presence of label noise and class imbalance, which are common in real-world applications. To address these issues, we propose a novel asymmetric bounded loss function within the general framework of robust loss functions for machine learning (RML). This loss function allows for class-dependent misclassification penalties while ensuring robustness to label noise. By incorporating this loss into the SVM framework, we develop a new model, referred to as asymmetric loss SVM (ALSVM), which is efficiently optimized via the stochastic variance reduced gradient method. We further provide a theoretical analysis by deriving generalization error bounds based on Rademacher complexity, and demonstrate the robustness by showing that its influence function is bounded. Extensive experiments on benchmark datasets, particularly those related to disease classification, demonstrate that the proposed method consistently improves performance across multiple evaluation metrics.