<p>In this paper, we propose a novel kernel-free quadratic surface support vector machine with the 0–1 loss function, termed <InlineEquation ID="IEq4"> <EquationSource Format="TEX">\(L_{0/1}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mrow> <mn>0</mn> <mo stretchy="false">/</mo> <mn>1</mn> </mrow> </msub> </math></EquationSource> </InlineEquation>-QSSVM, for binary classification. Unlike kernel-based methods, our method explicitly learns a quadratic decision hypersurface in the original feature space, eliminating the need to select kernel functions and their corresponding parameters and making the model more interpretable. Although the 0–1 loss is non-differentiable, we establish first-order optimality conditions via its proximal operator and design an efficient algorithm, called <InlineEquation ID="IEq5"> <EquationSource Format="TEX">\(L_{0/1}^{*}\)</EquationSource> <EquationSource Format="MATHML"><math> <mmultiscripts> <mi>L</mi> <mrow> <mn>0</mn> <mo stretchy="false">/</mo> <mn>1</mn> </mrow> <mrow> <mrow /> <mo>∗</mo> </mrow> </mmultiscripts> </math></EquationSource> </InlineEquation>-ADMM, which incorporates a working set strategy inspired by support vectors. We prove that all support vectors lie on the support hypersurfaces, providing a clear geometric display. To further validate the effectiveness of our method, we discuss the convergence and computational complexity of the algorithm, along with the interpretability of the method. Moreover, numerical experiments on artificial and benchmark datasets are conducted, demonstrating that our <InlineEquation ID="IEq6"> <EquationSource Format="TEX">\(L_{0/1}\)</EquationSource> <EquationSource Format="MATHML"><math> <msub> <mi>L</mi> <mrow> <mn>0</mn> <mo stretchy="false">/</mo> <mn>1</mn> </mrow> </msub> </math></EquationSource> </InlineEquation>-QSSVM achieves higher accuracy, fewer support vectors, and less computational time compared to state-of-the-art methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

A Kernel-Free Quadratic Surface Support Vector Machine with \({ L}_{0/1}\) Soft-Margin Loss Function

  • Yu-Lan Wang,
  • Zhi-Xia Yang,
  • Ming-Yang Wu,
  • Jun-You Ye

摘要

In this paper, we propose a novel kernel-free quadratic surface support vector machine with the 0–1 loss function, termed \(L_{0/1}\) L 0 / 1 -QSSVM, for binary classification. Unlike kernel-based methods, our method explicitly learns a quadratic decision hypersurface in the original feature space, eliminating the need to select kernel functions and their corresponding parameters and making the model more interpretable. Although the 0–1 loss is non-differentiable, we establish first-order optimality conditions via its proximal operator and design an efficient algorithm, called \(L_{0/1}^{*}\) L 0 / 1 -ADMM, which incorporates a working set strategy inspired by support vectors. We prove that all support vectors lie on the support hypersurfaces, providing a clear geometric display. To further validate the effectiveness of our method, we discuss the convergence and computational complexity of the algorithm, along with the interpretability of the method. Moreover, numerical experiments on artificial and benchmark datasets are conducted, demonstrating that our \(L_{0/1}\) L 0 / 1 -QSSVM achieves higher accuracy, fewer support vectors, and less computational time compared to state-of-the-art methods.