Weighted Heronian–Maclaurin mean-based classifiers combined with FM and their application in binary classification
摘要
Addressing feature interactions is essential in binary classification issues. This paper explores methods for capturing complete weighted feature interactions under two distinct assumptions: independent and dependent importance. Building upon the normalized interaction-weighted HM (NIWHM) and Maclaurin mean (NIWMM) operators, we introduce the normalized interaction-weighted Heronian–Maclaurin mean (NIWHMM) and the normalized weighted Heronian–Maclaurin mean (NWHMM) operators. These operators are further generalized into the weighted Heronian–Maclaurin mean (WHMM) operators. Subsequently, we propose a WHMM-based classifier to capture complete weighted feature interactions with independent importance. Furthermore, drawing inspiration from the factorization machine (FM) and its associated classifiers, we propose an FM-WHMM-based classifier to capture complete weighted feature interactions with dependent importance. Extensive experiments on synthetic and real-world datasets validate the effectiveness of the proposed classifiers. Given their demonstrated ability to capture complete weighted feature interactions, the proposed methods are considered to have promising application potential in fields requiring feature interactions, such as recommendation systems and sentiment analysis.