This study evaluates three ensemble techniques—basic stacking, hard voting, and soft voting—for predicting diabetes onset using the Pima Indians Diabetes dataset. While traditional methods often focus on single models, this research emphasizes the benefits of combining models like Cat Boost, random forest, logistic regression, linear discriminant analysis, and gradient boosting classifier (LightGBM) within ensemble frameworks. The models were rigorously assessed using metrics for evaluation such as AUC-ROC curves, confusion matrices, F1 scores, etc. The advanced calibrated model achieved the highest performance, with an accuracy of 90.10%, precision of 90.32%, recall of 81.16%, and an F1 score of 85.50%. The soft voting model also delivered strong results, with an accuracy of 89.06%, precision of 87.50%, recall of 81.16%, and F1 score of 84.21%. In comparison, the hard voting model recorded an accuracy of 88.02%, precision of 85.94%, recall of 79.71%, and F1 score of 82.71%. These results highlight the potential of advanced ensemble methods to enhance predictive accuracy. Future work could involve integrating these models with real-time monitoring systems for improved healthcare diagnostics and applying them to diverse datasets and medical conditions.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Benchmarking Ensemble Methods: Stacking, Hard Voting, and Soft Voting

  • Jossy George,
  • Jai Yadav,
  • Akhil M. Nair

摘要

This study evaluates three ensemble techniques—basic stacking, hard voting, and soft voting—for predicting diabetes onset using the Pima Indians Diabetes dataset. While traditional methods often focus on single models, this research emphasizes the benefits of combining models like Cat Boost, random forest, logistic regression, linear discriminant analysis, and gradient boosting classifier (LightGBM) within ensemble frameworks. The models were rigorously assessed using metrics for evaluation such as AUC-ROC curves, confusion matrices, F1 scores, etc. The advanced calibrated model achieved the highest performance, with an accuracy of 90.10%, precision of 90.32%, recall of 81.16%, and an F1 score of 85.50%. The soft voting model also delivered strong results, with an accuracy of 89.06%, precision of 87.50%, recall of 81.16%, and F1 score of 84.21%. In comparison, the hard voting model recorded an accuracy of 88.02%, precision of 85.94%, recall of 79.71%, and F1 score of 82.71%. These results highlight the potential of advanced ensemble methods to enhance predictive accuracy. Future work could involve integrating these models with real-time monitoring systems for improved healthcare diagnostics and applying them to diverse datasets and medical conditions.