The paper introduces a novel hierarchical decision tree framework designed to enhance classification quality in dispersed and fragmented data. By integrating two levels of modeling, the framework employs local decision trees to generate prediction vectors, which are then synthesized through a global decision tree for final classification. Five distinct approaches – Tree, Tree & height, Bagging & stump, Bagging & height, and Bagging – are proposed and evaluated. Each method varies in how local models are constructed, focusing on factors such as tree depth, bagging methods, and tree stumps. Experimental results on data sets from the UCI Machine Learning Repository demonstrate that the Bagging approach, particularly with an optimized number of bags and trees height, consistently achieves superior performance across metrics including accuracy, F-measure, and balanced accuracy. These findings highlight the framework’s robustness and effectiveness in managing dispersed data, offering significant potential for applications in high-dimensional, fragmented and multi-class classification scenarios.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Novel Hierarchical Decision Tree Frameworks Introducing Tree Method Bagging-Stump Integration and Height Optimization

  • Małgorzata Przybyła-Kasperek,
  • Benjamin Agyare Addo

摘要

The paper introduces a novel hierarchical decision tree framework designed to enhance classification quality in dispersed and fragmented data. By integrating two levels of modeling, the framework employs local decision trees to generate prediction vectors, which are then synthesized through a global decision tree for final classification. Five distinct approaches – Tree, Tree & height, Bagging & stump, Bagging & height, and Bagging – are proposed and evaluated. Each method varies in how local models are constructed, focusing on factors such as tree depth, bagging methods, and tree stumps. Experimental results on data sets from the UCI Machine Learning Repository demonstrate that the Bagging approach, particularly with an optimized number of bags and trees height, consistently achieves superior performance across metrics including accuracy, F-measure, and balanced accuracy. These findings highlight the framework’s robustness and effectiveness in managing dispersed data, offering significant potential for applications in high-dimensional, fragmented and multi-class classification scenarios.