Exploring stacking methods for software effort estimation with hyperparameter tuning
摘要
This study explores the use of stacking ensemble methods for software effort estimation, leveraging the ISBSG dataset. The research compares individual machine learning models such as Support Vector Regression (SVR), Random Forest, AdaBoost, LASSO, and neural networks with stacked models over two phases. In Phase 1, five stacking models were developed, using SVR, Random Forest, AdaBoost, LASSO, and a neural network as base models. In Phase 2, four stacking models incorporated two neural networks as base models combined with different metamodels. The results indicate that stacking models with SVR as the metamodel outperformed individual models and other ensemble methods, especially in terms of MAE, MSE, MMRE, and MdMRE evaluation metrics. Friedman Test and Nemenyi Post-Hoc Test validated the results. These findings suggest that using SVR as the metamodel leads to improved accuracy and reliability in effort estimation, offering significant advantages for project management by enhancing predictive precision and optimizing resource allocation.