We investigate the efficacy of various regression-based surrogate models, integrated with a ranking procedure, within the Adaptive Differential Evolution with an Optional External Archive (JADE) method. In our previous work, efforts concentrated on 10-dimensional problems utilizing the CEC2013 benchmark set for single-criterion continuous optimization. In this study, we explore similar tests on 30-dimensional problems to study the scalability and efficiency of these surrogate models under increased complexity. The surrogate models - k Nearest Neighbors, XGBoost and Support Vector Machines - are used to regress the fitness function, thereby reducing the required number of fitness evaluations to achieve optimization progress. The training of these models is designed to remain cost-effective, requiring frequent recalibration throughout the optimization process. The Wilcoxon test based statistical analysis of experimental results has been made to validate the effectiveness of the surrogate models in both 10 and 30 dimensions. The results indicate that among the considered candidate surrogate models, kNN seems most effective and its incorporation into JADE increases the overall performance of that algorithm.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

What Is the Impact of Typical Surrogate Models on the Performance of the JADE Algorithm?

  • Konrad Krawczyk,
  • Jarosław Arabas

摘要

We investigate the efficacy of various regression-based surrogate models, integrated with a ranking procedure, within the Adaptive Differential Evolution with an Optional External Archive (JADE) method. In our previous work, efforts concentrated on 10-dimensional problems utilizing the CEC2013 benchmark set for single-criterion continuous optimization. In this study, we explore similar tests on 30-dimensional problems to study the scalability and efficiency of these surrogate models under increased complexity. The surrogate models - k Nearest Neighbors, XGBoost and Support Vector Machines - are used to regress the fitness function, thereby reducing the required number of fitness evaluations to achieve optimization progress. The training of these models is designed to remain cost-effective, requiring frequent recalibration throughout the optimization process. The Wilcoxon test based statistical analysis of experimental results has been made to validate the effectiveness of the surrogate models in both 10 and 30 dimensions. The results indicate that among the considered candidate surrogate models, kNN seems most effective and its incorporation into JADE increases the overall performance of that algorithm.